2023-07-24T05:18:04.463 INFO:root:teuthology version: 0.0.1.dev158+g1426592 2023-07-24T05:18:04.464 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/vshankar-2023-07-24_05:02:48-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7349233 --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} --name vshankar-2023-07-24_05:02:48-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi --owner scheduled_vshankar@teuthology -- /home/teuthworker/archive/vshankar-2023-07-24_05:02:48-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7349233/orig.config.yaml 2023-07-24T05:18:04.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-24T05:18:04.602 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-07-24_05:02:48-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7349233 branch: wip-vshankar-testing-20230720.042515 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: vshankar@redhat.com first_in_suite: false job_id: '7349233' kernel: flavor: default kdb: true sha1: c685da6f56cc77f2cfb9c4221be3960522616caf ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-07-24_05:02:48-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-vshankar-testing-20230720.042515 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: e2c50893bf78471cc8ee960317cc10390300dfd5 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: e2c50893bf78471cc8ee960317cc10390300dfd5 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20230720.042515 sha1: e2c50893bf78471cc8ee960317cc10390300dfd5 owner: scheduled_vshankar@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 632 sha1: e2c50893bf78471cc8ee960317cc10390300dfd5 sleep_before_teardown: 0 subset: 14/1024 suite: fs suite_branch: wip-vshankar-testing-20230720.042515 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_e2c50893bf78471cc8ee960317cc10390300dfd5/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: e2c50893bf78471cc8ee960317cc10390300dfd5 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi077.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi103.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 1426592083662fef3e03bbeec33624331f0fdbc1 timestamp: 2023-07-24_05:02:48 tube: smithi use_shaman: true user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-07-24T05:18:04.602 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_e2c50893bf78471cc8ee960317cc10390300dfd5/qa; will attempt to use it 2023-07-24T05:18:04.603 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_e2c50893bf78471cc8ee960317cc10390300dfd5/qa/tasks 2023-07-24T05:18:04.603 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-07-24T05:18:04.605 INFO:teuthology.task.internal:Checking packages... 2023-07-24T05:18:04.635 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'e2c50893bf78471cc8ee960317cc10390300dfd5' 2023-07-24T05:18:04.636 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-07-24T05:18:04.636 INFO:teuthology.packaging:ref: None 2023-07-24T05:18:04.636 INFO:teuthology.packaging:tag: None 2023-07-24T05:18:04.637 INFO:teuthology.packaging:branch: wip-vshankar-testing-20230720.042515 2023-07-24T05:18:04.637 INFO:teuthology.packaging:sha1: e2c50893bf78471cc8ee960317cc10390300dfd5 2023-07-24T05:18:04.637 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-vshankar-testing-20230720.042515 2023-07-24T05:18:04.933 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-5042-ge2c50893-1focal 2023-07-24T05:18:04.934 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-07-24T05:18:04.939 INFO:teuthology.task.internal:no buildpackages task found 2023-07-24T05:18:04.940 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-07-24T05:18:04.952 INFO:teuthology.task.internal:Saving configuration 2023-07-24T05:18:04.968 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-07-24T05:18:04.974 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-24T05:18:05.000 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi077.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-24_05:02:48-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7349233', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-24 05:04:00.009840', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-07-24T05:18:05.027 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi103.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-07-24_05:02:48-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7349233', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-24 05:04:00.008621', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-07-24T05:18:05.027 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-07-24T05:18:05.034 INFO:teuthology.task.internal:roles: ubuntu@smithi077.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-07-24T05:18:05.034 INFO:teuthology.task.internal:roles: ubuntu@smithi103.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-07-24T05:18:05.034 INFO:teuthology.run_tasks:Running task console_log... 2023-07-24T05:18:05.110 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff915a68e50>, signals=[15]) 2023-07-24T05:18:05.112 INFO:teuthology.run_tasks:Running task internal.connect... 2023-07-24T05:18:05.118 INFO:teuthology.task.internal:Opening connections... 2023-07-24T05:18:05.119 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi077.front.sepia.ceph.com 2023-07-24T05:18:05.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:18:05.172 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi103.front.sepia.ceph.com 2023-07-24T05:18:05.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:18:05.222 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-07-24T05:18:05.230 DEBUG:teuthology.orchestra.run.smithi077:> uname -m 2023-07-24T05:18:05.258 INFO:teuthology.orchestra.run.smithi077.stdout:x86_64 2023-07-24T05:18:05.259 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release 2023-07-24T05:18:05.306 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="Ubuntu" 2023-07-24T05:18:05.306 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-24T05:18:05.306 INFO:teuthology.orchestra.run.smithi077.stdout:ID=ubuntu 2023-07-24T05:18:05.307 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE=debian 2023-07-24T05:18:05.307 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-24T05:18:05.307 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="20.04" 2023-07-24T05:18:05.307 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-24T05:18:05.308 INFO:teuthology.orchestra.run.smithi077.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-24T05:18:05.308 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-24T05:18:05.308 INFO:teuthology.orchestra.run.smithi077.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-24T05:18:05.308 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_CODENAME=focal 2023-07-24T05:18:05.309 INFO:teuthology.orchestra.run.smithi077.stdout:UBUNTU_CODENAME=focal 2023-07-24T05:18:05.309 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2023-07-24T05:18:05.334 DEBUG:teuthology.orchestra.run.smithi103:> uname -m 2023-07-24T05:18:05.341 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64 2023-07-24T05:18:05.342 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2023-07-24T05:18:05.390 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="Ubuntu" 2023-07-24T05:18:05.390 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-07-24T05:18:05.390 INFO:teuthology.orchestra.run.smithi103.stdout:ID=ubuntu 2023-07-24T05:18:05.390 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE=debian 2023-07-24T05:18:05.390 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-07-24T05:18:05.391 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="20.04" 2023-07-24T05:18:05.391 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-24T05:18:05.391 INFO:teuthology.orchestra.run.smithi103.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-24T05:18:05.391 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-24T05:18:05.391 INFO:teuthology.orchestra.run.smithi103.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-24T05:18:05.391 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_CODENAME=focal 2023-07-24T05:18:05.391 INFO:teuthology.orchestra.run.smithi103.stdout:UBUNTU_CODENAME=focal 2023-07-24T05:18:05.392 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2023-07-24T05:18:05.417 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-07-24T05:18:05.426 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-07-24T05:18:05.432 INFO:teuthology.task.internal:Checking for old test directory... 2023-07-24T05:18:05.433 DEBUG:teuthology.orchestra.run.smithi077:> test '!' -e /home/ubuntu/cephtest 2023-07-24T05:18:05.435 DEBUG:teuthology.orchestra.run.smithi103:> test '!' -e /home/ubuntu/cephtest 2023-07-24T05:18:05.440 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-07-24T05:18:05.446 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-07-24T05:18:05.447 DEBUG:teuthology.orchestra.run.smithi077:> test -z $(ls -A /var/lib/ceph) 2023-07-24T05:18:05.449 DEBUG:teuthology.orchestra.run.smithi103:> test -z $(ls -A /var/lib/ceph) 2023-07-24T05:18:05.502 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-07-24T05:18:05.563 INFO:teuthology.run_tasks:Running task kernel... 2023-07-24T05:18:05.580 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': 'c685da6f56cc77f2cfb9c4221be3960522616caf'} 2023-07-24T05:18:05.581 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': 'c685da6f56cc77f2cfb9c4221be3960522616caf'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': 'c685da6f56cc77f2cfb9c4221be3960522616caf'}}, timeout 300 2023-07-24T05:18:05.581 DEBUG:teuthology.orchestra.run.smithi077:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-24T05:18:05.582 DEBUG:teuthology.orchestra.run.smithi103:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-24T05:18:05.587 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-24T05:18:05.588 DEBUG:teuthology.task.kernel:sha1 for mon.a is c685da6f56cc77f2cfb9c4221be3960522616caf 2023-07-24T05:18:05.588 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "c685da6f56cc77f2cfb9c4221be3960522616caf"... 2023-07-24T05:18:05.588 DEBUG:teuthology.orchestra.run.smithi077:> uname -r 2023-07-24T05:18:05.589 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-24T05:18:05.589 DEBUG:teuthology.task.kernel:sha1 for mon.b is c685da6f56cc77f2cfb9c4221be3960522616caf 2023-07-24T05:18:05.590 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "c685da6f56cc77f2cfb9c4221be3960522616caf"... 2023-07-24T05:18:05.590 DEBUG:teuthology.orchestra.run.smithi103:> uname -r 2023-07-24T05:18:05.596 INFO:teuthology.orchestra.run.smithi077.stdout:5.4.0-124-generic 2023-07-24T05:18:05.596 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs c685da6f56cc77f2cfb9c4221be3960522616caf 2023-07-24T05:18:05.596 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-07-24T05:18:05.597 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=c685da6f56cc77f2cfb9c4221be3960522616caf 2023-07-24T05:18:05.638 INFO:teuthology.orchestra.run.smithi103.stdout:5.4.0-124-generic 2023-07-24T05:18:05.638 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs c685da6f56cc77f2cfb9c4221be3960522616caf 2023-07-24T05:18:05.638 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-07-24T05:18:05.639 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=c685da6f56cc77f2cfb9c4221be3960522616caf 2023-07-24T05:18:05.912 INFO:teuthology.task.kernel:Installing linux-firmware on mon.a... 2023-07-24T05:18:05.913 DEBUG:teuthology.orchestra.run.smithi077:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-07-24T05:18:05.928 INFO:teuthology.orchestra.run.smithi077.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2023-07-24T05:18:05.962 INFO:teuthology.task.kernel:Installing linux-firmware on mon.b... 2023-07-24T05:18:05.962 DEBUG:teuthology.orchestra.run.smithi103:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-07-24T05:18:05.985 INFO:teuthology.orchestra.run.smithi103.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2023-07-24T05:18:06.039 INFO:teuthology.orchestra.run.smithi077.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-07-24T05:18:06.041 DEBUG:teuthology.orchestra.run.smithi077:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-07-24T05:18:06.070 DEBUG:teuthology.orchestra.run.smithi077:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-07-24T05:18:06.084 DEBUG:teuthology.orchestra.run.smithi077:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-07-24T05:18:06.093 INFO:teuthology.orchestra.run.smithi103.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-07-24T05:18:06.095 DEBUG:teuthology.orchestra.run.smithi103:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-07-24T05:18:06.124 DEBUG:teuthology.orchestra.run.smithi103:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-07-24T05:18:06.185 DEBUG:teuthology.orchestra.run.smithi103:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-07-24T05:29:18.180 INFO:teuthology.orchestra.run.smithi077.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-07-24T05:29:18.181 INFO:teuthology.orchestra.run.smithi077.stderr: * [new branch] main -> origin/main 2023-07-24T05:29:18.232 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20190312 -> 20190312 2023-07-24T05:29:18.232 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20190416 -> 20190416 2023-07-24T05:29:18.233 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20190514 -> 20190514 2023-07-24T05:29:18.233 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20190618 -> 20190618 2023-07-24T05:29:18.234 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20190717 -> 20190717 2023-07-24T05:29:18.234 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20190815 -> 20190815 2023-07-24T05:29:18.234 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20190923 -> 20190923 2023-07-24T05:29:18.234 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20191022 -> 20191022 2023-07-24T05:29:18.234 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20191215 -> 20191215 2023-07-24T05:29:18.235 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20200122 -> 20200122 2023-07-24T05:29:18.235 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20200316 -> 20200316 2023-07-24T05:29:18.235 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20200421 -> 20200421 2023-07-24T05:29:18.235 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20200519 -> 20200519 2023-07-24T05:29:18.235 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20200619 -> 20200619 2023-07-24T05:29:18.235 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20200721 -> 20200721 2023-07-24T05:29:18.235 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20200817 -> 20200817 2023-07-24T05:29:18.236 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20200918 -> 20200918 2023-07-24T05:29:18.237 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20201022 -> 20201022 2023-07-24T05:29:18.237 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20201118 -> 20201118 2023-07-24T05:29:18.237 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20201218 -> 20201218 2023-07-24T05:29:18.237 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20210208 -> 20210208 2023-07-24T05:29:18.237 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20210315 -> 20210315 2023-07-24T05:29:18.237 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20210511 -> 20210511 2023-07-24T05:29:18.237 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20210716 -> 20210716 2023-07-24T05:29:18.237 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20210818 -> 20210818 2023-07-24T05:29:18.238 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20210919 -> 20210919 2023-07-24T05:29:18.239 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20211027 -> 20211027 2023-07-24T05:29:18.239 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20211216 -> 20211216 2023-07-24T05:29:18.239 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20220209 -> 20220209 2023-07-24T05:29:18.240 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20220310 -> 20220310 2023-07-24T05:29:18.240 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20220411 -> 20220411 2023-07-24T05:29:18.240 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20220509 -> 20220509 2023-07-24T05:29:18.240 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20220610 -> 20220610 2023-07-24T05:29:18.240 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20220708 -> 20220708 2023-07-24T05:29:18.240 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20220815 -> 20220815 2023-07-24T05:29:18.240 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20220913 -> 20220913 2023-07-24T05:29:18.241 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20221012 -> 20221012 2023-07-24T05:29:18.241 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20221109 -> 20221109 2023-07-24T05:29:18.241 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20221214 -> 20221214 2023-07-24T05:29:18.241 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20230117 -> 20230117 2023-07-24T05:29:18.241 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20230210 -> 20230210 2023-07-24T05:29:18.241 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20230310 -> 20230310 2023-07-24T05:29:18.241 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20230404 -> 20230404 2023-07-24T05:29:18.241 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20230515 -> 20230515 2023-07-24T05:29:18.242 INFO:teuthology.orchestra.run.smithi077.stderr: * [new tag] 20230625 -> 20230625 2023-07-24T05:29:20.672 INFO:teuthology.orchestra.run.smithi103.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-07-24T05:29:20.673 INFO:teuthology.orchestra.run.smithi103.stderr: * [new branch] main -> origin/main 2023-07-24T05:29:20.727 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20190312 -> 20190312 2023-07-24T05:29:20.727 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20190416 -> 20190416 2023-07-24T05:29:20.727 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20190514 -> 20190514 2023-07-24T05:29:20.728 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20190618 -> 20190618 2023-07-24T05:29:20.728 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20190717 -> 20190717 2023-07-24T05:29:20.728 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20190815 -> 20190815 2023-07-24T05:29:20.728 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20190923 -> 20190923 2023-07-24T05:29:20.728 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20191022 -> 20191022 2023-07-24T05:29:20.728 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20191215 -> 20191215 2023-07-24T05:29:20.730 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20200122 -> 20200122 2023-07-24T05:29:20.730 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20200316 -> 20200316 2023-07-24T05:29:20.730 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20200421 -> 20200421 2023-07-24T05:29:20.730 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20200519 -> 20200519 2023-07-24T05:29:20.730 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20200619 -> 20200619 2023-07-24T05:29:20.730 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20200721 -> 20200721 2023-07-24T05:29:20.731 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20200817 -> 20200817 2023-07-24T05:29:20.731 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20200918 -> 20200918 2023-07-24T05:29:20.731 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20201022 -> 20201022 2023-07-24T05:29:20.731 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20201118 -> 20201118 2023-07-24T05:29:20.731 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20201218 -> 20201218 2023-07-24T05:29:20.731 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20210208 -> 20210208 2023-07-24T05:29:20.731 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20210315 -> 20210315 2023-07-24T05:29:20.731 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20210511 -> 20210511 2023-07-24T05:29:20.732 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20210716 -> 20210716 2023-07-24T05:29:20.732 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20210818 -> 20210818 2023-07-24T05:29:20.733 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20210919 -> 20210919 2023-07-24T05:29:20.734 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20211027 -> 20211027 2023-07-24T05:29:20.734 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20211216 -> 20211216 2023-07-24T05:29:20.734 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20220209 -> 20220209 2023-07-24T05:29:20.734 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20220310 -> 20220310 2023-07-24T05:29:20.734 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20220411 -> 20220411 2023-07-24T05:29:20.734 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20220509 -> 20220509 2023-07-24T05:29:20.734 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20220610 -> 20220610 2023-07-24T05:29:20.735 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20220708 -> 20220708 2023-07-24T05:29:20.735 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20220815 -> 20220815 2023-07-24T05:29:20.735 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20220913 -> 20220913 2023-07-24T05:29:20.735 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20221012 -> 20221012 2023-07-24T05:29:20.735 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20221109 -> 20221109 2023-07-24T05:29:20.735 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20221214 -> 20221214 2023-07-24T05:29:20.735 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20230117 -> 20230117 2023-07-24T05:29:20.735 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20230210 -> 20230210 2023-07-24T05:29:20.736 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20230310 -> 20230310 2023-07-24T05:29:20.736 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20230404 -> 20230404 2023-07-24T05:29:20.736 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20230515 -> 20230515 2023-07-24T05:29:20.736 INFO:teuthology.orchestra.run.smithi103.stderr: * [new tag] 20230625 -> 20230625 2023-07-24T05:29:21.450 INFO:teuthology.orchestra.run.smithi077.stderr:Updating files: 51% (1521/2977) Updating files: 52% (1549/2977) Updating files: 53% (1578/2977) Updating files: 54% (1608/2977) Updating files: 55% (1638/2977) Updating files: 56% (1668/2977) Updating files: 57% (1697/2977) Updating files: 58% (1727/2977) Updating files: 59% (1757/2977) Updating files: 60% (1787/2977) Updating files: 61% (1816/2977) Updating files: 62% (1846/2977) Updating files: 63% (1876/2977) Updating files: 64% (1906/2977) Updating files: 65% (1936/2977) Updating files: 65% (1957/2977) Updating files: 66% (1965/2977) Updating files: 67% (1995/2977) Updating files: 68% (2025/2977) Updating files: 69% (2055/2977) Updating files: 70% (2084/2977) Updating files: 71% (2114/2977) Updating files: 72% (2144/2977) Updating files: 73% (2174/2977) Updating files: 74% (2203/2977) Updating files: 75% (2233/2977) Updating files: 76% (2263/2977) Updating files: 77% (2293/2977) Updating files: 78% (2323/2977) Updating files: 79% (2352/2977) Updating files: 80% (2382/2977) Updating files: 81% (2412/2977) Updating files: 82% (2442/2977) Updating files: 82% (2458/2977) Updating files: 83% (2471/2977) Updating files: 84% (2501/2977) Updating files: 85% (2531/2977) Updating files: 86% (2561/2977) Updating files: 87% (2590/2977) Updating files: 88% (2620/2977) Updating files: 89% (2650/2977) Updating files: 90% (2680/2977) Updating files: 91% (2710/2977) Updating files: 92% (2739/2977) Updating files: 93% (2769/2977) Updating files: 94% (2799/2977) Updating files: 95% (2829/2977) Updating files: 96% (2858/2977) Updating files: 97% (2888/2977) Updating files: 98% (2918/2977) Updating files: 99% (2948/2977) Updating files: 100% (2977/2977) Updating files: 100% (2977/2977), done. 2023-07-24T05:29:21.455 INFO:teuthology.orchestra.run.smithi077.stdout:HEAD is now at d3f66064 Partially revert "amdgpu: DMCUB updates for DCN 3.1.4 and 3.1.5" 2023-07-24T05:29:21.470 INFO:teuthology.task.kernel:Downloading kernel c685da6f56cc77f2cfb9c4221be3960522616caf on mon.a... 2023-07-24T05:29:21.470 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=c685da6f56cc77f2cfb9c4221be3960522616caf 2023-07-24T05:29:21.760 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/c685da6f56cc77f2cfb9c4221be3960522616caf/ubuntu/focal/flavors/default/pool/main/l/linux-6.5.0-rc1-gc685da6f56cc/ 2023-07-24T05:29:21.760 DEBUG:teuthology.orchestra.run.smithi077:> rm -f /tmp/linux-image.deb && echo linux-image-6.5.0-rc1-gc685da6f56cc_6.5.0-rc1-gc685da6f56cc-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://1.chacra.ceph.com/r/kernel/testing/c685da6f56cc77f2cfb9c4221be3960522616caf/ubuntu/focal/flavors/default/pool/main/l/linux-6.5.0-rc1-gc685da6f56cc/ --input-file=- 2023-07-24T05:29:21.762 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi077.front.sepia.ceph.com to complete... 2023-07-24T05:29:23.959 INFO:teuthology.orchestra.run.smithi103.stderr:Updating files: 50% (1505/2977) Updating files: 51% (1519/2977) Updating files: 52% (1549/2977) Updating files: 53% (1578/2977) Updating files: 54% (1608/2977) Updating files: 55% (1638/2977) Updating files: 56% (1668/2977) Updating files: 57% (1697/2977) Updating files: 58% (1727/2977) Updating files: 59% (1757/2977) Updating files: 60% (1787/2977) Updating files: 61% (1816/2977) Updating files: 62% (1846/2977) Updating files: 63% (1876/2977) Updating files: 64% (1906/2977) Updating files: 65% (1936/2977) Updating files: 65% (1956/2977) Updating files: 66% (1965/2977) Updating files: 67% (1995/2977) Updating files: 68% (2025/2977) Updating files: 69% (2055/2977) Updating files: 70% (2084/2977) Updating files: 71% (2114/2977) Updating files: 72% (2144/2977) Updating files: 73% (2174/2977) Updating files: 74% (2203/2977) Updating files: 75% (2233/2977) Updating files: 76% (2263/2977) Updating files: 77% (2293/2977) Updating files: 78% (2323/2977) Updating files: 79% (2352/2977) Updating files: 80% (2382/2977) Updating files: 81% (2412/2977) Updating files: 82% (2442/2977) Updating files: 82% (2452/2977) Updating files: 83% (2471/2977) Updating files: 84% (2501/2977) Updating files: 85% (2531/2977) Updating files: 86% (2561/2977) Updating files: 87% (2590/2977) Updating files: 88% (2620/2977) Updating files: 89% (2650/2977) Updating files: 90% (2680/2977) Updating files: 91% (2710/2977) Updating files: 92% (2739/2977) Updating files: 93% (2769/2977) Updating files: 94% (2799/2977) Updating files: 95% (2829/2977) Updating files: 96% (2858/2977) Updating files: 97% (2888/2977) Updating files: 98% (2918/2977) Updating files: 99% (2948/2977) Updating files: 100% (2977/2977) Updating files: 100% (2977/2977), done. 2023-07-24T05:29:23.964 INFO:teuthology.orchestra.run.smithi103.stdout:HEAD is now at d3f66064 Partially revert "amdgpu: DMCUB updates for DCN 3.1.4 and 3.1.5" 2023-07-24T05:29:23.978 INFO:teuthology.task.kernel:Downloading kernel c685da6f56cc77f2cfb9c4221be3960522616caf on mon.b... 2023-07-24T05:29:23.979 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=c685da6f56cc77f2cfb9c4221be3960522616caf 2023-07-24T05:29:24.257 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/c685da6f56cc77f2cfb9c4221be3960522616caf/ubuntu/focal/flavors/default/pool/main/l/linux-6.5.0-rc1-gc685da6f56cc/ 2023-07-24T05:29:24.257 DEBUG:teuthology.orchestra.run.smithi103:> rm -f /tmp/linux-image.deb && echo linux-image-6.5.0-rc1-gc685da6f56cc_6.5.0-rc1-gc685da6f56cc-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://1.chacra.ceph.com/r/kernel/testing/c685da6f56cc77f2cfb9c4221be3960522616caf/ubuntu/focal/flavors/default/pool/main/l/linux-6.5.0-rc1-gc685da6f56cc/ --input-file=- 2023-07-24T05:29:24.259 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi103.front.sepia.ceph.com to complete... 2023-07-24T05:29:26.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24 05:29:26 URL:https://1.chacra.ceph.com/r/kernel/testing/c685da6f56cc77f2cfb9c4221be3960522616caf/ubuntu/focal/flavors/default/pool/main/l/linux-6.5.0-rc1-gc685da6f56cc/linux-image-6.5.0-rc1-gc685da6f56cc_6.5.0-rc1-gc685da6f56cc-1_amd64.deb [38851044/38851044] -> "/tmp/linux-image.deb" [1] 2023-07-24T05:29:26.366 INFO:teuthology.orchestra.run.smithi077.stderr:FINISHED --2023-07-24 05:29:26-- 2023-07-24T05:29:26.367 INFO:teuthology.orchestra.run.smithi077.stderr:Total wall clock time: 4.6s 2023-07-24T05:29:26.367 INFO:teuthology.orchestra.run.smithi077.stderr:Downloaded: 1 files, 37M in 3.5s (10.7 MB/s) 2023-07-24T05:29:26.368 INFO:teuthology.task.kernel:Installing kernel c685da6f56cc77f2cfb9c4221be3960522616caf on mon.a... 2023-07-24T05:29:26.369 DEBUG:teuthology.orchestra.run.smithi077:> sudo dpkg -i /tmp/linux-image.deb 2023-07-24T05:29:26.662 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package linux-image-6.5.0-rc1-gc685da6f56cc. 2023-07-24T05:29:28.380 INFO:teuthology.orchestra.run.smithi077.stdout:(Reading database ... 104373 files and directories currently installed.) 2023-07-24T05:29:28.384 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-07-24T05:29:28.529 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking linux-image-6.5.0-rc1-gc685da6f56cc (6.5.0-rc1-gc685da6f56cc-1) ... 2023-07-24T05:29:30.144 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24 05:29:30 URL:https://1.chacra.ceph.com/r/kernel/testing/c685da6f56cc77f2cfb9c4221be3960522616caf/ubuntu/focal/flavors/default/pool/main/l/linux-6.5.0-rc1-gc685da6f56cc/linux-image-6.5.0-rc1-gc685da6f56cc_6.5.0-rc1-gc685da6f56cc-1_amd64.deb [38851044/38851044] -> "/tmp/linux-image.deb" [1] 2023-07-24T05:29:30.145 INFO:teuthology.orchestra.run.smithi103.stderr:FINISHED --2023-07-24 05:29:30-- 2023-07-24T05:29:30.145 INFO:teuthology.orchestra.run.smithi103.stderr:Total wall clock time: 5.9s 2023-07-24T05:29:30.145 INFO:teuthology.orchestra.run.smithi103.stderr:Downloaded: 1 files, 37M in 5.6s (6.59 MB/s) 2023-07-24T05:29:30.146 INFO:teuthology.task.kernel:Installing kernel c685da6f56cc77f2cfb9c4221be3960522616caf on mon.b... 2023-07-24T05:29:30.146 DEBUG:teuthology.orchestra.run.smithi103:> sudo dpkg -i /tmp/linux-image.deb 2023-07-24T05:29:30.402 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package linux-image-6.5.0-rc1-gc685da6f56cc. 2023-07-24T05:29:31.415 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up linux-image-6.5.0-rc1-gc685da6f56cc (6.5.0-rc1-gc685da6f56cc-1) ... 2023-07-24T05:29:31.536 INFO:teuthology.orchestra.run.smithi077.stderr:update-initramfs: Generating /boot/initrd.img-6.5.0-rc1-gc685da6f56cc 2023-07-24T05:29:32.150 INFO:teuthology.orchestra.run.smithi103.stdout:(Reading database ... 104373 files and directories currently installed.) 2023-07-24T05:29:32.155 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-07-24T05:29:32.364 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking linux-image-6.5.0-rc1-gc685da6f56cc (6.5.0-rc1-gc685da6f56cc-1) ... 2023-07-24T05:29:35.339 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up linux-image-6.5.0-rc1-gc685da6f56cc (6.5.0-rc1-gc685da6f56cc-1) ... 2023-07-24T05:29:35.453 INFO:teuthology.orchestra.run.smithi103.stderr:update-initramfs: Generating /boot/initrd.img-6.5.0-rc1-gc685da6f56cc 2023-07-24T05:29:56.010 INFO:teuthology.orchestra.run.smithi077.stderr:Sourcing file `/etc/default/grub' 2023-07-24T05:29:56.022 INFO:teuthology.orchestra.run.smithi077.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-24T05:29:56.051 INFO:teuthology.orchestra.run.smithi077.stderr:Generating grub configuration file ... 2023-07-24T05:29:56.389 INFO:teuthology.orchestra.run.smithi077.stderr:Found linux image: /boot/vmlinuz-6.5.0-rc1-gc685da6f56cc 2023-07-24T05:29:56.413 INFO:teuthology.orchestra.run.smithi077.stderr:Found initrd image: /boot/initrd.img-6.5.0-rc1-gc685da6f56cc 2023-07-24T05:29:56.772 INFO:teuthology.orchestra.run.smithi077.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-07-24T05:29:56.786 INFO:teuthology.orchestra.run.smithi077.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-07-24T05:29:59.467 INFO:teuthology.orchestra.run.smithi077.stderr:done 2023-07-24T05:29:59.642 DEBUG:teuthology.orchestra.run.smithi077:> dpkg-deb -c /tmp/linux-image.deb 2023-07-24T05:29:59.652 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./ 2023-07-24T05:29:59.652 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./boot/ 2023-07-24T05:29:59.652 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 4380308 2023-07-20 12:16 ./boot/System.map-6.5.0-rc1-gc685da6f56cc 2023-07-24T05:29:59.666 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 168433 2023-07-20 12:16 ./boot/config-6.5.0-rc1-gc685da6f56cc 2023-07-24T05:29:59.666 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11280224 2023-07-20 12:16 ./boot/vmlinuz-6.5.0-rc1-gc685da6f56cc 2023-07-24T05:29:59.689 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./etc/ 2023-07-24T05:29:59.689 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./etc/kernel/ 2023-07-24T05:29:59.689 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./etc/kernel/postinst.d/ 2023-07-24T05:29:59.689 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./etc/kernel/postrm.d/ 2023-07-24T05:29:59.689 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./etc/kernel/preinst.d/ 2023-07-24T05:29:59.689 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./etc/kernel/prerm.d/ 2023-07-24T05:29:59.690 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/ 2023-07-24T05:29:59.690 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/ 2023-07-24T05:29:59.690 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/ 2023-07-24T05:29:59.690 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/ 2023-07-24T05:29:59.690 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/ 2023-07-24T05:29:59.690 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/ 2023-07-24T05:29:59.690 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/ 2023-07-24T05:29:59.691 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 490385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/aesni-intel.ko 2023-07-24T05:29:59.691 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-07-24T05:29:59.691 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-07-24T05:29:59.691 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 30313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-07-24T05:29:59.691 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 93113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-07-24T05:29:59.693 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 106729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-07-24T05:29:59.693 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 152241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-07-24T05:29:59.693 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-07-24T05:29:59.693 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-07-24T05:29:59.694 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 83889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-07-24T05:29:59.694 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-07-24T05:29:59.694 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 47225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-07-24T05:29:59.694 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 47209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/serpent-avx2.ko 2023-07-24T05:29:59.694 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 51801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-07-24T05:29:59.694 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 38937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-07-24T05:29:59.694 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 40529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-07-24T05:29:59.695 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 58585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-07-24T05:29:59.695 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 50497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-07-24T05:29:59.695 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 32065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-07-24T05:29:59.695 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-07-24T05:29:59.695 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/ 2023-07-24T05:29:59.695 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/cpu/ 2023-07-24T05:29:59.695 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/cpu/mce/ 2023-07-24T05:29:59.695 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 40113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-07-24T05:29:59.696 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/cpuid.ko 2023-07-24T05:29:59.696 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/msr.ko 2023-07-24T05:29:59.696 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kvm/ 2023-07-24T05:29:59.696 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 348417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kvm/kvm-amd.ko 2023-07-24T05:29:59.696 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 972641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kvm/kvm-intel.ko 2023-07-24T05:29:59.696 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 2273145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kvm/kvm.ko 2023-07-24T05:29:59.697 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/ 2023-07-24T05:29:59.697 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 53521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/af_alg.ko 2023-07-24T05:29:59.705 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/algif_hash.ko 2023-07-24T05:29:59.705 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/algif_skcipher.ko 2023-07-24T05:29:59.705 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/ansi_cprng.ko 2023-07-24T05:29:59.706 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/anubis.ko 2023-07-24T05:29:59.706 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/arc4.ko 2023-07-24T05:29:59.706 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/asymmetric_keys/ 2023-07-24T05:29:59.706 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-07-24T05:29:59.706 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/ 2023-07-24T05:29:59.706 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_memcpy.ko 2023-07-24T05:29:59.706 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_pq.ko 2023-07-24T05:29:59.706 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_raid6_recov.ko 2023-07-24T05:29:59.707 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_tx.ko 2023-07-24T05:29:59.707 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_xor.ko 2023-07-24T05:29:59.707 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/raid6test.ko 2023-07-24T05:29:59.707 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/authenc.ko 2023-07-24T05:29:59.707 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/authencesn.ko 2023-07-24T05:29:59.707 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/blake2b_generic.ko 2023-07-24T05:29:59.707 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/blowfish_common.ko 2023-07-24T05:29:59.707 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/blowfish_generic.ko 2023-07-24T05:29:59.708 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 38873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/camellia_generic.ko 2023-07-24T05:29:59.708 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cast5_generic.ko 2023-07-24T05:29:59.708 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cast6_generic.ko 2023-07-24T05:29:59.708 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cast_common.ko 2023-07-24T05:29:59.708 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 35097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/ccm.ko 2023-07-24T05:29:59.708 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cmac.ko 2023-07-24T05:29:59.708 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/crc32_generic.ko 2023-07-24T05:29:59.709 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 46961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cryptd.ko 2023-07-24T05:29:59.709 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/crypto_engine.ko 2023-07-24T05:29:59.709 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/crypto_simd.ko 2023-07-24T05:29:59.709 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/crypto_user.ko 2023-07-24T05:29:59.709 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cts.ko 2023-07-24T05:29:59.709 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/des_generic.ko 2023-07-24T05:29:59.709 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/dh_generic.ko 2023-07-24T05:29:59.709 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/echainiv.ko 2023-07-24T05:29:59.710 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/essiv.ko 2023-07-24T05:29:59.710 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/fcrypt.ko 2023-07-24T05:29:59.710 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/khazad.ko 2023-07-24T05:29:59.710 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/lrw.ko 2023-07-24T05:29:59.710 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/lz4.ko 2023-07-24T05:29:59.710 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/lz4hc.ko 2023-07-24T05:29:59.710 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/md4.ko 2023-07-24T05:29:59.710 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/michael_mic.ko 2023-07-24T05:29:59.711 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/pcbc.ko 2023-07-24T05:29:59.711 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/pcrypt.ko 2023-07-24T05:29:59.711 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/rmd160.ko 2023-07-24T05:29:59.711 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/seed.ko 2023-07-24T05:29:59.711 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/serpent_generic.ko 2023-07-24T05:29:59.711 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 149193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/tcrypt.ko 2023-07-24T05:29:59.711 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/tea.ko 2023-07-24T05:29:59.712 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/twofish_common.ko 2023-07-24T05:29:59.712 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/twofish_generic.ko 2023-07-24T05:29:59.712 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/vmac.ko 2023-07-24T05:29:59.712 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 36185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/wp512.ko 2023-07-24T05:29:59.712 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/xcbc.ko 2023-07-24T05:29:59.712 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/xor.ko 2023-07-24T05:29:59.712 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/xts.ko 2023-07-24T05:29:59.712 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/xxhash_generic.ko 2023-07-24T05:29:59.713 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ 2023-07-24T05:29:59.713 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/ 2023-07-24T05:29:59.713 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/acpi_extlog.ko 2023-07-24T05:29:59.713 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/acpi_ipmi.ko 2023-07-24T05:29:59.713 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/acpi_pad.ko 2023-07-24T05:29:59.713 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/apei/ 2023-07-24T05:29:59.713 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 31241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/apei/einj.ko 2023-07-24T05:29:59.714 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/ec_sys.ko 2023-07-24T05:29:59.714 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/platform_profile.ko 2023-07-24T05:29:59.714 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/sbs.ko 2023-07-24T05:29:59.714 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/sbshc.ko 2023-07-24T05:29:59.714 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 100401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/video.ko 2023-07-24T05:29:59.714 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/ 2023-07-24T05:29:59.714 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/acard-ahci.ko 2023-07-24T05:29:59.714 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 88625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/ahci.ko 2023-07-24T05:29:59.715 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/ahci_platform.ko 2023-07-24T05:29:59.715 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 87841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/libahci.ko 2023-07-24T05:29:59.715 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 35049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/libahci_platform.ko 2023-07-24T05:29:59.715 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_acpi.ko 2023-07-24T05:29:59.715 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 30553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_ali.ko 2023-07-24T05:29:59.715 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_amd.ko 2023-07-24T05:29:59.715 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_artop.ko 2023-07-24T05:29:59.715 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_atiixp.ko 2023-07-24T05:29:59.716 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_atp867x.ko 2023-07-24T05:29:59.716 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_cmd640.ko 2023-07-24T05:29:59.716 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_cmd64x.ko 2023-07-24T05:29:59.716 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_cypress.ko 2023-07-24T05:29:59.716 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_efar.ko 2023-07-24T05:29:59.716 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_hpt366.ko 2023-07-24T05:29:59.716 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 34033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_hpt37x.ko 2023-07-24T05:29:59.717 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_hpt3x2n.ko 2023-07-24T05:29:59.717 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_hpt3x3.ko 2023-07-24T05:29:59.717 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_it8213.ko 2023-07-24T05:29:59.717 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 35177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_it821x.ko 2023-07-24T05:29:59.717 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_jmicron.ko 2023-07-24T05:29:59.717 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 51737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_legacy.ko 2023-07-24T05:29:59.717 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_marvell.ko 2023-07-24T05:29:59.717 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_mpiix.ko 2023-07-24T05:29:59.718 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_netcell.ko 2023-07-24T05:29:59.718 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_ninja32.ko 2023-07-24T05:29:59.718 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_ns87410.ko 2023-07-24T05:29:59.718 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_ns87415.ko 2023-07-24T05:29:59.718 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_oldpiix.ko 2023-07-24T05:29:59.718 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_opti.ko 2023-07-24T05:29:59.718 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_optidma.ko 2023-07-24T05:29:59.718 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 32521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_pcmcia.ko 2023-07-24T05:29:59.719 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 37729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_pdc2027x.ko 2023-07-24T05:29:59.719 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-07-24T05:29:59.719 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_piccolo.ko 2023-07-24T05:29:59.719 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_radisys.ko 2023-07-24T05:29:59.719 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_rdc.ko 2023-07-24T05:29:59.719 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_rz1000.ko 2023-07-24T05:29:59.719 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_sch.ko 2023-07-24T05:29:59.719 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_serverworks.ko 2023-07-24T05:29:59.720 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_sil680.ko 2023-07-24T05:29:59.720 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_sl82c105.ko 2023-07-24T05:29:59.720 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_triflex.ko 2023-07-24T05:29:59.720 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 30425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_via.ko 2023-07-24T05:29:59.720 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pdc_adma.ko 2023-07-24T05:29:59.720 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_inic162x.ko 2023-07-24T05:29:59.720 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 83225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_mv.ko 2023-07-24T05:29:59.721 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 70537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_nv.ko 2023-07-24T05:29:59.721 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 37369 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_promise.ko 2023-07-24T05:29:59.721 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_qstor.ko 2023-07-24T05:29:59.721 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_sil.ko 2023-07-24T05:29:59.721 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 38273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_sil24.ko 2023-07-24T05:29:59.721 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_sis.ko 2023-07-24T05:29:59.721 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_svw.ko 2023-07-24T05:29:59.721 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 44721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_sx4.ko 2023-07-24T05:29:59.722 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_uli.ko 2023-07-24T05:29:59.722 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 35121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_via.ko 2023-07-24T05:29:59.722 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_vsc.ko 2023-07-24T05:29:59.722 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/auxdisplay/ 2023-07-24T05:29:59.722 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/auxdisplay/ks0108.ko 2023-07-24T05:29:59.722 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/bcma/ 2023-07-24T05:29:59.722 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 124457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/bcma/bcma.ko 2023-07-24T05:29:59.722 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/ 2023-07-24T05:29:59.723 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/aoe/ 2023-07-24T05:29:59.723 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 113705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/aoe/aoe.ko 2023-07-24T05:29:59.723 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/drbd/ 2023-07-24T05:29:59.723 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 968433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/drbd/drbd.ko 2023-07-24T05:29:59.754 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 173201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/floppy.ko 2023-07-24T05:29:59.755 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/mtip32xx/ 2023-07-24T05:29:59.755 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 94297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-07-24T05:29:59.755 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 115345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/nbd.ko 2023-07-24T05:29:59.755 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/null_blk/ 2023-07-24T05:29:59.755 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 110361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/null_blk/null_blk.ko 2023-07-24T05:29:59.755 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 98225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/pktcdvd.ko 2023-07-24T05:29:59.755 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 257529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/rbd.ko 2023-07-24T05:29:59.756 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/xen-blkback/ 2023-07-24T05:29:59.756 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 98129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-07-24T05:29:59.756 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/zram/ 2023-07-24T05:29:59.756 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 60201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/zram/zram.ko 2023-07-24T05:29:59.756 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ 2023-07-24T05:29:59.756 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 30849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/applicom.ko 2023-07-24T05:29:59.756 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hangcheck-timer.ko 2023-07-24T05:29:59.756 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/ 2023-07-24T05:29:59.757 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/amd-rng.ko 2023-07-24T05:29:59.757 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/intel-rng.ko 2023-07-24T05:29:59.757 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-07-24T05:29:59.757 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/via-rng.ko 2023-07-24T05:29:59.757 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15633 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/virtio-rng.ko 2023-07-24T05:29:59.757 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ 2023-07-24T05:29:59.757 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 30857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-07-24T05:29:59.758 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 150665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-07-24T05:29:59.758 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-07-24T05:29:59.758 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 139057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_si.ko 2023-07-24T05:29:59.758 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 70833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-07-24T05:29:59.758 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 53609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-07-24T05:29:59.758 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 36321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/lp.ko 2023-07-24T05:29:59.758 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/mwave/ 2023-07-24T05:29:59.758 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 84121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/mwave/mwave.ko 2023-07-24T05:29:59.759 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/nvram.ko 2023-07-24T05:29:59.759 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 32169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ppdev.ko 2023-07-24T05:29:59.759 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 51113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tlclk.ko 2023-07-24T05:29:59.759 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/ 2023-07-24T05:29:59.759 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_atmel.ko 2023-07-24T05:29:59.759 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-07-24T05:29:59.759 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-07-24T05:29:59.759 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 32985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-07-24T05:29:59.760 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 30121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_infineon.ko 2023-07-24T05:29:59.760 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_nsc.ko 2023-07-24T05:29:59.760 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-07-24T05:29:59.760 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/xillybus/ 2023-07-24T05:29:59.760 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/xillybus/xillybus_class.ko 2023-07-24T05:29:59.760 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 50945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/xillybus/xillybus_core.ko 2023-07-24T05:29:59.760 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-07-24T05:29:59.760 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/clk/ 2023-07-24T05:29:59.761 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/clk/clk-palmas.ko 2023-07-24T05:29:59.761 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 47849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/clk/clk-si5351.ko 2023-07-24T05:29:59.761 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/clk/clk-twl6040.ko 2023-07-24T05:29:59.761 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/clk/clk-wm831x.ko 2023-07-24T05:29:59.761 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/ 2023-07-24T05:29:59.761 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-07-24T05:29:59.761 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/p4-clockmod.ko 2023-07-24T05:29:59.761 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/speedstep-lib.ko 2023-07-24T05:29:59.762 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/ 2023-07-24T05:29:59.762 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/ccp/ 2023-07-24T05:29:59.762 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 70785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-07-24T05:29:59.762 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 234473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/ccp/ccp.ko 2023-07-24T05:29:59.762 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/ 2023-07-24T05:29:59.762 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/ 2023-07-24T05:29:59.762 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/qat_common/ 2023-07-24T05:29:59.763 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 408489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-07-24T05:29:59.763 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-07-24T05:29:59.763 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-07-24T05:29:59.763 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/padlock-aes.ko 2023-07-24T05:29:59.763 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/padlock-sha.ko 2023-07-24T05:29:59.763 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/virtio/ 2023-07-24T05:29:59.763 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 68937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-07-24T05:29:59.764 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dca/ 2023-07-24T05:29:59.764 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dca/dca.ko 2023-07-24T05:29:59.764 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/ 2023-07-24T05:29:59.764 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/dw/ 2023-07-24T05:29:59.764 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/dw/dw_dmac.ko 2023-07-24T05:29:59.764 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/ioat/ 2023-07-24T05:29:59.764 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 122641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/ioat/ioatdma.ko 2023-07-24T05:29:59.765 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/ 2023-07-24T05:29:59.765 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 80273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/amd64_edac.ko 2023-07-24T05:29:59.765 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 35769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/e752x_edac.ko 2023-07-24T05:29:59.765 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 63617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/edac_mce_amd.ko 2023-07-24T05:29:59.765 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i3000_edac.ko 2023-07-24T05:29:59.765 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i3200_edac.ko 2023-07-24T05:29:59.765 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i5100_edac.ko 2023-07-24T05:29:59.765 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i5400_edac.ko 2023-07-24T05:29:59.766 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i7300_edac.ko 2023-07-24T05:29:59.766 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 52025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i7core_edac.ko 2023-07-24T05:29:59.766 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i82975x_edac.ko 2023-07-24T05:29:59.766 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/ie31200_edac.ko 2023-07-24T05:29:59.766 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 56809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/sb_edac.ko 2023-07-24T05:29:59.766 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/x38_edac.ko 2023-07-24T05:29:59.766 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/ 2023-07-24T05:29:59.766 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-gpio.ko 2023-07-24T05:29:59.767 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-max14577.ko 2023-07-24T05:29:59.767 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-max77693.ko 2023-07-24T05:29:59.767 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-max8997.ko 2023-07-24T05:29:59.767 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-palmas.ko 2023-07-24T05:29:59.767 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-rt8973a.ko 2023-07-24T05:29:59.767 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-sm5502.ko 2023-07-24T05:29:59.767 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/ 2023-07-24T05:29:59.767 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 34953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/dmi-sysfs.ko 2023-07-24T05:29:59.768 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/efi/ 2023-07-24T05:29:59.768 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/efi/efi-pstore.ko 2023-07-24T05:29:59.768 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/iscsi_ibft.ko 2023-07-24T05:29:59.768 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/ 2023-07-24T05:29:59.768 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-adp5520.ko 2023-07-24T05:29:59.768 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-amd8111.ko 2023-07-24T05:29:59.768 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-arizona.ko 2023-07-24T05:29:59.769 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-da9052.ko 2023-07-24T05:29:59.769 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-da9055.ko 2023-07-24T05:29:59.769 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-dln2.ko 2023-07-24T05:29:59.769 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 77849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-f7188x.ko 2023-07-24T05:29:59.769 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-generic.ko 2023-07-24T05:29:59.769 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-ich.ko 2023-07-24T05:29:59.769 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-07-24T05:29:59.769 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-kempld.ko 2023-07-24T05:29:59.770 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-lp3943.ko 2023-07-24T05:29:59.770 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-max7300.ko 2023-07-24T05:29:59.770 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-max730x.ko 2023-07-24T05:29:59.770 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-max732x.ko 2023-07-24T05:29:59.770 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-07-24T05:29:59.770 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 46761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-pca953x.ko 2023-07-24T05:29:59.770 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-pcf857x.ko 2023-07-24T05:29:59.770 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-rdc321x.ko 2023-07-24T05:29:59.771 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-sch.ko 2023-07-24T05:29:59.771 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-sch311x.ko 2023-07-24T05:29:59.771 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-tps65912.ko 2023-07-24T05:29:59.771 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-twl4030.ko 2023-07-24T05:29:59.771 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-twl6040.ko 2023-07-24T05:29:59.771 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-viperboard.ko 2023-07-24T05:29:59.771 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-vx855.ko 2023-07-24T05:29:59.771 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-wm831x.ko 2023-07-24T05:29:59.772 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-wm8350.ko 2023-07-24T05:29:59.772 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-wm8994.ko 2023-07-24T05:29:59.772 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/ 2023-07-24T05:29:59.772 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-a4tech.ko 2023-07-24T05:29:59.772 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 39081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-apple.ko 2023-07-24T05:29:59.772 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-appleir.ko 2023-07-24T05:29:59.772 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-aureal.ko 2023-07-24T05:29:59.772 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-axff.ko 2023-07-24T05:29:59.773 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-belkin.ko 2023-07-24T05:29:59.773 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-cherry.ko 2023-07-24T05:29:59.773 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-chicony.ko 2023-07-24T05:29:59.773 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 59145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-cp2112.ko 2023-07-24T05:29:59.773 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-cypress.ko 2023-07-24T05:29:59.773 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-dr.ko 2023-07-24T05:29:59.773 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-elecom.ko 2023-07-24T05:29:59.774 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-elo.ko 2023-07-24T05:29:59.774 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-emsff.ko 2023-07-24T05:29:59.774 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-ezkey.ko 2023-07-24T05:29:59.774 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-gaff.ko 2023-07-24T05:29:59.774 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-generic.ko 2023-07-24T05:29:59.774 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-gt683r.ko 2023-07-24T05:29:59.774 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-gyration.ko 2023-07-24T05:29:59.774 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-holtek-kbd.ko 2023-07-24T05:29:59.775 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-holtek-mouse.ko 2023-07-24T05:29:59.775 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-holtekff.ko 2023-07-24T05:29:59.775 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-hyperv.ko 2023-07-24T05:29:59.775 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-icade.ko 2023-07-24T05:29:59.775 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-kensington.ko 2023-07-24T05:29:59.775 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-keytouch.ko 2023-07-24T05:29:59.775 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-kye.ko 2023-07-24T05:29:59.775 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-lcpower.ko 2023-07-24T05:29:59.776 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-led.ko 2023-07-24T05:29:59.776 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 42297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-lenovo.ko 2023-07-24T05:29:59.776 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 30761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-lg-g15.ko 2023-07-24T05:29:59.776 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 57809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-logitech-dj.ko 2023-07-24T05:29:59.776 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 100897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-07-24T05:29:59.776 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 80993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-logitech.ko 2023-07-24T05:29:59.776 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 30801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-magicmouse.ko 2023-07-24T05:29:59.776 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-microsoft.ko 2023-07-24T05:29:59.777 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-monterey.ko 2023-07-24T05:29:59.777 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 50153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-multitouch.ko 2023-07-24T05:29:59.777 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 32593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-ntrig.ko 2023-07-24T05:29:59.777 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-ortek.ko 2023-07-24T05:29:59.777 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-penmount.ko 2023-07-24T05:29:59.777 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-petalynx.ko 2023-07-24T05:29:59.777 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 72937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-picolcd.ko 2023-07-24T05:29:59.778 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-pl.ko 2023-07-24T05:29:59.778 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-plantronics.ko 2023-07-24T05:29:59.778 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-primax.ko 2023-07-24T05:29:59.778 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 35457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-rmi.ko 2023-07-24T05:29:59.778 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-arvo.ko 2023-07-24T05:29:59.778 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-common.ko 2023-07-24T05:29:59.778 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 31361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-isku.ko 2023-07-24T05:29:59.778 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-kone.ko 2023-07-24T05:29:59.779 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 31065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-07-24T05:29:59.779 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-konepure.ko 2023-07-24T05:29:59.779 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-07-24T05:29:59.779 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-lua.ko 2023-07-24T05:29:59.779 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-pyra.ko 2023-07-24T05:29:59.779 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-ryos.ko 2023-07-24T05:29:59.779 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-savu.ko 2023-07-24T05:29:59.779 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat.ko 2023-07-24T05:29:59.780 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-saitek.ko 2023-07-24T05:29:59.780 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-samsung.ko 2023-07-24T05:29:59.780 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 36801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-sensor-hub.ko 2023-07-24T05:29:59.780 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-sjoy.ko 2023-07-24T05:29:59.780 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 51201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-sony.ko 2023-07-24T05:29:59.780 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-speedlink.ko 2023-07-24T05:29:59.780 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-steelseries.ko 2023-07-24T05:29:59.781 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-sunplus.ko 2023-07-24T05:29:59.781 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-thrustmaster.ko 2023-07-24T05:29:59.781 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-tivo.ko 2023-07-24T05:29:59.781 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-tmff.ko 2023-07-24T05:29:59.781 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-topseed.ko 2023-07-24T05:29:59.781 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-twinhan.ko 2023-07-24T05:29:59.781 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 71457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-uclogic.ko 2023-07-24T05:29:59.781 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-waltop.ko 2023-07-24T05:29:59.782 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 143585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-wiimote.ko 2023-07-24T05:29:59.782 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-xinmo.ko 2023-07-24T05:29:59.782 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-zpff.ko 2023-07-24T05:29:59.782 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-zydacron.ko 2023-07-24T05:29:59.782 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 267713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid.ko 2023-07-24T05:29:59.782 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 32321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/uhid.ko 2023-07-24T05:29:59.782 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/usbhid/ 2023-07-24T05:29:59.783 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 125721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/usbhid/usbhid.ko 2023-07-24T05:29:59.783 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/usbhid/usbkbd.ko 2023-07-24T05:29:59.783 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/usbhid/usbmouse.ko 2023-07-24T05:29:59.783 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 217401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/wacom.ko 2023-07-24T05:29:59.783 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hv/ 2023-07-24T05:29:59.783 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 63497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hv/hv_balloon.ko 2023-07-24T05:29:59.783 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 89609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hv/hv_utils.ko 2023-07-24T05:29:59.783 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 301449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hv/hv_vmbus.ko 2023-07-24T05:29:59.784 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ 2023-07-24T05:29:59.784 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 66593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/abituguru.ko 2023-07-24T05:29:59.784 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 61393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/abituguru3.ko 2023-07-24T05:29:59.784 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 34745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/acpi_power_meter.ko 2023-07-24T05:29:59.784 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ad7414.ko 2023-07-24T05:29:59.784 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ad7418.ko 2023-07-24T05:29:59.784 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adc128d818.ko 2023-07-24T05:29:59.784 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 31729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm1025.ko 2023-07-24T05:29:59.785 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 97977 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm1026.ko 2023-07-24T05:29:59.785 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm1029.ko 2023-07-24T05:29:59.785 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 45553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm1031.ko 2023-07-24T05:29:59.785 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm9240.ko 2023-07-24T05:29:59.785 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ads7828.ko 2023-07-24T05:29:59.785 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7410.ko 2023-07-24T05:29:59.785 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7411.ko 2023-07-24T05:29:59.785 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 74433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7462.ko 2023-07-24T05:29:59.786 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 39585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7470.ko 2023-07-24T05:29:59.786 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 67929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7475.ko 2023-07-24T05:29:59.786 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7x10.ko 2023-07-24T05:29:59.786 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 39073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/amc6821.ko 2023-07-24T05:29:59.786 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 55265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/applesmc.ko 2023-07-24T05:29:59.786 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 49913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/asb100.ko 2023-07-24T05:29:59.786 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 58617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/asc7621.ko 2023-07-24T05:29:59.786 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 40881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/asus_atk0110.ko 2023-07-24T05:29:59.787 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/atxp1.ko 2023-07-24T05:29:59.787 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/coretemp.ko 2023-07-24T05:29:59.787 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/da9052-hwmon.ko 2023-07-24T05:29:59.787 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/da9055-hwmon.ko 2023-07-24T05:29:59.787 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 44465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-07-24T05:29:59.787 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 99601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/dme1737.ko 2023-07-24T05:29:59.787 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ds1621.ko 2023-07-24T05:29:59.787 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ds620.ko 2023-07-24T05:29:59.788 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/emc1403.ko 2023-07-24T05:29:59.788 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/emc2103.ko 2023-07-24T05:29:59.788 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 30321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/emc6w201.ko 2023-07-24T05:29:59.788 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 66985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/f71805f.ko 2023-07-24T05:29:59.788 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 94457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/f71882fg.ko 2023-07-24T05:29:59.788 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 41401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/f75375s.ko 2023-07-24T05:29:59.788 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/fam15h_power.ko 2023-07-24T05:29:59.789 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 55433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/fschmd.ko 2023-07-24T05:29:59.789 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/g760a.ko 2023-07-24T05:29:59.789 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/g762.ko 2023-07-24T05:29:59.789 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 46801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/gl518sm.ko 2023-07-24T05:29:59.789 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 45529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/gl520sm.ko 2023-07-24T05:29:59.789 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/hih6130.ko 2023-07-24T05:29:59.789 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/hwmon-vid.ko 2023-07-24T05:29:59.789 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/i5500_temp.ko 2023-07-24T05:29:59.790 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/i5k_amb.ko 2023-07-24T05:29:59.790 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 34505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ibmaem.ko 2023-07-24T05:29:59.790 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ibmpex.ko 2023-07-24T05:29:59.790 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ina209.ko 2023-07-24T05:29:59.790 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ina2xx.ko 2023-07-24T05:29:59.790 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 129217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/it87.ko 2023-07-24T05:29:59.790 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/jc42.ko 2023-07-24T05:29:59.790 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/k10temp.ko 2023-07-24T05:29:59.791 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/k8temp.ko 2023-07-24T05:29:59.791 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lineage-pem.ko 2023-07-24T05:29:59.791 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 48601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm63.ko 2023-07-24T05:29:59.791 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm73.ko 2023-07-24T05:29:59.791 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 36777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm75.ko 2023-07-24T05:29:59.791 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm77.ko 2023-07-24T05:29:59.791 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 34657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm78.ko 2023-07-24T05:29:59.791 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 31745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm80.ko 2023-07-24T05:29:59.792 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm83.ko 2023-07-24T05:29:59.792 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 72833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm85.ko 2023-07-24T05:29:59.792 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 46153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm87.ko 2023-07-24T05:29:59.792 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 37913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm90.ko 2023-07-24T05:29:59.792 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm92.ko 2023-07-24T05:29:59.792 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 108841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm93.ko 2023-07-24T05:29:59.792 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm95234.ko 2023-07-24T05:29:59.792 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm95241.ko 2023-07-24T05:29:59.793 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm95245.ko 2023-07-24T05:29:59.793 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc2945.ko 2023-07-24T05:29:59.793 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4151.ko 2023-07-24T05:29:59.793 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4215.ko 2023-07-24T05:29:59.793 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4222.ko 2023-07-24T05:29:59.793 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4245.ko 2023-07-24T05:29:59.793 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4260.ko 2023-07-24T05:29:59.794 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4261.ko 2023-07-24T05:29:59.794 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max16065.ko 2023-07-24T05:29:59.794 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max1619.ko 2023-07-24T05:29:59.794 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max1668.ko 2023-07-24T05:29:59.794 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max197.ko 2023-07-24T05:29:59.794 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max6639.ko 2023-07-24T05:29:59.794 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max6650.ko 2023-07-24T05:29:59.794 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 35777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max6697.ko 2023-07-24T05:29:59.795 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/mc13783-adc.ko 2023-07-24T05:29:59.795 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/mcp3021.ko 2023-07-24T05:29:59.795 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-07-24T05:29:59.795 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 44129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/nct6683.ko 2023-07-24T05:29:59.795 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 116737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/nct6775-core.ko 2023-07-24T05:29:59.795 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 60705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/nct6775.ko 2023-07-24T05:29:59.795 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 59737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/nct7802.ko 2023-07-24T05:29:59.795 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 82337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pc87360.ko 2023-07-24T05:29:59.796 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 54433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pc87427.ko 2023-07-24T05:29:59.796 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pcf8591.ko 2023-07-24T05:29:59.796 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/ 2023-07-24T05:29:59.796 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-07-24T05:29:59.796 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-07-24T05:29:59.796 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-07-24T05:29:59.796 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/max16064.ko 2023-07-24T05:29:59.797 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/max34440.ko 2023-07-24T05:29:59.797 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/max8688.ko 2023-07-24T05:29:59.797 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-07-24T05:29:59.797 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 81841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-07-24T05:29:59.797 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-07-24T05:29:59.797 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 30729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-07-24T05:29:59.797 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-07-24T05:29:59.798 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-07-24T05:29:59.798 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/powr1220.ko 2023-07-24T05:29:59.798 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sch5627.ko 2023-07-24T05:29:59.798 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sch5636.ko 2023-07-24T05:29:59.798 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sch56xx-common.ko 2023-07-24T05:29:59.798 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 32137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sht15.ko 2023-07-24T05:29:59.799 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sht21.ko 2023-07-24T05:29:59.799 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/shtc1.ko 2023-07-24T05:29:59.799 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 40105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sis5595.ko 2023-07-24T05:29:59.799 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 31929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/smm665.ko 2023-07-24T05:29:59.799 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/smsc47b397.ko 2023-07-24T05:29:59.799 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 39193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/smsc47m1.ko 2023-07-24T05:29:59.799 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 37385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/smsc47m192.ko 2023-07-24T05:29:59.800 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/thmc50.ko 2023-07-24T05:29:59.800 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/tmp102.ko 2023-07-24T05:29:59.800 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/tmp103.ko 2023-07-24T05:29:59.800 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/tmp401.ko 2023-07-24T05:29:59.800 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/tmp421.ko 2023-07-24T05:29:59.800 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/via-cputemp.ko 2023-07-24T05:29:59.800 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 41945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/via686a.ko 2023-07-24T05:29:59.801 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 52457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/vt1211.ko 2023-07-24T05:29:59.801 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 51545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/vt8231.ko 2023-07-24T05:29:59.801 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 57513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83627ehf.ko 2023-07-24T05:29:59.801 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 78873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83627hf.ko 2023-07-24T05:29:59.801 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 71345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83781d.ko 2023-07-24T05:29:59.801 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 63289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83791d.ko 2023-07-24T05:29:59.801 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 71321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83792d.ko 2023-07-24T05:29:59.802 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 101457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83793.ko 2023-07-24T05:29:59.802 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 119505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83795.ko 2023-07-24T05:29:59.802 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83l785ts.ko 2023-07-24T05:29:59.802 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 35625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83l786ng.ko 2023-07-24T05:29:59.802 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-07-24T05:29:59.802 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-07-24T05:29:59.802 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/ 2023-07-24T05:29:59.803 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/algos/ 2023-07-24T05:29:59.803 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-07-24T05:29:59.803 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-07-24T05:29:59.803 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/ 2023-07-24T05:29:59.803 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-07-24T05:29:59.803 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-07-24T05:29:59.803 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-07-24T05:29:59.804 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-07-24T05:29:59.804 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-07-24T05:29:59.804 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-07-24T05:29:59.804 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-07-24T05:29:59.804 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 6929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-07-24T05:29:59.804 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-07-24T05:29:59.804 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 48553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-07-24T05:29:59.805 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-07-24T05:29:59.805 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-07-24T05:29:59.805 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-07-24T05:29:59.805 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-07-24T05:29:59.805 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-07-24T05:29:59.805 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 62729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-i801.ko 2023-07-24T05:29:59.806 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-isch.ko 2023-07-24T05:29:59.806 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 47889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-07-24T05:29:59.806 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17369 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-07-24T05:29:59.806 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-07-24T05:29:59.806 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-07-24T05:29:59.806 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-07-24T05:29:59.806 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-parport.ko 2023-07-24T05:29:59.807 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-07-24T05:29:59.807 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 47241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-07-24T05:29:59.807 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-07-24T05:29:59.807 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-07-24T05:29:59.807 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-07-24T05:29:59.807 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-07-24T05:29:59.807 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-07-24T05:29:59.808 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-07-24T05:29:59.808 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-07-24T05:29:59.808 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-07-24T05:29:59.808 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-via.ko 2023-07-24T05:29:59.808 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-07-24T05:29:59.808 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-07-24T05:29:59.808 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 47593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-07-24T05:29:59.809 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/i2c-mux.ko 2023-07-24T05:29:59.809 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/i2c-smbus.ko 2023-07-24T05:29:59.809 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/i2c-stub.ko 2023-07-24T05:29:59.809 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/muxes/ 2023-07-24T05:29:59.809 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-07-24T05:29:59.809 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-07-24T05:29:59.809 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-07-24T05:29:59.810 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ 2023-07-24T05:29:59.810 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ 2023-07-24T05:29:59.810 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 273641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ib_cm.ko 2023-07-24T05:29:59.810 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 876913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ib_core.ko 2023-07-24T05:29:59.810 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 69321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ib_umad.ko 2023-07-24T05:29:59.810 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 324145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-07-24T05:29:59.810 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 97961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/iw_cm.ko 2023-07-24T05:29:59.810 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 279321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/rdma_cm.ko 2023-07-24T05:29:59.811 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 66177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-07-24T05:29:59.811 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/ 2023-07-24T05:29:59.811 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/cxgb4/ 2023-07-24T05:29:59.811 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 492561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-07-24T05:29:59.811 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mlx4/ 2023-07-24T05:29:59.811 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 419217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-07-24T05:29:59.811 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mlx5/ 2023-07-24T05:29:59.812 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 739705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-07-24T05:29:59.812 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mthca/ 2023-07-24T05:29:59.812 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 296649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-07-24T05:29:59.812 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/ocrdma/ 2023-07-24T05:29:59.812 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 153681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-07-24T05:29:59.812 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/usnic/ 2023-07-24T05:29:59.812 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 169017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-07-24T05:29:59.812 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/ 2023-07-24T05:29:59.813 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/ipoib/ 2023-07-24T05:29:59.813 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 263177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-07-24T05:29:59.813 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/iser/ 2023-07-24T05:29:59.813 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 100225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-07-24T05:29:59.813 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/isert/ 2023-07-24T05:29:59.813 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 111993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-07-24T05:29:59.813 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/srp/ 2023-07-24T05:29:59.814 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 129081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-07-24T05:29:59.814 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/srpt/ 2023-07-24T05:29:59.814 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 129553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-07-24T05:29:59.814 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/ 2023-07-24T05:29:59.814 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/evbug.ko 2023-07-24T05:29:59.814 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/ff-memless.ko 2023-07-24T05:29:59.814 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/ 2023-07-24T05:29:59.814 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-07-24T05:29:59.815 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/fm801-gp.ko 2023-07-24T05:29:59.815 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 41217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/gameport.ko 2023-07-24T05:29:59.815 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/lightning.ko 2023-07-24T05:29:59.815 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/ns558.ko 2023-07-24T05:29:59.815 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 41825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/joydev.ko 2023-07-24T05:29:59.815 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/ 2023-07-24T05:29:59.815 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-07-24T05:29:59.815 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 30441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-07-24T05:29:59.816 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-07-24T05:29:59.816 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-07-24T05:29:59.816 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 36649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/gpio_keys.ko 2023-07-24T05:29:59.816 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-07-24T05:29:59.816 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/lkkbd.ko 2023-07-24T05:29:59.816 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/lm8323.ko 2023-07-24T05:29:59.816 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/lm8333.ko 2023-07-24T05:29:59.817 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-07-24T05:29:59.817 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-07-24T05:29:59.817 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-07-24T05:29:59.817 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-07-24T05:29:59.817 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/newtonkbd.ko 2023-07-24T05:29:59.817 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-07-24T05:29:59.817 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/qt1070.ko 2023-07-24T05:29:59.817 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/qt2160.ko 2023-07-24T05:29:59.818 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-07-24T05:29:59.818 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/stowaway.ko 2023-07-24T05:29:59.818 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/sunkbd.ko 2023-07-24T05:29:59.818 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-07-24T05:29:59.818 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-07-24T05:29:59.818 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-07-24T05:29:59.818 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/xtkbd.ko 2023-07-24T05:29:59.819 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/matrix-keymap.ko 2023-07-24T05:29:59.819 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/ 2023-07-24T05:29:59.819 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 34329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/appletouch.ko 2023-07-24T05:29:59.819 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 34177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/bcm5974.ko 2023-07-24T05:29:59.819 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 123681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/cyapatp.ko 2023-07-24T05:29:59.819 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 89449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/elan_i2c.ko 2023-07-24T05:29:59.819 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/gpio_mouse.ko 2023-07-24T05:29:59.820 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 335849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/psmouse.ko 2023-07-24T05:29:59.820 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/sermouse.ko 2023-07-24T05:29:59.820 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-07-24T05:29:59.820 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/synaptics_usb.ko 2023-07-24T05:29:59.820 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/vsxxxaa.ko 2023-07-24T05:29:59.820 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/rmi4/ 2023-07-24T05:29:59.820 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 109849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/rmi4/rmi_core.ko 2023-07-24T05:29:59.820 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/ 2023-07-24T05:29:59.821 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/altera_ps2.ko 2023-07-24T05:29:59.821 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/arc_ps2.ko 2023-07-24T05:29:59.821 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/ct82c710.ko 2023-07-24T05:29:59.821 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-07-24T05:29:59.821 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/parkbd.ko 2023-07-24T05:29:59.821 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/pcips2.ko 2023-07-24T05:29:59.821 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/ps2mult.ko 2023-07-24T05:29:59.821 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/serio_raw.ko 2023-07-24T05:29:59.822 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17977 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/serport.ko 2023-07-24T05:29:59.822 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/sparse-keymap.ko 2023-07-24T05:29:59.822 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/iommu/ 2023-07-24T05:29:59.822 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/iommu/amd/ 2023-07-24T05:29:59.822 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 38857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/iommu/amd/iommu_v2.ko 2023-07-24T05:29:59.822 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/ 2023-07-24T05:29:59.822 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-88pm860x.ko 2023-07-24T05:29:59.822 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-adp5520.ko 2023-07-24T05:29:59.823 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 59753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-bd2802.ko 2023-07-24T05:29:59.823 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-blinkm.ko 2023-07-24T05:29:59.823 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-da903x.ko 2023-07-24T05:29:59.823 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-da9052.ko 2023-07-24T05:29:59.823 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-gpio.ko 2023-07-24T05:29:59.823 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lm3530.ko 2023-07-24T05:29:59.823 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 30505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lm3533.ko 2023-07-24T05:29:59.824 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lm355x.ko 2023-07-24T05:29:59.824 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lm3642.ko 2023-07-24T05:29:59.824 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lp3944.ko 2023-07-24T05:29:59.824 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lp8788.ko 2023-07-24T05:29:59.824 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-max8997.ko 2023-07-24T05:29:59.824 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-mc13783.ko 2023-07-24T05:29:59.824 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-menf21bmc.ko 2023-07-24T05:29:59.825 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-pca9532.ko 2023-07-24T05:29:59.825 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-pca955x.ko 2023-07-24T05:29:59.825 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-pca963x.ko 2023-07-24T05:29:59.825 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 34433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-ss4200.ko 2023-07-24T05:29:59.825 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-tca6507.ko 2023-07-24T05:29:59.825 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-wm831x-status.ko 2023-07-24T05:29:59.825 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-wm8350.ko 2023-07-24T05:29:59.825 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ 2023-07-24T05:29:59.826 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-07-24T05:29:59.826 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-07-24T05:29:59.826 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-07-24T05:29:59.826 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-07-24T05:29:59.826 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-07-24T05:29:59.826 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-07-24T05:29:59.826 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-07-24T05:29:59.826 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-07-24T05:29:59.827 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/ 2023-07-24T05:29:59.827 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/bcache/ 2023-07-24T05:29:59.827 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 655473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/bcache/bcache.ko 2023-07-24T05:29:59.827 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 40569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-bio-prison.ko 2023-07-24T05:29:59.827 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 89601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-bufio.ko 2023-07-24T05:29:59.827 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 47465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-cache-smq.ko 2023-07-24T05:29:59.827 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 155993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-cache.ko 2023-07-24T05:29:59.828 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 107049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-crypt.ko 2023-07-24T05:29:59.828 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-delay.ko 2023-07-24T05:29:59.828 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 53897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-era.ko 2023-07-24T05:29:59.828 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-flakey.ko 2023-07-24T05:29:59.828 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 41593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-log-userspace.ko 2023-07-24T05:29:59.828 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 32721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-log.ko 2023-07-24T05:29:59.828 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 49545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-mirror.ko 2023-07-24T05:29:59.828 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 78017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-multipath.ko 2023-07-24T05:29:59.829 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-queue-length.ko 2023-07-24T05:29:59.829 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 70769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-raid.ko 2023-07-24T05:29:59.829 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 36273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-region-hash.ko 2023-07-24T05:29:59.829 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-round-robin.ko 2023-07-24T05:29:59.829 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-service-time.ko 2023-07-24T05:29:59.829 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 109593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-snapshot.ko 2023-07-24T05:29:59.829 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-switch.ko 2023-07-24T05:29:59.829 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 181585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-thin-pool.ko 2023-07-24T05:29:59.830 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 51737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-verity.ko 2023-07-24T05:29:59.830 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-zero.ko 2023-07-24T05:29:59.830 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/faulty.ko 2023-07-24T05:29:59.830 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/linear.ko 2023-07-24T05:29:59.830 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 32305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/multipath.ko 2023-07-24T05:29:59.830 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/persistent-data/ 2023-07-24T05:29:59.830 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 199937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-07-24T05:29:59.830 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 37321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/raid0.ko 2023-07-24T05:29:59.831 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 112609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/raid1.ko 2023-07-24T05:29:59.831 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 160553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/raid10.ko 2023-07-24T05:29:59.831 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 396153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/raid456.ko 2023-07-24T05:29:59.831 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/ 2023-07-24T05:29:59.831 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/ 2023-07-24T05:29:59.831 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 178113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptbase.ko 2023-07-24T05:29:59.831 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 63385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptctl.ko 2023-07-24T05:29:59.832 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 44649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptfc.ko 2023-07-24T05:29:59.832 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 37161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptlan.ko 2023-07-24T05:29:59.832 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 123305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptsas.ko 2023-07-24T05:29:59.832 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 79017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptscsih.ko 2023-07-24T05:29:59.832 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 53081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptspi.ko 2023-07-24T05:29:59.832 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/ 2023-07-24T05:29:59.832 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/88pm800.ko 2023-07-24T05:29:59.832 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/88pm805.ko 2023-07-24T05:29:59.833 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/88pm80x.ko 2023-07-24T05:29:59.833 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/arizona-i2c.ko 2023-07-24T05:29:59.833 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 123721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/arizona.ko 2023-07-24T05:29:59.833 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/bcm590xx.ko 2023-07-24T05:29:59.833 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/cros_ec_dev.ko 2023-07-24T05:29:59.833 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 34993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/dln2.ko 2023-07-24T05:29:59.833 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/janz-cmodio.ko 2023-07-24T05:29:59.833 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 53585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/kempld-core.ko 2023-07-24T05:29:59.834 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lm3533-core.ko 2023-07-24T05:29:59.834 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-07-24T05:29:59.834 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lp3943.ko 2023-07-24T05:29:59.834 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 54569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lpc_ich.ko 2023-07-24T05:29:59.834 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lpc_sch.ko 2023-07-24T05:29:59.834 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/max8907.ko 2023-07-24T05:29:59.834 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/mc13xxx-core.ko 2023-07-24T05:29:59.834 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-07-24T05:29:59.835 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/menf21bmc.ko 2023-07-24T05:29:59.835 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/pcf50633-adc.ko 2023-07-24T05:29:59.835 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/pcf50633-gpio.ko 2023-07-24T05:29:59.835 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 34873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/pcf50633.ko 2023-07-24T05:29:59.835 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-07-24T05:29:59.835 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/retu-mfd.ko 2023-07-24T05:29:59.835 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 80425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/si476x-core.ko 2023-07-24T05:29:59.836 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 48441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/sm501.ko 2023-07-24T05:29:59.836 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-07-24T05:29:59.836 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 51137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/tps65010.ko 2023-07-24T05:29:59.836 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/tps6507x.ko 2023-07-24T05:29:59.836 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/viperboard.ko 2023-07-24T05:29:59.836 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/vx855.ko 2023-07-24T05:29:59.836 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/wl1273-core.ko 2023-07-24T05:29:59.836 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 44345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/wm8994.ko 2023-07-24T05:29:59.837 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ 2023-07-24T05:29:59.837 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-07-24T05:29:59.837 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 48489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ad525x_dpot.ko 2023-07-24T05:29:59.837 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/altera-stapl/ 2023-07-24T05:29:59.837 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 46585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-07-24T05:29:59.837 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/apds9802als.ko 2023-07-24T05:29:59.837 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 36729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/apds990x.ko 2023-07-24T05:29:59.837 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 45593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/bh1770glc.ko 2023-07-24T05:29:59.838 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/c2port/ 2023-07-24T05:29:59.838 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-07-24T05:29:59.838 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 35305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/c2port/core.ko 2023-07-24T05:29:59.838 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/cb710/ 2023-07-24T05:29:59.838 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/cb710/cb710.ko 2023-07-24T05:29:59.838 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ds1682.ko 2023-07-24T05:29:59.838 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/dummy-irq.ko 2023-07-24T05:29:59.838 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/echo/ 2023-07-24T05:29:59.839 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/echo/echo.ko 2023-07-24T05:29:59.839 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/ 2023-07-24T05:29:59.839 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 37849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/at24.ko 2023-07-24T05:29:59.839 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/eeprom.ko 2023-07-24T05:29:59.839 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-07-24T05:29:59.839 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/max6875.ko 2023-07-24T05:29:59.839 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 32993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/enclosure.ko 2023-07-24T05:29:59.839 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/genwqe/ 2023-07-24T05:29:59.840 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 152137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-07-24T05:29:59.847 INFO:teuthology.orchestra.run.smithi103.stderr:Sourcing file `/etc/default/grub' 2023-07-24T05:29:59.858 INFO:teuthology.orchestra.run.smithi103.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-24T05:29:59.871 INFO:teuthology.orchestra.run.smithi103.stderr:Generating grub configuration file ... 2023-07-24T05:29:59.887 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/hmc6352.ko 2023-07-24T05:29:59.887 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 31193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/hpilo.ko 2023-07-24T05:29:59.887 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ibmasm/ 2023-07-24T05:29:59.887 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 72601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-07-24T05:29:59.887 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ics932s401.ko 2023-07-24T05:29:59.888 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/isl29003.ko 2023-07-24T05:29:59.888 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/isl29020.ko 2023-07-24T05:29:59.888 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/lis3lv02d/ 2023-07-24T05:29:59.888 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 42585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-07-24T05:29:59.888 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-07-24T05:29:59.888 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/mei/ 2023-07-24T05:29:59.888 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 125209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/mei/mei-me.ko 2023-07-24T05:29:59.889 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 56521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/mei/mei-txe.ko 2023-07-24T05:29:59.889 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 309857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/mei/mei.ko 2023-07-24T05:29:59.889 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 31329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/phantom.ko 2023-07-24T05:29:59.889 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ti-st/ 2023-07-24T05:29:59.889 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 74905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ti-st/st_drv.ko 2023-07-24T05:29:59.889 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/tifm_7xx1.ko 2023-07-24T05:29:59.889 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/tifm_core.ko 2023-07-24T05:29:59.889 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/tsl2550.ko 2023-07-24T05:29:59.890 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 48673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/vmw_balloon.ko 2023-07-24T05:29:59.890 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/vmw_vmci/ 2023-07-24T05:29:59.890 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 183857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-07-24T05:29:59.890 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ 2023-07-24T05:29:59.890 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/bonding/ 2023-07-24T05:29:59.890 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 487801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/bonding/bonding.ko 2023-07-24T05:29:59.890 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/ 2023-07-24T05:29:59.890 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/b53/ 2023-07-24T05:29:59.891 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 106009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/b53/b53_common.ko 2023-07-24T05:29:59.891 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 40281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/bcm-sf2.ko 2023-07-24T05:29:59.891 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/mv88e6060.ko 2023-07-24T05:29:59.891 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/mv88e6xxx/ 2023-07-24T05:29:59.891 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 452481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-07-24T05:29:59.891 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dummy.ko 2023-07-24T05:29:59.891 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/eql.ko 2023-07-24T05:29:59.892 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ 2023-07-24T05:29:59.892 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/ 2023-07-24T05:29:59.892 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 45785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-07-24T05:29:59.892 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 42105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-07-24T05:29:59.892 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 130489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-07-24T05:29:59.892 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 68785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-07-24T05:29:59.892 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/ 2023-07-24T05:29:59.892 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 37649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/8390.ko 2023-07-24T05:29:59.893 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 59689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-07-24T05:29:59.893 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-07-24T05:29:59.893 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 99113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-07-24T05:29:59.893 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/adaptec/ 2023-07-24T05:29:59.893 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 54521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-07-24T05:29:59.893 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/agere/ 2023-07-24T05:29:59.893 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 69145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/agere/et131x.ko 2023-07-24T05:29:59.893 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/alteon/ 2023-07-24T05:29:59.894 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 59521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-07-24T05:29:59.894 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/altera/ 2023-07-24T05:29:59.894 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 41393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-07-24T05:29:59.894 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/amd/ 2023-07-24T05:29:59.894 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 54545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-07-24T05:29:59.894 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 49225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-07-24T05:29:59.894 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 87345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-07-24T05:29:59.894 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/ 2023-07-24T05:29:59.895 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/alx/ 2023-07-24T05:29:59.895 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 97321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-07-24T05:29:59.895 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-07-24T05:29:59.895 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 104585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-07-24T05:29:59.895 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-07-24T05:29:59.895 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 90257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-07-24T05:29:59.895 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atlx/ 2023-07-24T05:29:59.895 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 81505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-07-24T05:29:59.896 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 69713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-07-24T05:29:59.896 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/ 2023-07-24T05:29:59.896 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 78401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-07-24T05:29:59.896 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 176881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-07-24T05:29:59.896 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-07-24T05:29:59.896 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 1422209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-07-24T05:29:59.896 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 128377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-07-24T05:29:59.897 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/genet/ 2023-07-24T05:29:59.897 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 132289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-07-24T05:29:59.897 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 312145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-07-24T05:29:59.897 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/brocade/ 2023-07-24T05:29:59.897 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/brocade/bna/ 2023-07-24T05:29:59.897 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 323601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-07-24T05:29:59.897 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/ 2023-07-24T05:29:59.897 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-07-24T05:29:59.898 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 193433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-07-24T05:29:59.898 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-07-24T05:29:59.898 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 347641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-07-24T05:29:59.898 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-07-24T05:29:59.898 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 1044145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-07-24T05:29:59.898 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-07-24T05:29:59.898 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 166113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-07-24T05:29:59.898 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-07-24T05:29:59.899 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 34881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-07-24T05:29:59.899 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/cisco/ 2023-07-24T05:29:59.899 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/cisco/enic/ 2023-07-24T05:29:59.899 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 204329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-07-24T05:29:59.899 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/ 2023-07-24T05:29:59.899 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/ 2023-07-24T05:29:59.899 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 69449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-07-24T05:29:59.899 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 61489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-07-24T05:29:59.900 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 141161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-07-24T05:29:59.900 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 51433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-07-24T05:29:59.900 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 62865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-07-24T05:29:59.900 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 31305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-07-24T05:29:59.900 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dlink/ 2023-07-24T05:29:59.900 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 60873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-07-24T05:29:59.900 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 62833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-07-24T05:29:59.901 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 45721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dnet.ko 2023-07-24T05:29:59.901 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ec_bhf.ko 2023-07-24T05:29:59.901 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/emulex/ 2023-07-24T05:29:59.901 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/emulex/benet/ 2023-07-24T05:29:59.901 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 281329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-07-24T05:29:59.901 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 49505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ethoc.ko 2023-07-24T05:29:59.901 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 51737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/fealnx.ko 2023-07-24T05:29:59.901 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/fujitsu/ 2023-07-24T05:29:59.902 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 45281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-07-24T05:29:59.902 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ 2023-07-24T05:29:59.902 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 90465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e100.ko 2023-07-24T05:29:59.902 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e1000/ 2023-07-24T05:29:59.902 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 295713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-07-24T05:29:59.902 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e1000e/ 2023-07-24T05:29:59.902 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 584249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-07-24T05:29:59.902 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/fm10k/ 2023-07-24T05:29:59.903 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 246321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-07-24T05:29:59.903 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/i40e/ 2023-07-24T05:29:59.903 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 923969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-07-24T05:29:59.903 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/iavf/ 2023-07-24T05:29:59.903 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 298097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-07-24T05:29:59.903 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/igb/ 2023-07-24T05:29:59.903 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 514889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-07-24T05:29:59.903 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/igbvf/ 2023-07-24T05:29:59.904 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 93593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-07-24T05:29:59.904 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-07-24T05:29:59.904 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 734297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-07-24T05:29:59.904 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-07-24T05:29:59.904 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 151841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-07-24T05:29:59.904 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 86921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/jme.ko 2023-07-24T05:29:59.905 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/marvell/ 2023-07-24T05:29:59.905 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20977 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-07-24T05:29:59.905 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 102385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/marvell/skge.ko 2023-07-24T05:29:59.905 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 122681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-07-24T05:29:59.905 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/ 2023-07-24T05:29:59.905 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-07-24T05:29:59.905 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 727433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-07-24T05:29:59.905 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 280513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-07-24T05:29:59.906 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-07-24T05:29:59.906 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-07-24T05:29:59.906 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 1095817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-07-24T05:29:59.906 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel/ 2023-07-24T05:29:59.906 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 53041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-07-24T05:29:59.906 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 40993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-07-24T05:29:59.906 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-07-24T05:29:59.906 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 95665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-07-24T05:29:59.907 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/myricom/ 2023-07-24T05:29:59.907 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-07-24T05:29:59.907 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 108809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-07-24T05:29:59.907 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/natsemi/ 2023-07-24T05:29:59.907 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 73377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-07-24T05:29:59.907 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 47713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-07-24T05:29:59.907 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/neterion/ 2023-07-24T05:29:59.907 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 150905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-07-24T05:29:59.908 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/nvidia/ 2023-07-24T05:29:59.908 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 136785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-07-24T05:29:59.908 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/packetengines/ 2023-07-24T05:29:59.908 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 50481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-07-24T05:29:59.908 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 43145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-07-24T05:29:59.908 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/ 2023-07-24T05:29:59.908 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-07-24T05:29:59.908 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 227113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-07-24T05:29:59.909 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 87081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-07-24T05:29:59.909 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-07-24T05:29:59.909 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 671393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-07-24T05:29:59.909 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/rdc/ 2023-07-24T05:29:59.909 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 43017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-07-24T05:29:59.909 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/ 2023-07-24T05:29:59.909 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 67385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-07-24T05:29:59.909 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 83921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-07-24T05:29:59.910 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/atp.ko 2023-07-24T05:29:59.910 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 190089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-07-24T05:29:59.910 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/samsung/ 2023-07-24T05:29:59.910 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-07-24T05:29:59.910 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 104241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-07-24T05:29:59.910 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sfc/ 2023-07-24T05:29:59.910 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 952881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-07-24T05:29:59.910 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/silan/ 2023-07-24T05:29:59.911 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 47177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-07-24T05:29:59.911 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sis/ 2023-07-24T05:29:59.911 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 54809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sis/sis190.ko 2023-07-24T05:29:59.911 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 63273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sis/sis900.ko 2023-07-24T05:29:59.911 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/ 2023-07-24T05:29:59.911 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 61537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-07-24T05:29:59.911 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 67129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-07-24T05:29:59.911 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 73345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-07-24T05:29:59.912 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 68209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-07-24T05:29:59.912 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/ 2023-07-24T05:29:59.912 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-07-24T05:29:59.912 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-07-24T05:29:59.912 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 40137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-07-24T05:29:59.912 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-07-24T05:29:59.912 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 481681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-07-24T05:29:59.913 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/ 2023-07-24T05:29:59.913 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 103321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/cassini.ko 2023-07-24T05:29:59.913 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 166121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/niu.ko 2023-07-24T05:29:59.913 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 66473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/sungem.ko 2023-07-24T05:29:59.913 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 78737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-07-24T05:29:59.913 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/tehuti/ 2023-07-24T05:29:59.913 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 49993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-07-24T05:29:59.913 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ti/ 2023-07-24T05:29:59.914 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 86465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ti/tlan.ko 2023-07-24T05:29:59.914 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/via/ 2023-07-24T05:29:59.914 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 80257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-07-24T05:29:59.914 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 83681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-07-24T05:29:59.914 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/wiznet/ 2023-07-24T05:29:59.914 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 46241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-07-24T05:29:59.914 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 30849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-07-24T05:29:59.914 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/xircom/ 2023-07-24T05:29:59.915 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 60041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-07-24T05:29:59.915 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/fddi/ 2023-07-24T05:29:59.915 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 41001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/fddi/defxx.ko 2023-07-24T05:29:59.915 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/fddi/skfp/ 2023-07-24T05:29:59.915 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 216977 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/fddi/skfp/skfp.ko 2023-07-24T05:29:59.915 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 77401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/geneve.ko 2023-07-24T05:29:59.915 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/hyperv/ 2023-07-24T05:29:59.915 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 235593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-07-24T05:29:59.916 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ieee802154/ 2023-07-24T05:29:59.916 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ieee802154/fakelb.ko 2023-07-24T05:29:59.916 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ifb.ko 2023-07-24T05:29:59.916 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ipvlan/ 2023-07-24T05:29:59.916 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 83737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ipvlan/ipvlan.ko 2023-07-24T05:29:59.916 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 62065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/macvlan.ko 2023-07-24T05:29:59.916 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/macvtap.ko 2023-07-24T05:29:59.917 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/ 2023-07-24T05:29:59.917 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-07-24T05:29:59.917 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-07-24T05:29:59.917 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/mdio-gpio.ko 2023-07-24T05:29:59.917 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/mdio-regmap.ko 2023-07-24T05:29:59.917 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio.ko 2023-07-24T05:29:59.917 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mii.ko 2023-07-24T05:29:59.917 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 41697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/netconsole.ko 2023-07-24T05:29:59.918 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/nlmon.ko 2023-07-24T05:29:59.918 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/pcs/ 2023-07-24T05:29:59.918 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/pcs/pcs-lynx.ko 2023-07-24T05:29:59.918 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 32329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-07-24T05:29:59.918 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/ 2023-07-24T05:29:59.918 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/amd.ko 2023-07-24T05:29:59.918 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 50097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-07-24T05:29:59.918 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 43273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/bcm7xxx.ko 2023-07-24T05:29:59.919 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/bcm87xx.ko 2023-07-24T05:29:59.919 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 41337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/broadcom.ko 2023-07-24T05:29:59.919 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/cicada.ko 2023-07-24T05:29:59.919 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/davicom.ko 2023-07-24T05:29:59.919 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/et1011c.ko 2023-07-24T05:29:59.919 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/icplus.ko 2023-07-24T05:29:59.919 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/lxt.ko 2023-07-24T05:29:59.920 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 78185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/marvell.ko 2023-07-24T05:29:59.920 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 75713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/micrel.ko 2023-07-24T05:29:59.920 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/national.ko 2023-07-24T05:29:59.920 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 97265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/phylink.ko 2023-07-24T05:29:59.920 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/qsemi.ko 2023-07-24T05:29:59.920 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 49553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/realtek.ko 2023-07-24T05:29:59.920 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/smsc.ko 2023-07-24T05:29:59.921 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/ste10Xp.ko 2023-07-24T05:29:59.921 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/vitesse.ko 2023-07-24T05:29:59.921 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/plip/ 2023-07-24T05:29:59.921 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 43465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/plip/plip.ko 2023-07-24T05:29:59.921 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ 2023-07-24T05:29:59.921 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/bsd_comp.ko 2023-07-24T05:29:59.921 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_async.ko 2023-07-24T05:29:59.921 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_deflate.ko 2023-07-24T05:29:59.922 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_mppe.ko 2023-07-24T05:29:59.922 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_synctty.ko 2023-07-24T05:29:59.922 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 42545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/pppoe.ko 2023-07-24T05:29:59.922 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/pppox.ko 2023-07-24T05:29:59.922 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 31969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/pptp.ko 2023-07-24T05:29:59.922 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/sb1000.ko 2023-07-24T05:29:59.922 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/slip/ 2023-07-24T05:29:59.922 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 42513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/slip/slip.ko 2023-07-24T05:29:59.923 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/sungem_phy.ko 2023-07-24T05:29:59.923 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 64889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/tap.ko 2023-07-24T05:29:59.923 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/ 2023-07-24T05:29:59.923 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 105961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team.ko 2023-07-24T05:29:59.923 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_activebackup.ko 2023-07-24T05:29:59.923 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_broadcast.ko 2023-07-24T05:29:59.923 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-07-24T05:29:59.924 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_random.ko 2023-07-24T05:29:59.924 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-07-24T05:29:59.924 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 88193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/veth.ko 2023-07-24T05:29:59.924 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/vmxnet3/ 2023-07-24T05:29:59.924 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 120497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-07-24T05:29:59.924 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/vxlan/ 2023-07-24T05:29:59.924 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 290665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/vxlan/vxlan.ko 2023-07-24T05:29:59.924 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/xen-netback/ 2023-07-24T05:29:59.925 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 143801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/xen-netback/xen-netback.ko 2023-07-24T05:29:59.925 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ntb/ 2023-07-24T05:29:59.925 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ntb/ntb.ko 2023-07-24T05:29:59.925 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/nvme/ 2023-07-24T05:29:59.925 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/nvme/host/ 2023-07-24T05:29:59.925 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 266561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/nvme/host/nvme-core.ko 2023-07-24T05:29:59.925 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 101937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/nvme/host/nvme.ko 2023-07-24T05:29:59.925 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/ 2023-07-24T05:29:59.926 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 133817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/parport.ko 2023-07-24T05:29:59.926 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/parport_cs.ko 2023-07-24T05:29:59.926 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 84337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/parport_pc.ko 2023-07-24T05:29:59.926 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/parport_serial.ko 2023-07-24T05:29:59.926 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/ 2023-07-24T05:29:59.926 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/hotplug/ 2023-07-24T05:29:59.926 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-07-24T05:29:59.926 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-07-24T05:29:59.927 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-07-24T05:29:59.927 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/pci-stub.ko 2023-07-24T05:29:59.927 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 47377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/xen-pcifront.ko 2023-07-24T05:29:59.927 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/ 2023-07-24T05:29:59.927 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/i82092.ko 2023-07-24T05:29:59.927 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 145785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/pcmcia.ko 2023-07-24T05:29:59.927 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 62081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/pcmcia_core.ko 2023-07-24T05:29:59.927 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 34345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-07-24T05:29:59.928 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 34265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/pd6729.ko 2023-07-24T05:29:59.928 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 112913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/yenta_socket.ko 2023-07-24T05:29:59.928 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/phy/ 2023-07-24T05:29:59.928 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/phy/broadcom/ 2023-07-24T05:29:59.928 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-07-24T05:29:59.928 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/phy/samsung/ 2023-07-24T05:29:59.928 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-07-24T05:29:59.929 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pinctrl/ 2023-07-24T05:29:59.929 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pinctrl/intel/ 2023-07-24T05:29:59.929 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 71521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-07-24T05:29:59.929 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/ 2023-07-24T05:29:59.929 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/ 2023-07-24T05:29:59.929 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 50889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-07-24T05:29:59.929 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_ec.ko 2023-07-24T05:29:59.929 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-07-24T05:29:59.930 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-07-24T05:29:59.930 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-07-24T05:29:59.930 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-07-24T05:29:59.930 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-07-24T05:29:59.930 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/ 2023-07-24T05:29:59.930 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 67097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/acer-wmi.ko 2023-07-24T05:29:59.930 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 39145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/acerhdf.ko 2023-07-24T05:29:59.930 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 36913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/apple-gmux.ko 2023-07-24T05:29:59.931 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 59665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/asus-laptop.ko 2023-07-24T05:29:59.931 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 30705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-07-24T05:29:59.931 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 106873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/asus-wmi.ko 2023-07-24T05:29:59.931 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 36913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/classmate-laptop.ko 2023-07-24T05:29:59.931 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 49121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-07-24T05:29:59.931 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-07-24T05:29:59.931 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 40265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-07-24T05:29:59.932 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-07-24T05:29:59.932 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 36657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/hdaps.ko 2023-07-24T05:29:59.932 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/ibm_rtl.ko 2023-07-24T05:29:59.932 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/intel/ 2023-07-24T05:29:59.932 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-07-24T05:29:59.932 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-07-24T05:29:59.932 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 43521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/intel_ips.ko 2023-07-24T05:29:59.932 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/msi-wmi.ko 2023-07-24T05:29:59.933 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/mxm-wmi.ko 2023-07-24T05:29:59.933 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 34801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-07-24T05:29:59.933 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 42329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/samsung-laptop.ko 2023-07-24T05:29:59.933 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/samsung-q10.ko 2023-07-24T05:29:59.933 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/topstar-laptop.ko 2023-07-24T05:29:59.933 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-07-24T05:29:59.933 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/toshiba_haps.ko 2023-07-24T05:29:59.933 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/wmi-bmof.ko 2023-07-24T05:29:59.934 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 57665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/wmi.ko 2023-07-24T05:29:59.934 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/ 2023-07-24T05:29:59.934 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/ 2023-07-24T05:29:59.934 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 30345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/88pm860x_battery.ko 2023-07-24T05:29:59.934 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/88pm860x_charger.ko 2023-07-24T05:29:59.934 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 55057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/bq2415x_charger.ko 2023-07-24T05:29:59.934 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 53993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/bq24190_charger.ko 2023-07-24T05:29:59.935 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/bq24735-charger.ko 2023-07-24T05:29:59.935 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-07-24T05:29:59.935 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/da9030_battery.ko 2023-07-24T05:29:59.935 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/da9052-battery.ko 2023-07-24T05:29:59.935 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/ds2760_battery.ko 2023-07-24T05:29:59.935 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/ds2780_battery.ko 2023-07-24T05:29:59.935 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/ds2781_battery.ko 2023-07-24T05:29:59.935 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/ds2782_battery.ko 2023-07-24T05:29:59.936 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/gpio-charger.ko 2023-07-24T05:29:59.936 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/isp1704_charger.ko 2023-07-24T05:29:59.936 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/lp8727_charger.ko 2023-07-24T05:29:59.936 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/max14577_charger.ko 2023-07-24T05:29:59.936 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/max17040_battery.ko 2023-07-24T05:29:59.936 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 30289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/max17042_battery.ko 2023-07-24T05:29:59.936 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/max8903_charger.ko 2023-07-24T05:29:59.936 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/max8925_power.ko 2023-07-24T05:29:59.937 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/pcf50633-charger.ko 2023-07-24T05:29:59.937 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 38009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/sbs-battery.ko 2023-07-24T05:29:59.937 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/test_power.ko 2023-07-24T05:29:59.937 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/tps65090-charger.ko 2023-07-24T05:29:59.937 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/wm831x_backup.ko 2023-07-24T05:29:59.937 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/wm831x_power.ko 2023-07-24T05:29:59.937 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/wm8350_power.ko 2023-07-24T05:29:59.938 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/powercap/ 2023-07-24T05:29:59.938 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 57737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/powercap/intel_rapl_common.ko 2023-07-24T05:29:59.938 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/powercap/intel_rapl_msr.ko 2023-07-24T05:29:59.938 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/ 2023-07-24T05:29:59.938 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/clients/ 2023-07-24T05:29:59.938 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/clients/pps-gpio.ko 2023-07-24T05:29:59.938 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/clients/pps-ldisc.ko 2023-07-24T05:29:59.939 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/clients/pps_parport.ko 2023-07-24T05:29:59.939 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 41921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/pps_core.ko 2023-07-24T05:29:59.939 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ptp/ 2023-07-24T05:29:59.939 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 66385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ptp/ptp.ko 2023-07-24T05:29:59.939 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ptp/ptp_kvm.ko 2023-07-24T05:29:59.939 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/ 2023-07-24T05:29:59.939 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-88pm80x.ko 2023-07-24T05:29:59.939 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-88pm860x.ko 2023-07-24T05:29:59.940 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-bq32k.ko 2023-07-24T05:29:59.940 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-bq4802.ko 2023-07-24T05:29:59.940 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-da9052.ko 2023-07-24T05:29:59.940 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-da9055.ko 2023-07-24T05:29:59.940 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-da9063.ko 2023-07-24T05:29:59.940 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1286.ko 2023-07-24T05:29:59.940 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 68577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1307.ko 2023-07-24T05:29:59.940 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1374.ko 2023-07-24T05:29:59.941 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1511.ko 2023-07-24T05:29:59.941 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1553.ko 2023-07-24T05:29:59.941 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1672.ko 2023-07-24T05:29:59.941 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13369 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1742.ko 2023-07-24T05:29:59.941 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds2404.ko 2023-07-24T05:29:59.941 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds3232.ko 2023-07-24T05:29:59.941 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-em3027.ko 2023-07-24T05:29:59.942 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-fm3130.ko 2023-07-24T05:29:59.942 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-isl12022.ko 2023-07-24T05:29:59.942 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 36057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-isl1208.ko 2023-07-24T05:29:59.942 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-lp8788.ko 2023-07-24T05:29:59.942 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 38097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-m41t80.ko 2023-07-24T05:29:59.942 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-m48t35.ko 2023-07-24T05:29:59.942 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-m48t59.ko 2023-07-24T05:29:59.942 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-m48t86.ko 2023-07-24T05:29:59.943 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11633 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-max6900.ko 2023-07-24T05:29:59.943 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-max8907.ko 2023-07-24T05:29:59.943 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-max8925.ko 2023-07-24T05:29:59.943 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-max8997.ko 2023-07-24T05:29:59.943 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-max8998.ko 2023-07-24T05:29:59.943 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-07-24T05:29:59.943 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-msm6242.ko 2023-07-24T05:29:59.943 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-palmas.ko 2023-07-24T05:29:59.944 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 40121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf2127.ko 2023-07-24T05:29:59.944 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17977 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf50633.ko 2023-07-24T05:29:59.944 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf85063.ko 2023-07-24T05:29:59.944 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf8523.ko 2023-07-24T05:29:59.944 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf8563.ko 2023-07-24T05:29:59.944 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf8583.ko 2023-07-24T05:29:59.944 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rc5t583.ko 2023-07-24T05:29:59.944 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rp5c01.ko 2023-07-24T05:29:59.945 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rs5c372.ko 2023-07-24T05:29:59.945 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-07-24T05:29:59.945 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rx8025.ko 2023-07-24T05:29:59.945 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rx8581.ko 2023-07-24T05:29:59.945 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-s35390a.ko 2023-07-24T05:29:59.945 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-07-24T05:29:59.945 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-tps6586x.ko 2023-07-24T05:29:59.945 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-tps65910.ko 2023-07-24T05:29:59.946 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-wm831x.ko 2023-07-24T05:29:59.946 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-wm8350.ko 2023-07-24T05:29:59.946 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-x1205.ko 2023-07-24T05:29:59.946 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ 2023-07-24T05:29:59.946 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 77617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/3w-9xxx.ko 2023-07-24T05:29:59.946 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 57665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/3w-sas.ko 2023-07-24T05:29:59.946 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 55169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/3w-xxxx.ko 2023-07-24T05:29:59.947 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 135169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/BusLogic.ko 2023-07-24T05:29:59.947 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/a100u2w.ko 2023-07-24T05:29:59.947 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aacraid/ 2023-07-24T05:29:59.947 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 272353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aacraid/aacraid.ko 2023-07-24T05:29:59.947 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 100617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/advansys.ko 2023-07-24T05:29:59.947 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic7xxx/ 2023-07-24T05:29:59.947 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 356265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-07-24T05:29:59.948 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 295801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-07-24T05:29:59.948 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic94xx/ 2023-07-24T05:29:59.948 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 189321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-07-24T05:29:59.948 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/am53c974.ko 2023-07-24T05:29:59.948 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/arcmsr/ 2023-07-24T05:29:59.948 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 106569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-07-24T05:29:59.948 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 38185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/atp870u.ko 2023-07-24T05:29:59.948 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/be2iscsi/ 2023-07-24T05:29:59.949 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 246897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-07-24T05:29:59.949 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bfa/ 2023-07-24T05:29:59.949 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 1172185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bfa/bfa.ko 2023-07-24T05:29:59.949 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bnx2fc/ 2023-07-24T05:29:59.949 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 237169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-07-24T05:29:59.949 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bnx2i/ 2023-07-24T05:29:59.949 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 115393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-07-24T05:29:59.949 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 40609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ch.ko 2023-07-24T05:29:59.950 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/csiostor/ 2023-07-24T05:29:59.950 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 308889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/csiostor/csiostor.ko 2023-07-24T05:29:59.950 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/ 2023-07-24T05:29:59.950 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-07-24T05:29:59.950 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 76193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-07-24T05:29:59.950 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-07-24T05:29:59.950 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 101449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-07-24T05:29:59.950 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 146785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-07-24T05:29:59.951 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 75529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/dc395x.ko 2023-07-24T05:29:59.951 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 38121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/dmx3191d.ko 2023-07-24T05:29:59.951 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/esas2r/ 2023-07-24T05:29:59.951 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 212401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/esas2r/esas2r.ko 2023-07-24T05:29:59.951 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 60489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/esp_scsi.ko 2023-07-24T05:29:59.951 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fcoe/ 2023-07-24T05:29:59.951 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 78289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fcoe/fcoe.ko 2023-07-24T05:29:59.952 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 158193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-07-24T05:29:59.952 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fdomain.ko 2023-07-24T05:29:59.952 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fnic/ 2023-07-24T05:29:59.952 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 261913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fnic/fnic.ko 2023-07-24T05:29:59.952 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 201793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/hpsa.ko 2023-07-24T05:29:59.952 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 51145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/hptiop.ko 2023-07-24T05:29:59.952 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 49065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/hv_storvsc.ko 2023-07-24T05:29:59.952 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 35321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/imm.ko 2023-07-24T05:29:59.953 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 44057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/initio.ko 2023-07-24T05:29:59.953 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 266521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ipr.ko 2023-07-24T05:29:59.953 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 101881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ips.ko 2023-07-24T05:29:59.953 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/isci/ 2023-07-24T05:29:59.953 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 317249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/isci/isci.ko 2023-07-24T05:29:59.953 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-07-24T05:29:59.953 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 52897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/iscsi_tcp.ko 2023-07-24T05:29:59.953 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libfc/ 2023-07-24T05:29:59.954 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 314961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libfc/libfc.ko 2023-07-24T05:29:59.954 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 145569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libiscsi.ko 2023-07-24T05:29:59.954 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 53521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libiscsi_tcp.ko 2023-07-24T05:29:59.954 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libsas/ 2023-07-24T05:29:59.954 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 217209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libsas/libsas.ko 2023-07-24T05:29:59.954 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/lpfc/ 2023-07-24T05:29:59.954 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 2192449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/lpfc/lpfc.ko 2023-07-24T05:29:59.954 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid/ 2023-07-24T05:29:59.955 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 73545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-07-24T05:29:59.955 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-07-24T05:29:59.955 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 310729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-07-24T05:29:59.955 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 84697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid.ko 2023-07-24T05:29:59.955 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mpt3sas/ 2023-07-24T05:29:59.955 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 659577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-07-24T05:29:59.955 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mvsas/ 2023-07-24T05:29:59.955 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 119929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mvsas/mvsas.ko 2023-07-24T05:29:59.956 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 78153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mvumi.ko 2023-07-24T05:29:59.956 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pcmcia/ 2023-07-24T05:29:59.956 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 81601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-07-24T05:29:59.956 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-07-24T05:29:59.956 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-07-24T05:29:59.956 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-07-24T05:29:59.956 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pm8001/ 2023-07-24T05:29:59.957 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 364257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-07-24T05:29:59.957 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 123489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pmcraid.ko 2023-07-24T05:29:59.957 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ppa.ko 2023-07-24T05:29:59.957 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 55345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla1280.ko 2023-07-24T05:29:59.957 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla2xxx/ 2023-07-24T05:29:59.957 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 1860025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-07-24T05:29:59.957 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 85313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-07-24T05:29:59.957 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla4xxx/ 2023-07-24T05:29:59.958 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 558865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-07-24T05:29:59.958 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qlogicfas408.ko 2023-07-24T05:29:59.958 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/raid_class.ko 2023-07-24T05:29:59.958 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 238801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_debug.ko 2023-07-24T05:29:59.958 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 173921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_fc.ko 2023-07-24T05:29:59.958 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 278865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-07-24T05:29:59.958 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 97705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_sas.ko 2023-07-24T05:29:59.958 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 73881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_spi.ko 2023-07-24T05:29:59.959 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 44993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_srp.ko 2023-07-24T05:29:59.959 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ses.ko 2023-07-24T05:29:59.959 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 115849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/st.ko 2023-07-24T05:29:59.959 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 46825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/stex.ko 2023-07-24T05:29:59.959 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/sym53c8xx_2/ 2023-07-24T05:29:59.959 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 162121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-07-24T05:29:59.959 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 42361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/virtio_scsi.ko 2023-07-24T05:29:59.959 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 50297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/vmw_pvscsi.ko 2023-07-24T05:29:59.960 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 40001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/wd719x.ko 2023-07-24T05:29:59.960 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 50025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/xen-scsifront.ko 2023-07-24T05:29:59.960 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ssb/ 2023-07-24T05:29:59.960 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 129417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ssb/ssb.ko 2023-07-24T05:29:59.960 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/ 2023-07-24T05:29:59.960 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/iscsi/ 2023-07-24T05:29:59.960 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 739089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-07-24T05:29:59.961 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/loopback/ 2023-07-24T05:29:59.961 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 49985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/loopback/tcm_loop.ko 2023-07-24T05:29:59.961 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 39713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_file.ko 2023-07-24T05:29:59.961 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 42961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_iblock.ko 2023-07-24T05:29:59.961 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 931721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_mod.ko 2023-07-24T05:29:59.961 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 44321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_pscsi.ko 2023-07-24T05:29:59.961 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 122545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_user.ko 2023-07-24T05:29:59.961 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/tcm_fc/ 2023-07-24T05:29:59.962 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 75641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-07-24T05:29:59.962 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/ 2023-07-24T05:29:59.962 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/ 2023-07-24T05:29:59.962 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/ 2023-07-24T05:29:59.962 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-07-24T05:29:59.962 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-07-24T05:29:59.962 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-07-24T05:29:59.962 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-07-24T05:29:59.963 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-07-24T05:29:59.963 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-07-24T05:29:59.963 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-07-24T05:29:59.963 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-07-24T05:29:59.963 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-07-24T05:29:59.963 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-07-24T05:29:59.963 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-07-24T05:29:59.964 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 37065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-07-24T05:29:59.964 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 30729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-07-24T05:29:59.964 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-07-24T05:29:59.964 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-07-24T05:29:59.964 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-07-24T05:29:59.964 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/ 2023-07-24T05:29:59.964 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/ipwireless/ 2023-07-24T05:29:59.965 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 78073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-07-24T05:29:59.965 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 57881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/moxa.ko 2023-07-24T05:29:59.965 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 50793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/mxser.ko 2023-07-24T05:29:59.965 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 107545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/n_gsm.ko 2023-07-24T05:29:59.965 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 32041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/n_hdlc.ko 2023-07-24T05:29:59.965 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 68137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/nozomi.ko 2023-07-24T05:29:59.965 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/ 2023-07-24T05:29:59.965 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/8250/ 2023-07-24T05:29:59.966 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 35745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-07-24T05:29:59.966 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 59497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-07-24T05:29:59.966 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-07-24T05:29:59.966 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/altera_uart.ko 2023-07-24T05:29:59.966 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/arc_uart.ko 2023-07-24T05:29:59.966 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 72193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-07-24T05:29:59.966 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/jsm/ 2023-07-24T05:29:59.966 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 103017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/jsm/jsm.ko 2023-07-24T05:29:59.967 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/rp2.ko 2023-07-24T05:29:59.967 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 52073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/sc16is7xx.ko 2023-07-24T05:29:59.967 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 100185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/synclink_gt.ko 2023-07-24T05:29:59.967 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/ 2023-07-24T05:29:59.967 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/core/ 2023-07-24T05:29:59.967 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 536617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/core/ufshcd-core.ko 2023-07-24T05:29:59.967 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/host/ 2023-07-24T05:29:59.967 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-07-24T05:29:59.968 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-07-24T05:29:59.968 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/ 2023-07-24T05:29:59.968 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 44585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio.ko 2023-07-24T05:29:59.968 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_aec.ko 2023-07-24T05:29:59.968 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_cif.ko 2023-07-24T05:29:59.968 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_dmem_genirq.ko 2023-07-24T05:29:59.968 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_mf624.ko 2023-07-24T05:29:59.969 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_netx.ko 2023-07-24T05:29:59.969 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_pci_generic.ko 2023-07-24T05:29:59.969 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-07-24T05:29:59.969 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13633 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_sercos3.ko 2023-07-24T05:29:59.969 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/ 2023-07-24T05:29:59.969 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/c67x00/ 2023-07-24T05:29:59.969 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 73273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/c67x00/c67x00.ko 2023-07-24T05:29:59.969 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/chipidea/ 2023-07-24T05:29:59.970 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 143785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-07-24T05:29:59.970 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-07-24T05:29:59.970 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-07-24T05:29:59.970 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-07-24T05:29:59.970 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/ 2023-07-24T05:29:59.970 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 85457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/cdc-acm.ko 2023-07-24T05:29:59.970 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 51393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/cdc-wdm.ko 2023-07-24T05:29:59.970 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 47465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/usblp.ko 2023-07-24T05:29:59.971 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 89833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/usbtmc.ko 2023-07-24T05:29:59.971 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/common/ 2023-07-24T05:29:59.971 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/common/ulpi.ko 2023-07-24T05:29:59.971 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc2/ 2023-07-24T05:29:59.971 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-07-24T05:29:59.971 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc3/ 2023-07-24T05:29:59.971 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-07-24T05:29:59.971 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-07-24T05:29:59.972 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 445801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc3/dwc3.ko 2023-07-24T05:29:59.972 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/ 2023-07-24T05:29:59.972 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/ 2023-07-24T05:29:59.972 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 60089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/u_ether.ko 2023-07-24T05:29:59.972 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 51753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/u_serial.ko 2023-07-24T05:29:59.972 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-07-24T05:29:59.972 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 42649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-07-24T05:29:59.972 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-07-24T05:29:59.973 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 36585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-07-24T05:29:59.973 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 92377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-07-24T05:29:59.973 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 51025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-07-24T05:29:59.973 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 122073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-07-24T05:29:59.973 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 57921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-07-24T05:29:59.973 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-07-24T05:29:59.973 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 31265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-07-24T05:29:59.974 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 57705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-07-24T05:29:59.974 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 85841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-07-24T05:29:59.974 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-07-24T05:29:59.974 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 58433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-07-24T05:29:59.974 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 67337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-07-24T05:29:59.974 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/ 2023-07-24T05:29:59.974 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-07-24T05:29:59.974 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-07-24T05:29:59.975 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-07-24T05:29:59.975 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-07-24T05:29:59.975 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-07-24T05:29:59.975 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-07-24T05:29:59.975 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-07-24T05:29:59.975 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16977 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-07-24T05:29:59.975 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 32073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-07-24T05:29:59.975 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-07-24T05:29:59.976 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-07-24T05:29:59.976 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-07-24T05:29:59.976 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 62153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-07-24T05:29:59.976 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-07-24T05:29:59.976 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 161233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/libcomposite.ko 2023-07-24T05:29:59.976 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/ 2023-07-24T05:29:59.976 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-07-24T05:29:59.977 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/bdc/ 2023-07-24T05:29:59.977 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 157665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-07-24T05:29:59.977 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 36065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-07-24T05:29:59.977 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 52993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-07-24T05:29:59.977 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 69689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-07-24T05:29:59.977 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 56009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-07-24T05:29:59.977 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 76033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/net2272.ko 2023-07-24T05:29:59.977 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 75057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/net2280.ko 2023-07-24T05:29:59.978 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 73153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-07-24T05:29:59.978 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 65793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-07-24T05:29:59.978 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 66073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-07-24T05:29:59.978 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 81489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-07-24T05:29:59.978 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 156033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-07-24T05:29:59.978 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/ 2023-07-24T05:29:59.978 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/bcma-hcd.ko 2023-07-24T05:29:59.979 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 80097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/isp116x-hcd.ko 2023-07-24T05:29:59.979 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 87337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-07-24T05:29:59.979 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 78849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-07-24T05:29:59.979 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 51305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/sl811-hcd.ko 2023-07-24T05:29:59.979 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/sl811_cs.ko 2023-07-24T05:29:59.979 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/ssb-hcd.ko 2023-07-24T05:29:59.979 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-07-24T05:29:59.979 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/image/ 2023-07-24T05:29:59.980 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 34585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/image/mdc800.ko 2023-07-24T05:29:59.980 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/image/microtek.ko 2023-07-24T05:29:59.980 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/ 2023-07-24T05:29:59.980 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 41841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/adutux.ko 2023-07-24T05:29:59.980 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/appledisplay.ko 2023-07-24T05:29:59.980 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-07-24T05:29:59.980 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/cytherm.ko 2023-07-24T05:29:59.980 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/ehset.ko 2023-07-24T05:29:59.981 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/emi26.ko 2023-07-24T05:29:59.981 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/emi62.ko 2023-07-24T05:29:59.981 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/ezusb.ko 2023-07-24T05:29:59.981 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/idmouse.ko 2023-07-24T05:29:59.981 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 36617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/iowarrior.ko 2023-07-24T05:29:59.981 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/isight_firmware.ko 2023-07-24T05:29:59.981 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 36529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/ldusb.ko 2023-07-24T05:29:59.982 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 36265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/legousbtower.ko 2023-07-24T05:29:59.982 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/lvstest.ko 2023-07-24T05:29:59.982 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/sisusbvga/ 2023-07-24T05:29:59.982 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 64841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-07-24T05:29:59.982 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/trancevibrator.ko 2023-07-24T05:29:59.982 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/usb3503.ko 2023-07-24T05:29:59.982 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/usblcd.ko 2023-07-24T05:29:59.982 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/usbsevseg.ko 2023-07-24T05:29:59.983 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 70873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/usbtest.ko 2023-07-24T05:29:59.983 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 41945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/uss720.ko 2023-07-24T05:29:59.983 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/yurex.ko 2023-07-24T05:29:59.983 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/mon/ 2023-07-24T05:29:59.983 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 73185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/mon/usbmon.ko 2023-07-24T05:29:59.983 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/musb/ 2023-07-24T05:29:59.983 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 301521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/musb/musb_hdrc.ko 2023-07-24T05:29:59.983 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy/ 2023-07-24T05:29:59.984 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy/phy-generic.ko 2023-07-24T05:29:59.984 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-07-24T05:29:59.984 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy/phy-isp1301.ko 2023-07-24T05:29:59.984 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy/phy-tahvo.ko 2023-07-24T05:29:59.984 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ 2023-07-24T05:29:59.984 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/aircable.ko 2023-07-24T05:29:59.984 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ark3116.ko 2023-07-24T05:29:59.984 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/belkin_sa.ko 2023-07-24T05:29:59.985 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 38105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ch341.ko 2023-07-24T05:29:59.985 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 70209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/cp210x.ko 2023-07-24T05:29:59.985 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 31169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/cyberjack.ko 2023-07-24T05:29:59.985 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 57937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/cypress_m8.ko 2023-07-24T05:29:59.985 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 49753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/digi_acceleport.ko 2023-07-24T05:29:59.985 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/empeg.ko 2023-07-24T05:29:59.985 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 43897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/f81232.ko 2023-07-24T05:29:59.985 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 175145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ftdi_sio.ko 2023-07-24T05:29:59.986 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 52713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/garmin_gps.ko 2023-07-24T05:29:59.986 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 137105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/io_edgeport.ko 2023-07-24T05:29:59.986 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 124673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/io_ti.ko 2023-07-24T05:29:59.986 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 67769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ipaq.ko 2023-07-24T05:29:59.986 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ipw.ko 2023-07-24T05:29:59.986 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ir-usb.ko 2023-07-24T05:29:59.986 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 57937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-07-24T05:29:59.987 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 107417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/keyspan.ko 2023-07-24T05:29:59.987 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 35497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/keyspan_pda.ko 2023-07-24T05:29:59.987 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/kl5kusb105.ko 2023-07-24T05:29:59.987 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/kobil_sct.ko 2023-07-24T05:29:59.987 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 32841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/mct_u232.ko 2023-07-24T05:29:59.987 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/metro-usb.ko 2023-07-24T05:29:59.987 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 66489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/mos7720.ko 2023-07-24T05:29:59.987 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 78113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/mos7840.ko 2023-07-24T05:29:59.988 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 56593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/mxuport.ko 2023-07-24T05:29:59.988 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/navman.ko 2023-07-24T05:29:59.988 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/omninet.ko 2023-07-24T05:29:59.988 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/opticon.ko 2023-07-24T05:29:59.988 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 189729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/option.ko 2023-07-24T05:29:59.988 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 38905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/oti6858.ko 2023-07-24T05:29:59.988 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 54313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/pl2303.ko 2023-07-24T05:29:59.988 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/qcaux.ko 2023-07-24T05:29:59.989 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 37825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/qcserial.ko 2023-07-24T05:29:59.989 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 34561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/quatech2.ko 2023-07-24T05:29:59.989 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/safe_serial.ko 2023-07-24T05:29:59.989 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 51297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/sierra.ko 2023-07-24T05:29:59.989 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/spcp8x5.ko 2023-07-24T05:29:59.989 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ssu100.ko 2023-07-24T05:29:59.989 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/symbolserial.ko 2023-07-24T05:29:59.989 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 61337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-07-24T05:29:59.990 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-07-24T05:29:59.990 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/usb_debug.ko 2023-07-24T05:29:59.990 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/usb_wwan.ko 2023-07-24T05:29:59.990 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 125505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/usbserial.ko 2023-07-24T05:29:59.990 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/visor.ko 2023-07-24T05:29:59.990 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 37409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/whiteheat.ko 2023-07-24T05:29:59.990 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/wishbone-serial.ko 2023-07-24T05:29:59.990 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/xsens_mt.ko 2023-07-24T05:29:59.991 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ 2023-07-24T05:29:59.991 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 52913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/uas.ko 2023-07-24T05:29:59.991 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-alauda.ko 2023-07-24T05:29:59.991 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-cypress.ko 2023-07-24T05:29:59.991 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-datafab.ko 2023-07-24T05:29:59.991 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-07-24T05:29:59.991 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-freecom.ko 2023-07-24T05:29:59.991 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-isd200.ko 2023-07-24T05:29:59.992 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-07-24T05:29:59.992 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-karma.ko 2023-07-24T05:29:59.992 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-onetouch.ko 2023-07-24T05:29:59.992 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-realtek.ko 2023-07-24T05:29:59.992 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-sddr09.ko 2023-07-24T05:29:59.992 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-sddr55.ko 2023-07-24T05:29:59.992 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 35337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-usbat.ko 2023-07-24T05:29:59.993 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 180017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/usb-storage.ko 2023-07-24T05:29:59.993 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/usbip/ 2023-07-24T05:29:59.993 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 67457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/usbip/usbip-core.ko 2023-07-24T05:29:59.993 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 71345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/usbip/usbip-host.ko 2023-07-24T05:29:59.993 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 105401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-07-24T05:29:59.993 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/ 2023-07-24T05:29:59.993 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/pci/ 2023-07-24T05:29:59.993 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 153697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-07-24T05:29:59.994 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/pci/vfio-pci.ko 2023-07-24T05:29:59.994 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 100569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/vfio.ko 2023-07-24T05:29:59.994 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 75137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-07-24T05:29:59.994 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/ 2023-07-24T05:29:59.994 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 113889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/vhost.ko 2023-07-24T05:29:59.994 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/vhost_iotlb.ko 2023-07-24T05:29:59.994 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 58137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/vhost_net.ko 2023-07-24T05:29:59.995 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 86521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/vhost_scsi.ko 2023-07-24T05:29:59.995 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/ 2023-07-24T05:29:59.995 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/ 2023-07-24T05:29:59.995 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-07-24T05:29:59.995 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/aat2870_bl.ko 2023-07-24T05:29:59.995 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/adp5520_bl.ko 2023-07-24T05:29:59.995 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 32609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/adp8860_bl.ko 2023-07-24T05:29:59.996 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 39993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/adp8870_bl.ko 2023-07-24T05:29:59.996 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/apple_bl.ko 2023-07-24T05:29:59.996 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/as3711_bl.ko 2023-07-24T05:29:59.996 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/bd6107.ko 2023-07-24T05:29:59.996 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/da903x_bl.ko 2023-07-24T05:29:59.996 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/da9052_bl.ko 2023-07-24T05:29:59.996 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/gpio_backlight.ko 2023-07-24T05:29:59.996 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/kb3886_bl.ko 2023-07-24T05:29:59.997 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/lcd.ko 2023-07-24T05:29:59.997 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/lm3533_bl.ko 2023-07-24T05:29:59.997 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/lm3639_bl.ko 2023-07-24T05:29:59.997 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/lv5207lp.ko 2023-07-24T05:29:59.997 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/max8925_bl.ko 2023-07-24T05:29:59.997 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/pandora_bl.ko 2023-07-24T05:29:59.997 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-07-24T05:29:59.998 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/platform_lcd.ko 2023-07-24T05:29:59.998 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/wm831x_bl.ko 2023-07-24T05:29:59.998 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/ 2023-07-24T05:29:59.998 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/ 2023-07-24T05:29:59.998 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/ds2482.ko 2023-07-24T05:29:59.998 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 38961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/ds2490.ko 2023-07-24T05:29:59.999 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/matrox_w1.ko 2023-07-24T05:29:59.999 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/w1-gpio.ko 2023-07-24T05:29:59.999 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/ 2023-07-24T05:29:59.999 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-07-24T05:29:59.999 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-07-24T05:29:59.999 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-07-24T05:29:59.999 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-07-24T05:30:00.000 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-07-24T05:30:00.000 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-07-24T05:30:00.000 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-07-24T05:30:00.000 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-07-24T05:30:00.000 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-07-24T05:30:00.000 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_smem.ko 2023-07-24T05:30:00.000 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 56425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_therm.ko 2023-07-24T05:30:00.001 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 102657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/wire.ko 2023-07-24T05:30:00.001 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/ 2023-07-24T05:30:00.001 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/acquirewdt.ko 2023-07-24T05:30:00.001 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19977 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/advantechwdt.ko 2023-07-24T05:30:00.001 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/alim1535_wdt.ko 2023-07-24T05:30:00.001 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/alim7101_wdt.ko 2023-07-24T05:30:00.001 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/cpu5wdt.ko 2023-07-24T05:30:00.001 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/da9052_wdt.ko 2023-07-24T05:30:00.002 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/da9055_wdt.ko 2023-07-24T05:30:00.002 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/da9063_wdt.ko 2023-07-24T05:30:00.002 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/dw_wdt.ko 2023-07-24T05:30:00.002 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/eurotechwdt.ko 2023-07-24T05:30:00.002 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/f71808e_wdt.ko 2023-07-24T05:30:00.002 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/hpwdt.ko 2023-07-24T05:30:00.002 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/i6300esb.ko 2023-07-24T05:30:00.003 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-07-24T05:30:00.003 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/iTCO_wdt.ko 2023-07-24T05:30:00.003 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/ib700wdt.ko 2023-07-24T05:30:00.003 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/ibmasr.ko 2023-07-24T05:30:00.003 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-07-24T05:30:00.003 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/it8712f_wdt.ko 2023-07-24T05:30:00.003 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/it87_wdt.ko 2023-07-24T05:30:00.004 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/kempld_wdt.ko 2023-07-24T05:30:00.004 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/machzwd.ko 2023-07-24T05:30:00.004 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/mena21_wdt.ko 2023-07-24T05:30:00.004 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-07-24T05:30:00.004 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/nv_tco.ko 2023-07-24T05:30:00.004 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-07-24T05:30:00.004 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/pc87413_wdt.ko 2023-07-24T05:30:00.005 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 38657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/pcwd_pci.ko 2023-07-24T05:30:00.005 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 31825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/pcwd_usb.ko 2023-07-24T05:30:00.005 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/retu_wdt.ko 2023-07-24T05:30:00.005 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-07-24T05:30:00.005 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-07-24T05:30:00.005 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-07-24T05:30:00.005 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sc1200wdt.ko 2023-07-24T05:30:00.005 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sch311x_wdt.ko 2023-07-24T05:30:00.006 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-07-24T05:30:00.006 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/softdog.ko 2023-07-24T05:30:00.006 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sp5100_tco.ko 2023-07-24T05:30:00.006 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/twl4030_wdt.ko 2023-07-24T05:30:00.006 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/via_wdt.ko 2023-07-24T05:30:00.006 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-07-24T05:30:00.006 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/w83877f_wdt.ko 2023-07-24T05:30:00.006 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/w83977f_wdt.ko 2023-07-24T05:30:00.007 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/wafer5823wdt.ko 2023-07-24T05:30:00.007 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/wdt_pci.ko 2023-07-24T05:30:00.007 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/wm831x_wdt.ko 2023-07-24T05:30:00.007 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/wm8350_wdt.ko 2023-07-24T05:30:00.007 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/xen_wdt.ko 2023-07-24T05:30:00.007 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/ 2023-07-24T05:30:00.007 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-evtchn.ko 2023-07-24T05:30:00.007 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-gntalloc.ko 2023-07-24T05:30:00.008 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 47841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-gntdev.ko 2023-07-24T05:30:00.008 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-pciback/ 2023-07-24T05:30:00.008 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 176417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-07-24T05:30:00.008 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 40105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-privcmd.ko 2023-07-24T05:30:00.008 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 71321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-scsiback.ko 2023-07-24T05:30:00.008 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xenfs/ 2023-07-24T05:30:00.008 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xenfs/xenfs.ko 2023-07-24T05:30:00.009 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ 2023-07-24T05:30:00.009 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/9p/ 2023-07-24T05:30:00.009 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 165697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/9p/9p.ko 2023-07-24T05:30:00.009 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/adfs/ 2023-07-24T05:30:00.009 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 60881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/adfs/adfs.ko 2023-07-24T05:30:00.009 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/affs/ 2023-07-24T05:30:00.009 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 162617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/affs/affs.ko 2023-07-24T05:30:00.009 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/afs/ 2023-07-24T05:30:00.010 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 931937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/afs/kafs.ko 2023-07-24T05:30:00.010 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/autofs/ 2023-07-24T05:30:00.010 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 100937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/autofs/autofs4.ko 2023-07-24T05:30:00.010 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/befs/ 2023-07-24T05:30:00.010 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 64481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/befs/befs.ko 2023-07-24T05:30:00.010 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/bfs/ 2023-07-24T05:30:00.010 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 40993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/bfs/bfs.ko 2023-07-24T05:30:00.010 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 34625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/binfmt_misc.ko 2023-07-24T05:30:00.011 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/btrfs/ 2023-07-24T05:30:00.011 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 3468681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/btrfs/btrfs.ko 2023-07-24T05:30:00.011 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/cachefiles/ 2023-07-24T05:30:00.011 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 305745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/cachefiles/cachefiles.ko 2023-07-24T05:30:00.011 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ceph/ 2023-07-24T05:30:00.011 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 1312545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ceph/ceph.ko 2023-07-24T05:30:00.011 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/coda/ 2023-07-24T05:30:00.011 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 100321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/coda/coda.ko 2023-07-24T05:30:00.012 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/configfs/ 2023-07-24T05:30:00.012 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 108073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/configfs/configfs.ko 2023-07-24T05:30:00.012 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/cramfs/ 2023-07-24T05:30:00.012 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/cramfs/cramfs.ko 2023-07-24T05:30:00.012 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/dlm/ 2023-07-24T05:30:00.012 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 633825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/dlm/dlm.ko 2023-07-24T05:30:00.012 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/efs/ 2023-07-24T05:30:00.013 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 36585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/efs/efs.ko 2023-07-24T05:30:00.013 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/f2fs/ 2023-07-24T05:30:00.013 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 1500513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/f2fs/f2fs.ko 2023-07-24T05:30:00.013 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fat/ 2023-07-24T05:30:00.013 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fat/msdos.ko 2023-07-24T05:30:00.013 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/freevxfs/ 2023-07-24T05:30:00.013 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 42457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/freevxfs/freevxfs.ko 2023-07-24T05:30:00.013 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fscache/ 2023-07-24T05:30:00.014 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 226505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fscache/fscache.ko 2023-07-24T05:30:00.014 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fuse/ 2023-07-24T05:30:00.014 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fuse/cuse.ko 2023-07-24T05:30:00.014 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/gfs2/ 2023-07-24T05:30:00.014 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 1226249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/gfs2/gfs2.ko 2023-07-24T05:30:00.041 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hfs/ 2023-07-24T05:30:00.041 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 141241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hfs/hfs.ko 2023-07-24T05:30:00.041 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hfsplus/ 2023-07-24T05:30:00.041 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 221553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hfsplus/hfsplus.ko 2023-07-24T05:30:00.042 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hpfs/ 2023-07-24T05:30:00.042 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 193577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hpfs/hpfs.ko 2023-07-24T05:30:00.042 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/isofs/ 2023-07-24T05:30:00.042 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 74393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/isofs/isofs.ko 2023-07-24T05:30:00.042 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/jfs/ 2023-07-24T05:30:00.042 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 420745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/jfs/jfs.ko 2023-07-24T05:30:00.042 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/lockd/ 2023-07-24T05:30:00.042 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 279041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/lockd/lockd.ko 2023-07-24T05:30:00.043 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/minix/ 2023-07-24T05:30:00.043 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 87897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/minix/minix.ko 2023-07-24T05:30:00.043 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/netfs/ 2023-07-24T05:30:00.043 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 124697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/netfs/netfs.ko 2023-07-24T05:30:00.043 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/ 2023-07-24T05:30:00.043 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/blocklayout/ 2023-07-24T05:30:00.043 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 81521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-07-24T05:30:00.043 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/filelayout/ 2023-07-24T05:30:00.044 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 59425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-07-24T05:30:00.044 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/flexfilelayout/ 2023-07-24T05:30:00.044 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 117705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-07-24T05:30:00.044 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 1053889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/nfs.ko 2023-07-24T05:30:00.044 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 66089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/nfsv2.ko 2023-07-24T05:30:00.044 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 119801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/nfsv3.ko 2023-07-24T05:30:00.044 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 2041809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/nfsv4.ko 2023-07-24T05:30:00.045 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs_common/ 2023-07-24T05:30:00.045 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs_common/grace.ko 2023-07-24T05:30:00.045 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs_common/nfs_acl.ko 2023-07-24T05:30:00.045 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfsd/ 2023-07-24T05:30:00.045 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 1504993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfsd/nfsd.ko 2023-07-24T05:30:00.045 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nilfs2/ 2023-07-24T05:30:00.045 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 591417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nilfs2/nilfs2.ko 2023-07-24T05:30:00.045 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/ 2023-07-24T05:30:00.046 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-celtic.ko 2023-07-24T05:30:00.046 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-centeuro.ko 2023-07-24T05:30:00.046 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-croatian.ko 2023-07-24T05:30:00.046 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-cyrillic.ko 2023-07-24T05:30:00.046 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-gaelic.ko 2023-07-24T05:30:00.046 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-greek.ko 2023-07-24T05:30:00.046 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-iceland.ko 2023-07-24T05:30:00.046 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-inuit.ko 2023-07-24T05:30:00.047 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-roman.ko 2023-07-24T05:30:00.047 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-romanian.ko 2023-07-24T05:30:00.047 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-turkish.ko 2023-07-24T05:30:00.047 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_ascii.ko 2023-07-24T05:30:00.047 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp1250.ko 2023-07-24T05:30:00.047 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp1251.ko 2023-07-24T05:30:00.047 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp1255.ko 2023-07-24T05:30:00.047 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp737.ko 2023-07-24T05:30:00.048 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp775.ko 2023-07-24T05:30:00.048 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp850.ko 2023-07-24T05:30:00.048 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp852.ko 2023-07-24T05:30:00.048 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp855.ko 2023-07-24T05:30:00.048 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp857.ko 2023-07-24T05:30:00.048 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp860.ko 2023-07-24T05:30:00.048 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp861.ko 2023-07-24T05:30:00.048 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp862.ko 2023-07-24T05:30:00.049 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp863.ko 2023-07-24T05:30:00.049 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp864.ko 2023-07-24T05:30:00.049 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp865.ko 2023-07-24T05:30:00.049 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp866.ko 2023-07-24T05:30:00.049 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp869.ko 2023-07-24T05:30:00.049 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp874.ko 2023-07-24T05:30:00.049 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 94137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp932.ko 2023-07-24T05:30:00.049 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 142673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp936.ko 2023-07-24T05:30:00.050 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 165745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp949.ko 2023-07-24T05:30:00.050 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 118121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp950.ko 2023-07-24T05:30:00.050 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_euc-jp.ko 2023-07-24T05:30:00.050 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-1.ko 2023-07-24T05:30:00.050 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-13.ko 2023-07-24T05:30:00.050 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-14.ko 2023-07-24T05:30:00.050 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-15.ko 2023-07-24T05:30:00.051 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-2.ko 2023-07-24T05:30:00.051 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-3.ko 2023-07-24T05:30:00.051 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-4.ko 2023-07-24T05:30:00.051 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-5.ko 2023-07-24T05:30:00.051 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-6.ko 2023-07-24T05:30:00.051 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-7.ko 2023-07-24T05:30:00.051 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-9.ko 2023-07-24T05:30:00.052 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_koi8-r.ko 2023-07-24T05:30:00.052 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_koi8-ru.ko 2023-07-24T05:30:00.052 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_koi8-u.ko 2023-07-24T05:30:00.052 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_utf8.ko 2023-07-24T05:30:00.052 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ntfs/ 2023-07-24T05:30:00.052 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 219073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ntfs/ntfs.ko 2023-07-24T05:30:00.052 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ 2023-07-24T05:30:00.052 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/cluster/ 2023-07-24T05:30:00.053 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 244177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-07-24T05:30:00.053 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/dlm/ 2023-07-24T05:30:00.053 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 440785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-07-24T05:30:00.053 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/dlmfs/ 2023-07-24T05:30:00.053 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 53841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-07-24T05:30:00.053 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 2589569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ocfs2.ko 2023-07-24T05:30:00.053 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-07-24T05:30:00.053 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 31585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-07-24T05:30:00.054 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 35881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-07-24T05:30:00.054 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/omfs/ 2023-07-24T05:30:00.054 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 52569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/omfs/omfs.ko 2023-07-24T05:30:00.054 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/overlayfs/ 2023-07-24T05:30:00.054 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 336473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/overlayfs/overlay.ko 2023-07-24T05:30:00.054 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/pstore/ 2023-07-24T05:30:00.054 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 54609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/pstore/ramoops.ko 2023-07-24T05:30:00.054 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/qnx4/ 2023-07-24T05:30:00.055 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/qnx4/qnx4.ko 2023-07-24T05:30:00.055 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/qnx6/ 2023-07-24T05:30:00.055 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 46649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/qnx6/qnx6.ko 2023-07-24T05:30:00.055 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/quota/ 2023-07-24T05:30:00.055 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 30881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/quota/quota_tree.ko 2023-07-24T05:30:00.055 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/quota/quota_v1.ko 2023-07-24T05:30:00.055 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/quota/quota_v2.ko 2023-07-24T05:30:00.056 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/reiserfs/ 2023-07-24T05:30:00.056 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 530697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/reiserfs/reiserfs.ko 2023-07-24T05:30:00.056 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/romfs/ 2023-07-24T05:30:00.056 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/romfs/romfs.ko 2023-07-24T05:30:00.056 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/ 2023-07-24T05:30:00.056 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/client/ 2023-07-24T05:30:00.056 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 2658777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/client/cifs.ko 2023-07-24T05:30:00.056 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/common/ 2023-07-24T05:30:00.057 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/common/cifs_arc4.ko 2023-07-24T05:30:00.057 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/common/cifs_md4.ko 2023-07-24T05:30:00.057 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/squashfs/ 2023-07-24T05:30:00.057 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 134313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/squashfs/squashfs.ko 2023-07-24T05:30:00.057 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/sysv/ 2023-07-24T05:30:00.057 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 89737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/sysv/sysv.ko 2023-07-24T05:30:00.057 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/udf/ 2023-07-24T05:30:00.057 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 248049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/udf/udf.ko 2023-07-24T05:30:00.058 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ufs/ 2023-07-24T05:30:00.058 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 160857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ufs/ufs.ko 2023-07-24T05:30:00.058 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/xfs/ 2023-07-24T05:30:00.058 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 3998129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/xfs/xfs.ko 2023-07-24T05:30:00.058 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/ 2023-07-24T05:30:00.058 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/locking/ 2023-07-24T05:30:00.058 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 74865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/locking/locktorture.ko 2023-07-24T05:30:00.058 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/time/ 2023-07-24T05:30:00.059 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/time/test_udelay.ko 2023-07-24T05:30:00.059 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 58473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/torture.ko 2023-07-24T05:30:00.059 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/ 2023-07-24T05:30:00.059 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 6833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crc-itu-t.ko 2023-07-24T05:30:00.059 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 6529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crc7.ko 2023-07-24T05:30:00.059 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crc8.ko 2023-07-24T05:30:00.059 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crypto/ 2023-07-24T05:30:00.059 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crypto/libarc4.ko 2023-07-24T05:30:00.060 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 37081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crypto/libdes.ko 2023-07-24T05:30:00.060 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/interval_tree_test.ko 2023-07-24T05:30:00.060 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/libcrc32c.ko 2023-07-24T05:30:00.060 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/lru_cache.ko 2023-07-24T05:30:00.060 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/lz4/ 2023-07-24T05:30:00.060 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/lz4/lz4_compress.ko 2023-07-24T05:30:00.060 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22633 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/lz4/lz4hc_compress.ko 2023-07-24T05:30:00.061 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/math/ 2023-07-24T05:30:00.061 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 6617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/math/cordic.ko 2023-07-24T05:30:00.061 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/memory-notifier-error-inject.ko 2023-07-24T05:30:00.061 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/notifier-error-inject.ko 2023-07-24T05:30:00.061 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/percpu_test.ko 2023-07-24T05:30:00.061 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/pm-notifier-error-inject.ko 2023-07-24T05:30:00.061 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/raid6/ 2023-07-24T05:30:00.062 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 143433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/raid6/raid6_pq.ko 2023-07-24T05:30:00.062 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/rbtree_test.ko 2023-07-24T05:30:00.062 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/reed_solomon/ 2023-07-24T05:30:00.062 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/reed_solomon/reed_solomon.ko 2023-07-24T05:30:00.062 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 38841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test-kstrtox.ko 2023-07-24T05:30:00.062 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test-string_helpers.ko 2023-07-24T05:30:00.062 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 4760825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test_bpf.ko 2023-07-24T05:30:00.063 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 49081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test_firmware.ko 2023-07-24T05:30:00.063 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 6369 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test_module.ko 2023-07-24T05:30:00.063 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test_user_copy.ko 2023-07-24T05:30:00.063 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/ts_bm.ko 2023-07-24T05:30:00.063 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/ts_fsm.ko 2023-07-24T05:30:00.063 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/ts_kmp.ko 2023-07-24T05:30:00.063 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/xz/ 2023-07-24T05:30:00.063 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/xz/xz_dec_test.ko 2023-07-24T05:30:00.064 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/mm/ 2023-07-24T05:30:00.064 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/mm/hwpoison-inject.ko 2023-07-24T05:30:00.064 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ 2023-07-24T05:30:00.064 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/ 2023-07-24T05:30:00.064 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 55737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/6lowpan.ko 2023-07-24T05:30:00.064 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_dest.ko 2023-07-24T05:30:00.064 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_fragment.ko 2023-07-24T05:30:00.064 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_hop.ko 2023-07-24T05:30:00.065 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 6985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_ipv6.ko 2023-07-24T05:30:00.065 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_mobility.ko 2023-07-24T05:30:00.065 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_routing.ko 2023-07-24T05:30:00.065 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_udp.ko 2023-07-24T05:30:00.065 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/ 2023-07-24T05:30:00.065 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 30385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/garp.ko 2023-07-24T05:30:00.065 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 34785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/mrp.ko 2023-07-24T05:30:00.065 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/p8022.ko 2023-07-24T05:30:00.066 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/psnap.ko 2023-07-24T05:30:00.066 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/stp.ko 2023-07-24T05:30:00.066 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/8021q/ 2023-07-24T05:30:00.066 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 81017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/8021q/8021q.ko 2023-07-24T05:30:00.066 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/ 2023-07-24T05:30:00.066 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 198417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/9pnet.ko 2023-07-24T05:30:00.066 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 35961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/9pnet_fd.ko 2023-07-24T05:30:00.066 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/9pnet_rdma.ko 2023-07-24T05:30:00.067 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 32257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/9pnet_virtio.ko 2023-07-24T05:30:00.067 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/batman-adv/ 2023-07-24T05:30:00.067 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 652553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/batman-adv/batman-adv.ko 2023-07-24T05:30:00.067 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/ 2023-07-24T05:30:00.067 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 63825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/br_netfilter.ko 2023-07-24T05:30:00.067 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 772505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/bridge.ko 2023-07-24T05:30:00.067 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ 2023-07-24T05:30:00.067 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-07-24T05:30:00.068 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_among.ko 2023-07-24T05:30:00.068 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_arp.ko 2023-07-24T05:30:00.068 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-07-24T05:30:00.068 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-07-24T05:30:00.068 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_ip.ko 2023-07-24T05:30:00.068 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-07-24T05:30:00.068 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_limit.ko 2023-07-24T05:30:00.069 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_log.ko 2023-07-24T05:30:00.069 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_mark.ko 2023-07-24T05:30:00.069 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-07-24T05:30:00.069 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-07-24T05:30:00.069 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-07-24T05:30:00.069 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-07-24T05:30:00.069 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_snat.ko 2023-07-24T05:30:00.069 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_stp.ko 2023-07-24T05:30:00.070 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-07-24T05:30:00.070 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-07-24T05:30:00.070 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-07-24T05:30:00.070 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-07-24T05:30:00.070 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 55937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebtables.ko 2023-07-24T05:30:00.070 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-07-24T05:30:00.070 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-07-24T05:30:00.071 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ceph/ 2023-07-24T05:30:00.071 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 1046417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ceph/libceph.ko 2023-07-24T05:30:00.071 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/core/ 2023-07-24T05:30:00.071 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 124793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/core/pktgen.ko 2023-07-24T05:30:00.071 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/ 2023-07-24T05:30:00.071 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 194321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/dccp.ko 2023-07-24T05:30:00.071 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/dccp_diag.ko 2023-07-24T05:30:00.071 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 56945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/dccp_ipv4.ko 2023-07-24T05:30:00.072 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 59457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/dccp_ipv6.ko 2023-07-24T05:30:00.072 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/ 2023-07-24T05:30:00.072 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 390297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/dsa_core.ko 2023-07-24T05:30:00.072 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/tag_brcm.ko 2023-07-24T05:30:00.072 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/tag_dsa.ko 2023-07-24T05:30:00.072 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/tag_none.ko 2023-07-24T05:30:00.072 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/tag_trailer.ko 2023-07-24T05:30:00.073 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/hsr/ 2023-07-24T05:30:00.073 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 100257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/hsr/hsr.ko 2023-07-24T05:30:00.073 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/ 2023-07-24T05:30:00.073 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/6lowpan/ 2023-07-24T05:30:00.073 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 45169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-07-24T05:30:00.073 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 254601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/ieee802154.ko 2023-07-24T05:30:00.073 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 47265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/ieee802154_socket.ko 2023-07-24T05:30:00.073 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ 2023-07-24T05:30:00.074 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ah4.ko 2023-07-24T05:30:00.074 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 38801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/esp4.ko 2023-07-24T05:30:00.074 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 48345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/fou.ko 2023-07-24T05:30:00.074 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/gre.ko 2023-07-24T05:30:00.074 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 48529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/inet_diag.ko 2023-07-24T05:30:00.074 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 60529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ip_gre.ko 2023-07-24T05:30:00.074 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 61281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ip_tunnel.ko 2023-07-24T05:30:00.074 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 34369 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ip_vti.ko 2023-07-24T05:30:00.075 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ipcomp.ko 2023-07-24T05:30:00.075 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ipip.ko 2023-07-24T05:30:00.075 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ 2023-07-24T05:30:00.075 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 37689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/arp_tables.ko 2023-07-24T05:30:00.075 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-07-24T05:30:00.075 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-07-24T05:30:00.075 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 41601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ip_tables.ko 2023-07-24T05:30:00.075 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-07-24T05:30:00.076 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-07-24T05:30:00.076 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-07-24T05:30:00.076 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-07-24T05:30:00.076 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-07-24T05:30:00.076 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-07-24T05:30:00.076 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-07-24T05:30:00.076 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-07-24T05:30:00.077 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-07-24T05:30:00.077 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_security.ko 2023-07-24T05:30:00.077 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-07-24T05:30:00.077 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-07-24T05:30:00.077 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-07-24T05:30:00.077 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-07-24T05:30:00.077 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-07-24T05:30:00.077 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-07-24T05:30:00.078 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-07-24T05:30:00.078 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-07-24T05:30:00.078 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-07-24T05:30:00.078 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-07-24T05:30:00.078 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-07-24T05:30:00.078 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_bic.ko 2023-07-24T05:30:00.078 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_dctcp.ko 2023-07-24T05:30:00.078 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_diag.ko 2023-07-24T05:30:00.079 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_highspeed.ko 2023-07-24T05:30:00.079 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_htcp.ko 2023-07-24T05:30:00.079 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_hybla.ko 2023-07-24T05:30:00.079 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_illinois.ko 2023-07-24T05:30:00.079 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_lp.ko 2023-07-24T05:30:00.079 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_scalable.ko 2023-07-24T05:30:00.079 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_vegas.ko 2023-07-24T05:30:00.079 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_veno.ko 2023-07-24T05:30:00.080 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_westwood.ko 2023-07-24T05:30:00.080 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_yeah.ko 2023-07-24T05:30:00.080 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tunnel4.ko 2023-07-24T05:30:00.080 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/udp_diag.ko 2023-07-24T05:30:00.080 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 41577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/udp_tunnel.ko 2023-07-24T05:30:00.080 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/xfrm4_tunnel.ko 2023-07-24T05:30:00.080 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ 2023-07-24T05:30:00.081 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ah6.ko 2023-07-24T05:30:00.081 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 39537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/esp6.ko 2023-07-24T05:30:00.081 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/fou6.ko 2023-07-24T05:30:00.081 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 80793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ip6_gre.ko 2023-07-24T05:30:00.081 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 92817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ip6_tunnel.ko 2023-07-24T05:30:00.081 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-07-24T05:30:00.081 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 54001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ip6_vti.ko 2023-07-24T05:30:00.081 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ipcomp6.ko 2023-07-24T05:30:00.082 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/mip6.ko 2023-07-24T05:30:00.082 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ 2023-07-24T05:30:00.082 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 42209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-07-24T05:30:00.082 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-07-24T05:30:00.082 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-07-24T05:30:00.082 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-07-24T05:30:00.082 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-07-24T05:30:00.082 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-07-24T05:30:00.083 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-07-24T05:30:00.083 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-07-24T05:30:00.083 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-07-24T05:30:00.083 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-07-24T05:30:00.083 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-07-24T05:30:00.083 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-07-24T05:30:00.083 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-07-24T05:30:00.083 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-07-24T05:30:00.084 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-07-24T05:30:00.084 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-07-24T05:30:00.084 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-07-24T05:30:00.084 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 38833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-07-24T05:30:00.084 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-07-24T05:30:00.084 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-07-24T05:30:00.084 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-07-24T05:30:00.085 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-07-24T05:30:00.085 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9633 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-07-24T05:30:00.085 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-07-24T05:30:00.085 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-07-24T05:30:00.085 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 73161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/sit.ko 2023-07-24T05:30:00.085 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/tunnel6.ko 2023-07-24T05:30:00.085 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/xfrm6_tunnel.ko 2023-07-24T05:30:00.085 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/key/ 2023-07-24T05:30:00.086 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 82929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/key/af_key.ko 2023-07-24T05:30:00.086 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/ 2023-07-24T05:30:00.086 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 125873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_core.ko 2023-07-24T05:30:00.086 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_debugfs.ko 2023-07-24T05:30:00.086 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 25865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_eth.ko 2023-07-24T05:30:00.086 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 35049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_ip.ko 2023-07-24T05:30:00.086 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 36745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_ip6.ko 2023-07-24T05:30:00.086 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_netlink.ko 2023-07-24T05:30:00.087 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 53153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_ppp.ko 2023-07-24T05:30:00.087 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/lapb/ 2023-07-24T05:30:00.087 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 48065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/lapb/lapb.ko 2023-07-24T05:30:00.087 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/llc/ 2023-07-24T05:30:00.087 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/llc/llc.ko 2023-07-24T05:30:00.087 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 267017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/llc/llc2.ko 2023-07-24T05:30:00.087 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/mac802154/ 2023-07-24T05:30:00.087 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 291041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/mac802154/mac802154.ko 2023-07-24T05:30:00.088 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/mpls/ 2023-07-24T05:30:00.088 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/mpls/mpls_gso.ko 2023-07-24T05:30:00.088 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ 2023-07-24T05:30:00.088 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ 2023-07-24T05:30:00.088 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 119649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set.ko 2023-07-24T05:30:00.088 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-07-24T05:30:00.088 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-07-24T05:30:00.089 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-07-24T05:30:00.089 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 102033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-07-24T05:30:00.089 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 103121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-07-24T05:30:00.089 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 104593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-07-24T05:30:00.089 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 105129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-07-24T05:30:00.089 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 114393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-07-24T05:30:00.089 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 61161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-07-24T05:30:00.089 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 111161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-07-24T05:30:00.090 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 114673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-07-24T05:30:00.090 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 114329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-07-24T05:30:00.090 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 113217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-07-24T05:30:00.090 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 116217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-07-24T05:30:00.090 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 30145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-07-24T05:30:00.090 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ 2023-07-24T05:30:00.090 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 412481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs.ko 2023-07-24T05:30:00.090 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-07-24T05:30:00.091 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-07-24T05:30:00.091 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-07-24T05:30:00.091 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-07-24T05:30:00.091 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-07-24T05:30:00.091 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-07-24T05:30:00.091 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-07-24T05:30:00.091 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-07-24T05:30:00.091 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-07-24T05:30:00.092 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-07-24T05:30:00.092 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-07-24T05:30:00.092 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-07-24T05:30:00.092 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-07-24T05:30:00.092 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 48897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conncount.ko 2023-07-24T05:30:00.092 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 408689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack.ko 2023-07-24T05:30:00.092 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-07-24T05:30:00.092 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-07-24T05:30:00.093 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-07-24T05:30:00.093 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 118145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_h323.ko 2023-07-24T05:30:00.093 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_irc.ko 2023-07-24T05:30:00.093 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-07-24T05:30:00.093 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 108393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-07-24T05:30:00.093 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-07-24T05:30:00.093 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_sane.ko 2023-07-24T05:30:00.093 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 66641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_sip.ko 2023-07-24T05:30:00.094 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-07-24T05:30:00.094 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-07-24T05:30:00.094 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_dup_netdev.ko 2023-07-24T05:30:00.094 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 88513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_flow_table.ko 2023-07-24T05:30:00.094 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_flow_table_inet.ko 2023-07-24T05:30:00.094 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 37129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_log_syslog.ko 2023-07-24T05:30:00.094 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 95353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat.ko 2023-07-24T05:30:00.095 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_amanda.ko 2023-07-24T05:30:00.095 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_ftp.ko 2023-07-24T05:30:00.095 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_irc.ko 2023-07-24T05:30:00.095 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_sip.ko 2023-07-24T05:30:00.095 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_tftp.ko 2023-07-24T05:30:00.095 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 44025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_synproxy_core.ko 2023-07-24T05:30:00.095 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 592185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_tables.ko 2023-07-24T05:30:00.095 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 43873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink.ko 2023-07-24T05:30:00.096 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 30273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_acct.ko 2023-07-24T05:30:00.096 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 30625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-07-24T05:30:00.096 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 39905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_log.ko 2023-07-24T05:30:00.096 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_osf.ko 2023-07-24T05:30:00.096 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 49673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_queue.ko 2023-07-24T05:30:00.096 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_chain_nat.ko 2023-07-24T05:30:00.096 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_compat.ko 2023-07-24T05:30:00.096 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 40721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_ct.ko 2023-07-24T05:30:00.097 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_dup_netdev.ko 2023-07-24T05:30:00.097 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_fib.ko 2023-07-24T05:30:00.097 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_fwd_netdev.ko 2023-07-24T05:30:00.097 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_hash.ko 2023-07-24T05:30:00.097 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_limit.ko 2023-07-24T05:30:00.097 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_log.ko 2023-07-24T05:30:00.097 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_masq.ko 2023-07-24T05:30:00.098 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_nat.ko 2023-07-24T05:30:00.098 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_numgen.ko 2023-07-24T05:30:00.098 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_osf.ko 2023-07-24T05:30:00.098 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_queue.ko 2023-07-24T05:30:00.098 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_redir.ko 2023-07-24T05:30:00.098 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_reject.ko 2023-07-24T05:30:00.098 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_reject_inet.ko 2023-07-24T05:30:00.098 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_socket.ko 2023-07-24T05:30:00.099 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_synproxy.ko 2023-07-24T05:30:00.099 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_tproxy.ko 2023-07-24T05:30:00.099 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 89329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/x_tables.ko 2023-07-24T05:30:00.099 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_AUDIT.ko 2023-07-24T05:30:00.099 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9633 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_CHECKSUM.ko 2023-07-24T05:30:00.099 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_CLASSIFY.ko 2023-07-24T05:30:00.099 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-07-24T05:30:00.099 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 18169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_CT.ko 2023-07-24T05:30:00.100 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_DSCP.ko 2023-07-24T05:30:00.100 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_HL.ko 2023-07-24T05:30:00.100 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_HMARK.ko 2023-07-24T05:30:00.100 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 38857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_IDLETIMER.ko 2023-07-24T05:30:00.100 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_LED.ko 2023-07-24T05:30:00.100 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_LOG.ko 2023-07-24T05:30:00.100 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_MASQUERADE.ko 2023-07-24T05:30:00.100 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_NETMAP.ko 2023-07-24T05:30:00.101 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_NFLOG.ko 2023-07-24T05:30:00.101 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_NFQUEUE.ko 2023-07-24T05:30:00.101 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_RATEEST.ko 2023-07-24T05:30:00.101 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_REDIRECT.ko 2023-07-24T05:30:00.101 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 14337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_SECMARK.ko 2023-07-24T05:30:00.101 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TCPMSS.ko 2023-07-24T05:30:00.101 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-07-24T05:30:00.102 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17369 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TEE.ko 2023-07-24T05:30:00.102 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TPROXY.ko 2023-07-24T05:30:00.102 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TRACE.ko 2023-07-24T05:30:00.102 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_addrtype.ko 2023-07-24T05:30:00.102 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_bpf.ko 2023-07-24T05:30:00.102 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_cgroup.ko 2023-07-24T05:30:00.102 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_cluster.ko 2023-07-24T05:30:00.102 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_comment.ko 2023-07-24T05:30:00.103 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_connbytes.ko 2023-07-24T05:30:00.103 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_connlabel.ko 2023-07-24T05:30:00.103 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_connlimit.ko 2023-07-24T05:30:00.103 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_connmark.ko 2023-07-24T05:30:00.103 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_conntrack.ko 2023-07-24T05:30:00.103 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_cpu.ko 2023-07-24T05:30:00.103 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_dccp.ko 2023-07-24T05:30:00.103 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_devgroup.ko 2023-07-24T05:30:00.104 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_dscp.ko 2023-07-24T05:30:00.104 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_ecn.ko 2023-07-24T05:30:00.104 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_esp.ko 2023-07-24T05:30:00.104 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 43457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_hashlimit.ko 2023-07-24T05:30:00.104 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_helper.ko 2023-07-24T05:30:00.104 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_hl.ko 2023-07-24T05:30:00.104 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_ipcomp.ko 2023-07-24T05:30:00.104 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_iprange.ko 2023-07-24T05:30:00.105 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_ipvs.ko 2023-07-24T05:30:00.105 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_l2tp.ko 2023-07-24T05:30:00.105 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_length.ko 2023-07-24T05:30:00.105 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_limit.ko 2023-07-24T05:30:00.105 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_mac.ko 2023-07-24T05:30:00.105 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_mark.ko 2023-07-24T05:30:00.105 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_multiport.ko 2023-07-24T05:30:00.105 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_nat.ko 2023-07-24T05:30:00.106 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_nfacct.ko 2023-07-24T05:30:00.106 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_osf.ko 2023-07-24T05:30:00.106 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_owner.ko 2023-07-24T05:30:00.106 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_physdev.ko 2023-07-24T05:30:00.106 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7633 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_pkttype.ko 2023-07-24T05:30:00.106 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_policy.ko 2023-07-24T05:30:00.106 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_quota.ko 2023-07-24T05:30:00.106 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_rateest.ko 2023-07-24T05:30:00.107 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_realm.ko 2023-07-24T05:30:00.107 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 36441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_recent.ko 2023-07-24T05:30:00.107 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_sctp.ko 2023-07-24T05:30:00.107 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 30089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_set.ko 2023-07-24T05:30:00.107 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_socket.ko 2023-07-24T05:30:00.107 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_state.ko 2023-07-24T05:30:00.107 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_statistic.ko 2023-07-24T05:30:00.107 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_string.ko 2023-07-24T05:30:00.108 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 8553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_tcpmss.ko 2023-07-24T05:30:00.108 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_tcpudp.ko 2023-07-24T05:30:00.108 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_time.ko 2023-07-24T05:30:00.108 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_u32.ko 2023-07-24T05:30:00.108 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netlink/ 2023-07-24T05:30:00.108 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netlink/netlink_diag.ko 2023-07-24T05:30:00.108 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/nsh/ 2023-07-24T05:30:00.109 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 12425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/nsh/nsh.ko 2023-07-24T05:30:00.109 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/ 2023-07-24T05:30:00.109 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 379545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/openvswitch.ko 2023-07-24T05:30:00.109 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/vport-geneve.ko 2023-07-24T05:30:00.109 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/vport-gre.ko 2023-07-24T05:30:00.109 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 11793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/vport-vxlan.ko 2023-07-24T05:30:00.109 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/packet/ 2023-07-24T05:30:00.109 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/packet/af_packet_diag.ko 2023-07-24T05:30:00.110 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/phonet/ 2023-07-24T05:30:00.110 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 109961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/phonet/phonet.ko 2023-07-24T05:30:00.110 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 54761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/phonet/pn_pep.ko 2023-07-24T05:30:00.110 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rds/ 2023-07-24T05:30:00.110 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 252825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rds/rds.ko 2023-07-24T05:30:00.110 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 165081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rds/rds_rdma.ko 2023-07-24T05:30:00.110 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 67241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rds/rds_tcp.ko 2023-07-24T05:30:00.110 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rxrpc/ 2023-07-24T05:30:00.111 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 820137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rxrpc/rxrpc.ko 2023-07-24T05:30:00.111 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/ 2023-07-24T05:30:00.111 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 32249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_csum.ko 2023-07-24T05:30:00.111 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_gact.ko 2023-07-24T05:30:00.111 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_ipt.ko 2023-07-24T05:30:00.111 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 34057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_mirred.ko 2023-07-24T05:30:00.111 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_nat.ko 2023-07-24T05:30:00.111 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 43817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_pedit.ko 2023-07-24T05:30:00.112 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 31985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_police.ko 2023-07-24T05:30:00.112 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_simple.ko 2023-07-24T05:30:00.112 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 36353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_skbedit.ko 2023-07-24T05:30:00.112 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 36057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_vlan.ko 2023-07-24T05:30:00.112 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_basic.ko 2023-07-24T05:30:00.112 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_bpf.ko 2023-07-24T05:30:00.112 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_cgroup.ko 2023-07-24T05:30:00.113 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 31377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_flow.ko 2023-07-24T05:30:00.113 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 31065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_fw.ko 2023-07-24T05:30:00.113 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 37953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_route.ko 2023-07-24T05:30:00.113 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 59217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_u32.ko 2023-07-24T05:30:00.113 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_cmp.ko 2023-07-24T05:30:00.113 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 13457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_ipset.ko 2023-07-24T05:30:00.113 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_meta.ko 2023-07-24T05:30:00.113 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_nbyte.ko 2023-07-24T05:30:00.114 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_text.ko 2023-07-24T05:30:00.114 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_u32.ko 2023-07-24T05:30:00.114 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 21649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_choke.ko 2023-07-24T05:30:00.114 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_codel.ko 2023-07-24T05:30:00.114 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_drr.ko 2023-07-24T05:30:00.114 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 33609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_fq.ko 2023-07-24T05:30:00.114 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 31601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_fq_codel.ko 2023-07-24T05:30:00.114 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 35433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_gred.ko 2023-07-24T05:30:00.115 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 48409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_hfsc.ko 2023-07-24T05:30:00.115 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_hhf.ko 2023-07-24T05:30:00.115 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 65793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_htb.ko 2023-07-24T05:30:00.115 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 16065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_ingress.ko 2023-07-24T05:30:00.115 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 29809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_mqprio.ko 2023-07-24T05:30:00.115 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_mqprio_lib.ko 2023-07-24T05:30:00.115 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_multiq.ko 2023-07-24T05:30:00.115 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 35601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_netem.ko 2023-07-24T05:30:00.116 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_pie.ko 2023-07-24T05:30:00.116 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_plug.ko 2023-07-24T05:30:00.116 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 24729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_prio.ko 2023-07-24T05:30:00.116 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 47617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_qfq.ko 2023-07-24T05:30:00.116 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 32953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_red.ko 2023-07-24T05:30:00.116 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 26881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_sfb.ko 2023-07-24T05:30:00.116 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 31425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_sfq.ko 2023-07-24T05:30:00.116 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 28897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_tbf.ko 2023-07-24T05:30:00.117 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 27729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_teql.ko 2023-07-24T05:30:00.117 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sctp/ 2023-07-24T05:30:00.117 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 930369 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sctp/sctp.ko 2023-07-24T05:30:00.117 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 19033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sctp/sctp_diag.ko 2023-07-24T05:30:00.117 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/ 2023-07-24T05:30:00.117 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/auth_gss/ 2023-07-24T05:30:00.117 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 335569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-07-24T05:30:00.118 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 61833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-07-24T05:30:00.118 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 1514649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/sunrpc.ko 2023-07-24T05:30:00.118 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/xprtrdma/ 2023-07-24T05:30:00.118 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 707401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-07-24T05:30:00.118 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/tipc/ 2023-07-24T05:30:00.118 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/tipc/diag.ko 2023-07-24T05:30:00.118 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 862233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/tipc/tipc.ko 2023-07-24T05:30:00.118 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/unix/ 2023-07-24T05:30:00.119 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/unix/unix_diag.ko 2023-07-24T05:30:00.119 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/ 2023-07-24T05:30:00.119 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 84841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-07-24T05:30:00.119 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 68033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-07-24T05:30:00.119 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 95985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vsock.ko 2023-07-24T05:30:00.119 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 10705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vsock_diag.ko 2023-07-24T05:30:00.119 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 17521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vsock_loopback.ko 2023-07-24T05:30:00.119 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/x25/ 2023-07-24T05:30:00.120 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 125097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/x25/x25.ko 2023-07-24T05:30:00.120 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/xfrm/ 2023-07-24T05:30:00.120 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 22657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/xfrm/xfrm_algo.ko 2023-07-24T05:30:00.120 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 20705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/xfrm/xfrm_ipcomp.ko 2023-07-24T05:30:00.120 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 102265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/xfrm/xfrm_user.ko 2023-07-24T05:30:00.120 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/virt/ 2023-07-24T05:30:00.120 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/virt/lib/ 2023-07-24T05:30:00.120 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 15513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/virt/lib/irqbypass.ko 2023-07-24T05:30:00.121 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 638200 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.alias 2023-07-24T05:30:00.121 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 623896 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.alias.bin 2023-07-24T05:30:00.121 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 7656 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.builtin 2023-07-24T05:30:00.121 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 23361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.builtin.alias.bin 2023-07-24T05:30:00.121 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 9821 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.builtin.bin 2023-07-24T05:30:00.121 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 69903 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.builtin.modinfo 2023-07-24T05:30:00.121 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 146449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.dep 2023-07-24T05:30:00.121 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 232695 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.dep.bin 2023-07-24T05:30:00.122 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 210 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.devname 2023-07-24T05:30:00.122 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 72754 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.order 2023-07-24T05:30:00.122 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 879 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.softdep 2023-07-24T05:30:00.122 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 252883 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.symbols 2023-07-24T05:30:00.122 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 307884 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.symbols.bin 2023-07-24T05:30:00.122 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./usr/ 2023-07-24T05:30:00.122 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./usr/share/ 2023-07-24T05:30:00.122 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./usr/share/doc/ 2023-07-24T05:30:00.123 INFO:teuthology.orchestra.run.smithi077.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./usr/share/doc/linux-image-6.5.0-rc1-gc685da6f56cc/ 2023-07-24T05:30:00.123 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 173 2023-07-20 12:16 ./usr/share/doc/linux-image-6.5.0-rc1-gc685da6f56cc/changelog.Debian.gz 2023-07-24T05:30:00.123 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r-- root/root 691 2023-07-20 12:16 ./usr/share/doc/linux-image-6.5.0-rc1-gc685da6f56cc/copyright 2023-07-24T05:30:00.124 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc1-gc685da6f56cc 2023-07-24T05:30:00.124 INFO:teuthology.task.kernel:searching for kernel 6.5.0-rc1-gc685da6f56cc 2023-07-24T05:30:00.125 DEBUG:teuthology.orchestra.run.smithi077:> egrep '(submenu|menuentry.*6.5.0-rc1-gc685da6f56cc).*{' /boot/grub/grub.cfg 2023-07-24T05:30:00.133 INFO:teuthology.orchestra.run.smithi077.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-07-24T05:30:00.133 INFO:teuthology.orchestra.run.smithi077.stdout: menuentry 'Ubuntu, with Linux 6.5.0-rc1-gc685da6f56cc' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.5.0-rc1-gc685da6f56cc-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-07-24T05:30:00.133 INFO:teuthology.orchestra.run.smithi077.stdout: menuentry 'Ubuntu, with Linux 6.5.0-rc1-gc685da6f56cc (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.5.0-rc1-gc685da6f56cc-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-07-24T05:30:00.134 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-07-24T05:30:00.134 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.5.0-rc1-gc685da6f56cc 2023-07-24T05:30:00.134 DEBUG:teuthology.orchestra.run.smithi077:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-07-24T05:30:00.178 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi077.front.sepia.ceph.com to complete... 2023-07-24T05:30:00.233 INFO:teuthology.orchestra.run.smithi103.stderr:Found linux image: /boot/vmlinuz-6.5.0-rc1-gc685da6f56cc 2023-07-24T05:30:00.257 INFO:teuthology.orchestra.run.smithi103.stderr:Found initrd image: /boot/initrd.img-6.5.0-rc1-gc685da6f56cc 2023-07-24T05:30:00.640 INFO:teuthology.orchestra.run.smithi103.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-07-24T05:30:00.654 INFO:teuthology.orchestra.run.smithi103.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-07-24T05:30:00.726 INFO:teuthology.orchestra.run.smithi077.stderr:Sourcing file `/etc/default/grub' 2023-07-24T05:30:00.728 INFO:teuthology.orchestra.run.smithi077.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-24T05:30:00.742 INFO:teuthology.orchestra.run.smithi077.stderr:Generating grub configuration file ... 2023-07-24T05:30:00.994 INFO:teuthology.orchestra.run.smithi077.stderr:Found linux image: /boot/vmlinuz-6.5.0-rc1-gc685da6f56cc 2023-07-24T05:30:01.005 INFO:teuthology.orchestra.run.smithi077.stderr:Found initrd image: /boot/initrd.img-6.5.0-rc1-gc685da6f56cc 2023-07-24T05:30:01.357 INFO:teuthology.orchestra.run.smithi077.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-07-24T05:30:01.370 INFO:teuthology.orchestra.run.smithi077.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-07-24T05:30:03.128 INFO:teuthology.orchestra.run.smithi077.stderr:done 2023-07-24T05:30:03.322 INFO:teuthology.orchestra.run.smithi103.stderr:done 2023-07-24T05:30:03.479 DEBUG:teuthology.orchestra.run.smithi103:> dpkg-deb -c /tmp/linux-image.deb 2023-07-24T05:30:03.489 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./ 2023-07-24T05:30:03.490 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./boot/ 2023-07-24T05:30:03.490 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 4380308 2023-07-20 12:16 ./boot/System.map-6.5.0-rc1-gc685da6f56cc 2023-07-24T05:30:03.504 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 168433 2023-07-20 12:16 ./boot/config-6.5.0-rc1-gc685da6f56cc 2023-07-24T05:30:03.505 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11280224 2023-07-20 12:16 ./boot/vmlinuz-6.5.0-rc1-gc685da6f56cc 2023-07-24T05:30:03.527 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./etc/ 2023-07-24T05:30:03.527 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./etc/kernel/ 2023-07-24T05:30:03.527 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./etc/kernel/postinst.d/ 2023-07-24T05:30:03.527 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./etc/kernel/postrm.d/ 2023-07-24T05:30:03.527 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./etc/kernel/preinst.d/ 2023-07-24T05:30:03.527 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./etc/kernel/prerm.d/ 2023-07-24T05:30:03.528 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/ 2023-07-24T05:30:03.528 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/ 2023-07-24T05:30:03.528 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/ 2023-07-24T05:30:03.528 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/ 2023-07-24T05:30:03.528 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/ 2023-07-24T05:30:03.528 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/ 2023-07-24T05:30:03.528 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/ 2023-07-24T05:30:03.528 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 490385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/aesni-intel.ko 2023-07-24T05:30:03.530 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-07-24T05:30:03.531 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-07-24T05:30:03.531 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 30313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-07-24T05:30:03.531 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 93113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-07-24T05:30:03.531 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 106729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-07-24T05:30:03.531 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 152241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-07-24T05:30:03.531 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-07-24T05:30:03.532 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-07-24T05:30:03.532 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 83889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-07-24T05:30:03.532 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-07-24T05:30:03.532 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 47225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-07-24T05:30:03.532 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 47209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/serpent-avx2.ko 2023-07-24T05:30:03.532 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 51801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-07-24T05:30:03.532 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 38937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-07-24T05:30:03.532 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 40529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-07-24T05:30:03.533 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 58585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-07-24T05:30:03.533 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 50497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-07-24T05:30:03.533 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 32065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-07-24T05:30:03.533 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-07-24T05:30:03.533 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/ 2023-07-24T05:30:03.533 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/cpu/ 2023-07-24T05:30:03.533 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/cpu/mce/ 2023-07-24T05:30:03.533 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 40113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-07-24T05:30:03.534 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/cpuid.ko 2023-07-24T05:30:03.534 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/msr.ko 2023-07-24T05:30:03.534 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kvm/ 2023-07-24T05:30:03.534 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 348417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kvm/kvm-amd.ko 2023-07-24T05:30:03.534 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 972641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kvm/kvm-intel.ko 2023-07-24T05:30:03.534 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 2273145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kvm/kvm.ko 2023-07-24T05:30:03.543 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/ 2023-07-24T05:30:03.543 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 53521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/af_alg.ko 2023-07-24T05:30:03.543 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/algif_hash.ko 2023-07-24T05:30:03.543 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/algif_skcipher.ko 2023-07-24T05:30:03.543 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/ansi_cprng.ko 2023-07-24T05:30:03.543 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/anubis.ko 2023-07-24T05:30:03.544 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/arc4.ko 2023-07-24T05:30:03.544 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/asymmetric_keys/ 2023-07-24T05:30:03.544 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-07-24T05:30:03.544 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/ 2023-07-24T05:30:03.544 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_memcpy.ko 2023-07-24T05:30:03.544 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_pq.ko 2023-07-24T05:30:03.544 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_raid6_recov.ko 2023-07-24T05:30:03.544 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_tx.ko 2023-07-24T05:30:03.545 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_xor.ko 2023-07-24T05:30:03.545 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/raid6test.ko 2023-07-24T05:30:03.545 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/authenc.ko 2023-07-24T05:30:03.545 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/authencesn.ko 2023-07-24T05:30:03.545 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/blake2b_generic.ko 2023-07-24T05:30:03.545 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/blowfish_common.ko 2023-07-24T05:30:03.545 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/blowfish_generic.ko 2023-07-24T05:30:03.546 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 38873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/camellia_generic.ko 2023-07-24T05:30:03.546 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cast5_generic.ko 2023-07-24T05:30:03.546 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cast6_generic.ko 2023-07-24T05:30:03.546 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cast_common.ko 2023-07-24T05:30:03.546 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 35097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/ccm.ko 2023-07-24T05:30:03.546 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cmac.ko 2023-07-24T05:30:03.546 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/crc32_generic.ko 2023-07-24T05:30:03.546 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 46961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cryptd.ko 2023-07-24T05:30:03.547 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/crypto_engine.ko 2023-07-24T05:30:03.547 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/crypto_simd.ko 2023-07-24T05:30:03.547 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/crypto_user.ko 2023-07-24T05:30:03.547 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cts.ko 2023-07-24T05:30:03.547 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/des_generic.ko 2023-07-24T05:30:03.547 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/dh_generic.ko 2023-07-24T05:30:03.547 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/echainiv.ko 2023-07-24T05:30:03.547 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/essiv.ko 2023-07-24T05:30:03.548 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/fcrypt.ko 2023-07-24T05:30:03.548 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/khazad.ko 2023-07-24T05:30:03.548 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/lrw.ko 2023-07-24T05:30:03.548 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/lz4.ko 2023-07-24T05:30:03.548 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/lz4hc.ko 2023-07-24T05:30:03.548 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/md4.ko 2023-07-24T05:30:03.548 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/michael_mic.ko 2023-07-24T05:30:03.548 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/pcbc.ko 2023-07-24T05:30:03.549 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/pcrypt.ko 2023-07-24T05:30:03.549 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/rmd160.ko 2023-07-24T05:30:03.549 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/seed.ko 2023-07-24T05:30:03.549 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/serpent_generic.ko 2023-07-24T05:30:03.549 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 149193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/tcrypt.ko 2023-07-24T05:30:03.549 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/tea.ko 2023-07-24T05:30:03.549 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/twofish_common.ko 2023-07-24T05:30:03.549 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/twofish_generic.ko 2023-07-24T05:30:03.550 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/vmac.ko 2023-07-24T05:30:03.550 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 36185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/wp512.ko 2023-07-24T05:30:03.550 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/xcbc.ko 2023-07-24T05:30:03.550 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/xor.ko 2023-07-24T05:30:03.550 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/xts.ko 2023-07-24T05:30:03.550 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/xxhash_generic.ko 2023-07-24T05:30:03.550 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ 2023-07-24T05:30:03.550 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/ 2023-07-24T05:30:03.551 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/acpi_extlog.ko 2023-07-24T05:30:03.551 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/acpi_ipmi.ko 2023-07-24T05:30:03.551 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/acpi_pad.ko 2023-07-24T05:30:03.551 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/apei/ 2023-07-24T05:30:03.551 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 31241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/apei/einj.ko 2023-07-24T05:30:03.551 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/ec_sys.ko 2023-07-24T05:30:03.551 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/platform_profile.ko 2023-07-24T05:30:03.552 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/sbs.ko 2023-07-24T05:30:03.552 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/sbshc.ko 2023-07-24T05:30:03.552 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 100401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/video.ko 2023-07-24T05:30:03.552 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/ 2023-07-24T05:30:03.552 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/acard-ahci.ko 2023-07-24T05:30:03.552 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 88625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/ahci.ko 2023-07-24T05:30:03.552 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/ahci_platform.ko 2023-07-24T05:30:03.552 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 87841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/libahci.ko 2023-07-24T05:30:03.553 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 35049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/libahci_platform.ko 2023-07-24T05:30:03.553 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_acpi.ko 2023-07-24T05:30:03.553 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 30553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_ali.ko 2023-07-24T05:30:03.553 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_amd.ko 2023-07-24T05:30:03.553 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_artop.ko 2023-07-24T05:30:03.553 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_atiixp.ko 2023-07-24T05:30:03.553 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_atp867x.ko 2023-07-24T05:30:03.553 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_cmd640.ko 2023-07-24T05:30:03.554 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_cmd64x.ko 2023-07-24T05:30:03.554 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_cypress.ko 2023-07-24T05:30:03.554 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_efar.ko 2023-07-24T05:30:03.554 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_hpt366.ko 2023-07-24T05:30:03.554 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 34033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_hpt37x.ko 2023-07-24T05:30:03.554 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_hpt3x2n.ko 2023-07-24T05:30:03.554 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_hpt3x3.ko 2023-07-24T05:30:03.554 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_it8213.ko 2023-07-24T05:30:03.555 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 35177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_it821x.ko 2023-07-24T05:30:03.555 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_jmicron.ko 2023-07-24T05:30:03.555 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 51737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_legacy.ko 2023-07-24T05:30:03.555 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_marvell.ko 2023-07-24T05:30:03.555 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_mpiix.ko 2023-07-24T05:30:03.555 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_netcell.ko 2023-07-24T05:30:03.555 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_ninja32.ko 2023-07-24T05:30:03.555 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_ns87410.ko 2023-07-24T05:30:03.556 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_ns87415.ko 2023-07-24T05:30:03.556 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_oldpiix.ko 2023-07-24T05:30:03.556 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_opti.ko 2023-07-24T05:30:03.556 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_optidma.ko 2023-07-24T05:30:03.556 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 32521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_pcmcia.ko 2023-07-24T05:30:03.556 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 37729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_pdc2027x.ko 2023-07-24T05:30:03.556 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-07-24T05:30:03.557 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_piccolo.ko 2023-07-24T05:30:03.557 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_radisys.ko 2023-07-24T05:30:03.557 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_rdc.ko 2023-07-24T05:30:03.557 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_rz1000.ko 2023-07-24T05:30:03.557 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_sch.ko 2023-07-24T05:30:03.557 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_serverworks.ko 2023-07-24T05:30:03.557 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_sil680.ko 2023-07-24T05:30:03.557 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_sl82c105.ko 2023-07-24T05:30:03.558 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_triflex.ko 2023-07-24T05:30:03.558 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 30425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_via.ko 2023-07-24T05:30:03.558 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pdc_adma.ko 2023-07-24T05:30:03.558 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_inic162x.ko 2023-07-24T05:30:03.558 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 83225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_mv.ko 2023-07-24T05:30:03.558 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 70537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_nv.ko 2023-07-24T05:30:03.558 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 37369 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_promise.ko 2023-07-24T05:30:03.558 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_qstor.ko 2023-07-24T05:30:03.559 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_sil.ko 2023-07-24T05:30:03.559 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 38273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_sil24.ko 2023-07-24T05:30:03.559 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_sis.ko 2023-07-24T05:30:03.559 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_svw.ko 2023-07-24T05:30:03.559 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 44721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_sx4.ko 2023-07-24T05:30:03.559 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_uli.ko 2023-07-24T05:30:03.559 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 35121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_via.ko 2023-07-24T05:30:03.559 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_vsc.ko 2023-07-24T05:30:03.560 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/auxdisplay/ 2023-07-24T05:30:03.560 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/auxdisplay/ks0108.ko 2023-07-24T05:30:03.560 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/bcma/ 2023-07-24T05:30:03.560 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 124457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/bcma/bcma.ko 2023-07-24T05:30:03.560 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/ 2023-07-24T05:30:03.560 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/aoe/ 2023-07-24T05:30:03.560 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 113705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/aoe/aoe.ko 2023-07-24T05:30:03.560 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/drbd/ 2023-07-24T05:30:03.561 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 968433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/drbd/drbd.ko 2023-07-24T05:30:03.589 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 173201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/floppy.ko 2023-07-24T05:30:03.589 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/mtip32xx/ 2023-07-24T05:30:03.589 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 94297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-07-24T05:30:03.589 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 115345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/nbd.ko 2023-07-24T05:30:03.589 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/null_blk/ 2023-07-24T05:30:03.589 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 110361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/null_blk/null_blk.ko 2023-07-24T05:30:03.590 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 98225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/pktcdvd.ko 2023-07-24T05:30:03.590 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 257529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/rbd.ko 2023-07-24T05:30:03.590 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/xen-blkback/ 2023-07-24T05:30:03.590 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 98129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-07-24T05:30:03.590 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/zram/ 2023-07-24T05:30:03.590 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 60201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/zram/zram.ko 2023-07-24T05:30:03.590 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ 2023-07-24T05:30:03.590 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 30849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/applicom.ko 2023-07-24T05:30:03.591 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hangcheck-timer.ko 2023-07-24T05:30:03.591 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/ 2023-07-24T05:30:03.591 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/amd-rng.ko 2023-07-24T05:30:03.591 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/intel-rng.ko 2023-07-24T05:30:03.591 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-07-24T05:30:03.591 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/via-rng.ko 2023-07-24T05:30:03.591 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15633 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/virtio-rng.ko 2023-07-24T05:30:03.592 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ 2023-07-24T05:30:03.592 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 30857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-07-24T05:30:03.592 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 150665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-07-24T05:30:03.592 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-07-24T05:30:03.592 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 139057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_si.ko 2023-07-24T05:30:03.592 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 70833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-07-24T05:30:03.592 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 53609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-07-24T05:30:03.592 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 36321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/lp.ko 2023-07-24T05:30:03.593 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/mwave/ 2023-07-24T05:30:03.593 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 84121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/mwave/mwave.ko 2023-07-24T05:30:03.593 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/nvram.ko 2023-07-24T05:30:03.593 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 32169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ppdev.ko 2023-07-24T05:30:03.593 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 51113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tlclk.ko 2023-07-24T05:30:03.593 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/ 2023-07-24T05:30:03.593 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_atmel.ko 2023-07-24T05:30:03.593 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-07-24T05:30:03.594 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-07-24T05:30:03.594 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 32985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-07-24T05:30:03.594 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 30121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_infineon.ko 2023-07-24T05:30:03.594 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_nsc.ko 2023-07-24T05:30:03.594 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-07-24T05:30:03.594 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/xillybus/ 2023-07-24T05:30:03.594 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/xillybus/xillybus_class.ko 2023-07-24T05:30:03.595 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 50945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/xillybus/xillybus_core.ko 2023-07-24T05:30:03.595 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-07-24T05:30:03.595 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/clk/ 2023-07-24T05:30:03.595 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/clk/clk-palmas.ko 2023-07-24T05:30:03.595 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 47849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/clk/clk-si5351.ko 2023-07-24T05:30:03.595 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/clk/clk-twl6040.ko 2023-07-24T05:30:03.595 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/clk/clk-wm831x.ko 2023-07-24T05:30:03.595 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/ 2023-07-24T05:30:03.596 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-07-24T05:30:03.596 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/p4-clockmod.ko 2023-07-24T05:30:03.596 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/speedstep-lib.ko 2023-07-24T05:30:03.596 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/ 2023-07-24T05:30:03.596 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/ccp/ 2023-07-24T05:30:03.596 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 70785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-07-24T05:30:03.596 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 234473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/ccp/ccp.ko 2023-07-24T05:30:03.596 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/ 2023-07-24T05:30:03.597 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/ 2023-07-24T05:30:03.597 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/qat_common/ 2023-07-24T05:30:03.597 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 408489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-07-24T05:30:03.597 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-07-24T05:30:03.597 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-07-24T05:30:03.597 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/padlock-aes.ko 2023-07-24T05:30:03.597 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/padlock-sha.ko 2023-07-24T05:30:03.597 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/virtio/ 2023-07-24T05:30:03.598 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 68937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-07-24T05:30:03.598 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dca/ 2023-07-24T05:30:03.598 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dca/dca.ko 2023-07-24T05:30:03.598 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/ 2023-07-24T05:30:03.598 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/dw/ 2023-07-24T05:30:03.598 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/dw/dw_dmac.ko 2023-07-24T05:30:03.598 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/ioat/ 2023-07-24T05:30:03.599 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 122641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/ioat/ioatdma.ko 2023-07-24T05:30:03.599 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/ 2023-07-24T05:30:03.599 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 80273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/amd64_edac.ko 2023-07-24T05:30:03.599 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 35769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/e752x_edac.ko 2023-07-24T05:30:03.599 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 63617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/edac_mce_amd.ko 2023-07-24T05:30:03.599 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i3000_edac.ko 2023-07-24T05:30:03.599 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i3200_edac.ko 2023-07-24T05:30:03.599 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i5100_edac.ko 2023-07-24T05:30:03.600 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i5400_edac.ko 2023-07-24T05:30:03.600 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i7300_edac.ko 2023-07-24T05:30:03.600 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 52025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i7core_edac.ko 2023-07-24T05:30:03.600 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i82975x_edac.ko 2023-07-24T05:30:03.600 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/ie31200_edac.ko 2023-07-24T05:30:03.600 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 56809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/sb_edac.ko 2023-07-24T05:30:03.600 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/x38_edac.ko 2023-07-24T05:30:03.600 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/ 2023-07-24T05:30:03.601 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-gpio.ko 2023-07-24T05:30:03.601 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-max14577.ko 2023-07-24T05:30:03.601 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-max77693.ko 2023-07-24T05:30:03.601 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-max8997.ko 2023-07-24T05:30:03.601 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-palmas.ko 2023-07-24T05:30:03.601 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-rt8973a.ko 2023-07-24T05:30:03.601 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/extcon/extcon-sm5502.ko 2023-07-24T05:30:03.601 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/ 2023-07-24T05:30:03.602 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 34953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/dmi-sysfs.ko 2023-07-24T05:30:03.602 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/efi/ 2023-07-24T05:30:03.602 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/efi/efi-pstore.ko 2023-07-24T05:30:03.602 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/iscsi_ibft.ko 2023-07-24T05:30:03.602 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/ 2023-07-24T05:30:03.602 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-adp5520.ko 2023-07-24T05:30:03.602 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-amd8111.ko 2023-07-24T05:30:03.603 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-arizona.ko 2023-07-24T05:30:03.603 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-da9052.ko 2023-07-24T05:30:03.603 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-da9055.ko 2023-07-24T05:30:03.603 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-dln2.ko 2023-07-24T05:30:03.603 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 77849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-f7188x.ko 2023-07-24T05:30:03.603 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-generic.ko 2023-07-24T05:30:03.603 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-ich.ko 2023-07-24T05:30:03.603 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-07-24T05:30:03.604 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-kempld.ko 2023-07-24T05:30:03.604 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-lp3943.ko 2023-07-24T05:30:03.604 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-max7300.ko 2023-07-24T05:30:03.604 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-max730x.ko 2023-07-24T05:30:03.604 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-max732x.ko 2023-07-24T05:30:03.604 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-07-24T05:30:03.604 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 46761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-pca953x.ko 2023-07-24T05:30:03.604 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-pcf857x.ko 2023-07-24T05:30:03.605 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-rdc321x.ko 2023-07-24T05:30:03.605 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-sch.ko 2023-07-24T05:30:03.605 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-sch311x.ko 2023-07-24T05:30:03.605 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-tps65912.ko 2023-07-24T05:30:03.605 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-twl4030.ko 2023-07-24T05:30:03.605 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-twl6040.ko 2023-07-24T05:30:03.605 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-viperboard.ko 2023-07-24T05:30:03.605 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-vx855.ko 2023-07-24T05:30:03.606 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-wm831x.ko 2023-07-24T05:30:03.606 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-wm8350.ko 2023-07-24T05:30:03.606 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-wm8994.ko 2023-07-24T05:30:03.606 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/ 2023-07-24T05:30:03.606 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-a4tech.ko 2023-07-24T05:30:03.606 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 39081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-apple.ko 2023-07-24T05:30:03.606 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-appleir.ko 2023-07-24T05:30:03.606 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-aureal.ko 2023-07-24T05:30:03.607 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-axff.ko 2023-07-24T05:30:03.607 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-belkin.ko 2023-07-24T05:30:03.607 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-cherry.ko 2023-07-24T05:30:03.607 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-chicony.ko 2023-07-24T05:30:03.607 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 59145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-cp2112.ko 2023-07-24T05:30:03.607 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-cypress.ko 2023-07-24T05:30:03.607 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-dr.ko 2023-07-24T05:30:03.608 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-elecom.ko 2023-07-24T05:30:03.608 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-elo.ko 2023-07-24T05:30:03.608 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-emsff.ko 2023-07-24T05:30:03.608 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-ezkey.ko 2023-07-24T05:30:03.608 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-gaff.ko 2023-07-24T05:30:03.608 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-generic.ko 2023-07-24T05:30:03.608 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-gt683r.ko 2023-07-24T05:30:03.608 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-gyration.ko 2023-07-24T05:30:03.609 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-holtek-kbd.ko 2023-07-24T05:30:03.609 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-holtek-mouse.ko 2023-07-24T05:30:03.609 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-holtekff.ko 2023-07-24T05:30:03.609 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-hyperv.ko 2023-07-24T05:30:03.609 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-icade.ko 2023-07-24T05:30:03.609 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-kensington.ko 2023-07-24T05:30:03.609 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-keytouch.ko 2023-07-24T05:30:03.609 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-kye.ko 2023-07-24T05:30:03.610 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-lcpower.ko 2023-07-24T05:30:03.610 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-led.ko 2023-07-24T05:30:03.610 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 42297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-lenovo.ko 2023-07-24T05:30:03.610 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 30761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-lg-g15.ko 2023-07-24T05:30:03.610 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 57809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-logitech-dj.ko 2023-07-24T05:30:03.610 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 100897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-07-24T05:30:03.610 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 80993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-logitech.ko 2023-07-24T05:30:03.610 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 30801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-magicmouse.ko 2023-07-24T05:30:03.611 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-microsoft.ko 2023-07-24T05:30:03.611 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-monterey.ko 2023-07-24T05:30:03.611 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 50153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-multitouch.ko 2023-07-24T05:30:03.611 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 32593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-ntrig.ko 2023-07-24T05:30:03.611 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-ortek.ko 2023-07-24T05:30:03.611 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-penmount.ko 2023-07-24T05:30:03.611 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-petalynx.ko 2023-07-24T05:30:03.611 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 72937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-picolcd.ko 2023-07-24T05:30:03.612 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-pl.ko 2023-07-24T05:30:03.612 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-plantronics.ko 2023-07-24T05:30:03.612 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-primax.ko 2023-07-24T05:30:03.612 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 35457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-rmi.ko 2023-07-24T05:30:03.612 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-arvo.ko 2023-07-24T05:30:03.612 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-common.ko 2023-07-24T05:30:03.612 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 31361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-isku.ko 2023-07-24T05:30:03.612 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-kone.ko 2023-07-24T05:30:03.613 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 31065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-07-24T05:30:03.613 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-konepure.ko 2023-07-24T05:30:03.613 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-07-24T05:30:03.613 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-lua.ko 2023-07-24T05:30:03.613 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-pyra.ko 2023-07-24T05:30:03.613 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-ryos.ko 2023-07-24T05:30:03.613 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-savu.ko 2023-07-24T05:30:03.614 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat.ko 2023-07-24T05:30:03.614 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-saitek.ko 2023-07-24T05:30:03.614 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-samsung.ko 2023-07-24T05:30:03.614 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 36801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-sensor-hub.ko 2023-07-24T05:30:03.614 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-sjoy.ko 2023-07-24T05:30:03.614 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 51201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-sony.ko 2023-07-24T05:30:03.614 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-speedlink.ko 2023-07-24T05:30:03.614 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-steelseries.ko 2023-07-24T05:30:03.615 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-sunplus.ko 2023-07-24T05:30:03.615 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-thrustmaster.ko 2023-07-24T05:30:03.615 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-tivo.ko 2023-07-24T05:30:03.615 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-tmff.ko 2023-07-24T05:30:03.615 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-topseed.ko 2023-07-24T05:30:03.615 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-twinhan.ko 2023-07-24T05:30:03.615 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 71457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-uclogic.ko 2023-07-24T05:30:03.615 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-waltop.ko 2023-07-24T05:30:03.616 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 143585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-wiimote.ko 2023-07-24T05:30:03.616 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-xinmo.ko 2023-07-24T05:30:03.616 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-zpff.ko 2023-07-24T05:30:03.616 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-zydacron.ko 2023-07-24T05:30:03.616 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 267713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid.ko 2023-07-24T05:30:03.616 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 32321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/uhid.ko 2023-07-24T05:30:03.616 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/usbhid/ 2023-07-24T05:30:03.616 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 125721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/usbhid/usbhid.ko 2023-07-24T05:30:03.617 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/usbhid/usbkbd.ko 2023-07-24T05:30:03.617 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/usbhid/usbmouse.ko 2023-07-24T05:30:03.617 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 217401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/wacom.ko 2023-07-24T05:30:03.617 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hv/ 2023-07-24T05:30:03.617 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 63497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hv/hv_balloon.ko 2023-07-24T05:30:03.617 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 89609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hv/hv_utils.ko 2023-07-24T05:30:03.617 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 301449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hv/hv_vmbus.ko 2023-07-24T05:30:03.617 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ 2023-07-24T05:30:03.618 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 66593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/abituguru.ko 2023-07-24T05:30:03.618 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 61393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/abituguru3.ko 2023-07-24T05:30:03.618 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 34745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/acpi_power_meter.ko 2023-07-24T05:30:03.618 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ad7414.ko 2023-07-24T05:30:03.618 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ad7418.ko 2023-07-24T05:30:03.618 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adc128d818.ko 2023-07-24T05:30:03.618 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 31729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm1025.ko 2023-07-24T05:30:03.619 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 97977 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm1026.ko 2023-07-24T05:30:03.619 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm1029.ko 2023-07-24T05:30:03.619 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 45553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm1031.ko 2023-07-24T05:30:03.619 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm9240.ko 2023-07-24T05:30:03.619 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ads7828.ko 2023-07-24T05:30:03.619 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7410.ko 2023-07-24T05:30:03.619 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7411.ko 2023-07-24T05:30:03.619 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 74433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7462.ko 2023-07-24T05:30:03.620 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 39585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7470.ko 2023-07-24T05:30:03.620 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 67929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7475.ko 2023-07-24T05:30:03.620 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7x10.ko 2023-07-24T05:30:03.620 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 39073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/amc6821.ko 2023-07-24T05:30:03.620 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 55265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/applesmc.ko 2023-07-24T05:30:03.620 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 49913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/asb100.ko 2023-07-24T05:30:03.620 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 58617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/asc7621.ko 2023-07-24T05:30:03.620 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 40881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/asus_atk0110.ko 2023-07-24T05:30:03.621 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/atxp1.ko 2023-07-24T05:30:03.621 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/coretemp.ko 2023-07-24T05:30:03.621 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/da9052-hwmon.ko 2023-07-24T05:30:03.621 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/da9055-hwmon.ko 2023-07-24T05:30:03.621 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 44465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-07-24T05:30:03.621 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 99601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/dme1737.ko 2023-07-24T05:30:03.621 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ds1621.ko 2023-07-24T05:30:03.621 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ds620.ko 2023-07-24T05:30:03.622 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/emc1403.ko 2023-07-24T05:30:03.622 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/emc2103.ko 2023-07-24T05:30:03.622 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 30321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/emc6w201.ko 2023-07-24T05:30:03.622 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 66985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/f71805f.ko 2023-07-24T05:30:03.622 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 94457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/f71882fg.ko 2023-07-24T05:30:03.622 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 41401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/f75375s.ko 2023-07-24T05:30:03.622 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/fam15h_power.ko 2023-07-24T05:30:03.622 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 55433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/fschmd.ko 2023-07-24T05:30:03.623 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/g760a.ko 2023-07-24T05:30:03.623 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/g762.ko 2023-07-24T05:30:03.623 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 46801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/gl518sm.ko 2023-07-24T05:30:03.623 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 45529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/gl520sm.ko 2023-07-24T05:30:03.623 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/hih6130.ko 2023-07-24T05:30:03.623 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/hwmon-vid.ko 2023-07-24T05:30:03.623 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/i5500_temp.ko 2023-07-24T05:30:03.623 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/i5k_amb.ko 2023-07-24T05:30:03.624 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 34505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ibmaem.ko 2023-07-24T05:30:03.624 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ibmpex.ko 2023-07-24T05:30:03.624 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ina209.ko 2023-07-24T05:30:03.624 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ina2xx.ko 2023-07-24T05:30:03.624 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 129217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/it87.ko 2023-07-24T05:30:03.624 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/jc42.ko 2023-07-24T05:30:03.624 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/k10temp.ko 2023-07-24T05:30:03.625 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/k8temp.ko 2023-07-24T05:30:03.625 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lineage-pem.ko 2023-07-24T05:30:03.625 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 48601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm63.ko 2023-07-24T05:30:03.625 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm73.ko 2023-07-24T05:30:03.625 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 36777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm75.ko 2023-07-24T05:30:03.625 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm77.ko 2023-07-24T05:30:03.625 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 34657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm78.ko 2023-07-24T05:30:03.625 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 31745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm80.ko 2023-07-24T05:30:03.626 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm83.ko 2023-07-24T05:30:03.626 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 72833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm85.ko 2023-07-24T05:30:03.626 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 46153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm87.ko 2023-07-24T05:30:03.626 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 37913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm90.ko 2023-07-24T05:30:03.626 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm92.ko 2023-07-24T05:30:03.626 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 108841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm93.ko 2023-07-24T05:30:03.626 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm95234.ko 2023-07-24T05:30:03.626 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm95241.ko 2023-07-24T05:30:03.627 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm95245.ko 2023-07-24T05:30:03.627 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc2945.ko 2023-07-24T05:30:03.627 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4151.ko 2023-07-24T05:30:03.627 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4215.ko 2023-07-24T05:30:03.627 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4222.ko 2023-07-24T05:30:03.627 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4245.ko 2023-07-24T05:30:03.627 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4260.ko 2023-07-24T05:30:03.627 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4261.ko 2023-07-24T05:30:03.628 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max16065.ko 2023-07-24T05:30:03.628 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max1619.ko 2023-07-24T05:30:03.628 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max1668.ko 2023-07-24T05:30:03.628 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max197.ko 2023-07-24T05:30:03.628 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max6639.ko 2023-07-24T05:30:03.628 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max6650.ko 2023-07-24T05:30:03.628 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 35777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max6697.ko 2023-07-24T05:30:03.628 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/mc13783-adc.ko 2023-07-24T05:30:03.629 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/mcp3021.ko 2023-07-24T05:30:03.629 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-07-24T05:30:03.629 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 44129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/nct6683.ko 2023-07-24T05:30:03.629 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 116737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/nct6775-core.ko 2023-07-24T05:30:03.629 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 60705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/nct6775.ko 2023-07-24T05:30:03.629 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 59737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/nct7802.ko 2023-07-24T05:30:03.629 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 82337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pc87360.ko 2023-07-24T05:30:03.629 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 54433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pc87427.ko 2023-07-24T05:30:03.630 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pcf8591.ko 2023-07-24T05:30:03.630 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/ 2023-07-24T05:30:03.630 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-07-24T05:30:03.630 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-07-24T05:30:03.630 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-07-24T05:30:03.630 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/max16064.ko 2023-07-24T05:30:03.630 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/max34440.ko 2023-07-24T05:30:03.630 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/max8688.ko 2023-07-24T05:30:03.631 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-07-24T05:30:03.631 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 81841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-07-24T05:30:03.631 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-07-24T05:30:03.631 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 30729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-07-24T05:30:03.631 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-07-24T05:30:03.631 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-07-24T05:30:03.631 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/powr1220.ko 2023-07-24T05:30:03.631 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sch5627.ko 2023-07-24T05:30:03.632 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sch5636.ko 2023-07-24T05:30:03.632 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sch56xx-common.ko 2023-07-24T05:30:03.632 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 32137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sht15.ko 2023-07-24T05:30:03.632 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sht21.ko 2023-07-24T05:30:03.632 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/shtc1.ko 2023-07-24T05:30:03.632 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 40105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sis5595.ko 2023-07-24T05:30:03.632 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 31929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/smm665.ko 2023-07-24T05:30:03.633 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/smsc47b397.ko 2023-07-24T05:30:03.633 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 39193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/smsc47m1.ko 2023-07-24T05:30:03.633 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 37385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/smsc47m192.ko 2023-07-24T05:30:03.633 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/thmc50.ko 2023-07-24T05:30:03.633 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/tmp102.ko 2023-07-24T05:30:03.633 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/tmp103.ko 2023-07-24T05:30:03.633 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/tmp401.ko 2023-07-24T05:30:03.633 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/tmp421.ko 2023-07-24T05:30:03.634 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/via-cputemp.ko 2023-07-24T05:30:03.634 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 41945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/via686a.ko 2023-07-24T05:30:03.634 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 52457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/vt1211.ko 2023-07-24T05:30:03.634 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 51545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/vt8231.ko 2023-07-24T05:30:03.634 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 57513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83627ehf.ko 2023-07-24T05:30:03.634 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 78873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83627hf.ko 2023-07-24T05:30:03.634 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 71345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83781d.ko 2023-07-24T05:30:03.634 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 63289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83791d.ko 2023-07-24T05:30:03.635 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 71321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83792d.ko 2023-07-24T05:30:03.635 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 101457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83793.ko 2023-07-24T05:30:03.635 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 119505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83795.ko 2023-07-24T05:30:03.635 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83l785ts.ko 2023-07-24T05:30:03.635 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 35625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83l786ng.ko 2023-07-24T05:30:03.635 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-07-24T05:30:03.635 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-07-24T05:30:03.635 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/ 2023-07-24T05:30:03.636 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/algos/ 2023-07-24T05:30:03.636 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-07-24T05:30:03.636 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-07-24T05:30:03.636 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/ 2023-07-24T05:30:03.636 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-07-24T05:30:03.636 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-07-24T05:30:03.636 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-07-24T05:30:03.636 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-07-24T05:30:03.637 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-07-24T05:30:03.637 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-07-24T05:30:03.637 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-07-24T05:30:03.637 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 6929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-07-24T05:30:03.637 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-07-24T05:30:03.637 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 48553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-07-24T05:30:03.637 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-07-24T05:30:03.637 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-07-24T05:30:03.638 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-07-24T05:30:03.638 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-07-24T05:30:03.638 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-07-24T05:30:03.638 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 62729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-i801.ko 2023-07-24T05:30:03.638 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-isch.ko 2023-07-24T05:30:03.638 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 47889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-07-24T05:30:03.638 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17369 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-07-24T05:30:03.639 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-07-24T05:30:03.639 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-07-24T05:30:03.639 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-07-24T05:30:03.639 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-parport.ko 2023-07-24T05:30:03.639 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-07-24T05:30:03.639 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 47241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-07-24T05:30:03.639 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-07-24T05:30:03.639 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-07-24T05:30:03.640 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-07-24T05:30:03.640 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-07-24T05:30:03.640 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-07-24T05:30:03.640 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-07-24T05:30:03.640 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-07-24T05:30:03.640 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-07-24T05:30:03.640 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-via.ko 2023-07-24T05:30:03.640 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-07-24T05:30:03.641 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-07-24T05:30:03.641 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 47593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-07-24T05:30:03.641 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/i2c-mux.ko 2023-07-24T05:30:03.641 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/i2c-smbus.ko 2023-07-24T05:30:03.641 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/i2c-stub.ko 2023-07-24T05:30:03.641 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/muxes/ 2023-07-24T05:30:03.641 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-07-24T05:30:03.641 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-07-24T05:30:03.642 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-07-24T05:30:03.642 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ 2023-07-24T05:30:03.642 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ 2023-07-24T05:30:03.642 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 273641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ib_cm.ko 2023-07-24T05:30:03.642 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 876913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ib_core.ko 2023-07-24T05:30:03.642 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 69321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ib_umad.ko 2023-07-24T05:30:03.642 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 324145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-07-24T05:30:03.642 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 97961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/iw_cm.ko 2023-07-24T05:30:03.643 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 279321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/rdma_cm.ko 2023-07-24T05:30:03.643 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 66177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-07-24T05:30:03.643 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/ 2023-07-24T05:30:03.643 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/cxgb4/ 2023-07-24T05:30:03.643 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 492561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-07-24T05:30:03.643 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mlx4/ 2023-07-24T05:30:03.643 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 419217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-07-24T05:30:03.643 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mlx5/ 2023-07-24T05:30:03.644 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 739705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-07-24T05:30:03.644 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mthca/ 2023-07-24T05:30:03.644 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 296649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-07-24T05:30:03.644 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/ocrdma/ 2023-07-24T05:30:03.644 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 153681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-07-24T05:30:03.644 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/usnic/ 2023-07-24T05:30:03.644 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 169017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-07-24T05:30:03.645 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/ 2023-07-24T05:30:03.645 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/ipoib/ 2023-07-24T05:30:03.645 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 263177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-07-24T05:30:03.645 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/iser/ 2023-07-24T05:30:03.645 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 100225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-07-24T05:30:03.645 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/isert/ 2023-07-24T05:30:03.645 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 111993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-07-24T05:30:03.645 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/srp/ 2023-07-24T05:30:03.646 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 129081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-07-24T05:30:03.646 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/srpt/ 2023-07-24T05:30:03.646 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 129553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-07-24T05:30:03.646 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/ 2023-07-24T05:30:03.646 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/evbug.ko 2023-07-24T05:30:03.646 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/ff-memless.ko 2023-07-24T05:30:03.646 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/ 2023-07-24T05:30:03.646 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-07-24T05:30:03.647 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/fm801-gp.ko 2023-07-24T05:30:03.647 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 41217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/gameport.ko 2023-07-24T05:30:03.647 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/lightning.ko 2023-07-24T05:30:03.647 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/ns558.ko 2023-07-24T05:30:03.647 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 41825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/joydev.ko 2023-07-24T05:30:03.647 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/ 2023-07-24T05:30:03.647 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-07-24T05:30:03.647 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 30441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-07-24T05:30:03.648 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-07-24T05:30:03.648 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-07-24T05:30:03.648 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 36649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/gpio_keys.ko 2023-07-24T05:30:03.648 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-07-24T05:30:03.648 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/lkkbd.ko 2023-07-24T05:30:03.648 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/lm8323.ko 2023-07-24T05:30:03.648 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/lm8333.ko 2023-07-24T05:30:03.649 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-07-24T05:30:03.649 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-07-24T05:30:03.649 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-07-24T05:30:03.649 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-07-24T05:30:03.649 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/newtonkbd.ko 2023-07-24T05:30:03.649 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-07-24T05:30:03.649 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/qt1070.ko 2023-07-24T05:30:03.649 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/qt2160.ko 2023-07-24T05:30:03.650 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-07-24T05:30:03.650 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/stowaway.ko 2023-07-24T05:30:03.650 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/sunkbd.ko 2023-07-24T05:30:03.650 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-07-24T05:30:03.650 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-07-24T05:30:03.650 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-07-24T05:30:03.650 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/xtkbd.ko 2023-07-24T05:30:03.650 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/matrix-keymap.ko 2023-07-24T05:30:03.651 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/ 2023-07-24T05:30:03.651 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 34329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/appletouch.ko 2023-07-24T05:30:03.651 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 34177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/bcm5974.ko 2023-07-24T05:30:03.651 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 123681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/cyapatp.ko 2023-07-24T05:30:03.651 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 89449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/elan_i2c.ko 2023-07-24T05:30:03.651 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/gpio_mouse.ko 2023-07-24T05:30:03.651 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 335849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/psmouse.ko 2023-07-24T05:30:03.651 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/sermouse.ko 2023-07-24T05:30:03.652 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-07-24T05:30:03.652 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/synaptics_usb.ko 2023-07-24T05:30:03.652 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/vsxxxaa.ko 2023-07-24T05:30:03.652 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/rmi4/ 2023-07-24T05:30:03.652 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 109849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/rmi4/rmi_core.ko 2023-07-24T05:30:03.652 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/ 2023-07-24T05:30:03.652 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/altera_ps2.ko 2023-07-24T05:30:03.652 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/arc_ps2.ko 2023-07-24T05:30:03.653 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/ct82c710.ko 2023-07-24T05:30:03.653 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-07-24T05:30:03.653 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/parkbd.ko 2023-07-24T05:30:03.653 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/pcips2.ko 2023-07-24T05:30:03.653 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/ps2mult.ko 2023-07-24T05:30:03.653 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/serio_raw.ko 2023-07-24T05:30:03.653 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17977 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/serport.ko 2023-07-24T05:30:03.653 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/sparse-keymap.ko 2023-07-24T05:30:03.654 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/iommu/ 2023-07-24T05:30:03.654 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/iommu/amd/ 2023-07-24T05:30:03.654 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 38857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/iommu/amd/iommu_v2.ko 2023-07-24T05:30:03.654 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/ 2023-07-24T05:30:03.654 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-88pm860x.ko 2023-07-24T05:30:03.654 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-adp5520.ko 2023-07-24T05:30:03.654 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 59753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-bd2802.ko 2023-07-24T05:30:03.654 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-blinkm.ko 2023-07-24T05:30:03.655 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-da903x.ko 2023-07-24T05:30:03.655 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-da9052.ko 2023-07-24T05:30:03.655 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-gpio.ko 2023-07-24T05:30:03.655 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lm3530.ko 2023-07-24T05:30:03.655 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 30505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lm3533.ko 2023-07-24T05:30:03.655 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lm355x.ko 2023-07-24T05:30:03.655 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lm3642.ko 2023-07-24T05:30:03.655 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lp3944.ko 2023-07-24T05:30:03.656 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lp8788.ko 2023-07-24T05:30:03.656 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-max8997.ko 2023-07-24T05:30:03.656 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-mc13783.ko 2023-07-24T05:30:03.656 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-menf21bmc.ko 2023-07-24T05:30:03.656 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-pca9532.ko 2023-07-24T05:30:03.656 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-pca955x.ko 2023-07-24T05:30:03.656 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-pca963x.ko 2023-07-24T05:30:03.657 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 34433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-ss4200.ko 2023-07-24T05:30:03.657 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-tca6507.ko 2023-07-24T05:30:03.657 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-wm831x-status.ko 2023-07-24T05:30:03.657 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-wm8350.ko 2023-07-24T05:30:03.657 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ 2023-07-24T05:30:03.657 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-07-24T05:30:03.657 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-07-24T05:30:03.657 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-07-24T05:30:03.658 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-07-24T05:30:03.658 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-07-24T05:30:03.658 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-07-24T05:30:03.658 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-07-24T05:30:03.658 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-07-24T05:30:03.658 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/ 2023-07-24T05:30:03.658 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/bcache/ 2023-07-24T05:30:03.658 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 655473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/bcache/bcache.ko 2023-07-24T05:30:03.659 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 40569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-bio-prison.ko 2023-07-24T05:30:03.659 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 89601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-bufio.ko 2023-07-24T05:30:03.659 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 47465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-cache-smq.ko 2023-07-24T05:30:03.659 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 155993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-cache.ko 2023-07-24T05:30:03.659 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 107049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-crypt.ko 2023-07-24T05:30:03.659 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-delay.ko 2023-07-24T05:30:03.659 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 53897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-era.ko 2023-07-24T05:30:03.659 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-flakey.ko 2023-07-24T05:30:03.660 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 41593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-log-userspace.ko 2023-07-24T05:30:03.660 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 32721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-log.ko 2023-07-24T05:30:03.660 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 49545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-mirror.ko 2023-07-24T05:30:03.660 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 78017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-multipath.ko 2023-07-24T05:30:03.660 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-queue-length.ko 2023-07-24T05:30:03.660 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 70769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-raid.ko 2023-07-24T05:30:03.660 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 36273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-region-hash.ko 2023-07-24T05:30:03.660 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-round-robin.ko 2023-07-24T05:30:03.661 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-service-time.ko 2023-07-24T05:30:03.661 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 109593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-snapshot.ko 2023-07-24T05:30:03.661 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-switch.ko 2023-07-24T05:30:03.661 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 181585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-thin-pool.ko 2023-07-24T05:30:03.661 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 51737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-verity.ko 2023-07-24T05:30:03.661 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-zero.ko 2023-07-24T05:30:03.661 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/faulty.ko 2023-07-24T05:30:03.661 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/linear.ko 2023-07-24T05:30:03.662 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 32305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/multipath.ko 2023-07-24T05:30:03.662 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/persistent-data/ 2023-07-24T05:30:03.662 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 199937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-07-24T05:30:03.662 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 37321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/raid0.ko 2023-07-24T05:30:03.662 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 112609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/raid1.ko 2023-07-24T05:30:03.662 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 160553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/raid10.ko 2023-07-24T05:30:03.662 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 396153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/raid456.ko 2023-07-24T05:30:03.702 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/ 2023-07-24T05:30:03.702 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/ 2023-07-24T05:30:03.703 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 178113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptbase.ko 2023-07-24T05:30:03.703 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 63385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptctl.ko 2023-07-24T05:30:03.703 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 44649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptfc.ko 2023-07-24T05:30:03.703 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 37161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptlan.ko 2023-07-24T05:30:03.703 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 123305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptsas.ko 2023-07-24T05:30:03.703 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 79017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptscsih.ko 2023-07-24T05:30:03.703 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 53081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptspi.ko 2023-07-24T05:30:03.703 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/ 2023-07-24T05:30:03.704 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/88pm800.ko 2023-07-24T05:30:03.704 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/88pm805.ko 2023-07-24T05:30:03.704 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/88pm80x.ko 2023-07-24T05:30:03.704 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/arizona-i2c.ko 2023-07-24T05:30:03.704 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 123721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/arizona.ko 2023-07-24T05:30:03.704 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/bcm590xx.ko 2023-07-24T05:30:03.704 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/cros_ec_dev.ko 2023-07-24T05:30:03.705 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 34993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/dln2.ko 2023-07-24T05:30:03.705 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/janz-cmodio.ko 2023-07-24T05:30:03.705 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 53585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/kempld-core.ko 2023-07-24T05:30:03.705 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lm3533-core.ko 2023-07-24T05:30:03.705 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-07-24T05:30:03.705 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lp3943.ko 2023-07-24T05:30:03.705 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 54569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lpc_ich.ko 2023-07-24T05:30:03.705 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lpc_sch.ko 2023-07-24T05:30:03.706 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/max8907.ko 2023-07-24T05:30:03.706 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/mc13xxx-core.ko 2023-07-24T05:30:03.706 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-07-24T05:30:03.706 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/menf21bmc.ko 2023-07-24T05:30:03.706 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/pcf50633-adc.ko 2023-07-24T05:30:03.706 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/pcf50633-gpio.ko 2023-07-24T05:30:03.706 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 34873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/pcf50633.ko 2023-07-24T05:30:03.706 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-07-24T05:30:03.707 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/retu-mfd.ko 2023-07-24T05:30:03.707 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 80425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/si476x-core.ko 2023-07-24T05:30:03.707 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 48441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/sm501.ko 2023-07-24T05:30:03.707 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-07-24T05:30:03.707 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 51137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/tps65010.ko 2023-07-24T05:30:03.707 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/tps6507x.ko 2023-07-24T05:30:03.707 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/viperboard.ko 2023-07-24T05:30:03.707 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/vx855.ko 2023-07-24T05:30:03.708 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/wl1273-core.ko 2023-07-24T05:30:03.708 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 44345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/wm8994.ko 2023-07-24T05:30:03.708 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ 2023-07-24T05:30:03.708 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-07-24T05:30:03.708 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 48489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ad525x_dpot.ko 2023-07-24T05:30:03.708 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/altera-stapl/ 2023-07-24T05:30:03.708 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 46585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-07-24T05:30:03.708 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/apds9802als.ko 2023-07-24T05:30:03.709 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 36729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/apds990x.ko 2023-07-24T05:30:03.709 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 45593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/bh1770glc.ko 2023-07-24T05:30:03.709 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/c2port/ 2023-07-24T05:30:03.709 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-07-24T05:30:03.709 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 35305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/c2port/core.ko 2023-07-24T05:30:03.709 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/cb710/ 2023-07-24T05:30:03.709 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/cb710/cb710.ko 2023-07-24T05:30:03.710 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ds1682.ko 2023-07-24T05:30:03.710 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/dummy-irq.ko 2023-07-24T05:30:03.710 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/echo/ 2023-07-24T05:30:03.710 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/echo/echo.ko 2023-07-24T05:30:03.710 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/ 2023-07-24T05:30:03.710 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 37849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/at24.ko 2023-07-24T05:30:03.710 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/eeprom.ko 2023-07-24T05:30:03.710 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-07-24T05:30:03.711 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/max6875.ko 2023-07-24T05:30:03.711 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 32993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/enclosure.ko 2023-07-24T05:30:03.711 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/genwqe/ 2023-07-24T05:30:03.711 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 152137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-07-24T05:30:03.711 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/hmc6352.ko 2023-07-24T05:30:03.711 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 31193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/hpilo.ko 2023-07-24T05:30:03.711 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ibmasm/ 2023-07-24T05:30:03.711 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 72601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-07-24T05:30:03.712 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ics932s401.ko 2023-07-24T05:30:03.712 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/isl29003.ko 2023-07-24T05:30:03.712 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/isl29020.ko 2023-07-24T05:30:03.712 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/lis3lv02d/ 2023-07-24T05:30:03.712 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 42585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-07-24T05:30:03.712 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-07-24T05:30:03.712 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/mei/ 2023-07-24T05:30:03.712 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 125209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/mei/mei-me.ko 2023-07-24T05:30:03.713 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 56521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/mei/mei-txe.ko 2023-07-24T05:30:03.713 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 309857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/mei/mei.ko 2023-07-24T05:30:03.713 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 31329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/phantom.ko 2023-07-24T05:30:03.713 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ti-st/ 2023-07-24T05:30:03.713 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 74905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/ti-st/st_drv.ko 2023-07-24T05:30:03.713 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/tifm_7xx1.ko 2023-07-24T05:30:03.713 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/tifm_core.ko 2023-07-24T05:30:03.713 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/tsl2550.ko 2023-07-24T05:30:03.714 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 48673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/vmw_balloon.ko 2023-07-24T05:30:03.714 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/vmw_vmci/ 2023-07-24T05:30:03.714 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 183857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-07-24T05:30:03.714 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ 2023-07-24T05:30:03.714 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/bonding/ 2023-07-24T05:30:03.714 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 487801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/bonding/bonding.ko 2023-07-24T05:30:03.714 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/ 2023-07-24T05:30:03.715 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/b53/ 2023-07-24T05:30:03.715 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 106009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/b53/b53_common.ko 2023-07-24T05:30:03.715 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 40281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/bcm-sf2.ko 2023-07-24T05:30:03.715 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/mv88e6060.ko 2023-07-24T05:30:03.715 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/mv88e6xxx/ 2023-07-24T05:30:03.715 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 452481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-07-24T05:30:03.715 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dummy.ko 2023-07-24T05:30:03.715 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/eql.ko 2023-07-24T05:30:03.716 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ 2023-07-24T05:30:03.716 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/ 2023-07-24T05:30:03.716 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 45785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-07-24T05:30:03.716 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 42105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-07-24T05:30:03.716 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 130489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-07-24T05:30:03.716 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 68785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-07-24T05:30:03.716 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/ 2023-07-24T05:30:03.716 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 37649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/8390.ko 2023-07-24T05:30:03.717 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 59689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-07-24T05:30:03.717 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-07-24T05:30:03.717 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 99113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-07-24T05:30:03.717 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/adaptec/ 2023-07-24T05:30:03.717 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 54521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-07-24T05:30:03.717 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/agere/ 2023-07-24T05:30:03.717 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 69145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/agere/et131x.ko 2023-07-24T05:30:03.717 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/alteon/ 2023-07-24T05:30:03.718 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 59521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-07-24T05:30:03.718 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/altera/ 2023-07-24T05:30:03.718 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 41393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-07-24T05:30:03.718 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/amd/ 2023-07-24T05:30:03.718 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 54545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-07-24T05:30:03.718 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 49225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-07-24T05:30:03.718 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 87345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-07-24T05:30:03.718 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/ 2023-07-24T05:30:03.719 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/alx/ 2023-07-24T05:30:03.719 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 97321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-07-24T05:30:03.719 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-07-24T05:30:03.719 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 104585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-07-24T05:30:03.719 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-07-24T05:30:03.719 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 90257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-07-24T05:30:03.719 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atlx/ 2023-07-24T05:30:03.719 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 81505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-07-24T05:30:03.720 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 69713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-07-24T05:30:03.720 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/ 2023-07-24T05:30:03.720 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 78401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-07-24T05:30:03.720 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 176881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-07-24T05:30:03.720 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-07-24T05:30:03.720 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 1422209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-07-24T05:30:03.720 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 128377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-07-24T05:30:03.721 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/genet/ 2023-07-24T05:30:03.721 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 132289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-07-24T05:30:03.721 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 312145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-07-24T05:30:03.721 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/brocade/ 2023-07-24T05:30:03.721 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/brocade/bna/ 2023-07-24T05:30:03.721 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 323601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-07-24T05:30:03.721 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/ 2023-07-24T05:30:03.721 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-07-24T05:30:03.722 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 193433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-07-24T05:30:03.722 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-07-24T05:30:03.722 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 347641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-07-24T05:30:03.722 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-07-24T05:30:03.722 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 1044145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-07-24T05:30:03.722 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-07-24T05:30:03.722 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 166113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-07-24T05:30:03.722 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-07-24T05:30:03.723 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 34881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-07-24T05:30:03.723 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/cisco/ 2023-07-24T05:30:03.723 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/cisco/enic/ 2023-07-24T05:30:03.723 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 204329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-07-24T05:30:03.723 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/ 2023-07-24T05:30:03.723 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/ 2023-07-24T05:30:03.723 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 69449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-07-24T05:30:03.723 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 61489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-07-24T05:30:03.724 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 141161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-07-24T05:30:03.724 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 51433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-07-24T05:30:03.724 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 62865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-07-24T05:30:03.724 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 31305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-07-24T05:30:03.724 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dlink/ 2023-07-24T05:30:03.724 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 60873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-07-24T05:30:03.724 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 62833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-07-24T05:30:03.724 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 45721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dnet.ko 2023-07-24T05:30:03.725 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ec_bhf.ko 2023-07-24T05:30:03.725 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/emulex/ 2023-07-24T05:30:03.725 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/emulex/benet/ 2023-07-24T05:30:03.725 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 281329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-07-24T05:30:03.725 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 49505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ethoc.ko 2023-07-24T05:30:03.725 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 51737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/fealnx.ko 2023-07-24T05:30:03.725 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/fujitsu/ 2023-07-24T05:30:03.726 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 45281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-07-24T05:30:03.726 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ 2023-07-24T05:30:03.726 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 90465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e100.ko 2023-07-24T05:30:03.726 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e1000/ 2023-07-24T05:30:03.726 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 295713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-07-24T05:30:03.726 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e1000e/ 2023-07-24T05:30:03.726 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 584249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-07-24T05:30:03.726 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/fm10k/ 2023-07-24T05:30:03.727 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 246321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-07-24T05:30:03.727 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/i40e/ 2023-07-24T05:30:03.727 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 923969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-07-24T05:30:03.727 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/iavf/ 2023-07-24T05:30:03.727 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 298097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-07-24T05:30:03.727 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/igb/ 2023-07-24T05:30:03.727 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 514889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-07-24T05:30:03.727 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/igbvf/ 2023-07-24T05:30:03.728 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 93593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-07-24T05:30:03.728 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-07-24T05:30:03.728 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 734297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-07-24T05:30:03.728 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-07-24T05:30:03.728 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 151841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-07-24T05:30:03.728 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 86921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/jme.ko 2023-07-24T05:30:03.728 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/marvell/ 2023-07-24T05:30:03.728 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20977 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-07-24T05:30:03.729 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 102385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/marvell/skge.ko 2023-07-24T05:30:03.729 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 122681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-07-24T05:30:03.729 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/ 2023-07-24T05:30:03.729 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-07-24T05:30:03.729 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 727433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-07-24T05:30:03.729 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 280513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-07-24T05:30:03.729 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-07-24T05:30:03.729 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-07-24T05:30:03.730 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 1095817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-07-24T05:30:03.730 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel/ 2023-07-24T05:30:03.730 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 53041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-07-24T05:30:03.730 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 40993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-07-24T05:30:03.730 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-07-24T05:30:03.730 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 95665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-07-24T05:30:03.730 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/myricom/ 2023-07-24T05:30:03.731 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-07-24T05:30:03.731 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 108809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-07-24T05:30:03.731 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/natsemi/ 2023-07-24T05:30:03.731 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 73377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-07-24T05:30:03.731 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 47713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-07-24T05:30:03.731 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/neterion/ 2023-07-24T05:30:03.731 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 150905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-07-24T05:30:03.731 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/nvidia/ 2023-07-24T05:30:03.732 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 136785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-07-24T05:30:03.732 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/packetengines/ 2023-07-24T05:30:03.732 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 50481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-07-24T05:30:03.732 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 43145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-07-24T05:30:03.732 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/ 2023-07-24T05:30:03.732 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-07-24T05:30:03.732 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 227113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-07-24T05:30:03.732 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 87081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-07-24T05:30:03.733 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-07-24T05:30:03.733 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 671393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-07-24T05:30:03.733 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/rdc/ 2023-07-24T05:30:03.733 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 43017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-07-24T05:30:03.733 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/ 2023-07-24T05:30:03.733 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 67385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-07-24T05:30:03.733 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 83921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-07-24T05:30:03.733 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/atp.ko 2023-07-24T05:30:03.734 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 190089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-07-24T05:30:03.734 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/samsung/ 2023-07-24T05:30:03.734 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-07-24T05:30:03.734 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 104241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-07-24T05:30:03.734 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sfc/ 2023-07-24T05:30:03.734 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 952881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-07-24T05:30:03.734 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/silan/ 2023-07-24T05:30:03.734 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 47177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-07-24T05:30:03.735 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sis/ 2023-07-24T05:30:03.735 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 54809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sis/sis190.ko 2023-07-24T05:30:03.735 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 63273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sis/sis900.ko 2023-07-24T05:30:03.735 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/ 2023-07-24T05:30:03.735 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 61537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-07-24T05:30:03.735 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 67129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-07-24T05:30:03.735 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 73345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-07-24T05:30:03.735 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 68209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-07-24T05:30:03.736 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/ 2023-07-24T05:30:03.736 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-07-24T05:30:03.736 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-07-24T05:30:03.736 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 40137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-07-24T05:30:03.736 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-07-24T05:30:03.736 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 481681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-07-24T05:30:03.736 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/ 2023-07-24T05:30:03.737 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 103321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/cassini.ko 2023-07-24T05:30:03.737 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 166121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/niu.ko 2023-07-24T05:30:03.737 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 66473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/sungem.ko 2023-07-24T05:30:03.737 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 78737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-07-24T05:30:03.737 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/tehuti/ 2023-07-24T05:30:03.737 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 49993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-07-24T05:30:03.737 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ti/ 2023-07-24T05:30:03.737 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 86465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ti/tlan.ko 2023-07-24T05:30:03.738 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/via/ 2023-07-24T05:30:03.738 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 80257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-07-24T05:30:03.738 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 83681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-07-24T05:30:03.738 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/wiznet/ 2023-07-24T05:30:03.738 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 46241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-07-24T05:30:03.738 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 30849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-07-24T05:30:03.738 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/xircom/ 2023-07-24T05:30:03.738 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 60041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-07-24T05:30:03.739 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/fddi/ 2023-07-24T05:30:03.739 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 41001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/fddi/defxx.ko 2023-07-24T05:30:03.739 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/fddi/skfp/ 2023-07-24T05:30:03.739 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 216977 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/fddi/skfp/skfp.ko 2023-07-24T05:30:03.739 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 77401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/geneve.ko 2023-07-24T05:30:03.739 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/hyperv/ 2023-07-24T05:30:03.739 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 235593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-07-24T05:30:03.739 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ieee802154/ 2023-07-24T05:30:03.740 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ieee802154/fakelb.ko 2023-07-24T05:30:03.740 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ifb.ko 2023-07-24T05:30:03.740 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ipvlan/ 2023-07-24T05:30:03.740 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 83737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ipvlan/ipvlan.ko 2023-07-24T05:30:03.740 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 62065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/macvlan.ko 2023-07-24T05:30:03.740 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/macvtap.ko 2023-07-24T05:30:03.740 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/ 2023-07-24T05:30:03.740 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-07-24T05:30:03.741 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-07-24T05:30:03.741 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/mdio-gpio.ko 2023-07-24T05:30:03.741 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/mdio-regmap.ko 2023-07-24T05:30:03.741 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio.ko 2023-07-24T05:30:03.741 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mii.ko 2023-07-24T05:30:03.741 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 41697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/netconsole.ko 2023-07-24T05:30:03.741 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/nlmon.ko 2023-07-24T05:30:03.741 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/pcs/ 2023-07-24T05:30:03.742 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/pcs/pcs-lynx.ko 2023-07-24T05:30:03.742 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 32329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-07-24T05:30:03.742 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/ 2023-07-24T05:30:03.742 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/amd.ko 2023-07-24T05:30:03.742 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 50097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-07-24T05:30:03.742 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 43273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/bcm7xxx.ko 2023-07-24T05:30:03.742 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/bcm87xx.ko 2023-07-24T05:30:03.742 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 41337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/broadcom.ko 2023-07-24T05:30:03.743 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/cicada.ko 2023-07-24T05:30:03.743 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/davicom.ko 2023-07-24T05:30:03.743 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/et1011c.ko 2023-07-24T05:30:03.743 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/icplus.ko 2023-07-24T05:30:03.743 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/lxt.ko 2023-07-24T05:30:03.743 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 78185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/marvell.ko 2023-07-24T05:30:03.743 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 75713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/micrel.ko 2023-07-24T05:30:03.743 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/national.ko 2023-07-24T05:30:03.744 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 97265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/phylink.ko 2023-07-24T05:30:03.744 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/qsemi.ko 2023-07-24T05:30:03.744 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 49553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/realtek.ko 2023-07-24T05:30:03.744 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/smsc.ko 2023-07-24T05:30:03.744 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/ste10Xp.ko 2023-07-24T05:30:03.744 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/vitesse.ko 2023-07-24T05:30:03.744 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/plip/ 2023-07-24T05:30:03.745 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 43465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/plip/plip.ko 2023-07-24T05:30:03.745 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ 2023-07-24T05:30:03.745 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/bsd_comp.ko 2023-07-24T05:30:03.745 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_async.ko 2023-07-24T05:30:03.745 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_deflate.ko 2023-07-24T05:30:03.745 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_mppe.ko 2023-07-24T05:30:03.745 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_synctty.ko 2023-07-24T05:30:03.745 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 42545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/pppoe.ko 2023-07-24T05:30:03.746 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/pppox.ko 2023-07-24T05:30:03.746 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 31969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/pptp.ko 2023-07-24T05:30:03.746 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/sb1000.ko 2023-07-24T05:30:03.746 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/slip/ 2023-07-24T05:30:03.746 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 42513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/slip/slip.ko 2023-07-24T05:30:03.746 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/sungem_phy.ko 2023-07-24T05:30:03.746 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 64889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/tap.ko 2023-07-24T05:30:03.746 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/ 2023-07-24T05:30:03.747 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 105961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team.ko 2023-07-24T05:30:03.747 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_activebackup.ko 2023-07-24T05:30:03.747 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_broadcast.ko 2023-07-24T05:30:03.747 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-07-24T05:30:03.747 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_random.ko 2023-07-24T05:30:03.747 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-07-24T05:30:03.747 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 88193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/veth.ko 2023-07-24T05:30:03.747 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/vmxnet3/ 2023-07-24T05:30:03.748 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 120497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-07-24T05:30:03.748 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/vxlan/ 2023-07-24T05:30:03.748 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 290665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/vxlan/vxlan.ko 2023-07-24T05:30:03.748 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/xen-netback/ 2023-07-24T05:30:03.748 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 143801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/xen-netback/xen-netback.ko 2023-07-24T05:30:03.748 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ntb/ 2023-07-24T05:30:03.748 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ntb/ntb.ko 2023-07-24T05:30:03.748 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/nvme/ 2023-07-24T05:30:03.749 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/nvme/host/ 2023-07-24T05:30:03.749 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 266561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/nvme/host/nvme-core.ko 2023-07-24T05:30:03.749 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 101937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/nvme/host/nvme.ko 2023-07-24T05:30:03.749 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/ 2023-07-24T05:30:03.749 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 133817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/parport.ko 2023-07-24T05:30:03.749 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/parport_cs.ko 2023-07-24T05:30:03.749 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 84337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/parport_pc.ko 2023-07-24T05:30:03.749 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/parport_serial.ko 2023-07-24T05:30:03.750 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/ 2023-07-24T05:30:03.750 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/hotplug/ 2023-07-24T05:30:03.750 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-07-24T05:30:03.750 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-07-24T05:30:03.750 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-07-24T05:30:03.750 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/pci-stub.ko 2023-07-24T05:30:03.750 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 47377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/xen-pcifront.ko 2023-07-24T05:30:03.750 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/ 2023-07-24T05:30:03.751 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/i82092.ko 2023-07-24T05:30:03.751 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 145785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/pcmcia.ko 2023-07-24T05:30:03.751 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 62081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/pcmcia_core.ko 2023-07-24T05:30:03.751 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 34345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-07-24T05:30:03.751 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 34265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/pd6729.ko 2023-07-24T05:30:03.751 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 112913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/yenta_socket.ko 2023-07-24T05:30:03.751 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/phy/ 2023-07-24T05:30:03.751 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/phy/broadcom/ 2023-07-24T05:30:03.752 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-07-24T05:30:03.752 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/phy/samsung/ 2023-07-24T05:30:03.752 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-07-24T05:30:03.752 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pinctrl/ 2023-07-24T05:30:03.752 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pinctrl/intel/ 2023-07-24T05:30:03.752 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 71521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-07-24T05:30:03.752 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/ 2023-07-24T05:30:03.752 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/ 2023-07-24T05:30:03.753 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 50889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-07-24T05:30:03.753 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_ec.ko 2023-07-24T05:30:03.753 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-07-24T05:30:03.753 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-07-24T05:30:03.753 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-07-24T05:30:03.753 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-07-24T05:30:03.753 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-07-24T05:30:03.753 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/ 2023-07-24T05:30:03.754 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 67097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/acer-wmi.ko 2023-07-24T05:30:03.754 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 39145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/acerhdf.ko 2023-07-24T05:30:03.754 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 36913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/apple-gmux.ko 2023-07-24T05:30:03.754 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 59665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/asus-laptop.ko 2023-07-24T05:30:03.754 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 30705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-07-24T05:30:03.754 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 106873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/asus-wmi.ko 2023-07-24T05:30:03.754 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 36913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/classmate-laptop.ko 2023-07-24T05:30:03.755 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 49121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-07-24T05:30:03.755 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-07-24T05:30:03.755 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 40265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-07-24T05:30:03.755 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-07-24T05:30:03.755 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 36657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/hdaps.ko 2023-07-24T05:30:03.755 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/ibm_rtl.ko 2023-07-24T05:30:03.755 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/intel/ 2023-07-24T05:30:03.755 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-07-24T05:30:03.756 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-07-24T05:30:03.756 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 43521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/intel_ips.ko 2023-07-24T05:30:03.756 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/msi-wmi.ko 2023-07-24T05:30:03.756 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/mxm-wmi.ko 2023-07-24T05:30:03.756 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 34801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-07-24T05:30:03.756 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 42329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/samsung-laptop.ko 2023-07-24T05:30:03.756 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/samsung-q10.ko 2023-07-24T05:30:03.756 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/topstar-laptop.ko 2023-07-24T05:30:03.757 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-07-24T05:30:03.757 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/toshiba_haps.ko 2023-07-24T05:30:03.757 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/wmi-bmof.ko 2023-07-24T05:30:03.757 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 57665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/wmi.ko 2023-07-24T05:30:03.757 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/ 2023-07-24T05:30:03.757 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/ 2023-07-24T05:30:03.757 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 30345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/88pm860x_battery.ko 2023-07-24T05:30:03.757 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/88pm860x_charger.ko 2023-07-24T05:30:03.758 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 55057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/bq2415x_charger.ko 2023-07-24T05:30:03.758 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 53993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/bq24190_charger.ko 2023-07-24T05:30:03.758 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/bq24735-charger.ko 2023-07-24T05:30:03.758 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-07-24T05:30:03.758 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/da9030_battery.ko 2023-07-24T05:30:03.758 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/da9052-battery.ko 2023-07-24T05:30:03.758 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/ds2760_battery.ko 2023-07-24T05:30:03.758 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/ds2780_battery.ko 2023-07-24T05:30:03.759 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/ds2781_battery.ko 2023-07-24T05:30:03.759 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/ds2782_battery.ko 2023-07-24T05:30:03.759 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/gpio-charger.ko 2023-07-24T05:30:03.759 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/isp1704_charger.ko 2023-07-24T05:30:03.759 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/lp8727_charger.ko 2023-07-24T05:30:03.759 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/max14577_charger.ko 2023-07-24T05:30:03.759 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/max17040_battery.ko 2023-07-24T05:30:03.759 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 30289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/max17042_battery.ko 2023-07-24T05:30:03.760 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/max8903_charger.ko 2023-07-24T05:30:03.760 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/max8925_power.ko 2023-07-24T05:30:03.760 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/pcf50633-charger.ko 2023-07-24T05:30:03.760 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 38009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/sbs-battery.ko 2023-07-24T05:30:03.760 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/test_power.ko 2023-07-24T05:30:03.760 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/tps65090-charger.ko 2023-07-24T05:30:03.760 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/wm831x_backup.ko 2023-07-24T05:30:03.760 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/wm831x_power.ko 2023-07-24T05:30:03.761 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/power/supply/wm8350_power.ko 2023-07-24T05:30:03.761 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/powercap/ 2023-07-24T05:30:03.761 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 57737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/powercap/intel_rapl_common.ko 2023-07-24T05:30:03.761 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/powercap/intel_rapl_msr.ko 2023-07-24T05:30:03.761 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/ 2023-07-24T05:30:03.761 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/clients/ 2023-07-24T05:30:03.761 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/clients/pps-gpio.ko 2023-07-24T05:30:03.762 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/clients/pps-ldisc.ko 2023-07-24T05:30:03.762 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/clients/pps_parport.ko 2023-07-24T05:30:03.762 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 41921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/pps_core.ko 2023-07-24T05:30:03.762 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ptp/ 2023-07-24T05:30:03.762 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 66385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ptp/ptp.ko 2023-07-24T05:30:03.762 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ptp/ptp_kvm.ko 2023-07-24T05:30:03.762 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/ 2023-07-24T05:30:03.762 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-88pm80x.ko 2023-07-24T05:30:03.763 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-88pm860x.ko 2023-07-24T05:30:03.763 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-bq32k.ko 2023-07-24T05:30:03.763 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-bq4802.ko 2023-07-24T05:30:03.763 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-da9052.ko 2023-07-24T05:30:03.763 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-da9055.ko 2023-07-24T05:30:03.763 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-da9063.ko 2023-07-24T05:30:03.763 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1286.ko 2023-07-24T05:30:03.763 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 68577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1307.ko 2023-07-24T05:30:03.764 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1374.ko 2023-07-24T05:30:03.764 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1511.ko 2023-07-24T05:30:03.764 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1553.ko 2023-07-24T05:30:03.764 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1672.ko 2023-07-24T05:30:03.764 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13369 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1742.ko 2023-07-24T05:30:03.764 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds2404.ko 2023-07-24T05:30:03.764 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds3232.ko 2023-07-24T05:30:03.764 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-em3027.ko 2023-07-24T05:30:03.765 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-fm3130.ko 2023-07-24T05:30:03.765 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-isl12022.ko 2023-07-24T05:30:03.765 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 36057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-isl1208.ko 2023-07-24T05:30:03.765 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-lp8788.ko 2023-07-24T05:30:03.765 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 38097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-m41t80.ko 2023-07-24T05:30:03.765 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-m48t35.ko 2023-07-24T05:30:03.765 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-m48t59.ko 2023-07-24T05:30:03.765 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-m48t86.ko 2023-07-24T05:30:03.766 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11633 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-max6900.ko 2023-07-24T05:30:03.766 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-max8907.ko 2023-07-24T05:30:03.766 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-max8925.ko 2023-07-24T05:30:03.766 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-max8997.ko 2023-07-24T05:30:03.766 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-max8998.ko 2023-07-24T05:30:03.766 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-07-24T05:30:03.766 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-msm6242.ko 2023-07-24T05:30:03.766 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-palmas.ko 2023-07-24T05:30:03.767 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 40121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf2127.ko 2023-07-24T05:30:03.767 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17977 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf50633.ko 2023-07-24T05:30:03.767 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf85063.ko 2023-07-24T05:30:03.767 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf8523.ko 2023-07-24T05:30:03.767 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf8563.ko 2023-07-24T05:30:03.767 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf8583.ko 2023-07-24T05:30:03.767 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rc5t583.ko 2023-07-24T05:30:03.767 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rp5c01.ko 2023-07-24T05:30:03.768 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rs5c372.ko 2023-07-24T05:30:03.768 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-07-24T05:30:03.768 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rx8025.ko 2023-07-24T05:30:03.768 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rx8581.ko 2023-07-24T05:30:03.768 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-s35390a.ko 2023-07-24T05:30:03.768 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-07-24T05:30:03.768 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-tps6586x.ko 2023-07-24T05:30:03.768 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-tps65910.ko 2023-07-24T05:30:03.769 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-wm831x.ko 2023-07-24T05:30:03.769 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-wm8350.ko 2023-07-24T05:30:03.769 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-x1205.ko 2023-07-24T05:30:03.769 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ 2023-07-24T05:30:03.769 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 77617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/3w-9xxx.ko 2023-07-24T05:30:03.769 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 57665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/3w-sas.ko 2023-07-24T05:30:03.769 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 55169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/3w-xxxx.ko 2023-07-24T05:30:03.769 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 135169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/BusLogic.ko 2023-07-24T05:30:03.770 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/a100u2w.ko 2023-07-24T05:30:03.770 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aacraid/ 2023-07-24T05:30:03.770 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 272353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aacraid/aacraid.ko 2023-07-24T05:30:03.770 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 100617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/advansys.ko 2023-07-24T05:30:03.770 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic7xxx/ 2023-07-24T05:30:03.770 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 356265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-07-24T05:30:03.770 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 295801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-07-24T05:30:03.771 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic94xx/ 2023-07-24T05:30:03.771 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 189321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-07-24T05:30:03.771 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/am53c974.ko 2023-07-24T05:30:03.771 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/arcmsr/ 2023-07-24T05:30:03.771 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 106569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-07-24T05:30:03.771 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 38185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/atp870u.ko 2023-07-24T05:30:03.771 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/be2iscsi/ 2023-07-24T05:30:03.771 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 246897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-07-24T05:30:03.772 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bfa/ 2023-07-24T05:30:03.772 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 1172185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bfa/bfa.ko 2023-07-24T05:30:03.772 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bnx2fc/ 2023-07-24T05:30:03.772 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 237169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-07-24T05:30:03.772 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bnx2i/ 2023-07-24T05:30:03.772 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 115393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-07-24T05:30:03.772 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 40609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ch.ko 2023-07-24T05:30:03.772 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/csiostor/ 2023-07-24T05:30:03.773 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 308889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/csiostor/csiostor.ko 2023-07-24T05:30:03.773 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/ 2023-07-24T05:30:03.773 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-07-24T05:30:03.773 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 76193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-07-24T05:30:03.773 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-07-24T05:30:03.773 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 101449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-07-24T05:30:03.773 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 146785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-07-24T05:30:03.773 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 75529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/dc395x.ko 2023-07-24T05:30:03.774 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 38121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/dmx3191d.ko 2023-07-24T05:30:03.774 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/esas2r/ 2023-07-24T05:30:03.774 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 212401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/esas2r/esas2r.ko 2023-07-24T05:30:03.774 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 60489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/esp_scsi.ko 2023-07-24T05:30:03.774 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fcoe/ 2023-07-24T05:30:03.774 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 78289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fcoe/fcoe.ko 2023-07-24T05:30:03.774 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 158193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-07-24T05:30:03.774 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fdomain.ko 2023-07-24T05:30:03.775 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fnic/ 2023-07-24T05:30:03.775 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 261913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fnic/fnic.ko 2023-07-24T05:30:03.775 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 201793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/hpsa.ko 2023-07-24T05:30:03.775 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 51145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/hptiop.ko 2023-07-24T05:30:03.775 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 49065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/hv_storvsc.ko 2023-07-24T05:30:03.775 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 35321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/imm.ko 2023-07-24T05:30:03.775 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 44057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/initio.ko 2023-07-24T05:30:03.775 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 266521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ipr.ko 2023-07-24T05:30:03.776 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 101881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ips.ko 2023-07-24T05:30:03.776 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/isci/ 2023-07-24T05:30:03.776 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 317249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/isci/isci.ko 2023-07-24T05:30:03.776 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-07-24T05:30:03.776 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 52897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/iscsi_tcp.ko 2023-07-24T05:30:03.776 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libfc/ 2023-07-24T05:30:03.776 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 314961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libfc/libfc.ko 2023-07-24T05:30:03.777 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 145569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libiscsi.ko 2023-07-24T05:30:03.777 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 53521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libiscsi_tcp.ko 2023-07-24T05:30:03.777 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libsas/ 2023-07-24T05:30:03.777 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 217209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libsas/libsas.ko 2023-07-24T05:30:03.777 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/lpfc/ 2023-07-24T05:30:03.777 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 2192449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/lpfc/lpfc.ko 2023-07-24T05:30:03.777 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid/ 2023-07-24T05:30:03.777 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 73545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-07-24T05:30:03.778 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-07-24T05:30:03.778 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 310729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-07-24T05:30:03.778 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 84697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid.ko 2023-07-24T05:30:03.778 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mpt3sas/ 2023-07-24T05:30:03.778 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 659577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-07-24T05:30:03.778 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mvsas/ 2023-07-24T05:30:03.778 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 119929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mvsas/mvsas.ko 2023-07-24T05:30:03.778 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 78153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mvumi.ko 2023-07-24T05:30:03.779 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pcmcia/ 2023-07-24T05:30:03.779 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 81601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-07-24T05:30:03.779 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-07-24T05:30:03.779 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-07-24T05:30:03.779 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-07-24T05:30:03.779 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pm8001/ 2023-07-24T05:30:03.779 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 364257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-07-24T05:30:03.779 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 123489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pmcraid.ko 2023-07-24T05:30:03.780 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ppa.ko 2023-07-24T05:30:03.780 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 55345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla1280.ko 2023-07-24T05:30:03.780 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla2xxx/ 2023-07-24T05:30:03.780 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 1860025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-07-24T05:30:03.780 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 85313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-07-24T05:30:03.780 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla4xxx/ 2023-07-24T05:30:03.780 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 558865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-07-24T05:30:03.780 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qlogicfas408.ko 2023-07-24T05:30:03.781 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/raid_class.ko 2023-07-24T05:30:03.781 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 238801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_debug.ko 2023-07-24T05:30:03.781 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 173921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_fc.ko 2023-07-24T05:30:03.781 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 278865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-07-24T05:30:03.781 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 97705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_sas.ko 2023-07-24T05:30:03.781 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 73881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_spi.ko 2023-07-24T05:30:03.781 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 44993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_srp.ko 2023-07-24T05:30:03.781 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ses.ko 2023-07-24T05:30:03.782 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 115849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/st.ko 2023-07-24T05:30:03.782 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 46825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/stex.ko 2023-07-24T05:30:03.782 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/sym53c8xx_2/ 2023-07-24T05:30:03.782 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 162121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-07-24T05:30:03.782 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 42361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/virtio_scsi.ko 2023-07-24T05:30:03.782 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 50297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/vmw_pvscsi.ko 2023-07-24T05:30:03.782 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 40001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/wd719x.ko 2023-07-24T05:30:03.783 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 50025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/xen-scsifront.ko 2023-07-24T05:30:03.783 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ssb/ 2023-07-24T05:30:03.783 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 129417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ssb/ssb.ko 2023-07-24T05:30:03.783 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/ 2023-07-24T05:30:03.783 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/iscsi/ 2023-07-24T05:30:03.783 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 739089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-07-24T05:30:03.783 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/loopback/ 2023-07-24T05:30:03.783 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 49985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/loopback/tcm_loop.ko 2023-07-24T05:30:03.784 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 39713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_file.ko 2023-07-24T05:30:03.784 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 42961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_iblock.ko 2023-07-24T05:30:03.784 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 931721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_mod.ko 2023-07-24T05:30:03.784 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 44321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_pscsi.ko 2023-07-24T05:30:03.784 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 122545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_user.ko 2023-07-24T05:30:03.784 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/tcm_fc/ 2023-07-24T05:30:03.784 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 75641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-07-24T05:30:03.784 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/ 2023-07-24T05:30:03.785 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/ 2023-07-24T05:30:03.785 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/ 2023-07-24T05:30:03.785 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-07-24T05:30:03.785 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-07-24T05:30:03.785 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-07-24T05:30:03.785 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-07-24T05:30:03.785 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-07-24T05:30:03.785 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-07-24T05:30:03.786 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-07-24T05:30:03.786 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-07-24T05:30:03.786 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-07-24T05:30:03.786 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-07-24T05:30:03.786 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-07-24T05:30:03.786 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 37065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-07-24T05:30:03.786 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 30729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-07-24T05:30:03.786 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-07-24T05:30:03.787 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-07-24T05:30:03.787 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-07-24T05:30:03.787 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/ 2023-07-24T05:30:03.787 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/ipwireless/ 2023-07-24T05:30:03.787 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 78073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-07-24T05:30:03.787 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 57881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/moxa.ko 2023-07-24T05:30:03.787 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 50793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/mxser.ko 2023-07-24T05:30:03.787 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 107545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/n_gsm.ko 2023-07-24T05:30:03.788 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 32041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/n_hdlc.ko 2023-07-24T05:30:03.788 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 68137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/nozomi.ko 2023-07-24T05:30:03.788 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/ 2023-07-24T05:30:03.788 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/8250/ 2023-07-24T05:30:03.788 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 35745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-07-24T05:30:03.788 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 59497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-07-24T05:30:03.788 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-07-24T05:30:03.789 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/altera_uart.ko 2023-07-24T05:30:03.789 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/arc_uart.ko 2023-07-24T05:30:03.789 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 72193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-07-24T05:30:03.789 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/jsm/ 2023-07-24T05:30:03.789 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 103017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/jsm/jsm.ko 2023-07-24T05:30:03.789 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/rp2.ko 2023-07-24T05:30:03.789 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 52073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/sc16is7xx.ko 2023-07-24T05:30:03.789 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 100185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/synclink_gt.ko 2023-07-24T05:30:03.790 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/ 2023-07-24T05:30:03.790 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/core/ 2023-07-24T05:30:03.790 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 536617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/core/ufshcd-core.ko 2023-07-24T05:30:03.790 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/host/ 2023-07-24T05:30:03.790 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-07-24T05:30:03.790 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-07-24T05:30:03.790 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/ 2023-07-24T05:30:03.790 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 44585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio.ko 2023-07-24T05:30:03.791 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_aec.ko 2023-07-24T05:30:03.791 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_cif.ko 2023-07-24T05:30:03.791 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_dmem_genirq.ko 2023-07-24T05:30:03.791 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_mf624.ko 2023-07-24T05:30:03.791 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_netx.ko 2023-07-24T05:30:03.791 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_pci_generic.ko 2023-07-24T05:30:03.791 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-07-24T05:30:03.791 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13633 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_sercos3.ko 2023-07-24T05:30:03.792 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/ 2023-07-24T05:30:03.792 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/c67x00/ 2023-07-24T05:30:03.792 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 73273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/c67x00/c67x00.ko 2023-07-24T05:30:03.792 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/chipidea/ 2023-07-24T05:30:03.792 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 143785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-07-24T05:30:03.792 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-07-24T05:30:03.792 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-07-24T05:30:03.792 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-07-24T05:30:03.793 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/ 2023-07-24T05:30:03.793 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 85457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/cdc-acm.ko 2023-07-24T05:30:03.793 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 51393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/cdc-wdm.ko 2023-07-24T05:30:03.793 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 47465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/usblp.ko 2023-07-24T05:30:03.793 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 89833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/usbtmc.ko 2023-07-24T05:30:03.793 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/common/ 2023-07-24T05:30:03.793 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/common/ulpi.ko 2023-07-24T05:30:03.793 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc2/ 2023-07-24T05:30:03.794 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-07-24T05:30:03.794 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc3/ 2023-07-24T05:30:03.794 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-07-24T05:30:03.794 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-07-24T05:30:03.794 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 445801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/dwc3/dwc3.ko 2023-07-24T05:30:03.794 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/ 2023-07-24T05:30:03.794 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/ 2023-07-24T05:30:03.794 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 60089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/u_ether.ko 2023-07-24T05:30:03.795 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 51753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/u_serial.ko 2023-07-24T05:30:03.795 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-07-24T05:30:03.795 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 42649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-07-24T05:30:03.795 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-07-24T05:30:03.795 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 36585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-07-24T05:30:03.795 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 92377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-07-24T05:30:03.795 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 51025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-07-24T05:30:03.795 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 122073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-07-24T05:30:03.796 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 57921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-07-24T05:30:03.796 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-07-24T05:30:03.796 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 31265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-07-24T05:30:03.796 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 57705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-07-24T05:30:03.796 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 85841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-07-24T05:30:03.796 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-07-24T05:30:03.796 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 58433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-07-24T05:30:03.797 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 67337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-07-24T05:30:03.797 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/ 2023-07-24T05:30:03.797 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-07-24T05:30:03.797 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-07-24T05:30:03.797 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-07-24T05:30:03.797 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-07-24T05:30:03.797 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-07-24T05:30:03.797 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-07-24T05:30:03.798 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-07-24T05:30:03.798 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16977 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-07-24T05:30:03.798 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 32073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-07-24T05:30:03.798 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-07-24T05:30:03.798 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-07-24T05:30:03.798 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-07-24T05:30:03.798 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 62153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-07-24T05:30:03.798 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15201 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-07-24T05:30:03.799 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 161233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/libcomposite.ko 2023-07-24T05:30:03.799 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/ 2023-07-24T05:30:03.799 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-07-24T05:30:03.799 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/bdc/ 2023-07-24T05:30:03.799 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 157665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-07-24T05:30:03.799 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 36065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-07-24T05:30:03.799 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 52993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-07-24T05:30:03.800 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 69689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-07-24T05:30:03.800 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 56009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-07-24T05:30:03.800 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 76033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/net2272.ko 2023-07-24T05:30:03.800 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 75057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/net2280.ko 2023-07-24T05:30:03.800 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 73153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-07-24T05:30:03.800 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 65793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-07-24T05:30:03.800 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 66073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-07-24T05:30:03.800 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 81489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-07-24T05:30:03.801 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 156033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-07-24T05:30:03.801 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/ 2023-07-24T05:30:03.801 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/bcma-hcd.ko 2023-07-24T05:30:03.801 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 80097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/isp116x-hcd.ko 2023-07-24T05:30:03.801 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 87337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-07-24T05:30:03.801 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 78849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-07-24T05:30:03.801 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 51305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/sl811-hcd.ko 2023-07-24T05:30:03.801 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/sl811_cs.ko 2023-07-24T05:30:03.802 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/ssb-hcd.ko 2023-07-24T05:30:03.802 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-07-24T05:30:03.802 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/image/ 2023-07-24T05:30:03.802 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 34585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/image/mdc800.ko 2023-07-24T05:30:03.802 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/image/microtek.ko 2023-07-24T05:30:03.802 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/ 2023-07-24T05:30:03.802 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 41841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/adutux.ko 2023-07-24T05:30:03.802 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/appledisplay.ko 2023-07-24T05:30:03.803 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-07-24T05:30:03.803 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/cytherm.ko 2023-07-24T05:30:03.803 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/ehset.ko 2023-07-24T05:30:03.803 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/emi26.ko 2023-07-24T05:30:03.803 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/emi62.ko 2023-07-24T05:30:03.803 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/ezusb.ko 2023-07-24T05:30:03.803 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/idmouse.ko 2023-07-24T05:30:03.803 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 36617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/iowarrior.ko 2023-07-24T05:30:03.804 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/isight_firmware.ko 2023-07-24T05:30:03.804 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 36529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/ldusb.ko 2023-07-24T05:30:03.804 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 36265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/legousbtower.ko 2023-07-24T05:30:03.804 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/lvstest.ko 2023-07-24T05:30:03.804 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/sisusbvga/ 2023-07-24T05:30:03.804 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 64841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-07-24T05:30:03.804 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/trancevibrator.ko 2023-07-24T05:30:03.805 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/usb3503.ko 2023-07-24T05:30:03.805 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/usblcd.ko 2023-07-24T05:30:03.805 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/usbsevseg.ko 2023-07-24T05:30:03.805 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 70873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/usbtest.ko 2023-07-24T05:30:03.805 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 41945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/uss720.ko 2023-07-24T05:30:03.805 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/yurex.ko 2023-07-24T05:30:03.805 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/mon/ 2023-07-24T05:30:03.805 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 73185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/mon/usbmon.ko 2023-07-24T05:30:03.806 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/musb/ 2023-07-24T05:30:03.806 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 301521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/musb/musb_hdrc.ko 2023-07-24T05:30:03.806 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy/ 2023-07-24T05:30:03.806 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy/phy-generic.ko 2023-07-24T05:30:03.806 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-07-24T05:30:03.806 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy/phy-isp1301.ko 2023-07-24T05:30:03.806 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy/phy-tahvo.ko 2023-07-24T05:30:03.806 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ 2023-07-24T05:30:03.807 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/aircable.ko 2023-07-24T05:30:03.807 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ark3116.ko 2023-07-24T05:30:03.807 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/belkin_sa.ko 2023-07-24T05:30:03.807 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 38105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ch341.ko 2023-07-24T05:30:03.807 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 70209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/cp210x.ko 2023-07-24T05:30:03.807 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 31169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/cyberjack.ko 2023-07-24T05:30:03.807 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 57937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/cypress_m8.ko 2023-07-24T05:30:03.807 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 49753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/digi_acceleport.ko 2023-07-24T05:30:03.808 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/empeg.ko 2023-07-24T05:30:03.808 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 43897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/f81232.ko 2023-07-24T05:30:03.808 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 175145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ftdi_sio.ko 2023-07-24T05:30:03.808 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 52713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/garmin_gps.ko 2023-07-24T05:30:03.808 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 137105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/io_edgeport.ko 2023-07-24T05:30:03.808 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 124673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/io_ti.ko 2023-07-24T05:30:03.808 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 67769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ipaq.ko 2023-07-24T05:30:03.808 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ipw.ko 2023-07-24T05:30:03.809 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ir-usb.ko 2023-07-24T05:30:03.809 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 57937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-07-24T05:30:03.809 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 107417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/keyspan.ko 2023-07-24T05:30:03.809 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 35497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/keyspan_pda.ko 2023-07-24T05:30:03.809 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/kl5kusb105.ko 2023-07-24T05:30:03.809 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/kobil_sct.ko 2023-07-24T05:30:03.809 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 32841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/mct_u232.ko 2023-07-24T05:30:03.809 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/metro-usb.ko 2023-07-24T05:30:03.810 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 66489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/mos7720.ko 2023-07-24T05:30:03.810 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 78113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/mos7840.ko 2023-07-24T05:30:03.810 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 56593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/mxuport.ko 2023-07-24T05:30:03.810 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/navman.ko 2023-07-24T05:30:03.810 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/omninet.ko 2023-07-24T05:30:03.810 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/opticon.ko 2023-07-24T05:30:03.810 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 189729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/option.ko 2023-07-24T05:30:03.810 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 38905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/oti6858.ko 2023-07-24T05:30:03.811 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 54313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/pl2303.ko 2023-07-24T05:30:03.811 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/qcaux.ko 2023-07-24T05:30:03.811 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 37825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/qcserial.ko 2023-07-24T05:30:03.811 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 34561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/quatech2.ko 2023-07-24T05:30:03.811 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/safe_serial.ko 2023-07-24T05:30:03.811 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 51297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/sierra.ko 2023-07-24T05:30:03.811 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/spcp8x5.ko 2023-07-24T05:30:03.811 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ssu100.ko 2023-07-24T05:30:03.812 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/symbolserial.ko 2023-07-24T05:30:03.812 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 61337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-07-24T05:30:03.812 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-07-24T05:30:03.812 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/usb_debug.ko 2023-07-24T05:30:03.812 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/usb_wwan.ko 2023-07-24T05:30:03.812 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 125505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/usbserial.ko 2023-07-24T05:30:03.812 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/visor.ko 2023-07-24T05:30:03.812 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 37409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/whiteheat.ko 2023-07-24T05:30:03.813 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/wishbone-serial.ko 2023-07-24T05:30:03.813 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/xsens_mt.ko 2023-07-24T05:30:03.813 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ 2023-07-24T05:30:03.813 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 52913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/uas.ko 2023-07-24T05:30:03.813 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-alauda.ko 2023-07-24T05:30:03.813 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-cypress.ko 2023-07-24T05:30:03.813 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-datafab.ko 2023-07-24T05:30:03.813 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-07-24T05:30:03.814 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-freecom.ko 2023-07-24T05:30:03.814 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-isd200.ko 2023-07-24T05:30:03.814 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-07-24T05:30:03.814 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-karma.ko 2023-07-24T05:30:03.814 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-onetouch.ko 2023-07-24T05:30:03.814 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-realtek.ko 2023-07-24T05:30:03.814 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-sddr09.ko 2023-07-24T05:30:03.814 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-sddr55.ko 2023-07-24T05:30:03.815 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 35337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-usbat.ko 2023-07-24T05:30:03.815 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 180017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/usb-storage.ko 2023-07-24T05:30:03.815 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/usbip/ 2023-07-24T05:30:03.815 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 67457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/usbip/usbip-core.ko 2023-07-24T05:30:03.815 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 71345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/usbip/usbip-host.ko 2023-07-24T05:30:03.815 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 105401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-07-24T05:30:03.815 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/ 2023-07-24T05:30:03.815 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/pci/ 2023-07-24T05:30:03.816 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 153697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-07-24T05:30:03.816 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/pci/vfio-pci.ko 2023-07-24T05:30:03.851 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 100569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/vfio.ko 2023-07-24T05:30:03.851 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 75137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-07-24T05:30:03.851 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/ 2023-07-24T05:30:03.851 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 113889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/vhost.ko 2023-07-24T05:30:03.851 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/vhost_iotlb.ko 2023-07-24T05:30:03.852 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 58137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/vhost_net.ko 2023-07-24T05:30:03.852 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 86521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/vhost_scsi.ko 2023-07-24T05:30:03.852 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/ 2023-07-24T05:30:03.852 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/ 2023-07-24T05:30:03.852 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-07-24T05:30:03.852 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/aat2870_bl.ko 2023-07-24T05:30:03.852 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/adp5520_bl.ko 2023-07-24T05:30:03.852 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 32609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/adp8860_bl.ko 2023-07-24T05:30:03.853 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 39993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/adp8870_bl.ko 2023-07-24T05:30:03.853 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/apple_bl.ko 2023-07-24T05:30:03.853 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/as3711_bl.ko 2023-07-24T05:30:03.853 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/bd6107.ko 2023-07-24T05:30:03.853 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/da903x_bl.ko 2023-07-24T05:30:03.853 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/da9052_bl.ko 2023-07-24T05:30:03.853 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/gpio_backlight.ko 2023-07-24T05:30:03.854 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14769 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/kb3886_bl.ko 2023-07-24T05:30:03.854 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/lcd.ko 2023-07-24T05:30:03.854 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/lm3533_bl.ko 2023-07-24T05:30:03.854 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/lm3639_bl.ko 2023-07-24T05:30:03.854 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/lv5207lp.ko 2023-07-24T05:30:03.854 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/max8925_bl.ko 2023-07-24T05:30:03.854 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/pandora_bl.ko 2023-07-24T05:30:03.854 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-07-24T05:30:03.855 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/platform_lcd.ko 2023-07-24T05:30:03.855 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/wm831x_bl.ko 2023-07-24T05:30:03.855 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/ 2023-07-24T05:30:03.855 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/ 2023-07-24T05:30:03.855 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/ds2482.ko 2023-07-24T05:30:03.855 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 38961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/ds2490.ko 2023-07-24T05:30:03.855 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/matrox_w1.ko 2023-07-24T05:30:03.855 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/w1-gpio.ko 2023-07-24T05:30:03.856 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/ 2023-07-24T05:30:03.856 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-07-24T05:30:03.856 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-07-24T05:30:03.856 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-07-24T05:30:03.856 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-07-24T05:30:03.856 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-07-24T05:30:03.856 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-07-24T05:30:03.856 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-07-24T05:30:03.857 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-07-24T05:30:03.857 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-07-24T05:30:03.857 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_smem.ko 2023-07-24T05:30:03.857 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 56425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_therm.ko 2023-07-24T05:30:03.857 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 102657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/wire.ko 2023-07-24T05:30:03.857 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/ 2023-07-24T05:30:03.857 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/acquirewdt.ko 2023-07-24T05:30:03.857 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19977 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/advantechwdt.ko 2023-07-24T05:30:03.858 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/alim1535_wdt.ko 2023-07-24T05:30:03.858 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/alim7101_wdt.ko 2023-07-24T05:30:03.858 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/cpu5wdt.ko 2023-07-24T05:30:03.858 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/da9052_wdt.ko 2023-07-24T05:30:03.858 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/da9055_wdt.ko 2023-07-24T05:30:03.858 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/da9063_wdt.ko 2023-07-24T05:30:03.858 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/dw_wdt.ko 2023-07-24T05:30:03.858 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/eurotechwdt.ko 2023-07-24T05:30:03.859 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/f71808e_wdt.ko 2023-07-24T05:30:03.859 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/hpwdt.ko 2023-07-24T05:30:03.859 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/i6300esb.ko 2023-07-24T05:30:03.859 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-07-24T05:30:03.859 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/iTCO_wdt.ko 2023-07-24T05:30:03.859 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/ib700wdt.ko 2023-07-24T05:30:03.859 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/ibmasr.ko 2023-07-24T05:30:03.860 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-07-24T05:30:03.860 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/it8712f_wdt.ko 2023-07-24T05:30:03.860 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/it87_wdt.ko 2023-07-24T05:30:03.860 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/kempld_wdt.ko 2023-07-24T05:30:03.860 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/machzwd.ko 2023-07-24T05:30:03.860 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/mena21_wdt.ko 2023-07-24T05:30:03.860 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-07-24T05:30:03.860 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/nv_tco.ko 2023-07-24T05:30:03.861 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-07-24T05:30:03.861 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/pc87413_wdt.ko 2023-07-24T05:30:03.861 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 38657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/pcwd_pci.ko 2023-07-24T05:30:03.861 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 31825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/pcwd_usb.ko 2023-07-24T05:30:03.861 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/retu_wdt.ko 2023-07-24T05:30:03.861 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-07-24T05:30:03.861 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-07-24T05:30:03.861 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-07-24T05:30:03.862 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sc1200wdt.ko 2023-07-24T05:30:03.862 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sch311x_wdt.ko 2023-07-24T05:30:03.862 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-07-24T05:30:03.862 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/softdog.ko 2023-07-24T05:30:03.862 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sp5100_tco.ko 2023-07-24T05:30:03.862 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/twl4030_wdt.ko 2023-07-24T05:30:03.862 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/via_wdt.ko 2023-07-24T05:30:03.862 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-07-24T05:30:03.863 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/w83877f_wdt.ko 2023-07-24T05:30:03.863 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/w83977f_wdt.ko 2023-07-24T05:30:03.863 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/wafer5823wdt.ko 2023-07-24T05:30:03.863 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/wdt_pci.ko 2023-07-24T05:30:03.863 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/wm831x_wdt.ko 2023-07-24T05:30:03.863 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/wm8350_wdt.ko 2023-07-24T05:30:03.863 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/xen_wdt.ko 2023-07-24T05:30:03.863 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/ 2023-07-24T05:30:03.864 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-evtchn.ko 2023-07-24T05:30:03.864 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-gntalloc.ko 2023-07-24T05:30:03.864 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 47841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-gntdev.ko 2023-07-24T05:30:03.864 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-pciback/ 2023-07-24T05:30:03.864 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 176417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-07-24T05:30:03.864 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 40105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-privcmd.ko 2023-07-24T05:30:03.864 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 71321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-scsiback.ko 2023-07-24T05:30:03.865 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xenfs/ 2023-07-24T05:30:03.865 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xenfs/xenfs.ko 2023-07-24T05:30:03.865 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ 2023-07-24T05:30:03.865 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/9p/ 2023-07-24T05:30:03.865 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 165697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/9p/9p.ko 2023-07-24T05:30:03.865 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/adfs/ 2023-07-24T05:30:03.865 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 60881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/adfs/adfs.ko 2023-07-24T05:30:03.865 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/affs/ 2023-07-24T05:30:03.866 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 162617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/affs/affs.ko 2023-07-24T05:30:03.866 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/afs/ 2023-07-24T05:30:03.866 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 931937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/afs/kafs.ko 2023-07-24T05:30:03.866 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/autofs/ 2023-07-24T05:30:03.866 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 100937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/autofs/autofs4.ko 2023-07-24T05:30:03.866 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/befs/ 2023-07-24T05:30:03.866 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 64481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/befs/befs.ko 2023-07-24T05:30:03.866 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/bfs/ 2023-07-24T05:30:03.867 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 40993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/bfs/bfs.ko 2023-07-24T05:30:03.867 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 34625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/binfmt_misc.ko 2023-07-24T05:30:03.867 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/btrfs/ 2023-07-24T05:30:03.867 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 3468681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/btrfs/btrfs.ko 2023-07-24T05:30:03.867 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/cachefiles/ 2023-07-24T05:30:03.867 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 305745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/cachefiles/cachefiles.ko 2023-07-24T05:30:03.867 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ceph/ 2023-07-24T05:30:03.867 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 1312545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ceph/ceph.ko 2023-07-24T05:30:03.868 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/coda/ 2023-07-24T05:30:03.868 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 100321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/coda/coda.ko 2023-07-24T05:30:03.868 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/configfs/ 2023-07-24T05:30:03.868 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 108073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/configfs/configfs.ko 2023-07-24T05:30:03.868 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/cramfs/ 2023-07-24T05:30:03.868 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/cramfs/cramfs.ko 2023-07-24T05:30:03.868 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/dlm/ 2023-07-24T05:30:03.868 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 633825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/dlm/dlm.ko 2023-07-24T05:30:03.869 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/efs/ 2023-07-24T05:30:03.869 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 36585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/efs/efs.ko 2023-07-24T05:30:03.869 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/f2fs/ 2023-07-24T05:30:03.869 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 1500513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/f2fs/f2fs.ko 2023-07-24T05:30:03.869 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fat/ 2023-07-24T05:30:03.869 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fat/msdos.ko 2023-07-24T05:30:03.869 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/freevxfs/ 2023-07-24T05:30:03.869 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 42457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/freevxfs/freevxfs.ko 2023-07-24T05:30:03.870 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fscache/ 2023-07-24T05:30:03.870 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 226505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fscache/fscache.ko 2023-07-24T05:30:03.870 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fuse/ 2023-07-24T05:30:03.870 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fuse/cuse.ko 2023-07-24T05:30:03.870 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/gfs2/ 2023-07-24T05:30:03.870 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 1226249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/gfs2/gfs2.ko 2023-07-24T05:30:03.870 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hfs/ 2023-07-24T05:30:03.870 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 141241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hfs/hfs.ko 2023-07-24T05:30:03.871 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hfsplus/ 2023-07-24T05:30:03.871 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 221553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hfsplus/hfsplus.ko 2023-07-24T05:30:03.871 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hpfs/ 2023-07-24T05:30:03.871 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 193577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hpfs/hpfs.ko 2023-07-24T05:30:03.871 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/isofs/ 2023-07-24T05:30:03.871 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 74393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/isofs/isofs.ko 2023-07-24T05:30:03.871 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/jfs/ 2023-07-24T05:30:03.871 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 420745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/jfs/jfs.ko 2023-07-24T05:30:03.872 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/lockd/ 2023-07-24T05:30:03.872 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 279041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/lockd/lockd.ko 2023-07-24T05:30:03.872 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/minix/ 2023-07-24T05:30:03.872 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 87897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/minix/minix.ko 2023-07-24T05:30:03.872 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/netfs/ 2023-07-24T05:30:03.872 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 124697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/netfs/netfs.ko 2023-07-24T05:30:03.872 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/ 2023-07-24T05:30:03.873 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/blocklayout/ 2023-07-24T05:30:03.873 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 81521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-07-24T05:30:03.873 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/filelayout/ 2023-07-24T05:30:03.873 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 59425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-07-24T05:30:03.873 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/flexfilelayout/ 2023-07-24T05:30:03.873 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 117705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-07-24T05:30:03.873 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 1053889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/nfs.ko 2023-07-24T05:30:03.873 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 66089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/nfsv2.ko 2023-07-24T05:30:03.874 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 119801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/nfsv3.ko 2023-07-24T05:30:03.874 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 2041809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/nfsv4.ko 2023-07-24T05:30:03.874 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs_common/ 2023-07-24T05:30:03.874 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs_common/grace.ko 2023-07-24T05:30:03.874 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs_common/nfs_acl.ko 2023-07-24T05:30:03.874 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfsd/ 2023-07-24T05:30:03.874 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 1504993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfsd/nfsd.ko 2023-07-24T05:30:03.874 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nilfs2/ 2023-07-24T05:30:03.875 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 591417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nilfs2/nilfs2.ko 2023-07-24T05:30:03.875 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/ 2023-07-24T05:30:03.875 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-celtic.ko 2023-07-24T05:30:03.875 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-centeuro.ko 2023-07-24T05:30:03.875 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-croatian.ko 2023-07-24T05:30:03.875 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-cyrillic.ko 2023-07-24T05:30:03.875 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-gaelic.ko 2023-07-24T05:30:03.875 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-greek.ko 2023-07-24T05:30:03.876 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-iceland.ko 2023-07-24T05:30:03.876 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-inuit.ko 2023-07-24T05:30:03.876 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-roman.ko 2023-07-24T05:30:03.876 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-romanian.ko 2023-07-24T05:30:03.876 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-turkish.ko 2023-07-24T05:30:03.876 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_ascii.ko 2023-07-24T05:30:03.876 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp1250.ko 2023-07-24T05:30:03.876 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp1251.ko 2023-07-24T05:30:03.877 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp1255.ko 2023-07-24T05:30:03.877 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp737.ko 2023-07-24T05:30:03.877 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp775.ko 2023-07-24T05:30:03.877 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp850.ko 2023-07-24T05:30:03.877 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp852.ko 2023-07-24T05:30:03.877 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp855.ko 2023-07-24T05:30:03.877 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp857.ko 2023-07-24T05:30:03.877 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp860.ko 2023-07-24T05:30:03.878 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp861.ko 2023-07-24T05:30:03.878 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp862.ko 2023-07-24T05:30:03.878 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp863.ko 2023-07-24T05:30:03.878 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp864.ko 2023-07-24T05:30:03.878 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp865.ko 2023-07-24T05:30:03.878 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp866.ko 2023-07-24T05:30:03.878 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp869.ko 2023-07-24T05:30:03.878 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp874.ko 2023-07-24T05:30:03.879 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 94137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp932.ko 2023-07-24T05:30:03.879 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 142673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp936.ko 2023-07-24T05:30:03.879 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 165745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp949.ko 2023-07-24T05:30:03.879 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 118121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp950.ko 2023-07-24T05:30:03.879 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_euc-jp.ko 2023-07-24T05:30:03.879 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-1.ko 2023-07-24T05:30:03.879 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-13.ko 2023-07-24T05:30:03.879 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-14.ko 2023-07-24T05:30:03.880 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-15.ko 2023-07-24T05:30:03.880 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-2.ko 2023-07-24T05:30:03.880 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-3.ko 2023-07-24T05:30:03.880 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-4.ko 2023-07-24T05:30:03.880 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-5.ko 2023-07-24T05:30:03.880 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-6.ko 2023-07-24T05:30:03.880 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-7.ko 2023-07-24T05:30:03.880 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-9.ko 2023-07-24T05:30:03.881 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_koi8-r.ko 2023-07-24T05:30:03.881 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_koi8-ru.ko 2023-07-24T05:30:03.881 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_koi8-u.ko 2023-07-24T05:30:03.881 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_utf8.ko 2023-07-24T05:30:03.881 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ntfs/ 2023-07-24T05:30:03.881 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 219073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ntfs/ntfs.ko 2023-07-24T05:30:03.881 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ 2023-07-24T05:30:03.881 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/cluster/ 2023-07-24T05:30:03.882 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 244177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-07-24T05:30:03.882 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/dlm/ 2023-07-24T05:30:03.882 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 440785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-07-24T05:30:03.882 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/dlmfs/ 2023-07-24T05:30:03.882 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 53841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-07-24T05:30:03.882 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 2589569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ocfs2.ko 2023-07-24T05:30:03.882 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-07-24T05:30:03.882 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 31585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-07-24T05:30:03.883 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 35881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-07-24T05:30:03.883 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/omfs/ 2023-07-24T05:30:03.883 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 52569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/omfs/omfs.ko 2023-07-24T05:30:03.883 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/overlayfs/ 2023-07-24T05:30:03.883 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 336473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/overlayfs/overlay.ko 2023-07-24T05:30:03.883 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/pstore/ 2023-07-24T05:30:03.883 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 54609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/pstore/ramoops.ko 2023-07-24T05:30:03.883 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/qnx4/ 2023-07-24T05:30:03.884 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/qnx4/qnx4.ko 2023-07-24T05:30:03.884 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/qnx6/ 2023-07-24T05:30:03.884 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 46649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/qnx6/qnx6.ko 2023-07-24T05:30:03.884 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/quota/ 2023-07-24T05:30:03.884 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 30881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/quota/quota_tree.ko 2023-07-24T05:30:03.884 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/quota/quota_v1.ko 2023-07-24T05:30:03.884 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/quota/quota_v2.ko 2023-07-24T05:30:03.885 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/reiserfs/ 2023-07-24T05:30:03.885 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 530697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/reiserfs/reiserfs.ko 2023-07-24T05:30:03.885 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/romfs/ 2023-07-24T05:30:03.885 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/romfs/romfs.ko 2023-07-24T05:30:03.885 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/ 2023-07-24T05:30:03.885 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/client/ 2023-07-24T05:30:03.885 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 2658777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/client/cifs.ko 2023-07-24T05:30:03.885 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/common/ 2023-07-24T05:30:03.886 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/common/cifs_arc4.ko 2023-07-24T05:30:03.886 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/common/cifs_md4.ko 2023-07-24T05:30:03.886 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/squashfs/ 2023-07-24T05:30:03.886 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 134313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/squashfs/squashfs.ko 2023-07-24T05:30:03.886 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/sysv/ 2023-07-24T05:30:03.886 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 89737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/sysv/sysv.ko 2023-07-24T05:30:03.886 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/udf/ 2023-07-24T05:30:03.886 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 248049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/udf/udf.ko 2023-07-24T05:30:03.887 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ufs/ 2023-07-24T05:30:03.887 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 160857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ufs/ufs.ko 2023-07-24T05:30:03.887 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/xfs/ 2023-07-24T05:30:03.887 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 3998129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/xfs/xfs.ko 2023-07-24T05:30:03.887 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/ 2023-07-24T05:30:03.887 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/locking/ 2023-07-24T05:30:03.887 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 74865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/locking/locktorture.ko 2023-07-24T05:30:03.887 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/time/ 2023-07-24T05:30:03.888 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/time/test_udelay.ko 2023-07-24T05:30:03.888 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 58473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/torture.ko 2023-07-24T05:30:03.888 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/ 2023-07-24T05:30:03.888 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 6833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crc-itu-t.ko 2023-07-24T05:30:03.888 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 6529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crc7.ko 2023-07-24T05:30:03.888 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crc8.ko 2023-07-24T05:30:03.888 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crypto/ 2023-07-24T05:30:03.888 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crypto/libarc4.ko 2023-07-24T05:30:03.889 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 37081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crypto/libdes.ko 2023-07-24T05:30:03.889 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/interval_tree_test.ko 2023-07-24T05:30:03.889 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/libcrc32c.ko 2023-07-24T05:30:03.889 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/lru_cache.ko 2023-07-24T05:30:03.889 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/lz4/ 2023-07-24T05:30:03.889 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/lz4/lz4_compress.ko 2023-07-24T05:30:03.889 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22633 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/lz4/lz4hc_compress.ko 2023-07-24T05:30:03.889 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/math/ 2023-07-24T05:30:03.890 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 6617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/math/cordic.ko 2023-07-24T05:30:03.890 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/memory-notifier-error-inject.ko 2023-07-24T05:30:03.890 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/notifier-error-inject.ko 2023-07-24T05:30:03.890 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/percpu_test.ko 2023-07-24T05:30:03.890 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/pm-notifier-error-inject.ko 2023-07-24T05:30:03.890 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/raid6/ 2023-07-24T05:30:03.890 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 143433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/raid6/raid6_pq.ko 2023-07-24T05:30:03.890 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/rbtree_test.ko 2023-07-24T05:30:03.891 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/reed_solomon/ 2023-07-24T05:30:03.891 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/reed_solomon/reed_solomon.ko 2023-07-24T05:30:03.891 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 38841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test-kstrtox.ko 2023-07-24T05:30:03.891 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test-string_helpers.ko 2023-07-24T05:30:03.891 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 4760825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test_bpf.ko 2023-07-24T05:30:03.891 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 49081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test_firmware.ko 2023-07-24T05:30:03.891 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 6369 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test_module.ko 2023-07-24T05:30:03.891 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/test_user_copy.ko 2023-07-24T05:30:03.892 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/ts_bm.ko 2023-07-24T05:30:03.892 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/ts_fsm.ko 2023-07-24T05:30:03.892 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/ts_kmp.ko 2023-07-24T05:30:03.892 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/xz/ 2023-07-24T05:30:03.892 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/xz/xz_dec_test.ko 2023-07-24T05:30:03.892 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/mm/ 2023-07-24T05:30:03.892 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/mm/hwpoison-inject.ko 2023-07-24T05:30:03.892 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ 2023-07-24T05:30:03.893 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/ 2023-07-24T05:30:03.893 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 55737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/6lowpan.ko 2023-07-24T05:30:03.893 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_dest.ko 2023-07-24T05:30:03.893 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_fragment.ko 2023-07-24T05:30:03.893 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_hop.ko 2023-07-24T05:30:03.893 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 6985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_ipv6.ko 2023-07-24T05:30:03.893 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_mobility.ko 2023-07-24T05:30:03.893 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_routing.ko 2023-07-24T05:30:03.894 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_udp.ko 2023-07-24T05:30:03.894 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/ 2023-07-24T05:30:03.894 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 30385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/garp.ko 2023-07-24T05:30:03.894 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 34785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/mrp.ko 2023-07-24T05:30:03.894 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/p8022.ko 2023-07-24T05:30:03.894 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/psnap.ko 2023-07-24T05:30:03.894 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/stp.ko 2023-07-24T05:30:03.894 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/8021q/ 2023-07-24T05:30:03.895 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 81017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/8021q/8021q.ko 2023-07-24T05:30:03.895 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/ 2023-07-24T05:30:03.895 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 198417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/9pnet.ko 2023-07-24T05:30:03.895 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 35961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/9pnet_fd.ko 2023-07-24T05:30:03.895 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/9pnet_rdma.ko 2023-07-24T05:30:03.895 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 32257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/9pnet_virtio.ko 2023-07-24T05:30:03.895 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/batman-adv/ 2023-07-24T05:30:03.895 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 652553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/batman-adv/batman-adv.ko 2023-07-24T05:30:03.896 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/ 2023-07-24T05:30:03.896 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 63825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/br_netfilter.ko 2023-07-24T05:30:03.896 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 772505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/bridge.ko 2023-07-24T05:30:03.896 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ 2023-07-24T05:30:03.896 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-07-24T05:30:03.896 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_among.ko 2023-07-24T05:30:03.896 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_arp.ko 2023-07-24T05:30:03.897 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-07-24T05:30:03.897 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-07-24T05:30:03.897 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_ip.ko 2023-07-24T05:30:03.897 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-07-24T05:30:03.897 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_limit.ko 2023-07-24T05:30:03.897 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_log.ko 2023-07-24T05:30:03.897 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7585 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_mark.ko 2023-07-24T05:30:03.897 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-07-24T05:30:03.898 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8385 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-07-24T05:30:03.898 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-07-24T05:30:03.898 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-07-24T05:30:03.898 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_snat.ko 2023-07-24T05:30:03.898 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_stp.ko 2023-07-24T05:30:03.898 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-07-24T05:30:03.898 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-07-24T05:30:03.898 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-07-24T05:30:03.899 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-07-24T05:30:03.899 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 55937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebtables.ko 2023-07-24T05:30:03.899 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-07-24T05:30:03.899 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-07-24T05:30:03.899 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ceph/ 2023-07-24T05:30:03.899 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 1046417 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ceph/libceph.ko 2023-07-24T05:30:03.899 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/core/ 2023-07-24T05:30:03.899 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 124793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/core/pktgen.ko 2023-07-24T05:30:03.900 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/ 2023-07-24T05:30:03.900 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 194321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/dccp.ko 2023-07-24T05:30:03.900 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8665 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/dccp_diag.ko 2023-07-24T05:30:03.900 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 56945 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/dccp_ipv4.ko 2023-07-24T05:30:03.900 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 59457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/dccp_ipv6.ko 2023-07-24T05:30:03.900 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/ 2023-07-24T05:30:03.900 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 390297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/dsa_core.ko 2023-07-24T05:30:03.900 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/tag_brcm.ko 2023-07-24T05:30:03.901 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/tag_dsa.ko 2023-07-24T05:30:03.901 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/tag_none.ko 2023-07-24T05:30:03.901 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/tag_trailer.ko 2023-07-24T05:30:03.901 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/hsr/ 2023-07-24T05:30:03.901 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 100257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/hsr/hsr.ko 2023-07-24T05:30:03.901 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/ 2023-07-24T05:30:03.901 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/6lowpan/ 2023-07-24T05:30:03.901 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 45169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-07-24T05:30:03.902 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 254601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/ieee802154.ko 2023-07-24T05:30:03.902 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 47265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/ieee802154_socket.ko 2023-07-24T05:30:03.902 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ 2023-07-24T05:30:03.902 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ah4.ko 2023-07-24T05:30:03.902 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 38801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/esp4.ko 2023-07-24T05:30:03.902 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 48345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/fou.ko 2023-07-24T05:30:03.902 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/gre.ko 2023-07-24T05:30:03.902 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 48529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/inet_diag.ko 2023-07-24T05:30:03.903 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 60529 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ip_gre.ko 2023-07-24T05:30:03.903 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 61281 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ip_tunnel.ko 2023-07-24T05:30:03.903 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 34369 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ip_vti.ko 2023-07-24T05:30:03.903 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ipcomp.ko 2023-07-24T05:30:03.903 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28889 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ipip.ko 2023-07-24T05:30:03.903 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ 2023-07-24T05:30:03.903 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 37689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/arp_tables.ko 2023-07-24T05:30:03.903 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-07-24T05:30:03.904 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-07-24T05:30:03.904 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 41601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ip_tables.ko 2023-07-24T05:30:03.904 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-07-24T05:30:03.904 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-07-24T05:30:03.904 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-07-24T05:30:03.904 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-07-24T05:30:03.904 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-07-24T05:30:03.904 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-07-24T05:30:03.905 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-07-24T05:30:03.905 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-07-24T05:30:03.905 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-07-24T05:30:03.905 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_security.ko 2023-07-24T05:30:03.905 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-07-24T05:30:03.905 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-07-24T05:30:03.905 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-07-24T05:30:03.906 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-07-24T05:30:03.906 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-07-24T05:30:03.906 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20561 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-07-24T05:30:03.906 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-07-24T05:30:03.906 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15225 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-07-24T05:30:03.906 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-07-24T05:30:03.906 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-07-24T05:30:03.906 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-07-24T05:30:03.907 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_bic.ko 2023-07-24T05:30:03.907 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_dctcp.ko 2023-07-24T05:30:03.907 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_diag.ko 2023-07-24T05:30:03.907 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_highspeed.ko 2023-07-24T05:30:03.907 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_htcp.ko 2023-07-24T05:30:03.907 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_hybla.ko 2023-07-24T05:30:03.907 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_illinois.ko 2023-07-24T05:30:03.907 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_lp.ko 2023-07-24T05:30:03.908 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_scalable.ko 2023-07-24T05:30:03.908 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_vegas.ko 2023-07-24T05:30:03.908 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_veno.ko 2023-07-24T05:30:03.908 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_westwood.ko 2023-07-24T05:30:03.908 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_yeah.ko 2023-07-24T05:30:03.908 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tunnel4.ko 2023-07-24T05:30:03.908 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/udp_diag.ko 2023-07-24T05:30:03.908 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 41577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/udp_tunnel.ko 2023-07-24T05:30:03.909 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/xfrm4_tunnel.ko 2023-07-24T05:30:03.909 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ 2023-07-24T05:30:03.909 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ah6.ko 2023-07-24T05:30:03.909 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 39537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/esp6.ko 2023-07-24T05:30:03.909 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/fou6.ko 2023-07-24T05:30:03.909 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 80793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ip6_gre.ko 2023-07-24T05:30:03.909 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 92817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ip6_tunnel.ko 2023-07-24T05:30:03.909 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-07-24T05:30:03.910 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 54001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ip6_vti.ko 2023-07-24T05:30:03.910 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ipcomp6.ko 2023-07-24T05:30:03.910 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/mip6.ko 2023-07-24T05:30:03.910 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ 2023-07-24T05:30:03.910 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 42209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-07-24T05:30:03.910 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-07-24T05:30:03.910 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-07-24T05:30:03.910 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-07-24T05:30:03.911 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-07-24T05:30:03.911 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-07-24T05:30:03.911 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-07-24T05:30:03.911 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-07-24T05:30:03.911 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8913 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-07-24T05:30:03.911 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-07-24T05:30:03.911 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10937 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-07-24T05:30:03.911 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-07-24T05:30:03.912 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-07-24T05:30:03.912 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-07-24T05:30:03.912 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-07-24T05:30:03.912 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-07-24T05:30:03.912 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-07-24T05:30:03.912 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 38833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-07-24T05:30:03.912 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-07-24T05:30:03.912 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-07-24T05:30:03.913 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-07-24T05:30:03.913 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-07-24T05:30:03.913 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9633 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-07-24T05:30:03.913 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-07-24T05:30:03.913 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9009 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-07-24T05:30:03.913 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 73161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/sit.ko 2023-07-24T05:30:03.913 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24193 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/tunnel6.ko 2023-07-24T05:30:03.914 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23305 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/xfrm6_tunnel.ko 2023-07-24T05:30:03.914 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/key/ 2023-07-24T05:30:03.914 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 82929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/key/af_key.ko 2023-07-24T05:30:03.914 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/ 2023-07-24T05:30:03.914 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 125873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_core.ko 2023-07-24T05:30:03.914 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_debugfs.ko 2023-07-24T05:30:03.914 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 25865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_eth.ko 2023-07-24T05:30:03.914 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 35049 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_ip.ko 2023-07-24T05:30:03.915 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 36745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_ip6.ko 2023-07-24T05:30:03.915 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_netlink.ko 2023-07-24T05:30:03.915 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 53153 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_ppp.ko 2023-07-24T05:30:03.915 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/lapb/ 2023-07-24T05:30:03.915 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 48065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/lapb/lapb.ko 2023-07-24T05:30:03.915 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/llc/ 2023-07-24T05:30:03.915 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/llc/llc.ko 2023-07-24T05:30:03.915 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 267017 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/llc/llc2.ko 2023-07-24T05:30:03.916 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/mac802154/ 2023-07-24T05:30:03.916 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 291041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/mac802154/mac802154.ko 2023-07-24T05:30:03.916 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/mpls/ 2023-07-24T05:30:03.916 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/mpls/mpls_gso.ko 2023-07-24T05:30:03.916 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ 2023-07-24T05:30:03.916 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ 2023-07-24T05:30:03.916 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 119649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set.ko 2023-07-24T05:30:03.916 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-07-24T05:30:03.917 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-07-24T05:30:03.917 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-07-24T05:30:03.917 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 102033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-07-24T05:30:03.917 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 103121 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-07-24T05:30:03.917 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 104593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-07-24T05:30:03.917 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 105129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-07-24T05:30:03.917 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 114393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-07-24T05:30:03.917 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 61161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-07-24T05:30:03.918 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 111161 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-07-24T05:30:03.918 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 114673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-07-24T05:30:03.918 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 114329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-07-24T05:30:03.918 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 113217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-07-24T05:30:03.918 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 116217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-07-24T05:30:03.918 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 30145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-07-24T05:30:03.918 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ 2023-07-24T05:30:03.918 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 412481 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs.ko 2023-07-24T05:30:03.919 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-07-24T05:30:03.919 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-07-24T05:30:03.919 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-07-24T05:30:03.919 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-07-24T05:30:03.919 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-07-24T05:30:03.919 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-07-24T05:30:03.919 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-07-24T05:30:03.919 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10681 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-07-24T05:30:03.920 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-07-24T05:30:03.920 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-07-24T05:30:03.920 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-07-24T05:30:03.920 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7697 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-07-24T05:30:03.920 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10993 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-07-24T05:30:03.920 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 48897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conncount.ko 2023-07-24T05:30:03.920 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 408689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack.ko 2023-07-24T05:30:03.920 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-07-24T05:30:03.921 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10177 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-07-24T05:30:03.921 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-07-24T05:30:03.921 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 118145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_h323.ko 2023-07-24T05:30:03.921 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_irc.ko 2023-07-24T05:30:03.921 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-07-24T05:30:03.921 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 108393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-07-24T05:30:03.921 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-07-24T05:30:03.921 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_sane.ko 2023-07-24T05:30:03.922 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 66641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_sip.ko 2023-07-24T05:30:03.922 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-07-24T05:30:03.922 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-07-24T05:30:03.922 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10113 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_dup_netdev.ko 2023-07-24T05:30:03.922 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 88513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_flow_table.ko 2023-07-24T05:30:03.922 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9593 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_flow_table_inet.ko 2023-07-24T05:30:03.922 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 37129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_log_syslog.ko 2023-07-24T05:30:03.923 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 95353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat.ko 2023-07-24T05:30:03.923 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_amanda.ko 2023-07-24T05:30:03.923 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_ftp.ko 2023-07-24T05:30:03.923 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_irc.ko 2023-07-24T05:30:03.923 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28929 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_sip.ko 2023-07-24T05:30:03.923 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_tftp.ko 2023-07-24T05:30:03.923 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 44025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_synproxy_core.ko 2023-07-24T05:30:03.923 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 592185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_tables.ko 2023-07-24T05:30:03.924 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 43873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink.ko 2023-07-24T05:30:03.924 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 30273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_acct.ko 2023-07-24T05:30:03.924 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 30625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-07-24T05:30:03.924 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 39905 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_log.ko 2023-07-24T05:30:03.924 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22713 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_osf.ko 2023-07-24T05:30:03.924 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 49673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_queue.ko 2023-07-24T05:30:03.924 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_chain_nat.ko 2023-07-24T05:30:03.924 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_compat.ko 2023-07-24T05:30:03.925 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 40721 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_ct.ko 2023-07-24T05:30:03.925 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_dup_netdev.ko 2023-07-24T05:30:03.925 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11345 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_fib.ko 2023-07-24T05:30:03.925 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13745 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_fwd_netdev.ko 2023-07-24T05:30:03.925 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14185 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_hash.ko 2023-07-24T05:30:03.925 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_limit.ko 2023-07-24T05:30:03.925 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_log.ko 2023-07-24T05:30:03.925 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_masq.ko 2023-07-24T05:30:03.926 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_nat.ko 2023-07-24T05:30:03.926 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_numgen.ko 2023-07-24T05:30:03.926 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_osf.ko 2023-07-24T05:30:03.926 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_queue.ko 2023-07-24T05:30:03.926 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_redir.ko 2023-07-24T05:30:03.926 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_reject.ko 2023-07-24T05:30:03.926 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_reject_inet.ko 2023-07-24T05:30:03.926 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12737 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_socket.ko 2023-07-24T05:30:03.927 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20393 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_synproxy.ko 2023-07-24T05:30:03.927 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14849 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_tproxy.ko 2023-07-24T05:30:03.927 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 89329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/x_tables.ko 2023-07-24T05:30:03.927 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_AUDIT.ko 2023-07-24T05:30:03.927 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9633 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_CHECKSUM.ko 2023-07-24T05:30:03.927 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_CLASSIFY.ko 2023-07-24T05:30:03.927 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-07-24T05:30:03.927 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 18169 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_CT.ko 2023-07-24T05:30:03.928 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10497 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_DSCP.ko 2023-07-24T05:30:03.928 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_HL.ko 2023-07-24T05:30:03.928 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_HMARK.ko 2023-07-24T05:30:03.928 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 38857 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_IDLETIMER.ko 2023-07-24T05:30:03.928 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13873 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_LED.ko 2023-07-24T05:30:03.928 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11489 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_LOG.ko 2023-07-24T05:30:03.928 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_MASQUERADE.ko 2023-07-24T05:30:03.928 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_NETMAP.ko 2023-07-24T05:30:03.929 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_NFLOG.ko 2023-07-24T05:30:03.929 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13289 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_NFQUEUE.ko 2023-07-24T05:30:03.929 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19689 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_RATEEST.ko 2023-07-24T05:30:03.929 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_REDIRECT.ko 2023-07-24T05:30:03.929 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 14337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_SECMARK.ko 2023-07-24T05:30:03.929 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TCPMSS.ko 2023-07-24T05:30:03.929 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-07-24T05:30:03.930 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17369 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TEE.ko 2023-07-24T05:30:03.930 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TPROXY.ko 2023-07-24T05:30:03.930 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TRACE.ko 2023-07-24T05:30:03.930 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_addrtype.ko 2023-07-24T05:30:03.930 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_bpf.ko 2023-07-24T05:30:03.930 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15577 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_cgroup.ko 2023-07-24T05:30:03.930 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11209 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_cluster.ko 2023-07-24T05:30:03.930 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_comment.ko 2023-07-24T05:30:03.931 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10465 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_connbytes.ko 2023-07-24T05:30:03.931 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_connlabel.ko 2023-07-24T05:30:03.931 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_connlimit.ko 2023-07-24T05:30:03.931 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_connmark.ko 2023-07-24T05:30:03.931 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_conntrack.ko 2023-07-24T05:30:03.931 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_cpu.ko 2023-07-24T05:30:03.931 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_dccp.ko 2023-07-24T05:30:03.931 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_devgroup.ko 2023-07-24T05:30:03.932 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8801 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_dscp.ko 2023-07-24T05:30:03.932 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_ecn.ko 2023-07-24T05:30:03.932 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_esp.ko 2023-07-24T05:30:03.932 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 43457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_hashlimit.ko 2023-07-24T05:30:03.932 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_helper.ko 2023-07-24T05:30:03.932 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7865 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_hl.ko 2023-07-24T05:30:03.932 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11921 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_ipcomp.ko 2023-07-24T05:30:03.932 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_iprange.ko 2023-07-24T05:30:03.933 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11785 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_ipvs.ko 2023-07-24T05:30:03.933 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16041 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_l2tp.ko 2023-07-24T05:30:03.933 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8001 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_length.ko 2023-07-24T05:30:03.933 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10273 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_limit.ko 2023-07-24T05:30:03.933 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_mac.ko 2023-07-24T05:30:03.933 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8641 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_mark.ko 2023-07-24T05:30:03.933 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_multiport.ko 2023-07-24T05:30:03.933 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_nat.ko 2023-07-24T05:30:03.934 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_nfacct.ko 2023-07-24T05:30:03.934 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8297 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_osf.ko 2023-07-24T05:30:03.934 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_owner.ko 2023-07-24T05:30:03.934 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_physdev.ko 2023-07-24T05:30:03.934 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7633 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_pkttype.ko 2023-07-24T05:30:03.934 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_policy.ko 2023-07-24T05:30:03.934 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_quota.ko 2023-07-24T05:30:03.934 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_rateest.ko 2023-07-24T05:30:03.935 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8257 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_realm.ko 2023-07-24T05:30:03.935 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 36441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_recent.ko 2023-07-24T05:30:03.935 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13329 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_sctp.ko 2023-07-24T05:30:03.935 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 30089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_set.ko 2023-07-24T05:30:03.935 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16089 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_socket.ko 2023-07-24T05:30:03.935 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9505 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_state.ko 2023-07-24T05:30:03.935 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9473 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_statistic.ko 2023-07-24T05:30:03.935 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_string.ko 2023-07-24T05:30:03.936 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 8553 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_tcpmss.ko 2023-07-24T05:30:03.936 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15777 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_tcpudp.ko 2023-07-24T05:30:03.936 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11129 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_time.ko 2023-07-24T05:30:03.936 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9105 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_u32.ko 2023-07-24T05:30:03.936 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netlink/ 2023-07-24T05:30:03.936 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13969 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netlink/netlink_diag.ko 2023-07-24T05:30:03.936 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/nsh/ 2023-07-24T05:30:03.936 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 12425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/nsh/nsh.ko 2023-07-24T05:30:03.937 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/ 2023-07-24T05:30:03.937 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 379545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/openvswitch.ko 2023-07-24T05:30:03.937 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10321 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/vport-geneve.ko 2023-07-24T05:30:03.937 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/vport-gre.ko 2023-07-24T05:30:03.937 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 11793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/vport-vxlan.ko 2023-07-24T05:30:03.937 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/packet/ 2023-07-24T05:30:03.937 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/packet/af_packet_diag.ko 2023-07-24T05:30:03.938 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/phonet/ 2023-07-24T05:30:03.938 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 109961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/phonet/phonet.ko 2023-07-24T05:30:03.938 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 54761 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/phonet/pn_pep.ko 2023-07-24T05:30:03.938 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rds/ 2023-07-24T05:30:03.938 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 252825 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rds/rds.ko 2023-07-24T05:30:03.938 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 165081 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rds/rds_rdma.ko 2023-07-24T05:30:03.938 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 67241 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rds/rds_tcp.ko 2023-07-24T05:30:03.938 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rxrpc/ 2023-07-24T05:30:03.939 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 820137 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rxrpc/rxrpc.ko 2023-07-24T05:30:03.939 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/ 2023-07-24T05:30:03.939 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 32249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_csum.ko 2023-07-24T05:30:03.939 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23537 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_gact.ko 2023-07-24T05:30:03.939 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_ipt.ko 2023-07-24T05:30:03.939 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 34057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_mirred.ko 2023-07-24T05:30:03.939 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_nat.ko 2023-07-24T05:30:03.939 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 43817 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_pedit.ko 2023-07-24T05:30:03.940 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 31985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_police.ko 2023-07-24T05:30:03.940 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20313 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_simple.ko 2023-07-24T05:30:03.940 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 36353 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_skbedit.ko 2023-07-24T05:30:03.940 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 36057 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_vlan.ko 2023-07-24T05:30:03.940 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26145 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_basic.ko 2023-07-24T05:30:03.940 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33673 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_bpf.ko 2023-07-24T05:30:03.940 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_cgroup.ko 2023-07-24T05:30:03.940 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 31377 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_flow.ko 2023-07-24T05:30:03.941 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 31065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_fw.ko 2023-07-24T05:30:03.941 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 37953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_route.ko 2023-07-24T05:30:03.941 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 59217 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_u32.ko 2023-07-24T05:30:03.941 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7441 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_cmp.ko 2023-07-24T05:30:03.941 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 13457 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_ipset.ko 2023-07-24T05:30:03.941 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33337 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_meta.ko 2023-07-24T05:30:03.941 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_nbyte.ko 2023-07-24T05:30:03.941 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10625 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_text.ko 2023-07-24T05:30:03.942 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7249 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_u32.ko 2023-07-24T05:30:03.942 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 21649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_choke.ko 2023-07-24T05:30:03.942 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20961 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_codel.ko 2023-07-24T05:30:03.942 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33753 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_drr.ko 2023-07-24T05:30:03.942 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 33609 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_fq.ko 2023-07-24T05:30:03.942 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 31601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_fq_codel.ko 2023-07-24T05:30:03.942 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 35433 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_gred.ko 2023-07-24T05:30:03.942 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 48409 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_hfsc.ko 2023-07-24T05:30:03.943 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22073 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_hhf.ko 2023-07-24T05:30:03.943 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 65793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_htb.ko 2023-07-24T05:30:03.943 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 16065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_ingress.ko 2023-07-24T05:30:03.943 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 29809 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_mqprio.ko 2023-07-24T05:30:03.943 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10793 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_mqprio_lib.ko 2023-07-24T05:30:03.943 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26065 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_multiq.ko 2023-07-24T05:30:03.943 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 35601 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_netem.ko 2023-07-24T05:30:03.943 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27545 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_pie.ko 2023-07-24T05:30:03.944 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_plug.ko 2023-07-24T05:30:03.944 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 24729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_prio.ko 2023-07-24T05:30:03.944 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 47617 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_qfq.ko 2023-07-24T05:30:03.944 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 32953 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_red.ko 2023-07-24T05:30:03.944 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 26881 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_sfb.ko 2023-07-24T05:30:03.944 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 31425 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_sfq.ko 2023-07-24T05:30:03.944 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 28897 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_tbf.ko 2023-07-24T05:30:03.944 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 27729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_teql.ko 2023-07-24T05:30:03.945 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sctp/ 2023-07-24T05:30:03.945 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 930369 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sctp/sctp.ko 2023-07-24T05:30:03.945 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 19033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sctp/sctp_diag.ko 2023-07-24T05:30:03.945 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/ 2023-07-24T05:30:03.945 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/auth_gss/ 2023-07-24T05:30:03.945 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 335569 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-07-24T05:30:03.945 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 61833 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-07-24T05:30:03.945 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 1514649 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/sunrpc.ko 2023-07-24T05:30:03.946 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/xprtrdma/ 2023-07-24T05:30:03.946 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 707401 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-07-24T05:30:03.946 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/tipc/ 2023-07-24T05:30:03.946 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10025 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/tipc/diag.ko 2023-07-24T05:30:03.946 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 862233 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/tipc/tipc.ko 2023-07-24T05:30:03.946 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/unix/ 2023-07-24T05:30:03.946 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15729 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/unix/unix_diag.ko 2023-07-24T05:30:03.946 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/ 2023-07-24T05:30:03.947 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 84841 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-07-24T05:30:03.947 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 68033 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-07-24T05:30:03.947 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 95985 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vsock.ko 2023-07-24T05:30:03.947 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 10705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vsock_diag.ko 2023-07-24T05:30:03.947 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 17521 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vsock_loopback.ko 2023-07-24T05:30:03.947 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/x25/ 2023-07-24T05:30:03.947 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 125097 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/x25/x25.ko 2023-07-24T05:30:03.948 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/xfrm/ 2023-07-24T05:30:03.948 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 22657 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/xfrm/xfrm_algo.ko 2023-07-24T05:30:03.948 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 20705 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/xfrm/xfrm_ipcomp.ko 2023-07-24T05:30:03.948 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 102265 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/xfrm/xfrm_user.ko 2023-07-24T05:30:03.948 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/virt/ 2023-07-24T05:30:03.948 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/virt/lib/ 2023-07-24T05:30:03.948 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 15513 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/virt/lib/irqbypass.ko 2023-07-24T05:30:03.948 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 638200 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.alias 2023-07-24T05:30:03.949 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 623896 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.alias.bin 2023-07-24T05:30:03.949 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 7656 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.builtin 2023-07-24T05:30:03.949 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 23361 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.builtin.alias.bin 2023-07-24T05:30:03.949 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 9821 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.builtin.bin 2023-07-24T05:30:03.949 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 69903 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.builtin.modinfo 2023-07-24T05:30:03.949 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 146449 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.dep 2023-07-24T05:30:03.949 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 232695 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.dep.bin 2023-07-24T05:30:03.949 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 210 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.devname 2023-07-24T05:30:03.950 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 72754 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.order 2023-07-24T05:30:03.950 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 879 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.softdep 2023-07-24T05:30:03.950 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 252883 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.symbols 2023-07-24T05:30:03.950 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 307884 2023-07-20 12:16 ./lib/modules/6.5.0-rc1-gc685da6f56cc/modules.symbols.bin 2023-07-24T05:30:03.950 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./usr/ 2023-07-24T05:30:03.950 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./usr/share/ 2023-07-24T05:30:03.950 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./usr/share/doc/ 2023-07-24T05:30:03.950 INFO:teuthology.orchestra.run.smithi103.stdout:drwxr-xr-x root/root 0 2023-07-20 12:16 ./usr/share/doc/linux-image-6.5.0-rc1-gc685da6f56cc/ 2023-07-24T05:30:03.951 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 173 2023-07-20 12:16 ./usr/share/doc/linux-image-6.5.0-rc1-gc685da6f56cc/changelog.Debian.gz 2023-07-24T05:30:03.951 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r-- root/root 691 2023-07-20 12:16 ./usr/share/doc/linux-image-6.5.0-rc1-gc685da6f56cc/copyright 2023-07-24T05:30:03.951 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc1-gc685da6f56cc 2023-07-24T05:30:03.952 INFO:teuthology.task.kernel:searching for kernel 6.5.0-rc1-gc685da6f56cc 2023-07-24T05:30:03.952 DEBUG:teuthology.orchestra.run.smithi103:> egrep '(submenu|menuentry.*6.5.0-rc1-gc685da6f56cc).*{' /boot/grub/grub.cfg 2023-07-24T05:30:03.960 INFO:teuthology.orchestra.run.smithi103.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-07-24T05:30:03.961 INFO:teuthology.orchestra.run.smithi103.stdout: menuentry 'Ubuntu, with Linux 6.5.0-rc1-gc685da6f56cc' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.5.0-rc1-gc685da6f56cc-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-07-24T05:30:03.961 INFO:teuthology.orchestra.run.smithi103.stdout: menuentry 'Ubuntu, with Linux 6.5.0-rc1-gc685da6f56cc (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.5.0-rc1-gc685da6f56cc-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-07-24T05:30:03.961 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-07-24T05:30:03.961 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.5.0-rc1-gc685da6f56cc 2023-07-24T05:30:03.962 DEBUG:teuthology.orchestra.run.smithi103:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-07-24T05:30:04.003 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi103.front.sepia.ceph.com to complete... 2023-07-24T05:30:04.710 INFO:teuthology.orchestra.run.smithi103.stderr:Sourcing file `/etc/default/grub' 2023-07-24T05:30:04.718 INFO:teuthology.orchestra.run.smithi103.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-24T05:30:04.724 INFO:teuthology.orchestra.run.smithi103.stderr:Generating grub configuration file ... 2023-07-24T05:30:04.986 INFO:teuthology.orchestra.run.smithi103.stderr:Found linux image: /boot/vmlinuz-6.5.0-rc1-gc685da6f56cc 2023-07-24T05:30:04.998 INFO:teuthology.orchestra.run.smithi103.stderr:Found initrd image: /boot/initrd.img-6.5.0-rc1-gc685da6f56cc 2023-07-24T05:30:05.352 INFO:teuthology.orchestra.run.smithi103.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-07-24T05:30:05.364 INFO:teuthology.orchestra.run.smithi103.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-07-24T05:30:07.017 INFO:teuthology.orchestra.run.smithi103.stderr:done 2023-07-24T05:30:34.244 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-07-24T05:30:34.244 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2023-07-24T05:30:34.245 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:30:38.144 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-07-24T05:30:38.144 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2023-07-24T05:30:38.145 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:30:56.500 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-07-24T05:31:05.509 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2023-07-24T05:31:05.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:31:08.560 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-07-24T05:31:08.784 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-07-24T05:31:17.792 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2023-07-24T05:31:17.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:31:20.564 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2023-07-24T05:31:20.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:31:20.852 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-07-24T05:31:23.636 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-07-24T05:31:32.860 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2023-07-24T05:31:32.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:31:35.924 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-07-24T05:31:38.642 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2023-07-24T05:31:38.643 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:31:50.935 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2023-07-24T05:31:50.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:31:54.000 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-07-24T05:31:57.168 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2023-07-24T05:32:12.013 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2023-07-24T05:32:12.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:32:15.088 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-07-24T05:32:15.170 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2023-07-24T05:32:15.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:32:15.410 DEBUG:teuthology.orchestra.run.smithi103:> true 2023-07-24T05:32:16.167 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2023-07-24T05:32:16.167 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.5.0-rc1-gc685da6f56cc"... 2023-07-24T05:32:16.168 DEBUG:teuthology.orchestra.run.smithi103:> uname -r 2023-07-24T05:32:16.229 INFO:teuthology.orchestra.run.smithi103.stdout:6.5.0-rc1-gc685da6f56cc 2023-07-24T05:32:16.230 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc1-gc685da6f56cc vs 6.5.0-rc1-gc685da6f56cc 2023-07-24T05:32:16.230 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-24T05:32:16.230 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-07-24T05:32:17.231 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-07-24T05:32:17.232 DEBUG:teuthology.orchestra.run.smithi103:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-07-24T05:32:17.333 INFO:teuthology.orchestra.run.smithi103.stdout:ttyS1 2023-07-24T05:32:17.394 DEBUG:teuthology.parallel:result is None 2023-07-24T05:32:36.089 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2023-07-24T05:32:36.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:32:51.441 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.77 2023-07-24T05:33:15.443 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2023-07-24T05:33:15.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:33:15.710 DEBUG:teuthology.orchestra.run.smithi077:> true 2023-07-24T05:33:16.428 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com' 2023-07-24T05:33:16.429 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.5.0-rc1-gc685da6f56cc"... 2023-07-24T05:33:16.429 DEBUG:teuthology.orchestra.run.smithi077:> uname -r 2023-07-24T05:33:16.489 INFO:teuthology.orchestra.run.smithi077.stdout:6.5.0-rc1-gc685da6f56cc 2023-07-24T05:33:16.490 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc1-gc685da6f56cc vs 6.5.0-rc1-gc685da6f56cc 2023-07-24T05:33:16.490 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-24T05:33:16.490 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-07-24T05:33:17.491 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-07-24T05:33:17.491 DEBUG:teuthology.orchestra.run.smithi077:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-07-24T05:33:17.590 INFO:teuthology.orchestra.run.smithi077.stdout:ttyS1 2023-07-24T05:33:17.645 DEBUG:teuthology.parallel:result is None 2023-07-24T05:33:17.646 INFO:teuthology.run_tasks:Running task internal.base... 2023-07-24T05:33:17.655 INFO:teuthology.task.internal:Creating test directory... 2023-07-24T05:33:17.656 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-24T05:33:17.663 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-24T05:33:17.686 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-07-24T05:33:17.694 INFO:teuthology.run_tasks:Running task internal.archive... 2023-07-24T05:33:17.700 INFO:teuthology.task.internal:Creating archive directory... 2023-07-24T05:33:17.701 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-24T05:33:17.726 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-24T05:33:17.759 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-07-24T05:33:17.766 INFO:teuthology.task.internal:Enabling coredump saving... 2023-07-24T05:33:17.766 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-24T05:33:17.798 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-24T05:33:17.835 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-24T05:33:17.857 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-24T05:33:17.867 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-24T05:33:17.893 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-24T05:33:17.896 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-07-24T05:33:17.903 INFO:teuthology.task.internal:Configuring sudo... 2023-07-24T05:33:17.903 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-24T05:33:17.910 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-24T05:33:17.949 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-07-24T05:33:17.957 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-07-24T05:33:17.958 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-24T05:33:17.994 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-24T05:33:18.011 DEBUG:teuthology.orchestra.run.smithi077:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-24T05:33:18.071 DEBUG:teuthology.orchestra.run.smithi077:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-24T05:33:18.129 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-07-24T05:33:18.130 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-24T05:33:18.225 DEBUG:teuthology.orchestra.run.smithi103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-24T05:33:18.248 DEBUG:teuthology.orchestra.run.smithi103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-24T05:33:18.310 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2023-07-24T05:33:18.310 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-24T05:33:18.397 DEBUG:teuthology.orchestra.run.smithi077:> sudo service rsyslog restart 2023-07-24T05:33:18.405 DEBUG:teuthology.orchestra.run.smithi103:> sudo service rsyslog restart 2023-07-24T05:33:18.584 INFO:teuthology.run_tasks:Running task internal.timer... 2023-07-24T05:33:18.596 INFO:teuthology.task.internal:Starting timer... 2023-07-24T05:33:18.597 INFO:teuthology.run_tasks:Running task pcp... 2023-07-24T05:33:18.607 INFO:teuthology.run_tasks:Running task selinux... 2023-07-24T05:33:18.615 DEBUG:teuthology.task.selinux:Excluding smithi077: OS 'ubuntu' does not support SELinux 2023-07-24T05:33:18.615 DEBUG:teuthology.task.selinux:Excluding smithi103: OS 'ubuntu' does not support SELinux 2023-07-24T05:33:18.616 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-07-24T05:33:18.616 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-07-24T05:33:18.616 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-07-24T05:33:18.616 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-07-24T05:33:18.624 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-07-24T05:33:18.631 INFO:teuthology.repo_utils:Fetching main from origin 2023-07-24T05:33:18.793 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-07-24T05:33:18.814 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-07-24T05:33:18.816 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi077.front.sepia.ceph.com,smithi103.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-07-24T05:41:06.675 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi077.front.sepia.ceph.com'), Remote(name='ubuntu@smithi103.front.sepia.ceph.com')] 2023-07-24T05:41:06.676 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2023-07-24T05:41:06.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:41:06.781 DEBUG:teuthology.orchestra.run.smithi077:> true 2023-07-24T05:41:07.011 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com' 2023-07-24T05:41:07.012 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2023-07-24T05:41:07.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-24T05:41:07.123 DEBUG:teuthology.orchestra.run.smithi103:> true 2023-07-24T05:41:07.355 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2023-07-24T05:41:07.356 INFO:teuthology.run_tasks:Running task clock... 2023-07-24T05:41:07.366 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-07-24T05:41:07.366 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-24T05:41:07.367 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-24T05:41:07.372 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-24T05:41:07.373 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-24T05:41:07.440 INFO:teuthology.orchestra.run.smithi077.stdout:24 Jul 05:41:07 ntpd[22150]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-07-24T05:41:07.440 INFO:teuthology.orchestra.run.smithi077.stdout:24 Jul 05:41:07 ntpd[22150]: Command line: ntpd -gq 2023-07-24T05:41:07.442 INFO:teuthology.orchestra.run.smithi077.stdout:24 Jul 05:41:07 ntpd[22150]: proto: precision = 0.066 usec (-24) 2023-07-24T05:41:07.442 INFO:teuthology.orchestra.run.smithi077.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-24T05:41:07.443 INFO:teuthology.orchestra.run.smithi077.stdout:24 Jul 05:41:07 ntpd[22150]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-24T05:41:07.443 INFO:teuthology.orchestra.run.smithi077.stdout:24 Jul 05:41:07 ntpd[22150]: restrict ::: KOD does nothing without LIMITED. 2023-07-24T05:41:07.443 INFO:teuthology.orchestra.run.smithi077.stderr:restrict ::: KOD does nothing without LIMITED. 2023-07-24T05:41:07.444 INFO:teuthology.orchestra.run.smithi077.stdout:24 Jul 05:41:07 ntpd[22150]: Listen and drop on 0 v6wildcard [::]:123 2023-07-24T05:41:07.444 INFO:teuthology.orchestra.run.smithi077.stdout:24 Jul 05:41:07 ntpd[22150]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-07-24T05:41:07.444 INFO:teuthology.orchestra.run.smithi077.stdout:24 Jul 05:41:07 ntpd[22150]: Listen normally on 2 lo 127.0.0.1:123 2023-07-24T05:41:07.445 INFO:teuthology.orchestra.run.smithi077.stdout:24 Jul 05:41:07 ntpd[22150]: Listen normally on 3 enp3s0f1 172.21.15.77:123 2023-07-24T05:41:07.445 INFO:teuthology.orchestra.run.smithi077.stdout:24 Jul 05:41:07 ntpd[22150]: Listen normally on 4 lo [::1]:123 2023-07-24T05:41:07.445 INFO:teuthology.orchestra.run.smithi077.stdout:24 Jul 05:41:07 ntpd[22150]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d3d3%5]:123 2023-07-24T05:41:07.445 INFO:teuthology.orchestra.run.smithi077.stdout:24 Jul 05:41:07 ntpd[22150]: Listening on routing socket on fd #22 for interface updates 2023-07-24T05:41:07.477 INFO:teuthology.orchestra.run.smithi103.stdout:24 Jul 05:41:07 ntpd[22110]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-07-24T05:41:07.477 INFO:teuthology.orchestra.run.smithi103.stdout:24 Jul 05:41:07 ntpd[22110]: Command line: ntpd -gq 2023-07-24T05:41:07.479 INFO:teuthology.orchestra.run.smithi103.stdout:24 Jul 05:41:07 ntpd[22110]: proto: precision = 0.063 usec (-24) 2023-07-24T05:41:07.479 INFO:teuthology.orchestra.run.smithi103.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-24T05:41:07.479 INFO:teuthology.orchestra.run.smithi103.stderr:restrict ::: KOD does nothing without LIMITED. 2023-07-24T05:41:07.480 INFO:teuthology.orchestra.run.smithi103.stdout:24 Jul 05:41:07 ntpd[22110]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-24T05:41:07.480 INFO:teuthology.orchestra.run.smithi103.stdout:24 Jul 05:41:07 ntpd[22110]: restrict ::: KOD does nothing without LIMITED. 2023-07-24T05:41:07.480 INFO:teuthology.orchestra.run.smithi103.stdout:24 Jul 05:41:07 ntpd[22110]: Listen and drop on 0 v6wildcard [::]:123 2023-07-24T05:41:07.481 INFO:teuthology.orchestra.run.smithi103.stdout:24 Jul 05:41:07 ntpd[22110]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-07-24T05:41:07.481 INFO:teuthology.orchestra.run.smithi103.stdout:24 Jul 05:41:07 ntpd[22110]: Listen normally on 2 lo 127.0.0.1:123 2023-07-24T05:41:07.481 INFO:teuthology.orchestra.run.smithi103.stdout:24 Jul 05:41:07 ntpd[22110]: Listen normally on 3 enp3s0f1 172.21.15.103:123 2023-07-24T05:41:07.481 INFO:teuthology.orchestra.run.smithi103.stdout:24 Jul 05:41:07 ntpd[22110]: Listen normally on 4 lo [::1]:123 2023-07-24T05:41:07.481 INFO:teuthology.orchestra.run.smithi103.stdout:24 Jul 05:41:07 ntpd[22110]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cc0b%5]:123 2023-07-24T05:41:07.481 INFO:teuthology.orchestra.run.smithi103.stdout:24 Jul 05:41:07 ntpd[22110]: Listening on routing socket on fd #22 for interface updates 2023-07-24T05:41:08.441 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:08 ntpd[22150]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-24T05:41:08.441 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:08 ntpd[22150]: can't open /var/log/ntpstats/rawstats.20230724: Permission denied 2023-07-24T05:41:08.442 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:08 ntpd[22150]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-24T05:41:08.442 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:08 ntpd[22150]: can't open /var/log/ntpstats/rawstats.20230724: Permission denied 2023-07-24T05:41:08.442 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:08 ntpd[22150]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-24T05:41:08.443 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:08 ntpd[22150]: can't open /var/log/ntpstats/peerstats.20230724: Permission denied 2023-07-24T05:41:08.478 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:08 ntpd[22110]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-24T05:41:08.478 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:08 ntpd[22110]: can't open /var/log/ntpstats/rawstats.20230724: Permission denied 2023-07-24T05:41:08.478 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:08 ntpd[22110]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-24T05:41:08.479 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:08 ntpd[22110]: can't open /var/log/ntpstats/rawstats.20230724: Permission denied 2023-07-24T05:41:08.479 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:08 ntpd[22110]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-24T05:41:08.479 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:08 ntpd[22110]: can't open /var/log/ntpstats/rawstats.20230724: Permission denied 2023-07-24T05:41:08.480 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:08 ntpd[22110]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-24T05:41:08.480 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:08 ntpd[22110]: can't open /var/log/ntpstats/rawstats.20230724: Permission denied 2023-07-24T05:41:08.480 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:08 ntpd[22110]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-24T05:41:08.480 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:08 ntpd[22110]: can't open /var/log/ntpstats/peerstats.20230724: Permission denied 2023-07-24T05:41:08.480 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:08 ntpd[22110]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-24T05:41:08.480 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:08 ntpd[22110]: can't open /var/log/ntpstats/rawstats.20230724: Permission denied 2023-07-24T05:41:08.481 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:08 ntpd[22110]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-24T05:41:08.481 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:08 ntpd[22110]: can't open /var/log/ntpstats/peerstats.20230724: Permission denied 2023-07-24T05:41:10.441 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:10 ntpd[22150]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-24T05:41:10.441 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:10 ntpd[22150]: can't open /var/log/ntpstats/rawstats.20230724: Permission denied 2023-07-24T05:41:10.441 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:10 ntpd[22150]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-24T05:41:10.442 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:10 ntpd[22150]: can't open /var/log/ntpstats/rawstats.20230724: Permission denied 2023-07-24T05:41:10.442 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:10 ntpd[22150]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-24T05:41:10.443 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:10 ntpd[22150]: can't open /var/log/ntpstats/rawstats.20230724: Permission denied 2023-07-24T05:41:10.443 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:10 ntpd[22150]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-24T05:41:10.443 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:10 ntpd[22150]: can't open /var/log/ntpstats/rawstats.20230724: Permission denied 2023-07-24T05:41:10.443 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:10 ntpd[22150]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-24T05:41:10.443 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:10 ntpd[22150]: can't open /var/log/ntpstats/peerstats.20230724: Permission denied 2023-07-24T05:41:10.443 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:10 ntpd[22150]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-24T05:41:10.444 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:10 ntpd[22150]: can't open /var/log/ntpstats/rawstats.20230724: Permission denied 2023-07-24T05:41:10.444 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:10 ntpd[22150]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-24T05:41:10.444 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:10 ntpd[22150]: can't open /var/log/ntpstats/peerstats.20230724: Permission denied 2023-07-24T05:41:10.478 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:10 ntpd[22110]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-24T05:41:10.479 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:10 ntpd[22110]: can't open /var/log/ntpstats/rawstats.20230724: Permission denied 2023-07-24T05:41:10.479 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:10 ntpd[22110]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-24T05:41:10.479 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:10 ntpd[22110]: can't open /var/log/ntpstats/rawstats.20230724: Permission denied 2023-07-24T05:41:10.479 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:10 ntpd[22110]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-24T05:41:10.479 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:10 ntpd[22110]: can't open /var/log/ntpstats/rawstats.20230724: Permission denied 2023-07-24T05:41:10.479 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:10 ntpd[22110]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-24T05:41:10.480 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:10 ntpd[22110]: can't open /var/log/ntpstats/peerstats.20230724: Permission denied 2023-07-24T05:41:10.480 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:10 ntpd[22110]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-24T05:41:10.480 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:10 ntpd[22110]: can't open /var/log/ntpstats/rawstats.20230724: Permission denied 2023-07-24T05:41:10.480 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:10 ntpd[22110]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-24T05:41:10.480 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:10 ntpd[22110]: can't open /var/log/ntpstats/peerstats.20230724: Permission denied 2023-07-24T05:41:12.442 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:12 ntpd[22150]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-24T05:41:12.442 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:12 ntpd[22150]: can't open /var/log/ntpstats/rawstats.20230724: Permission denied 2023-07-24T05:41:12.442 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:12 ntpd[22150]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-24T05:41:12.442 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:12 ntpd[22150]: can't open /var/log/ntpstats/rawstats.20230724: Permission denied 2023-07-24T05:41:12.442 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:12 ntpd[22150]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-24T05:41:12.443 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:12 ntpd[22150]: can't open /var/log/ntpstats/rawstats.20230724: Permission denied 2023-07-24T05:41:12.443 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:12 ntpd[22150]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-24T05:41:12.443 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:12 ntpd[22150]: can't open /var/log/ntpstats/rawstats.20230724: Permission denied 2023-07-24T05:41:12.443 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:12 ntpd[22150]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-24T05:41:12.443 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:12 ntpd[22150]: can't open /var/log/ntpstats/peerstats.20230724: Permission denied 2023-07-24T05:41:12.443 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:12 ntpd[22150]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-24T05:41:12.443 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:12 ntpd[22150]: can't open /var/log/ntpstats/rawstats.20230724: Permission denied 2023-07-24T05:41:12.444 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:12 ntpd[22150]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-24T05:41:12.444 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:12 ntpd[22150]: can't open /var/log/ntpstats/peerstats.20230724: Permission denied 2023-07-24T05:41:12.445 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:12 ntpd[22150]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-24T05:41:12.445 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:12 ntpd[22150]: can't open /var/log/ntpstats/rawstats.20230724: Permission denied 2023-07-24T05:41:12.445 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:12 ntpd[22150]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-24T05:41:12.445 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:12 ntpd[22150]: can't open /var/log/ntpstats/peerstats.20230724: Permission denied 2023-07-24T05:41:12.478 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:12 ntpd[22110]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-24T05:41:12.478 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:12 ntpd[22110]: can't open /var/log/ntpstats/rawstats.20230724: Permission denied 2023-07-24T05:41:12.479 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:12 ntpd[22110]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-24T05:41:12.479 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:12 ntpd[22110]: can't open /var/log/ntpstats/rawstats.20230724: Permission denied 2023-07-24T05:41:12.479 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:12 ntpd[22110]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-24T05:41:12.479 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:12 ntpd[22110]: can't open /var/log/ntpstats/rawstats.20230724: Permission denied 2023-07-24T05:41:12.479 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:12 ntpd[22110]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-24T05:41:12.479 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:12 ntpd[22110]: can't open /var/log/ntpstats/rawstats.20230724: Permission denied 2023-07-24T05:41:12.480 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:12 ntpd[22110]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-24T05:41:12.481 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:12 ntpd[22110]: can't open /var/log/ntpstats/peerstats.20230724: Permission denied 2023-07-24T05:41:12.481 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:12 ntpd[22110]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-24T05:41:12.481 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:12 ntpd[22110]: can't open /var/log/ntpstats/rawstats.20230724: Permission denied 2023-07-24T05:41:12.481 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:12 ntpd[22110]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-24T05:41:12.481 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:12 ntpd[22110]: can't open /var/log/ntpstats/peerstats.20230724: Permission denied 2023-07-24T05:41:12.481 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:12 ntpd[22110]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-24T05:41:12.481 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:12 ntpd[22110]: can't open /var/log/ntpstats/rawstats.20230724: Permission denied 2023-07-24T05:41:12.482 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:12 ntpd[22110]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-24T05:41:12.482 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:12 ntpd[22110]: can't open /var/log/ntpstats/peerstats.20230724: Permission denied 2023-07-24T05:41:14.441 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:14 ntpd[22150]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-24T05:41:14.442 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:14 ntpd[22150]: can't open /var/log/ntpstats/rawstats.20230724: Permission denied 2023-07-24T05:41:14.442 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:14 ntpd[22150]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-24T05:41:14.442 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:14 ntpd[22150]: can't open /var/log/ntpstats/rawstats.20230724: Permission denied 2023-07-24T05:41:14.442 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:14 ntpd[22150]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-24T05:41:14.442 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:14 ntpd[22150]: can't open /var/log/ntpstats/rawstats.20230724: Permission denied 2023-07-24T05:41:14.443 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:14 ntpd[22150]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-24T05:41:14.443 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:14 ntpd[22150]: can't open /var/log/ntpstats/rawstats.20230724: Permission denied 2023-07-24T05:41:14.443 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:14 ntpd[22150]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-24T05:41:14.443 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:14 ntpd[22150]: can't open /var/log/ntpstats/peerstats.20230724: Permission denied 2023-07-24T05:41:14.444 INFO:teuthology.orchestra.run.smithi077.stdout:24 Jul 05:41:14 ntpd[22150]: ntpd: time slew -0.000158 s 2023-07-24T05:41:14.444 INFO:teuthology.orchestra.run.smithi077.stdout:ntpd: time slew -0.000158s 2023-07-24T05:41:14.444 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:14 ntpd[22150]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-07-24T05:41:14.444 INFO:teuthology.orchestra.run.smithi077.stderr:24 Jul 05:41:14 ntpd[22150]: can't open /var/log/ntpstats/loopstats.20230724: Permission denied 2023-07-24T05:41:14.478 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:14 ntpd[22110]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-24T05:41:14.478 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:14 ntpd[22110]: can't open /var/log/ntpstats/rawstats.20230724: Permission denied 2023-07-24T05:41:14.478 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:14 ntpd[22110]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-24T05:41:14.478 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:14 ntpd[22110]: can't open /var/log/ntpstats/rawstats.20230724: Permission denied 2023-07-24T05:41:14.479 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:14 ntpd[22110]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-24T05:41:14.479 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:14 ntpd[22110]: can't open /var/log/ntpstats/rawstats.20230724: Permission denied 2023-07-24T05:41:14.479 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:14 ntpd[22110]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-24T05:41:14.480 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:14 ntpd[22110]: can't open /var/log/ntpstats/rawstats.20230724: Permission denied 2023-07-24T05:41:14.480 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:14 ntpd[22110]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-24T05:41:14.480 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:14 ntpd[22110]: can't open /var/log/ntpstats/peerstats.20230724: Permission denied 2023-07-24T05:41:14.480 INFO:teuthology.orchestra.run.smithi103.stdout:24 Jul 05:41:14 ntpd[22110]: ntpd: time slew -0.000487 s 2023-07-24T05:41:14.480 INFO:teuthology.orchestra.run.smithi103.stdout:ntpd: time slew -0.000487s 2023-07-24T05:41:14.481 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:14 ntpd[22110]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-07-24T05:41:14.481 INFO:teuthology.orchestra.run.smithi103.stderr:24 Jul 05:41:14 ntpd[22110]: can't open /var/log/ntpstats/loopstats.20230724: Permission denied 2023-07-24T05:41:14.577 INFO:teuthology.orchestra.run.smithi077.stdout: remote refid st t when poll reach delay offset jitter 2023-07-24T05:41:14.578 INFO:teuthology.orchestra.run.smithi077.stdout:============================================================================== 2023-07-24T05:41:14.578 INFO:teuthology.orchestra.run.smithi077.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-07-24T05:41:14.578 INFO:teuthology.orchestra.run.smithi077.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-07-24T05:41:14.578 INFO:teuthology.orchestra.run.smithi077.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-07-24T05:41:14.578 INFO:teuthology.orchestra.run.smithi077.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-07-24T05:41:14.616 INFO:teuthology.orchestra.run.smithi103.stdout: remote refid st t when poll reach delay offset jitter 2023-07-24T05:41:14.616 INFO:teuthology.orchestra.run.smithi103.stdout:============================================================================== 2023-07-24T05:41:14.616 INFO:teuthology.orchestra.run.smithi103.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-07-24T05:41:14.616 INFO:teuthology.orchestra.run.smithi103.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-07-24T05:41:14.616 INFO:teuthology.orchestra.run.smithi103.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-07-24T05:41:14.616 INFO:teuthology.orchestra.run.smithi103.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-07-24T05:41:14.618 INFO:teuthology.run_tasks:Running task install... 2023-07-24T05:41:14.626 DEBUG:teuthology.task.install:project ceph 2023-07-24T05:41:14.626 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'e2c50893bf78471cc8ee960317cc10390300dfd5'}} 2023-07-24T05:41:14.627 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'e2c50893bf78471cc8ee960317cc10390300dfd5'} 2023-07-24T05:41:14.627 INFO:teuthology.task.install:Using flavor: default 2023-07-24T05:41:14.633 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-07-24T05:41:14.633 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-07-24T05:41:14.634 DEBUG:teuthology.orchestra.run.smithi077:> sudo apt-key list | grep Ceph 2023-07-24T05:41:14.634 DEBUG:teuthology.orchestra.run.smithi103:> sudo apt-key list | grep Ceph 2023-07-24T05:41:14.862 INFO:teuthology.orchestra.run.smithi077.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-07-24T05:41:14.876 INFO:teuthology.orchestra.run.smithi103.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-07-24T05:41:15.005 INFO:teuthology.orchestra.run.smithi077.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-07-24T05:41:15.005 INFO:teuthology.orchestra.run.smithi077.stdout:uid [ unknown] Ceph.com (release key) 2023-07-24T05:41:15.007 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-07-24T05:41:15.007 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-07-24T05:41:15.007 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=e2c50893bf78471cc8ee960317cc10390300dfd5 2023-07-24T05:41:15.016 INFO:teuthology.orchestra.run.smithi103.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-07-24T05:41:15.017 INFO:teuthology.orchestra.run.smithi103.stdout:uid [ unknown] Ceph.com (release key) 2023-07-24T05:41:15.019 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-07-24T05:41:15.019 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-07-24T05:41:15.019 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=e2c50893bf78471cc8ee960317cc10390300dfd5 2023-07-24T05:41:15.317 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default/ 2023-07-24T05:41:15.317 INFO:teuthology.task.install.deb:Package version is 18.0.0-5042-ge2c50893-1focal 2023-07-24T05:41:15.351 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default/ 2023-07-24T05:41:15.351 INFO:teuthology.task.install.deb:Package version is 18.0.0-5042-ge2c50893-1focal 2023-07-24T05:41:15.653 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-07-24T05:41:15.653 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-07-24T05:41:15.655 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2023-07-24T05:41:15.656 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-07-24T05:41:15.689 DEBUG:teuthology.orchestra.run.smithi077:> sudo apt-get update 2023-07-24T05:41:15.690 DEBUG:teuthology.orchestra.run.smithi103:> sudo apt-get update 2023-07-24T05:41:16.072 INFO:teuthology.orchestra.run.smithi103.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-07-24T05:41:16.072 INFO:teuthology.orchestra.run.smithi103.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-07-24T05:41:16.097 INFO:teuthology.orchestra.run.smithi103.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-07-24T05:41:16.158 INFO:teuthology.orchestra.run.smithi103.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-07-24T05:41:16.179 INFO:teuthology.orchestra.run.smithi077.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-07-24T05:41:16.179 INFO:teuthology.orchestra.run.smithi077.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-07-24T05:41:16.219 INFO:teuthology.orchestra.run.smithi077.stdout:Ign:3 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal InRelease 2023-07-24T05:41:16.227 INFO:teuthology.orchestra.run.smithi103.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal InRelease 2023-07-24T05:41:16.266 INFO:teuthology.orchestra.run.smithi077.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-07-24T05:41:16.291 INFO:teuthology.orchestra.run.smithi077.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-07-24T05:41:16.298 INFO:teuthology.orchestra.run.smithi103.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-07-24T05:41:16.373 INFO:teuthology.orchestra.run.smithi077.stdout:Ign:6 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal Release.gpg 2023-07-24T05:41:16.379 INFO:teuthology.orchestra.run.smithi103.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal Release.gpg 2023-07-24T05:41:16.391 INFO:teuthology.orchestra.run.smithi077.stdout:Hit:7 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-07-24T05:41:16.450 INFO:teuthology.orchestra.run.smithi077.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-07-24T05:41:16.454 INFO:teuthology.orchestra.run.smithi103.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main i386 Packages [3,415 B] 2023-07-24T05:41:16.514 INFO:teuthology.orchestra.run.smithi077.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main i386 Packages [3,415 B] 2023-07-24T05:41:16.520 INFO:teuthology.orchestra.run.smithi103.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-07-24T05:41:17.520 INFO:teuthology.orchestra.run.smithi103.stdout:Fetched 28.4 kB in 1s (19.2 kB/s) 2023-07-24T05:41:17.606 INFO:teuthology.orchestra.run.smithi077.stdout:Fetched 28.4 kB in 2s (18.0 kB/s) 2023-07-24T05:41:18.707 INFO:teuthology.orchestra.run.smithi103.stdout:Reading package lists... 2023-07-24T05:41:18.745 DEBUG:teuthology.orchestra.run.smithi103:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-5042-ge2c50893-1focal cephadm=18.0.0-5042-ge2c50893-1focal ceph-mds=18.0.0-5042-ge2c50893-1focal ceph-mgr=18.0.0-5042-ge2c50893-1focal ceph-common=18.0.0-5042-ge2c50893-1focal ceph-fuse=18.0.0-5042-ge2c50893-1focal ceph-test=18.0.0-5042-ge2c50893-1focal ceph-volume=18.0.0-5042-ge2c50893-1focal radosgw=18.0.0-5042-ge2c50893-1focal python3-rados=18.0.0-5042-ge2c50893-1focal python3-rgw=18.0.0-5042-ge2c50893-1focal python3-cephfs=18.0.0-5042-ge2c50893-1focal python3-rbd=18.0.0-5042-ge2c50893-1focal libcephfs2=18.0.0-5042-ge2c50893-1focal libcephfs-dev=18.0.0-5042-ge2c50893-1focal librados2=18.0.0-5042-ge2c50893-1focal librbd1=18.0.0-5042-ge2c50893-1focal rbd-fuse=18.0.0-5042-ge2c50893-1focal python3-cephfs=18.0.0-5042-ge2c50893-1focal cephfs-shell=18.0.0-5042-ge2c50893-1focal cephfs-top=18.0.0-5042-ge2c50893-1focal cephfs-mirror=18.0.0-5042-ge2c50893-1focal 2023-07-24T05:41:18.813 INFO:teuthology.orchestra.run.smithi077.stdout:Reading package lists... 2023-07-24T05:41:18.851 DEBUG:teuthology.orchestra.run.smithi077:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-5042-ge2c50893-1focal cephadm=18.0.0-5042-ge2c50893-1focal ceph-mds=18.0.0-5042-ge2c50893-1focal ceph-mgr=18.0.0-5042-ge2c50893-1focal ceph-common=18.0.0-5042-ge2c50893-1focal ceph-fuse=18.0.0-5042-ge2c50893-1focal ceph-test=18.0.0-5042-ge2c50893-1focal ceph-volume=18.0.0-5042-ge2c50893-1focal radosgw=18.0.0-5042-ge2c50893-1focal python3-rados=18.0.0-5042-ge2c50893-1focal python3-rgw=18.0.0-5042-ge2c50893-1focal python3-cephfs=18.0.0-5042-ge2c50893-1focal python3-rbd=18.0.0-5042-ge2c50893-1focal libcephfs2=18.0.0-5042-ge2c50893-1focal libcephfs-dev=18.0.0-5042-ge2c50893-1focal librados2=18.0.0-5042-ge2c50893-1focal librbd1=18.0.0-5042-ge2c50893-1focal rbd-fuse=18.0.0-5042-ge2c50893-1focal python3-cephfs=18.0.0-5042-ge2c50893-1focal cephfs-shell=18.0.0-5042-ge2c50893-1focal cephfs-top=18.0.0-5042-ge2c50893-1focal cephfs-mirror=18.0.0-5042-ge2c50893-1focal 2023-07-24T05:41:18.869 INFO:teuthology.orchestra.run.smithi103.stdout:Reading package lists... 2023-07-24T05:41:18.968 INFO:teuthology.orchestra.run.smithi077.stdout:Reading package lists... 2023-07-24T05:41:19.060 INFO:teuthology.orchestra.run.smithi103.stdout:Building dependency tree... 2023-07-24T05:41:19.060 INFO:teuthology.orchestra.run.smithi103.stdout:Reading state information... 2023-07-24T05:41:19.170 INFO:teuthology.orchestra.run.smithi077.stdout:Building dependency tree... 2023-07-24T05:41:19.171 INFO:teuthology.orchestra.run.smithi077.stdout:Reading state information... 2023-07-24T05:41:19.230 INFO:teuthology.orchestra.run.smithi103.stdout:The following packages were automatically installed and are no longer required: 2023-07-24T05:41:19.232 INFO:teuthology.orchestra.run.smithi103.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-07-24T05:41:19.232 INFO:teuthology.orchestra.run.smithi103.stdout:Use 'sudo apt autoremove' to remove them. 2023-07-24T05:41:19.232 INFO:teuthology.orchestra.run.smithi103.stdout:The following additional packages will be installed: 2023-07-24T05:41:19.232 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-07-24T05:41:19.233 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-07-24T05:41:19.233 INFO:teuthology.orchestra.run.smithi103.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-07-24T05:41:19.233 INFO:teuthology.orchestra.run.smithi103.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-07-24T05:41:19.233 INFO:teuthology.orchestra.run.smithi103.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-07-24T05:41:19.234 INFO:teuthology.orchestra.run.smithi103.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-07-24T05:41:19.234 INFO:teuthology.orchestra.run.smithi103.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-07-24T05:41:19.234 INFO:teuthology.orchestra.run.smithi103.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-07-24T05:41:19.234 INFO:teuthology.orchestra.run.smithi103.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-07-24T05:41:19.235 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2023-07-24T05:41:19.235 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-07-24T05:41:19.235 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-07-24T05:41:19.235 INFO:teuthology.orchestra.run.smithi103.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-07-24T05:41:19.235 INFO:teuthology.orchestra.run.smithi103.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-07-24T05:41:19.235 INFO:teuthology.orchestra.run.smithi103.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-07-24T05:41:19.235 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-07-24T05:41:19.236 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2023-07-24T05:41:19.236 INFO:teuthology.orchestra.run.smithi103.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-07-24T05:41:19.236 INFO:teuthology.orchestra.run.smithi103.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-07-24T05:41:19.236 INFO:teuthology.orchestra.run.smithi103.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-07-24T05:41:19.236 INFO:teuthology.orchestra.run.smithi103.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-07-24T05:41:19.236 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-07-24T05:41:19.236 INFO:teuthology.orchestra.run.smithi103.stdout: qttranslations5-l10n socat xmlstarlet 2023-07-24T05:41:19.236 INFO:teuthology.orchestra.run.smithi103.stdout:Suggested packages: 2023-07-24T05:41:19.237 INFO:teuthology.orchestra.run.smithi103.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-07-24T05:41:19.237 INFO:teuthology.orchestra.run.smithi103.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-07-24T05:41:19.237 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-07-24T05:41:19.237 INFO:teuthology.orchestra.run.smithi103.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-07-24T05:41:19.237 INFO:teuthology.orchestra.run.smithi103.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-07-24T05:41:19.237 INFO:teuthology.orchestra.run.smithi103.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-07-24T05:41:19.237 INFO:teuthology.orchestra.run.smithi103.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-07-24T05:41:19.237 INFO:teuthology.orchestra.run.smithi103.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-07-24T05:41:19.238 INFO:teuthology.orchestra.run.smithi103.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-07-24T05:41:19.238 INFO:teuthology.orchestra.run.smithi103.stdout:Recommended packages: 2023-07-24T05:41:19.238 INFO:teuthology.orchestra.run.smithi103.stdout: btrfs-tools 2023-07-24T05:41:19.350 INFO:teuthology.orchestra.run.smithi077.stdout:The following packages were automatically installed and are no longer required: 2023-07-24T05:41:19.351 INFO:teuthology.orchestra.run.smithi077.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-07-24T05:41:19.351 INFO:teuthology.orchestra.run.smithi077.stdout:Use 'sudo apt autoremove' to remove them. 2023-07-24T05:41:19.351 INFO:teuthology.orchestra.run.smithi077.stdout:The following additional packages will be installed: 2023-07-24T05:41:19.351 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-07-24T05:41:19.352 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-07-24T05:41:19.352 INFO:teuthology.orchestra.run.smithi077.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-07-24T05:41:19.352 INFO:teuthology.orchestra.run.smithi077.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-07-24T05:41:19.352 INFO:teuthology.orchestra.run.smithi077.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-07-24T05:41:19.352 INFO:teuthology.orchestra.run.smithi077.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-07-24T05:41:19.353 INFO:teuthology.orchestra.run.smithi077.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-07-24T05:41:19.353 INFO:teuthology.orchestra.run.smithi077.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-07-24T05:41:19.353 INFO:teuthology.orchestra.run.smithi077.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-07-24T05:41:19.353 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2023-07-24T05:41:19.353 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-07-24T05:41:19.353 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-07-24T05:41:19.353 INFO:teuthology.orchestra.run.smithi077.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-07-24T05:41:19.353 INFO:teuthology.orchestra.run.smithi077.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-07-24T05:41:19.354 INFO:teuthology.orchestra.run.smithi077.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-07-24T05:41:19.354 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-07-24T05:41:19.354 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2023-07-24T05:41:19.354 INFO:teuthology.orchestra.run.smithi077.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-07-24T05:41:19.354 INFO:teuthology.orchestra.run.smithi077.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-07-24T05:41:19.354 INFO:teuthology.orchestra.run.smithi077.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-07-24T05:41:19.354 INFO:teuthology.orchestra.run.smithi077.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-07-24T05:41:19.354 INFO:teuthology.orchestra.run.smithi077.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-07-24T05:41:19.355 INFO:teuthology.orchestra.run.smithi077.stdout: qttranslations5-l10n socat xmlstarlet 2023-07-24T05:41:19.355 INFO:teuthology.orchestra.run.smithi077.stdout:Suggested packages: 2023-07-24T05:41:19.355 INFO:teuthology.orchestra.run.smithi077.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-07-24T05:41:19.355 INFO:teuthology.orchestra.run.smithi077.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-07-24T05:41:19.355 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-07-24T05:41:19.356 INFO:teuthology.orchestra.run.smithi077.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-07-24T05:41:19.356 INFO:teuthology.orchestra.run.smithi077.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-07-24T05:41:19.356 INFO:teuthology.orchestra.run.smithi077.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-07-24T05:41:19.356 INFO:teuthology.orchestra.run.smithi077.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-07-24T05:41:19.356 INFO:teuthology.orchestra.run.smithi077.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-07-24T05:41:19.356 INFO:teuthology.orchestra.run.smithi077.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-07-24T05:41:19.356 INFO:teuthology.orchestra.run.smithi077.stdout:Recommended packages: 2023-07-24T05:41:19.356 INFO:teuthology.orchestra.run.smithi077.stdout: btrfs-tools 2023-07-24T05:41:19.433 INFO:teuthology.orchestra.run.smithi103.stdout:The following NEW packages will be installed: 2023-07-24T05:41:19.433 INFO:teuthology.orchestra.run.smithi103.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-07-24T05:41:19.434 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-07-24T05:41:19.434 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-07-24T05:41:19.434 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-07-24T05:41:19.434 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-07-24T05:41:19.434 INFO:teuthology.orchestra.run.smithi103.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-07-24T05:41:19.434 INFO:teuthology.orchestra.run.smithi103.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-07-24T05:41:19.435 INFO:teuthology.orchestra.run.smithi103.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-07-24T05:41:19.435 INFO:teuthology.orchestra.run.smithi103.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-07-24T05:41:19.435 INFO:teuthology.orchestra.run.smithi103.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-07-24T05:41:19.436 INFO:teuthology.orchestra.run.smithi103.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-07-24T05:41:19.436 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2023-07-24T05:41:19.436 INFO:teuthology.orchestra.run.smithi103.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-07-24T05:41:19.436 INFO:teuthology.orchestra.run.smithi103.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-07-24T05:41:19.436 INFO:teuthology.orchestra.run.smithi103.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-07-24T05:41:19.436 INFO:teuthology.orchestra.run.smithi103.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-07-24T05:41:19.436 INFO:teuthology.orchestra.run.smithi103.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-07-24T05:41:19.436 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-07-24T05:41:19.437 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-07-24T05:41:19.437 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-07-24T05:41:19.437 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-07-24T05:41:19.437 INFO:teuthology.orchestra.run.smithi103.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-07-24T05:41:19.437 INFO:teuthology.orchestra.run.smithi103.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-07-24T05:41:19.437 INFO:teuthology.orchestra.run.smithi103.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-07-24T05:41:19.437 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-07-24T05:41:19.437 INFO:teuthology.orchestra.run.smithi103.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-07-24T05:41:19.438 INFO:teuthology.orchestra.run.smithi103.stdout:The following packages will be upgraded: 2023-07-24T05:41:19.438 INFO:teuthology.orchestra.run.smithi103.stdout: librados2 librbd1 2023-07-24T05:41:19.552 INFO:teuthology.orchestra.run.smithi077.stdout:The following NEW packages will be installed: 2023-07-24T05:41:19.553 INFO:teuthology.orchestra.run.smithi077.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-07-24T05:41:19.553 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-07-24T05:41:19.553 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-07-24T05:41:19.553 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-07-24T05:41:19.553 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-07-24T05:41:19.553 INFO:teuthology.orchestra.run.smithi077.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-07-24T05:41:19.553 INFO:teuthology.orchestra.run.smithi077.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-07-24T05:41:19.554 INFO:teuthology.orchestra.run.smithi077.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-07-24T05:41:19.554 INFO:teuthology.orchestra.run.smithi077.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-07-24T05:41:19.554 INFO:teuthology.orchestra.run.smithi077.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-07-24T05:41:19.555 INFO:teuthology.orchestra.run.smithi077.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-07-24T05:41:19.555 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2023-07-24T05:41:19.555 INFO:teuthology.orchestra.run.smithi077.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-07-24T05:41:19.555 INFO:teuthology.orchestra.run.smithi077.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-07-24T05:41:19.555 INFO:teuthology.orchestra.run.smithi077.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-07-24T05:41:19.555 INFO:teuthology.orchestra.run.smithi077.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-07-24T05:41:19.555 INFO:teuthology.orchestra.run.smithi077.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-07-24T05:41:19.555 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-07-24T05:41:19.556 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-07-24T05:41:19.556 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-07-24T05:41:19.556 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-07-24T05:41:19.556 INFO:teuthology.orchestra.run.smithi077.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-07-24T05:41:19.556 INFO:teuthology.orchestra.run.smithi077.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-07-24T05:41:19.556 INFO:teuthology.orchestra.run.smithi077.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-07-24T05:41:19.556 INFO:teuthology.orchestra.run.smithi077.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-07-24T05:41:19.557 INFO:teuthology.orchestra.run.smithi077.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-07-24T05:41:19.557 INFO:teuthology.orchestra.run.smithi077.stdout:The following packages will be upgraded: 2023-07-24T05:41:19.557 INFO:teuthology.orchestra.run.smithi077.stdout: librados2 librbd1 2023-07-24T05:41:19.659 INFO:teuthology.orchestra.run.smithi077.stdout:2 upgraded, 116 newly installed, 0 to remove and 210 not upgraded. 2023-07-24T05:41:19.659 INFO:teuthology.orchestra.run.smithi077.stdout:Need to get 210 MB of archives. 2023-07-24T05:41:19.659 INFO:teuthology.orchestra.run.smithi077.stdout:After this operation, 1,042 MB of additional disk space will be used. 2023-07-24T05:41:19.659 INFO:teuthology.orchestra.run.smithi077.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-07-24T05:41:19.663 INFO:teuthology.orchestra.run.smithi103.stdout:2 upgraded, 116 newly installed, 0 to remove and 210 not upgraded. 2023-07-24T05:41:19.663 INFO:teuthology.orchestra.run.smithi103.stdout:Need to get 210 MB of archives. 2023-07-24T05:41:19.664 INFO:teuthology.orchestra.run.smithi103.stdout:After this operation, 1,042 MB of additional disk space will be used. 2023-07-24T05:41:19.664 INFO:teuthology.orchestra.run.smithi103.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-07-24T05:41:19.686 INFO:teuthology.orchestra.run.smithi077.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-07-24T05:41:19.697 INFO:teuthology.orchestra.run.smithi077.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-07-24T05:41:19.698 INFO:teuthology.orchestra.run.smithi103.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-5042-ge2c50893-1focal [3,593 kB] 2023-07-24T05:41:19.734 INFO:teuthology.orchestra.run.smithi077.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-07-24T05:41:19.753 INFO:teuthology.orchestra.run.smithi103.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-07-24T05:41:19.774 INFO:teuthology.orchestra.run.smithi077.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-07-24T05:41:19.779 INFO:teuthology.orchestra.run.smithi077.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-07-24T05:41:19.791 INFO:teuthology.orchestra.run.smithi103.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-07-24T05:41:19.798 INFO:teuthology.orchestra.run.smithi077.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-07-24T05:41:19.815 INFO:teuthology.orchestra.run.smithi077.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-5042-ge2c50893-1focal [3,593 kB] 2023-07-24T05:41:19.863 INFO:teuthology.orchestra.run.smithi077.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-07-24T05:41:19.865 INFO:teuthology.orchestra.run.smithi077.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-07-24T05:41:19.877 INFO:teuthology.orchestra.run.smithi077.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-07-24T05:41:19.879 INFO:teuthology.orchestra.run.smithi077.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-07-24T05:41:19.924 INFO:teuthology.orchestra.run.smithi103.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-07-24T05:41:19.930 INFO:teuthology.orchestra.run.smithi077.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-07-24T05:41:20.038 INFO:teuthology.orchestra.run.smithi077.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-07-24T05:41:20.044 INFO:teuthology.orchestra.run.smithi077.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-07-24T05:41:20.057 INFO:teuthology.orchestra.run.smithi103.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-5042-ge2c50893-1focal [4,005 kB] 2023-07-24T05:41:20.082 INFO:teuthology.orchestra.run.smithi103.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-07-24T05:41:20.101 INFO:teuthology.orchestra.run.smithi103.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-07-24T05:41:20.119 INFO:teuthology.orchestra.run.smithi077.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-07-24T05:41:20.123 INFO:teuthology.orchestra.run.smithi077.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-07-24T05:41:20.139 INFO:teuthology.orchestra.run.smithi077.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-07-24T05:41:20.141 INFO:teuthology.orchestra.run.smithi077.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-07-24T05:41:20.142 INFO:teuthology.orchestra.run.smithi077.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-07-24T05:41:20.142 INFO:teuthology.orchestra.run.smithi077.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-07-24T05:41:20.149 INFO:teuthology.orchestra.run.smithi077.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-07-24T05:41:20.150 INFO:teuthology.orchestra.run.smithi077.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-07-24T05:41:20.172 INFO:teuthology.orchestra.run.smithi103.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-07-24T05:41:20.213 INFO:teuthology.orchestra.run.smithi077.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-07-24T05:41:20.241 INFO:teuthology.orchestra.run.smithi077.stdout:Get:25 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-5042-ge2c50893-1focal [4,005 kB] 2023-07-24T05:41:20.281 INFO:teuthology.orchestra.run.smithi103.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-5042-ge2c50893-1focal [725 kB] 2023-07-24T05:41:20.334 INFO:teuthology.orchestra.run.smithi077.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-07-24T05:41:20.340 INFO:teuthology.orchestra.run.smithi103.stdout:Get:11 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-5042-ge2c50893-1focal [377 kB] 2023-07-24T05:41:20.345 INFO:teuthology.orchestra.run.smithi077.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-07-24T05:41:20.356 INFO:teuthology.orchestra.run.smithi103.stdout:Get:12 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-5042-ge2c50893-1focal [22.5 kB] 2023-07-24T05:41:20.356 INFO:teuthology.orchestra.run.smithi103.stdout:Get:13 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-5042-ge2c50893-1focal [191 kB] 2023-07-24T05:41:20.386 INFO:teuthology.orchestra.run.smithi077.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-07-24T05:41:20.387 INFO:teuthology.orchestra.run.smithi103.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-5042-ge2c50893-1focal [50.2 kB] 2023-07-24T05:41:20.401 INFO:teuthology.orchestra.run.smithi103.stdout:Get:15 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-5042-ge2c50893-1focal [355 kB] 2023-07-24T05:41:20.415 INFO:teuthology.orchestra.run.smithi103.stdout:Get:16 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-5042-ge2c50893-1focal [6,806 kB] 2023-07-24T05:41:20.416 INFO:teuthology.orchestra.run.smithi077.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-07-24T05:41:20.421 INFO:teuthology.orchestra.run.smithi077.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-07-24T05:41:20.430 INFO:teuthology.orchestra.run.smithi103.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-07-24T05:41:20.443 INFO:teuthology.orchestra.run.smithi103.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-07-24T05:41:20.482 INFO:teuthology.orchestra.run.smithi103.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-07-24T05:41:20.490 INFO:teuthology.orchestra.run.smithi103.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-07-24T05:41:20.525 INFO:teuthology.orchestra.run.smithi077.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-07-24T05:41:20.526 INFO:teuthology.orchestra.run.smithi077.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-07-24T05:41:20.531 INFO:teuthology.orchestra.run.smithi077.stdout:Get:33 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-5042-ge2c50893-1focal [725 kB] 2023-07-24T05:41:20.532 INFO:teuthology.orchestra.run.smithi077.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-07-24T05:41:20.542 INFO:teuthology.orchestra.run.smithi077.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-07-24T05:41:20.557 INFO:teuthology.orchestra.run.smithi077.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-07-24T05:41:20.586 INFO:teuthology.orchestra.run.smithi077.stdout:Get:37 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-5042-ge2c50893-1focal [377 kB] 2023-07-24T05:41:20.593 INFO:teuthology.orchestra.run.smithi077.stdout:Get:38 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-5042-ge2c50893-1focal [22.5 kB] 2023-07-24T05:41:20.593 INFO:teuthology.orchestra.run.smithi077.stdout:Get:39 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-5042-ge2c50893-1focal [191 kB] 2023-07-24T05:41:20.641 INFO:teuthology.orchestra.run.smithi077.stdout:Get:40 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-5042-ge2c50893-1focal [50.2 kB] 2023-07-24T05:41:20.643 INFO:teuthology.orchestra.run.smithi077.stdout:Get:41 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-5042-ge2c50893-1focal [355 kB] 2023-07-24T05:41:20.653 INFO:teuthology.orchestra.run.smithi077.stdout:Get:42 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-5042-ge2c50893-1focal [6,806 kB] 2023-07-24T05:41:20.679 INFO:teuthology.orchestra.run.smithi077.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-07-24T05:41:20.706 INFO:teuthology.orchestra.run.smithi103.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-07-24T05:41:20.848 INFO:teuthology.orchestra.run.smithi103.stdout:Get:22 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-5042-ge2c50893-1focal [103 kB] 2023-07-24T05:41:20.849 INFO:teuthology.orchestra.run.smithi103.stdout:Get:23 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-5042-ge2c50893-1focal [464 kB] 2023-07-24T05:41:20.855 INFO:teuthology.orchestra.run.smithi103.stdout:Get:24 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-5042-ge2c50893-1focal [25.6 MB] 2023-07-24T05:41:20.943 INFO:teuthology.orchestra.run.smithi077.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-07-24T05:41:20.952 INFO:teuthology.orchestra.run.smithi077.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-07-24T05:41:20.973 INFO:teuthology.orchestra.run.smithi077.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-07-24T05:41:21.007 INFO:teuthology.orchestra.run.smithi077.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-07-24T05:41:21.009 INFO:teuthology.orchestra.run.smithi077.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-07-24T05:41:21.010 INFO:teuthology.orchestra.run.smithi077.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-07-24T05:41:21.011 INFO:teuthology.orchestra.run.smithi077.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-07-24T05:41:21.024 INFO:teuthology.orchestra.run.smithi077.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-07-24T05:41:21.041 INFO:teuthology.orchestra.run.smithi077.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-07-24T05:41:21.050 INFO:teuthology.orchestra.run.smithi077.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-07-24T05:41:21.139 INFO:teuthology.orchestra.run.smithi077.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-07-24T05:41:21.164 INFO:teuthology.orchestra.run.smithi077.stdout:Get:55 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-5042-ge2c50893-1focal [103 kB] 2023-07-24T05:41:21.166 INFO:teuthology.orchestra.run.smithi077.stdout:Get:56 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-5042-ge2c50893-1focal [464 kB] 2023-07-24T05:41:21.172 INFO:teuthology.orchestra.run.smithi077.stdout:Get:57 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-5042-ge2c50893-1focal [25.6 MB] 2023-07-24T05:41:21.174 INFO:teuthology.orchestra.run.smithi103.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-07-24T05:41:21.204 INFO:teuthology.orchestra.run.smithi103.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-07-24T05:41:21.238 INFO:teuthology.orchestra.run.smithi077.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-07-24T05:41:21.420 INFO:teuthology.orchestra.run.smithi103.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-07-24T05:41:21.430 INFO:teuthology.orchestra.run.smithi103.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-07-24T05:41:21.473 INFO:teuthology.orchestra.run.smithi103.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-07-24T05:41:21.482 INFO:teuthology.orchestra.run.smithi103.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-07-24T05:41:21.486 INFO:teuthology.orchestra.run.smithi103.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-07-24T05:41:21.490 INFO:teuthology.orchestra.run.smithi103.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-07-24T05:41:21.508 INFO:teuthology.orchestra.run.smithi103.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-07-24T05:41:21.511 INFO:teuthology.orchestra.run.smithi103.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-07-24T05:41:21.750 INFO:teuthology.orchestra.run.smithi103.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-07-24T05:41:21.759 INFO:teuthology.orchestra.run.smithi077.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-07-24T05:41:21.802 INFO:teuthology.orchestra.run.smithi077.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-07-24T05:41:21.804 INFO:teuthology.orchestra.run.smithi077.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-07-24T05:41:21.833 INFO:teuthology.orchestra.run.smithi077.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-07-24T05:41:21.833 INFO:teuthology.orchestra.run.smithi077.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-07-24T05:41:21.834 INFO:teuthology.orchestra.run.smithi077.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-07-24T05:41:21.834 INFO:teuthology.orchestra.run.smithi077.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-07-24T05:41:21.835 INFO:teuthology.orchestra.run.smithi077.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-07-24T05:41:21.836 INFO:teuthology.orchestra.run.smithi077.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-07-24T05:41:21.903 INFO:teuthology.orchestra.run.smithi077.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-07-24T05:41:22.015 INFO:teuthology.orchestra.run.smithi077.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-07-24T05:41:22.019 INFO:teuthology.orchestra.run.smithi077.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-07-24T05:41:22.027 INFO:teuthology.orchestra.run.smithi077.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-07-24T05:41:22.079 INFO:teuthology.orchestra.run.smithi077.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-07-24T05:41:22.093 INFO:teuthology.orchestra.run.smithi077.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-07-24T05:41:22.103 INFO:teuthology.orchestra.run.smithi077.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-07-24T05:41:22.105 INFO:teuthology.orchestra.run.smithi077.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-07-24T05:41:22.123 INFO:teuthology.orchestra.run.smithi077.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-07-24T05:41:22.135 INFO:teuthology.orchestra.run.smithi103.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-07-24T05:41:22.136 INFO:teuthology.orchestra.run.smithi077.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-07-24T05:41:22.137 INFO:teuthology.orchestra.run.smithi077.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-07-24T05:41:22.173 INFO:teuthology.orchestra.run.smithi103.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-07-24T05:41:22.255 INFO:teuthology.orchestra.run.smithi103.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-07-24T05:41:22.263 INFO:teuthology.orchestra.run.smithi077.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-07-24T05:41:22.333 INFO:teuthology.orchestra.run.smithi103.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-07-24T05:41:22.338 INFO:teuthology.orchestra.run.smithi103.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-07-24T05:41:22.433 INFO:teuthology.orchestra.run.smithi103.stdout:Get:41 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-5042-ge2c50893-1focal [11.0 MB] 2023-07-24T05:41:22.438 INFO:teuthology.orchestra.run.smithi077.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-07-24T05:41:22.463 INFO:teuthology.orchestra.run.smithi077.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-07-24T05:41:22.494 INFO:teuthology.orchestra.run.smithi103.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-07-24T05:41:22.495 INFO:teuthology.orchestra.run.smithi103.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-07-24T05:41:22.499 INFO:teuthology.orchestra.run.smithi103.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-07-24T05:41:22.505 INFO:teuthology.orchestra.run.smithi103.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-07-24T05:41:22.569 INFO:teuthology.orchestra.run.smithi103.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-07-24T05:41:22.815 INFO:teuthology.orchestra.run.smithi077.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-07-24T05:41:22.816 INFO:teuthology.orchestra.run.smithi103.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-07-24T05:41:22.817 INFO:teuthology.orchestra.run.smithi077.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-07-24T05:41:22.817 INFO:teuthology.orchestra.run.smithi077.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-07-24T05:41:22.818 INFO:teuthology.orchestra.run.smithi077.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-07-24T05:41:22.818 INFO:teuthology.orchestra.run.smithi077.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-07-24T05:41:22.820 INFO:teuthology.orchestra.run.smithi077.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-07-24T05:41:22.837 INFO:teuthology.orchestra.run.smithi077.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-07-24T05:41:22.838 INFO:teuthology.orchestra.run.smithi077.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-07-24T05:41:22.889 INFO:teuthology.orchestra.run.smithi077.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-07-24T05:41:22.942 INFO:teuthology.orchestra.run.smithi077.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-07-24T05:41:23.010 INFO:teuthology.orchestra.run.smithi077.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-07-24T05:41:23.024 INFO:teuthology.orchestra.run.smithi077.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-07-24T05:41:23.029 INFO:teuthology.orchestra.run.smithi077.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-07-24T05:41:23.049 INFO:teuthology.orchestra.run.smithi077.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-07-24T05:41:23.054 INFO:teuthology.orchestra.run.smithi077.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-07-24T05:41:23.163 INFO:teuthology.orchestra.run.smithi077.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-5042-ge2c50893-1focal [11.0 MB] 2023-07-24T05:41:23.190 INFO:teuthology.orchestra.run.smithi103.stdout:Get:48 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-5042-ge2c50893-1focal [223 kB] 2023-07-24T05:41:23.211 INFO:teuthology.orchestra.run.smithi103.stdout:Get:49 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-5042-ge2c50893-1focal [135 kB] 2023-07-24T05:41:23.217 INFO:teuthology.orchestra.run.smithi103.stdout:Get:50 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-5042-ge2c50893-1focal [1,553 kB] 2023-07-24T05:41:23.307 INFO:teuthology.orchestra.run.smithi103.stdout:Get:51 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-5042-ge2c50893-1focal [9,381 kB] 2023-07-24T05:41:23.312 INFO:teuthology.orchestra.run.smithi103.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-07-24T05:41:23.328 INFO:teuthology.orchestra.run.smithi103.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-07-24T05:41:23.387 INFO:teuthology.orchestra.run.smithi103.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-07-24T05:41:23.427 INFO:teuthology.orchestra.run.smithi103.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-07-24T05:41:23.438 INFO:teuthology.orchestra.run.smithi103.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-07-24T05:41:23.445 INFO:teuthology.orchestra.run.smithi103.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-07-24T05:41:23.449 INFO:teuthology.orchestra.run.smithi103.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-07-24T05:41:23.479 INFO:teuthology.orchestra.run.smithi103.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-07-24T05:41:23.494 INFO:teuthology.orchestra.run.smithi103.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-07-24T05:41:23.507 INFO:teuthology.orchestra.run.smithi103.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-07-24T05:41:23.679 INFO:teuthology.orchestra.run.smithi103.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-07-24T05:41:23.879 INFO:teuthology.orchestra.run.smithi103.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-07-24T05:41:23.892 INFO:teuthology.orchestra.run.smithi103.stdout:Get:64 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-5042-ge2c50893-1focal [31.3 MB] 2023-07-24T05:41:23.924 INFO:teuthology.orchestra.run.smithi077.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-5042-ge2c50893-1focal [223 kB] 2023-07-24T05:41:23.933 INFO:teuthology.orchestra.run.smithi077.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-5042-ge2c50893-1focal [135 kB] 2023-07-24T05:41:23.953 INFO:teuthology.orchestra.run.smithi077.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-5042-ge2c50893-1focal [1,553 kB] 2023-07-24T05:41:24.051 INFO:teuthology.orchestra.run.smithi077.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-5042-ge2c50893-1focal [9,381 kB] 2023-07-24T05:41:24.774 INFO:teuthology.orchestra.run.smithi077.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-5042-ge2c50893-1focal [31.3 MB] 2023-07-24T05:41:24.779 INFO:teuthology.orchestra.run.smithi103.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-07-24T05:41:24.848 INFO:teuthology.orchestra.run.smithi103.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-07-24T05:41:24.850 INFO:teuthology.orchestra.run.smithi103.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-07-24T05:41:24.907 INFO:teuthology.orchestra.run.smithi103.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-07-24T05:41:24.907 INFO:teuthology.orchestra.run.smithi103.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-07-24T05:41:24.908 INFO:teuthology.orchestra.run.smithi103.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-07-24T05:41:24.909 INFO:teuthology.orchestra.run.smithi103.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-07-24T05:41:24.909 INFO:teuthology.orchestra.run.smithi103.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-07-24T05:41:24.910 INFO:teuthology.orchestra.run.smithi103.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-07-24T05:41:25.097 INFO:teuthology.orchestra.run.smithi103.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-07-24T05:41:25.448 INFO:teuthology.orchestra.run.smithi103.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-07-24T05:41:25.461 INFO:teuthology.orchestra.run.smithi103.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-07-24T05:41:25.493 INFO:teuthology.orchestra.run.smithi103.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-07-24T05:41:25.667 INFO:teuthology.orchestra.run.smithi103.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-07-24T05:41:25.718 INFO:teuthology.orchestra.run.smithi103.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-07-24T05:41:25.750 INFO:teuthology.orchestra.run.smithi103.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-07-24T05:41:25.761 INFO:teuthology.orchestra.run.smithi103.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-07-24T05:41:25.813 INFO:teuthology.orchestra.run.smithi103.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-07-24T05:41:25.849 INFO:teuthology.orchestra.run.smithi103.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-07-24T05:41:25.851 INFO:teuthology.orchestra.run.smithi103.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-07-24T05:41:25.912 INFO:teuthology.orchestra.run.smithi103.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-5042-ge2c50893-1focal [3,808 B] 2023-07-24T05:41:25.913 INFO:teuthology.orchestra.run.smithi103.stdout:Get:86 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-5042-ge2c50893-1focal [835 kB] 2023-07-24T05:41:25.970 INFO:teuthology.orchestra.run.smithi103.stdout:Get:87 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-5042-ge2c50893-1focal [2,296 kB] 2023-07-24T05:41:26.102 INFO:teuthology.orchestra.run.smithi103.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-5042-ge2c50893-1focal [219 kB] 2023-07-24T05:41:26.109 INFO:teuthology.orchestra.run.smithi103.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-5042-ge2c50893-1focal [124 kB] 2023-07-24T05:41:26.113 INFO:teuthology.orchestra.run.smithi103.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-5042-ge2c50893-1focal [1,781 kB] 2023-07-24T05:41:26.179 INFO:teuthology.orchestra.run.smithi103.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-07-24T05:41:26.214 INFO:teuthology.orchestra.run.smithi103.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-5042-ge2c50893-1focal [7,892 kB] 2023-07-24T05:41:26.701 INFO:teuthology.orchestra.run.smithi103.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-07-24T05:41:26.720 INFO:teuthology.orchestra.run.smithi103.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-5042-ge2c50893-1focal [3,928 B] 2023-07-24T05:41:26.720 INFO:teuthology.orchestra.run.smithi103.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-5042-ge2c50893-1focal [51.0 MB] 2023-07-24T05:41:26.767 INFO:teuthology.orchestra.run.smithi103.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-07-24T05:41:27.016 INFO:teuthology.orchestra.run.smithi077.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-5042-ge2c50893-1focal [3,808 B] 2023-07-24T05:41:27.017 INFO:teuthology.orchestra.run.smithi077.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-5042-ge2c50893-1focal [835 kB] 2023-07-24T05:41:27.078 INFO:teuthology.orchestra.run.smithi077.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-5042-ge2c50893-1focal [2,296 kB] 2023-07-24T05:41:27.188 INFO:teuthology.orchestra.run.smithi103.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-07-24T05:41:27.190 INFO:teuthology.orchestra.run.smithi103.stdout:Get:98 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-07-24T05:41:27.190 INFO:teuthology.orchestra.run.smithi103.stdout:Get:99 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-07-24T05:41:27.191 INFO:teuthology.orchestra.run.smithi103.stdout:Get:100 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-07-24T05:41:27.191 INFO:teuthology.orchestra.run.smithi103.stdout:Get:101 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-07-24T05:41:27.192 INFO:teuthology.orchestra.run.smithi103.stdout:Get:102 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-07-24T05:41:27.248 INFO:teuthology.orchestra.run.smithi103.stdout:Get:103 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-07-24T05:41:27.248 INFO:teuthology.orchestra.run.smithi103.stdout:Get:104 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-07-24T05:41:27.281 INFO:teuthology.orchestra.run.smithi077.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-5042-ge2c50893-1focal [219 kB] 2023-07-24T05:41:27.288 INFO:teuthology.orchestra.run.smithi077.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-5042-ge2c50893-1focal [124 kB] 2023-07-24T05:41:27.305 INFO:teuthology.orchestra.run.smithi077.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-5042-ge2c50893-1focal [1,781 kB] 2023-07-24T05:41:27.427 INFO:teuthology.orchestra.run.smithi077.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-5042-ge2c50893-1focal [7,892 kB] 2023-07-24T05:41:27.444 INFO:teuthology.orchestra.run.smithi103.stdout:Get:105 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-07-24T05:41:27.638 INFO:teuthology.orchestra.run.smithi103.stdout:Get:106 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-07-24T05:41:27.896 INFO:teuthology.orchestra.run.smithi103.stdout:Get:107 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-07-24T05:41:27.950 INFO:teuthology.orchestra.run.smithi103.stdout:Get:108 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-07-24T05:41:27.967 INFO:teuthology.orchestra.run.smithi103.stdout:Get:109 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-07-24T05:41:27.993 INFO:teuthology.orchestra.run.smithi077.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-5042-ge2c50893-1focal [3,928 B] 2023-07-24T05:41:27.994 INFO:teuthology.orchestra.run.smithi077.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-5042-ge2c50893-1focal [51.0 MB] 2023-07-24T05:41:28.044 INFO:teuthology.orchestra.run.smithi103.stdout:Get:110 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-07-24T05:41:28.060 INFO:teuthology.orchestra.run.smithi103.stdout:Get:111 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-07-24T05:41:29.897 INFO:teuthology.orchestra.run.smithi103.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-5042-ge2c50893-1focal [220 kB] 2023-07-24T05:41:29.899 INFO:teuthology.orchestra.run.smithi103.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.0.0-5042-ge2c50893-1focal [258 kB] 2023-07-24T05:41:29.904 INFO:teuthology.orchestra.run.smithi103.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.0.0-5042-ge2c50893-1focal [23.3 kB] 2023-07-24T05:41:29.905 INFO:teuthology.orchestra.run.smithi103.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.0.0-5042-ge2c50893-1focal [12.9 kB] 2023-07-24T05:41:29.909 INFO:teuthology.orchestra.run.smithi103.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-5042-ge2c50893-1focal [28.0 kB] 2023-07-24T05:41:29.910 INFO:teuthology.orchestra.run.smithi103.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-5042-ge2c50893-1focal [13.8 MB] 2023-07-24T05:41:30.784 INFO:teuthology.orchestra.run.smithi103.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-5042-ge2c50893-1focal [96.6 kB] 2023-07-24T05:41:31.545 INFO:teuthology.orchestra.run.smithi077.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-5042-ge2c50893-1focal [220 kB] 2023-07-24T05:41:31.547 INFO:teuthology.orchestra.run.smithi077.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.0.0-5042-ge2c50893-1focal [258 kB] 2023-07-24T05:41:31.573 INFO:teuthology.orchestra.run.smithi077.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.0.0-5042-ge2c50893-1focal [23.3 kB] 2023-07-24T05:41:31.573 INFO:teuthology.orchestra.run.smithi077.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.0.0-5042-ge2c50893-1focal [12.9 kB] 2023-07-24T05:41:31.574 INFO:teuthology.orchestra.run.smithi077.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-5042-ge2c50893-1focal [28.0 kB] 2023-07-24T05:41:31.575 INFO:teuthology.orchestra.run.smithi077.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-5042-ge2c50893-1focal [13.8 MB] 2023-07-24T05:41:31.695 INFO:teuthology.orchestra.run.smithi103.stdout:Fetched 210 MB in 11s (18.5 MB/s) 2023-07-24T05:41:31.910 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-pyperclip. 2023-07-24T05:41:31.980 INFO:teuthology.orchestra.run.smithi103.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107758 files and directories currently installed.) 2023-07-24T05:41:31.984 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-07-24T05:41:32.022 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-07-24T05:41:32.384 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-wcwidth. 2023-07-24T05:41:32.404 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-07-24T05:41:32.442 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-07-24T05:41:32.588 INFO:teuthology.orchestra.run.smithi077.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230720.042515/e2c50893bf78471cc8ee960317cc10390300dfd5/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-5042-ge2c50893-1focal [96.6 kB] 2023-07-24T05:41:32.803 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-cmd2. 2023-07-24T05:41:32.822 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-07-24T05:41:33.011 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-07-24T05:41:33.415 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-07-24T05:41:33.435 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-07-24T05:41:33.504 INFO:teuthology.orchestra.run.smithi077.stdout:Fetched 210 MB in 13s (16.1 MB/s) 2023-07-24T05:41:33.515 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-07-24T05:41:33.683 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-pyperclip. 2023-07-24T05:41:33.754 INFO:teuthology.orchestra.run.smithi077.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107758 files and directories currently installed.) 2023-07-24T05:41:33.757 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-07-24T05:41:33.804 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-07-24T05:41:33.928 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-07-24T05:41:33.948 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-07-24T05:41:33.985 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-07-24T05:41:34.140 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-wcwidth. 2023-07-24T05:41:34.159 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-07-24T05:41:34.214 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-07-24T05:41:34.414 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-07-24T05:41:34.434 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-07-24T05:41:34.489 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-07-24T05:41:34.568 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-cmd2. 2023-07-24T05:41:34.587 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-07-24T05:41:34.626 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-07-24T05:41:35.001 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-07-24T05:41:35.020 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-07-24T05:41:35.021 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-07-24T05:41:35.041 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-07-24T05:41:35.077 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-24T05:41:35.121 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-07-24T05:41:35.534 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-07-24T05:41:35.553 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-07-24T05:41:35.592 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-07-24T05:41:35.646 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-07-24T05:41:35.659 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-07-24T05:41:35.729 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-24T05:41:35.995 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-07-24T05:41:36.014 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-07-24T05:41:36.053 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-07-24T05:41:36.142 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-07-24T05:41:36.160 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-07-24T05:41:36.199 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-24T05:41:36.582 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-07-24T05:41:36.602 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-07-24T05:41:36.628 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-07-24T05:41:36.648 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-07-24T05:41:36.681 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-24T05:41:36.686 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-07-24T05:41:37.128 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../010-librbd1_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:41:37.244 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-07-24T05:41:37.251 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking librbd1 (18.0.0-5042-ge2c50893-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-07-24T05:41:37.263 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-07-24T05:41:37.302 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-24T05:41:37.714 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-07-24T05:41:37.734 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-07-24T05:41:37.772 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-24T05:41:38.043 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../011-librados2_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:41:38.170 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking librados2 (18.0.0-5042-ge2c50893-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-07-24T05:41:38.232 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-07-24T05:41:38.251 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-07-24T05:41:38.291 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-07-24T05:41:38.717 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../010-librbd1_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:41:38.840 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking librbd1 (18.0.0-5042-ge2c50893-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-07-24T05:41:38.933 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libcephfs2. 2023-07-24T05:41:38.952 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:41:38.991 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libcephfs2 (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:41:39.378 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-rados. 2023-07-24T05:41:39.397 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../013-python3-rados_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:41:39.436 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-rados (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:41:39.601 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../011-librados2_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:41:39.725 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking librados2 (18.0.0-5042-ge2c50893-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-07-24T05:41:39.856 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-07-24T05:41:39.875 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-5042-ge2c50893-1focal_all.deb ... 2023-07-24T05:41:39.914 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-ceph-argparse (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:41:40.234 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-cephfs. 2023-07-24T05:41:40.253 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:41:40.292 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-cephfs (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:41:40.512 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libcephfs2. 2023-07-24T05:41:40.531 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:41:40.571 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libcephfs2 (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:41:40.695 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-ceph-common. 2023-07-24T05:41:40.715 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-5042-ge2c50893-1focal_all.deb ... 2023-07-24T05:41:40.753 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-ceph-common (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:41:40.965 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-rados. 2023-07-24T05:41:40.984 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../013-python3-rados_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:41:41.023 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-rados (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:41:41.124 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-prettytable. 2023-07-24T05:41:41.143 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2023-07-24T05:41:41.182 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-07-24T05:41:41.443 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-07-24T05:41:41.462 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-5042-ge2c50893-1focal_all.deb ... 2023-07-24T05:41:41.485 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-rbd. 2023-07-24T05:41:41.498 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:41:41.500 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-ceph-argparse (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:41:41.535 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-rbd (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:41:41.795 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-cephfs. 2023-07-24T05:41:41.815 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:41:41.853 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-cephfs (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:41:41.929 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-07-24T05:41:41.942 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-07-24T05:41:41.979 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-07-24T05:41:42.240 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-ceph-common. 2023-07-24T05:41:42.259 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-5042-ge2c50893-1focal_all.deb ... 2023-07-24T05:41:42.298 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-ceph-common (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:41:42.374 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-07-24T05:41:42.387 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2023-07-24T05:41:42.424 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-07-24T05:41:42.693 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-prettytable. 2023-07-24T05:41:42.712 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2023-07-24T05:41:42.751 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-07-24T05:41:42.769 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-07-24T05:41:42.782 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-07-24T05:41:42.819 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-07-24T05:41:43.078 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-rbd. 2023-07-24T05:41:43.097 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:41:43.136 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-rbd (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:41:43.239 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package librgw2. 2023-07-24T05:41:43.259 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../022-librgw2_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:41:43.306 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking librgw2 (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:41:43.556 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-07-24T05:41:43.575 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-07-24T05:41:43.614 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-07-24T05:41:44.009 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-07-24T05:41:44.027 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2023-07-24T05:41:44.067 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-07-24T05:41:44.284 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-rgw. 2023-07-24T05:41:44.302 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../023-python3-rgw_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:41:44.342 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-rgw (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:41:44.470 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-07-24T05:41:44.488 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-07-24T05:41:44.519 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-07-24T05:41:44.721 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package liboath0. 2023-07-24T05:41:44.740 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-07-24T05:41:44.779 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-07-24T05:41:44.931 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package librgw2. 2023-07-24T05:41:44.950 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../022-librgw2_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:41:44.989 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking librgw2 (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:41:45.141 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libradosstriper1. 2023-07-24T05:41:45.160 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../025-libradosstriper1_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:41:45.199 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libradosstriper1 (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:41:45.728 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-common. 2023-07-24T05:41:45.748 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../026-ceph-common_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:41:45.786 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-common (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:41:45.934 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-rgw. 2023-07-24T05:41:45.954 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../023-python3-rgw_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:41:46.009 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-rgw (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:41:46.412 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package liboath0. 2023-07-24T05:41:46.431 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-07-24T05:41:46.470 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-07-24T05:41:46.848 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libradosstriper1. 2023-07-24T05:41:46.867 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../025-libradosstriper1_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:41:46.906 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libradosstriper1 (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:41:47.410 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-common. 2023-07-24T05:41:47.428 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../026-ceph-common_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:41:47.459 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-common (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:41:48.475 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-base. 2023-07-24T05:41:48.487 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../027-ceph-base_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:41:48.544 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-base (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:41:50.056 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-cherrypy3. 2023-07-24T05:41:50.073 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-07-24T05:41:50.113 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-07-24T05:41:50.315 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-base. 2023-07-24T05:41:50.334 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../027-ceph-base_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:41:50.387 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-base (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:41:50.509 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-natsort. 2023-07-24T05:41:50.528 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2023-07-24T05:41:50.567 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-07-24T05:41:50.938 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-logutils. 2023-07-24T05:41:50.951 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-07-24T05:41:50.996 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-07-24T05:41:51.350 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-markupsafe. 2023-07-24T05:41:51.368 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-07-24T05:41:51.407 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-07-24T05:41:51.761 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-mako. 2023-07-24T05:41:51.779 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-07-24T05:41:51.811 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-cherrypy3. 2023-07-24T05:41:51.819 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-07-24T05:41:51.829 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-07-24T05:41:51.869 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-07-24T05:41:52.197 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-simplegeneric. 2023-07-24T05:41:52.216 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-07-24T05:41:52.255 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-07-24T05:41:52.256 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-natsort. 2023-07-24T05:41:52.274 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2023-07-24T05:41:52.314 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-07-24T05:41:52.601 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-singledispatch. 2023-07-24T05:41:52.620 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-07-24T05:41:52.658 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-07-24T05:41:52.692 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-logutils. 2023-07-24T05:41:52.705 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-07-24T05:41:52.742 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-07-24T05:41:53.012 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-webob. 2023-07-24T05:41:53.032 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-07-24T05:41:53.069 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-07-24T05:41:53.078 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-markupsafe. 2023-07-24T05:41:53.098 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-07-24T05:41:53.170 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-07-24T05:41:53.523 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-mako. 2023-07-24T05:41:53.541 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-07-24T05:41:53.581 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-07-24T05:41:53.984 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-simplegeneric. 2023-07-24T05:41:54.003 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-07-24T05:41:54.042 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-07-24T05:41:54.082 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-soupsieve. 2023-07-24T05:41:54.100 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-07-24T05:41:54.140 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-07-24T05:41:54.394 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-singledispatch. 2023-07-24T05:41:54.407 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-07-24T05:41:54.444 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-07-24T05:41:54.526 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-bs4. 2023-07-24T05:41:54.544 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-07-24T05:41:54.584 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-07-24T05:41:54.814 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-webob. 2023-07-24T05:41:54.827 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-07-24T05:41:54.864 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-07-24T05:41:55.021 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-waitress. 2023-07-24T05:41:55.040 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-07-24T05:41:55.086 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-07-24T05:41:55.242 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-soupsieve. 2023-07-24T05:41:55.262 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-07-24T05:41:55.300 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-07-24T05:41:55.508 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-tempita. 2023-07-24T05:41:55.527 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-07-24T05:41:55.566 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-07-24T05:41:55.670 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-bs4. 2023-07-24T05:41:55.689 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-07-24T05:41:55.728 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-07-24T05:41:55.911 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-paste. 2023-07-24T05:41:55.930 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-07-24T05:41:55.969 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-07-24T05:41:56.156 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-waitress. 2023-07-24T05:41:56.169 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-07-24T05:41:56.219 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-07-24T05:41:56.356 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-07-24T05:41:56.375 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-07-24T05:41:56.423 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-07-24T05:41:56.618 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-tempita. 2023-07-24T05:41:56.635 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-07-24T05:41:56.675 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-07-24T05:41:56.793 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-pastedeploy. 2023-07-24T05:41:56.811 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-07-24T05:41:56.851 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-07-24T05:41:57.036 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-paste. 2023-07-24T05:41:57.049 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-07-24T05:41:57.086 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-07-24T05:41:57.221 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-webtest. 2023-07-24T05:41:57.239 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-07-24T05:41:57.279 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-07-24T05:41:57.432 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-07-24T05:41:57.450 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-07-24T05:41:57.523 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-07-24T05:41:57.649 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-pecan. 2023-07-24T05:41:57.668 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-07-24T05:41:57.699 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-07-24T05:41:57.859 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-pastedeploy. 2023-07-24T05:41:57.878 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-07-24T05:41:57.917 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-07-24T05:41:58.129 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-werkzeug. 2023-07-24T05:41:58.148 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-07-24T05:41:58.187 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-07-24T05:41:58.287 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-webtest. 2023-07-24T05:41:58.305 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-07-24T05:41:58.345 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-07-24T05:41:58.558 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-07-24T05:41:58.576 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.0.0-5042-ge2c50893-1focal_all.deb ... 2023-07-24T05:41:58.615 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-mgr-modules-core (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:41:58.748 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-pecan. 2023-07-24T05:41:58.767 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-07-24T05:41:58.806 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-07-24T05:41:59.096 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-07-24T05:41:59.115 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:41:59.187 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:41:59.252 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-werkzeug. 2023-07-24T05:41:59.271 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-07-24T05:41:59.310 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-07-24T05:41:59.585 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-cryptography. 2023-07-24T05:41:59.604 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-07-24T05:41:59.642 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-07-24T05:41:59.672 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-07-24T05:41:59.691 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.0.0-5042-ge2c50893-1focal_all.deb ... 2023-07-24T05:41:59.729 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-mgr-modules-core (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:00.097 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-openssl. 2023-07-24T05:42:00.115 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2023-07-24T05:42:00.154 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-07-24T05:42:00.176 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-07-24T05:42:00.193 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:42:00.234 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:00.550 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-mgr. 2023-07-24T05:42:00.568 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../050-ceph-mgr_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:42:00.608 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-mgr (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:00.621 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-cryptography. 2023-07-24T05:42:00.640 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-07-24T05:42:00.678 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-07-24T05:42:01.116 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-openssl. 2023-07-24T05:42:01.135 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2023-07-24T05:42:01.136 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-mon. 2023-07-24T05:42:01.156 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../051-ceph-mon_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:42:01.174 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-07-24T05:42:01.194 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-mon (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:01.560 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-mgr. 2023-07-24T05:42:01.578 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../050-ceph-mgr_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:42:01.618 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-mgr (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:02.172 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-mon. 2023-07-24T05:42:02.191 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../051-ceph-mon_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:42:02.229 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-mon (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:02.515 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-osd. 2023-07-24T05:42:02.533 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../052-ceph-osd_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:42:02.573 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-osd (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:03.542 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-osd. 2023-07-24T05:42:03.561 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../052-ceph-osd_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:42:03.599 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-osd (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:05.293 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph. 2023-07-24T05:42:05.306 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../053-ceph_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:42:05.343 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:05.704 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-fuse. 2023-07-24T05:42:05.717 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../054-ceph-fuse_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:42:05.754 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-fuse (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:06.249 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-mds. 2023-07-24T05:42:06.268 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../055-ceph-mds_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:42:06.332 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-mds (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:06.352 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph. 2023-07-24T05:42:06.370 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../053-ceph_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:42:06.411 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:06.798 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-fuse. 2023-07-24T05:42:06.817 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../054-ceph-fuse_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:42:06.855 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-fuse (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:06.903 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package cephadm. 2023-07-24T05:42:06.916 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../056-cephadm_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:42:06.960 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking cephadm (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:07.314 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-asyncssh. 2023-07-24T05:42:07.316 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-mds. 2023-07-24T05:42:07.326 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2023-07-24T05:42:07.329 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../055-ceph-mds_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:42:07.363 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-07-24T05:42:07.374 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-mds (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:07.800 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-jinja2. 2023-07-24T05:42:07.819 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2_all.deb ... 2023-07-24T05:42:07.858 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-07-24T05:42:07.994 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package cephadm. 2023-07-24T05:42:08.015 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../056-cephadm_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:42:08.052 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking cephadm (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:08.245 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-07-24T05:42:08.264 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.0.0-5042-ge2c50893-1focal_all.deb ... 2023-07-24T05:42:08.303 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-mgr-cephadm (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:08.439 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-asyncssh. 2023-07-24T05:42:08.458 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2023-07-24T05:42:08.496 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-07-24T05:42:08.707 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-bcrypt. 2023-07-24T05:42:08.726 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-07-24T05:42:08.765 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-07-24T05:42:08.933 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-jinja2. 2023-07-24T05:42:08.953 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2_all.deb ... 2023-07-24T05:42:08.991 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-07-24T05:42:09.135 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-jwt. 2023-07-24T05:42:09.153 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-07-24T05:42:09.192 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-07-24T05:42:09.386 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-07-24T05:42:09.405 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.0.0-5042-ge2c50893-1focal_all.deb ... 2023-07-24T05:42:09.443 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-mgr-cephadm (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:09.554 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-repoze.lru. 2023-07-24T05:42:09.574 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../062-python3-repoze.lru_0.7-2_all.deb ... 2023-07-24T05:42:09.612 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-07-24T05:42:09.830 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-bcrypt. 2023-07-24T05:42:09.850 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-07-24T05:42:09.888 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-07-24T05:42:09.924 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libjs-underscore. 2023-07-24T05:42:09.943 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../063-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-07-24T05:42:09.981 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-07-24T05:42:10.258 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-jwt. 2023-07-24T05:42:10.277 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-07-24T05:42:10.315 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-07-24T05:42:10.327 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-07-24T05:42:10.345 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../064-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-07-24T05:42:10.384 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-07-24T05:42:10.677 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-repoze.lru. 2023-07-24T05:42:10.697 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../062-python3-repoze.lru_0.7-2_all.deb ... 2023-07-24T05:42:10.735 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-07-24T05:42:10.763 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-routes. 2023-07-24T05:42:10.781 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../065-python3-routes_2.4.1-2_all.deb ... 2023-07-24T05:42:10.820 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-07-24T05:42:11.046 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libjs-underscore. 2023-07-24T05:42:11.065 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../063-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-07-24T05:42:11.104 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-07-24T05:42:11.208 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-07-24T05:42:11.227 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../066-ceph-mgr-dashboard_18.0.0-5042-ge2c50893-1focal_all.deb ... 2023-07-24T05:42:11.265 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-mgr-dashboard (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:11.423 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-07-24T05:42:11.442 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../064-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-07-24T05:42:11.514 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-07-24T05:42:11.836 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-decorator. 2023-07-24T05:42:11.856 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../067-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-07-24T05:42:11.876 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-routes. 2023-07-24T05:42:11.894 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-07-24T05:42:11.894 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../065-python3-routes_2.4.1-2_all.deb ... 2023-07-24T05:42:11.933 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-07-24T05:42:12.272 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-07-24T05:42:12.292 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../068-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-07-24T05:42:12.312 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-07-24T05:42:12.330 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-07-24T05:42:12.331 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../066-ceph-mgr-dashboard_18.0.0-5042-ge2c50893-1focal_all.deb ... 2023-07-24T05:42:12.369 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-mgr-dashboard (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:12.708 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-scipy. 2023-07-24T05:42:12.721 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../069-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-07-24T05:42:12.758 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-07-24T05:42:12.957 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-decorator. 2023-07-24T05:42:12.975 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../067-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-07-24T05:42:13.015 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-07-24T05:42:13.334 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-07-24T05:42:13.354 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../068-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-07-24T05:42:13.425 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-07-24T05:42:13.778 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-scipy. 2023-07-24T05:42:13.798 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../069-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-07-24T05:42:13.827 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-07-24T05:42:14.165 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-07-24T05:42:14.180 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-07-24T05:42:14.226 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-07-24T05:42:14.830 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-joblib. 2023-07-24T05:42:14.849 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../071-python3-joblib_0.14.0-3_all.deb ... 2023-07-24T05:42:14.888 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-07-24T05:42:15.236 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-07-24T05:42:15.250 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-07-24T05:42:15.294 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-07-24T05:42:15.325 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-sklearn. 2023-07-24T05:42:15.344 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../072-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-07-24T05:42:15.383 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-07-24T05:42:15.881 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-joblib. 2023-07-24T05:42:15.901 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../071-python3-joblib_0.14.0-3_all.deb ... 2023-07-24T05:42:15.939 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-07-24T05:42:16.242 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-07-24T05:42:16.262 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../073-ceph-mgr-diskprediction-local_18.0.0-5042-ge2c50893-1focal_all.deb ... 2023-07-24T05:42:16.316 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:16.393 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-sklearn. 2023-07-24T05:42:16.413 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../072-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-07-24T05:42:16.450 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-07-24T05:42:17.209 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-07-24T05:42:17.229 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../073-ceph-mgr-diskprediction-local_18.0.0-5042-ge2c50893-1focal_all.deb ... 2023-07-24T05:42:17.316 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:17.579 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-cachetools. 2023-07-24T05:42:17.597 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../074-python3-cachetools_4.0.0-1_all.deb ... 2023-07-24T05:42:17.636 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-07-24T05:42:17.981 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-pyasn1. 2023-07-24T05:42:18.001 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../075-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-07-24T05:42:18.039 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-07-24T05:42:18.434 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-07-24T05:42:18.454 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../076-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-07-24T05:42:18.518 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-07-24T05:42:18.561 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-cachetools. 2023-07-24T05:42:18.581 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../074-python3-cachetools_4.0.0-1_all.deb ... 2023-07-24T05:42:18.619 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-07-24T05:42:18.879 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-rsa. 2023-07-24T05:42:18.898 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../077-python3-rsa_4.0-3_all.deb ... 2023-07-24T05:42:18.962 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-rsa (4.0-3) ... 2023-07-24T05:42:18.980 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-pyasn1. 2023-07-24T05:42:19.000 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../075-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-07-24T05:42:19.046 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-07-24T05:42:19.308 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-google-auth. 2023-07-24T05:42:19.327 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../078-python3-google-auth_1.5.1-2_all.deb ... 2023-07-24T05:42:19.381 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-07-24T05:42:19.434 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-07-24T05:42:19.451 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../076-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-07-24T05:42:19.483 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-07-24T05:42:19.778 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-blinker. 2023-07-24T05:42:19.796 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../079-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-07-24T05:42:19.827 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-rsa. 2023-07-24T05:42:19.835 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-07-24T05:42:19.846 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../077-python3-rsa_4.0-3_all.deb ... 2023-07-24T05:42:19.877 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-rsa (4.0-3) ... 2023-07-24T05:42:20.213 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-oauthlib. 2023-07-24T05:42:20.233 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../080-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-07-24T05:42:20.239 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-google-auth. 2023-07-24T05:42:20.258 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../078-python3-google-auth_1.5.1-2_all.deb ... 2023-07-24T05:42:20.271 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-07-24T05:42:20.305 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-07-24T05:42:20.700 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-blinker. 2023-07-24T05:42:20.719 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../079-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-07-24T05:42:20.758 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-07-24T05:42:20.786 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-07-24T05:42:20.805 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../081-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-07-24T05:42:20.844 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-07-24T05:42:21.093 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-oauthlib. 2023-07-24T05:42:21.107 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../080-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-07-24T05:42:21.168 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-07-24T05:42:21.214 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-websocket. 2023-07-24T05:42:21.234 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../082-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-07-24T05:42:21.272 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-07-24T05:42:21.635 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-kubernetes. 2023-07-24T05:42:21.653 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../083-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-07-24T05:42:21.675 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-07-24T05:42:21.694 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../081-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-07-24T05:42:21.701 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-07-24T05:42:21.732 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-07-24T05:42:22.111 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-websocket. 2023-07-24T05:42:22.131 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../082-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-07-24T05:42:22.168 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-07-24T05:42:22.357 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-07-24T05:42:22.377 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../084-ceph-mgr-k8sevents_18.0.0-5042-ge2c50893-1focal_all.deb ... 2023-07-24T05:42:22.415 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:22.531 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-kubernetes. 2023-07-24T05:42:22.551 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../083-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-07-24T05:42:22.605 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-07-24T05:42:22.819 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libonig5:amd64. 2023-07-24T05:42:22.837 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../085-libonig5_6.9.4-1_amd64.deb ... 2023-07-24T05:42:22.876 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-07-24T05:42:23.244 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-07-24T05:42:23.263 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../084-ceph-mgr-k8sevents_18.0.0-5042-ge2c50893-1focal_all.deb ... 2023-07-24T05:42:23.288 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libjq1:amd64. 2023-07-24T05:42:23.302 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:23.308 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../086-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-07-24T05:42:23.354 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-07-24T05:42:23.663 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libonig5:amd64. 2023-07-24T05:42:23.667 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package jq. 2023-07-24T05:42:23.683 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../085-libonig5_6.9.4-1_amd64.deb ... 2023-07-24T05:42:23.686 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../087-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-07-24T05:42:23.721 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-07-24T05:42:23.725 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-07-24T05:42:24.045 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package socat. 2023-07-24T05:42:24.064 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../088-socat_1.7.3.3-2_amd64.deb ... 2023-07-24T05:42:24.103 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking socat (1.7.3.3-2) ... 2023-07-24T05:42:24.165 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libjq1:amd64. 2023-07-24T05:42:24.185 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../086-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-07-24T05:42:24.223 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-07-24T05:42:24.457 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package xmlstarlet. 2023-07-24T05:42:24.476 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../089-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-07-24T05:42:24.514 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-07-24T05:42:24.559 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package jq. 2023-07-24T05:42:24.579 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../087-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-07-24T05:42:24.617 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-07-24T05:42:24.904 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package socat. 2023-07-24T05:42:24.922 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../088-socat_1.7.3.3-2_amd64.deb ... 2023-07-24T05:42:24.953 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-test. 2023-07-24T05:42:24.972 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../090-ceph-test_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:42:24.986 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking socat (1.7.3.3-2) ... 2023-07-24T05:42:25.010 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-test (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:25.323 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package xmlstarlet. 2023-07-24T05:42:25.343 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../089-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-07-24T05:42:25.380 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-07-24T05:42:25.827 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-test. 2023-07-24T05:42:25.846 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../090-ceph-test_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:42:25.885 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-test (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:29.340 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-volume. 2023-07-24T05:42:29.359 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../091-ceph-volume_18.0.0-5042-ge2c50893-1focal_all.deb ... 2023-07-24T05:42:29.398 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-volume (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:29.971 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package cephfs-mirror. 2023-07-24T05:42:29.991 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../092-cephfs-mirror_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:42:30.029 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking cephfs-mirror (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:30.139 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ceph-volume. 2023-07-24T05:42:30.160 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../091-ceph-volume_18.0.0-5042-ge2c50893-1focal_all.deb ... 2023-07-24T05:42:30.197 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ceph-volume (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:30.429 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-colorama. 2023-07-24T05:42:30.449 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../093-python3-colorama_0.4.3-1build1_all.deb ... 2023-07-24T05:42:30.486 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-07-24T05:42:30.671 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package cephfs-mirror. 2023-07-24T05:42:30.690 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../092-cephfs-mirror_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:42:30.730 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking cephfs-mirror (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:30.840 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package cephfs-shell. 2023-07-24T05:42:30.858 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../094-cephfs-shell_18.0.0-5042-ge2c50893-1focal_all.deb ... 2023-07-24T05:42:30.897 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking cephfs-shell (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:31.134 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-colorama. 2023-07-24T05:42:31.154 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../093-python3-colorama_0.4.3-1build1_all.deb ... 2023-07-24T05:42:31.191 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-07-24T05:42:31.209 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package cephfs-top. 2023-07-24T05:42:31.228 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../095-cephfs-top_18.0.0-5042-ge2c50893-1focal_all.deb ... 2023-07-24T05:42:31.267 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking cephfs-top (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:31.520 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package cephfs-shell. 2023-07-24T05:42:31.539 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../094-cephfs-shell_18.0.0-5042-ge2c50893-1focal_all.deb ... 2023-07-24T05:42:31.577 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking cephfs-shell (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:31.594 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package fonts-mathjax. 2023-07-24T05:42:31.613 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-07-24T05:42:31.652 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-07-24T05:42:31.887 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package cephfs-top. 2023-07-24T05:42:31.907 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../095-cephfs-top_18.0.0-5042-ge2c50893-1focal_all.deb ... 2023-07-24T05:42:31.945 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking cephfs-top (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:32.198 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libcephfs-dev. 2023-07-24T05:42:32.218 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../097-libcephfs-dev_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:42:32.239 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package fonts-mathjax. 2023-07-24T05:42:32.256 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libcephfs-dev (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:32.259 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-07-24T05:42:32.330 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-07-24T05:42:32.701 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package nvme-cli. 2023-07-24T05:42:32.721 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-07-24T05:42:32.797 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-07-24T05:42:32.885 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libcephfs-dev. 2023-07-24T05:42:32.904 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../097-libcephfs-dev_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:42:32.942 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libcephfs-dev (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:33.149 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-07-24T05:42:33.169 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-07-24T05:42:33.240 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-07-24T05:42:33.396 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package nvme-cli. 2023-07-24T05:42:33.415 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-07-24T05:42:33.484 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-07-24T05:42:33.694 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libjs-mathjax. 2023-07-24T05:42:33.713 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-07-24T05:42:33.751 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-07-24T05:42:33.875 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-07-24T05:42:33.895 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-07-24T05:42:33.933 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-07-24T05:42:34.378 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libjs-mathjax. 2023-07-24T05:42:34.398 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-07-24T05:42:34.436 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-07-24T05:42:35.803 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python-natsort-doc. 2023-07-24T05:42:35.825 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2023-07-24T05:42:35.903 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-07-24T05:42:36.272 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-atomicwrites. 2023-07-24T05:42:36.293 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../102-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-07-24T05:42:36.347 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-07-24T05:42:36.405 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python-natsort-doc. 2023-07-24T05:42:36.426 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2023-07-24T05:42:36.470 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-07-24T05:42:36.676 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-attr. 2023-07-24T05:42:36.697 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../103-python3-attr_19.3.0-2_all.deb ... 2023-07-24T05:42:36.767 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-07-24T05:42:36.866 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-atomicwrites. 2023-07-24T05:42:36.886 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../102-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-07-24T05:42:36.924 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-07-24T05:42:37.179 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-webencodings. 2023-07-24T05:42:37.199 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../104-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-07-24T05:42:37.245 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-07-24T05:42:37.294 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-attr. 2023-07-24T05:42:37.314 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../103-python3-attr_19.3.0-2_all.deb ... 2023-07-24T05:42:37.359 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-07-24T05:42:37.623 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-html5lib. 2023-07-24T05:42:37.643 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../105-python3-html5lib_1.0.1-2_all.deb ... 2023-07-24T05:42:37.689 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-07-24T05:42:37.730 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-webencodings. 2023-07-24T05:42:37.750 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../104-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-07-24T05:42:37.787 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-07-24T05:42:38.102 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-07-24T05:42:38.122 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../106-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-07-24T05:42:38.157 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-html5lib. 2023-07-24T05:42:38.159 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-07-24T05:42:38.176 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../105-python3-html5lib_1.0.1-2_all.deb ... 2023-07-24T05:42:38.214 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-07-24T05:42:38.627 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-07-24T05:42:38.647 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../106-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-07-24T05:42:38.663 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-packaging. 2023-07-24T05:42:38.683 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../107-python3-packaging_20.3-1_all.deb ... 2023-07-24T05:42:38.684 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-07-24T05:42:38.720 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-packaging (20.3-1) ... 2023-07-24T05:42:39.090 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-pastescript. 2023-07-24T05:42:39.111 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../108-python3-pastescript_2.0.2-4_all.deb ... 2023-07-24T05:42:39.148 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-07-24T05:42:39.205 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-packaging. 2023-07-24T05:42:39.224 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../107-python3-packaging_20.3-1_all.deb ... 2023-07-24T05:42:39.263 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-packaging (20.3-1) ... 2023-07-24T05:42:39.539 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-pluggy. 2023-07-24T05:42:39.560 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../109-python3-pluggy_0.13.0-2_all.deb ... 2023-07-24T05:42:39.596 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-07-24T05:42:39.624 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-pastescript. 2023-07-24T05:42:39.644 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../108-python3-pastescript_2.0.2-4_all.deb ... 2023-07-24T05:42:39.681 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-07-24T05:42:40.073 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-pluggy. 2023-07-24T05:42:40.093 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../109-python3-pluggy_0.13.0-2_all.deb ... 2023-07-24T05:42:40.138 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-07-24T05:42:40.334 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-psutil. 2023-07-24T05:42:40.354 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../110-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-07-24T05:42:40.391 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-07-24T05:42:40.795 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-py. 2023-07-24T05:42:40.816 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../111-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-07-24T05:42:40.861 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-07-24T05:42:40.950 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-psutil. 2023-07-24T05:42:40.971 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../110-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-07-24T05:42:41.016 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-07-24T05:42:41.248 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-pyinotify. 2023-07-24T05:42:41.269 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-07-24T05:42:41.314 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-07-24T05:42:41.411 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-py. 2023-07-24T05:42:41.431 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../111-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-07-24T05:42:41.468 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-07-24T05:42:41.701 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-pytest. 2023-07-24T05:42:41.721 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../113-python3-pytest_4.6.9-1_all.deb ... 2023-07-24T05:42:41.766 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-07-24T05:42:41.872 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-pyinotify. 2023-07-24T05:42:41.892 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-07-24T05:42:41.930 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-07-24T05:42:42.146 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-simplejson. 2023-07-24T05:42:42.166 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-07-24T05:42:42.204 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-07-24T05:42:42.291 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-pytest. 2023-07-24T05:42:42.312 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../113-python3-pytest_4.6.9-1_all.deb ... 2023-07-24T05:42:42.357 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-07-24T05:42:42.557 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-07-24T05:42:42.578 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-07-24T05:42:42.623 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-07-24T05:42:42.754 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package python3-simplejson. 2023-07-24T05:42:42.772 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-07-24T05:42:42.811 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-07-24T05:42:43.181 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-07-24T05:42:43.202 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-07-24T05:42:43.247 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-07-24T05:42:43.356 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package radosgw. 2023-07-24T05:42:43.374 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../116-radosgw_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:42:43.447 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking radosgw (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:43.938 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package radosgw. 2023-07-24T05:42:43.957 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../116-radosgw_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:42:43.995 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking radosgw (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:44.876 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package rbd-fuse. 2023-07-24T05:42:44.894 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../117-rbd-fuse_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:42:44.933 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking rbd-fuse (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:45.331 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-attr (19.3.0-2) ... 2023-07-24T05:42:45.441 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package rbd-fuse. 2023-07-24T05:42:45.461 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../117-rbd-fuse_18.0.0-5042-ge2c50893-1focal_amd64.deb ... 2023-07-24T05:42:45.498 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking rbd-fuse (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:45.716 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-07-24T05:42:45.850 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-07-24T05:42:45.889 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-attr (19.3.0-2) ... 2023-07-24T05:42:46.010 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-07-24T05:42:46.228 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up cephadm (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:46.272 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-07-24T05:42:46.398 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-07-24T05:42:46.524 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-07-24T05:42:46.783 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up cephadm (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:46.976 INFO:teuthology.orchestra.run.smithi103.stdout:Adding system user cephadm....done 2023-07-24T05:42:47.167 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-07-24T05:42:47.318 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-07-24T05:42:47.534 INFO:teuthology.orchestra.run.smithi077.stdout:Adding system user cephadm....done 2023-07-24T05:42:47.745 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-07-24T05:42:47.756 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-07-24T05:42:47.882 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-07-24T05:42:48.104 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-07-24T05:42:48.264 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-07-24T05:42:48.300 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-07-24T05:42:48.406 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-07-24T05:42:48.660 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-07-24T05:42:48.785 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-07-24T05:42:48.808 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-07-24T05:42:48.912 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-07-24T05:42:49.294 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-07-24T05:42:49.305 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-07-24T05:42:49.636 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-07-24T05:42:49.799 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-07-24T05:42:49.979 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-07-24T05:42:50.150 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-07-24T05:42:50.314 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-07-24T05:42:50.501 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-07-24T05:42:50.698 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-07-24T05:42:50.852 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-07-24T05:42:51.041 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-ceph-argparse (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:51.229 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-07-24T05:42:51.434 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-07-24T05:42:51.585 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-07-24T05:42:51.588 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-ceph-argparse (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:51.952 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-07-24T05:42:51.956 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-07-24T05:42:52.083 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-07-24T05:42:52.314 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-07-24T05:42:52.427 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-07-24T05:42:52.691 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-07-24T05:42:52.769 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-07-24T05:42:52.850 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-07-24T05:42:53.162 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-07-24T05:42:53.288 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-07-24T05:42:53.318 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-07-24T05:42:53.669 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-07-24T05:42:53.781 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-07-24T05:42:54.021 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-07-24T05:42:54.157 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-07-24T05:42:54.455 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-07-24T05:42:54.510 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-07-24T05:42:54.843 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-07-24T05:42:54.914 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-07-24T05:42:55.286 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-07-24T05:42:55.290 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-07-24T05:42:55.679 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-packaging (20.3-1) ... 2023-07-24T05:42:55.691 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-07-24T05:42:56.029 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-07-24T05:42:56.067 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-packaging (20.3-1) ... 2023-07-24T05:42:56.155 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-07-24T05:42:56.314 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-07-24T05:42:56.435 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-07-24T05:42:56.561 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-07-24T05:42:56.666 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-07-24T05:42:56.720 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-07-24T05:42:57.073 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-07-24T05:42:57.136 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-07-24T05:42:57.512 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-07-24T05:42:57.550 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-07-24T05:42:57.917 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-07-24T05:42:57.955 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-07-24T05:42:58.352 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-07-24T05:42:58.382 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up socat (1.7.3.3-2) ... 2023-07-24T05:42:58.517 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-ceph-common (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:58.796 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up socat (1.7.3.3-2) ... 2023-07-24T05:42:58.910 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-24T05:42:58.921 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-ceph-common (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:42:59.052 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-07-24T05:42:59.315 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-24T05:42:59.457 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-07-24T05:42:59.512 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-07-24T05:42:59.663 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-07-24T05:42:59.789 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-07-24T05:42:59.892 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-07-24T05:43:00.018 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-07-24T05:43:00.177 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-07-24T05:43:00.198 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-07-24T05:43:00.511 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-07-24T05:43:00.591 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-24T05:43:00.717 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-07-24T05:43:00.876 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-07-24T05:43:00.929 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-24T05:43:01.097 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-07-24T05:43:01.223 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-07-24T05:43:01.270 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-07-24T05:43:01.613 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-07-24T05:43:01.624 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-07-24T05:43:01.989 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-07-24T05:43:02.009 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-07-24T05:43:02.156 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-07-24T05:43:02.368 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-07-24T05:43:02.516 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-07-24T05:43:02.527 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-07-24T05:43:02.870 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-07-24T05:43:02.908 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-07-24T05:43:03.263 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-07-24T05:43:03.276 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-07-24T05:43:03.647 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-07-24T05:43:03.687 INFO:teuthology.orchestra.run.smithi103.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-07-24T05:43:03.997 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-07-24T05:43:04.038 INFO:teuthology.orchestra.run.smithi077.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-07-24T05:43:04.122 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-07-24T05:43:04.408 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-07-24T05:43:04.534 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-07-24T05:43:04.539 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-07-24T05:43:04.927 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-07-24T05:43:05.007 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-07-24T05:43:05.175 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-07-24T05:43:05.302 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-07-24T05:43:05.378 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-07-24T05:43:05.512 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-07-24T05:43:05.647 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-07-24T05:43:05.694 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-07-24T05:43:06.041 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-07-24T05:43:06.045 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-07-24T05:43:06.399 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-07-24T05:43:07.859 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-07-24T05:43:08.010 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-07-24T05:43:08.247 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-07-24T05:43:08.372 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-07-24T05:43:08.470 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-07-24T05:43:08.832 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-07-24T05:43:08.871 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-07-24T05:43:09.231 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-24T05:43:09.236 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-07-24T05:43:09.381 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-07-24T05:43:09.584 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-07-24T05:43:09.735 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-07-24T05:43:09.808 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-07-24T05:43:10.203 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-07-24T05:43:10.209 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-07-24T05:43:10.596 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-07-24T05:43:10.728 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-07-24T05:43:11.129 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-07-24T05:43:11.406 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-07-24T05:43:11.815 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-07-24T05:43:12.351 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-07-24T05:43:12.477 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-07-24T05:43:12.603 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-07-24T05:43:12.754 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-rsa (4.0-3) ... 2023-07-24T05:43:13.045 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-07-24T05:43:13.147 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-07-24T05:43:13.213 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-07-24T05:43:13.273 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-07-24T05:43:13.339 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-07-24T05:43:13.465 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-rsa (4.0-3) ... 2023-07-24T05:43:13.649 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-07-24T05:43:13.849 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-07-24T05:43:13.967 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-07-24T05:43:14.009 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-07-24T05:43:14.351 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-07-24T05:43:14.427 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-07-24T05:43:14.703 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-07-24T05:43:14.862 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up librados2 (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:15.082 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-07-24T05:43:15.087 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-07-24T05:43:15.216 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up librgw2 (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:15.376 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libsqlite3-mod-ceph (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:15.502 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libcephfs2 (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:15.539 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up librados2 (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:15.631 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-routes (2.4.1-2) ... 2023-07-24T05:43:15.759 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-07-24T05:43:15.885 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up librgw2 (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:16.032 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libradosstriper1 (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:16.053 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libsqlite3-mod-ceph (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:16.191 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-07-24T05:43:16.257 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libcephfs2 (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:16.383 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-routes (2.4.1-2) ... 2023-07-24T05:43:16.560 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up librbd1 (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:16.686 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-mgr-modules-core (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:16.776 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libradosstriper1 (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:16.812 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-fuse (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:16.901 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-07-24T05:43:17.105 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-24T05:43:17.106 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-24T05:43:17.295 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up librbd1 (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:17.454 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-mgr-modules-core (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:17.580 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-fuse (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:17.840 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-24T05:43:17.841 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-24T05:43:17.963 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libcephfs-dev (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:18.089 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-rados (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:18.240 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up cephfs-top (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:18.366 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-07-24T05:43:18.698 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libcephfs-dev (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:18.824 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-rados (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:18.983 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up cephfs-top (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:19.109 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-07-24T05:43:19.539 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-rbd (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:19.665 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up rbd-fuse (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:19.793 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-rgw (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:19.944 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-cephfs (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:20.071 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up cephfs-shell (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:20.196 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-common (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:20.285 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-rbd (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:20.433 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up rbd-fuse (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:20.551 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-rgw (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:20.676 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up python3-cephfs (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:20.836 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up cephfs-shell (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:20.880 INFO:teuthology.orchestra.run.smithi103.stdout:Adding group ceph....done 2023-07-24T05:43:20.962 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-common (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:21.379 INFO:teuthology.orchestra.run.smithi103.stdout:Adding system user ceph....done 2023-07-24T05:43:21.601 INFO:teuthology.orchestra.run.smithi103.stdout:Setting system user ceph properties....done 2023-07-24T05:43:21.613 INFO:teuthology.orchestra.run.smithi077.stdout:Adding group ceph....done 2023-07-24T05:43:21.639 INFO:teuthology.orchestra.run.smithi103.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-07-24T05:43:21.840 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-07-24T05:43:22.099 INFO:teuthology.orchestra.run.smithi077.stdout:Adding system user ceph....done 2023-07-24T05:43:22.340 INFO:teuthology.orchestra.run.smithi077.stdout:Setting system user ceph properties....done 2023-07-24T05:43:22.376 INFO:teuthology.orchestra.run.smithi077.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-07-24T05:43:22.396 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-07-24T05:43:22.567 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-07-24T05:43:23.125 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-07-24T05:43:23.275 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up cephfs-mirror (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:23.565 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-07-24T05:43:23.565 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-07-24T05:43:24.023 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up cephfs-mirror (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:24.288 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-07-24T05:43:24.289 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-07-24T05:43:24.410 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-test (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:24.544 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up radosgw (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:24.905 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-24T05:43:24.905 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-24T05:43:25.133 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-test (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:25.259 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up radosgw (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:25.572 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-24T05:43:25.572 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-24T05:43:26.146 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-base (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:26.666 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-07-24T05:43:26.794 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-base (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:27.285 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-07-24T05:43:27.607 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-mds (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:27.881 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-24T05:43:27.881 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-24T05:43:28.154 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-mds (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:28.439 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-24T05:43:28.439 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-24T05:43:28.741 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-mgr (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:29.045 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-24T05:43:29.045 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-24T05:43:29.231 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-mgr (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:29.496 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-24T05:43:29.497 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-24T05:43:29.859 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-osd (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:30.298 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-osd (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:30.663 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-24T05:43:30.663 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-24T05:43:31.093 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-24T05:43:31.093 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-24T05:43:31.470 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-mgr-k8sevents (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:31.596 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:31.747 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-mon (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:31.884 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-mgr-k8sevents (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:32.010 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:32.044 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-24T05:43:32.044 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-24T05:43:32.161 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-mon (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:32.424 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-24T05:43:32.424 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-24T05:43:32.882 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-mgr-cephadm (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:33.033 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:33.192 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-mgr-dashboard (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:33.295 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-mgr-cephadm (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:33.352 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-volume (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:33.446 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:33.478 INFO:teuthology.orchestra.run.smithi103.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-07-24T05:43:33.573 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-mgr-dashboard (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:33.663 INFO:teuthology.orchestra.run.smithi103.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-07-24T05:43:33.723 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ceph-volume (18.0.0-5042-ge2c50893-1focal) ... 2023-07-24T05:43:33.884 INFO:teuthology.orchestra.run.smithi077.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-07-24T05:43:34.043 INFO:teuthology.orchestra.run.smithi077.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-07-24T05:43:34.123 INFO:teuthology.orchestra.run.smithi103.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-07-24T05:43:34.536 INFO:teuthology.orchestra.run.smithi077.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-07-24T05:43:39.284 INFO:teuthology.orchestra.run.smithi103.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-07-24T05:43:39.731 INFO:teuthology.orchestra.run.smithi077.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-07-24T05:43:40.060 INFO:teuthology.orchestra.run.smithi103.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-07-24T05:43:40.066 DEBUG:teuthology.orchestra.run.smithi103:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-07-24T05:43:40.186 INFO:teuthology.orchestra.run.smithi103.stdout:Reading package lists... 2023-07-24T05:43:40.381 INFO:teuthology.orchestra.run.smithi103.stdout:Building dependency tree... 2023-07-24T05:43:40.382 INFO:teuthology.orchestra.run.smithi103.stdout:Reading state information... 2023-07-24T05:43:40.560 INFO:teuthology.orchestra.run.smithi077.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-07-24T05:43:40.566 DEBUG:teuthology.orchestra.run.smithi077:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-07-24T05:43:40.567 INFO:teuthology.orchestra.run.smithi103.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-07-24T05:43:40.567 INFO:teuthology.orchestra.run.smithi103.stdout:flex is already the newest version (2.6.4-6.2). 2023-07-24T05:43:40.567 INFO:teuthology.orchestra.run.smithi103.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-07-24T05:43:40.567 INFO:teuthology.orchestra.run.smithi103.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-07-24T05:43:40.567 INFO:teuthology.orchestra.run.smithi103.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-07-24T05:43:40.567 INFO:teuthology.orchestra.run.smithi103.stdout:The following packages were automatically installed and are no longer required: 2023-07-24T05:43:40.567 INFO:teuthology.orchestra.run.smithi103.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-07-24T05:43:40.568 INFO:teuthology.orchestra.run.smithi103.stdout:Use 'sudo apt autoremove' to remove them. 2023-07-24T05:43:40.568 INFO:teuthology.orchestra.run.smithi103.stdout:The following additional packages will be installed: 2023-07-24T05:43:40.569 INFO:teuthology.orchestra.run.smithi103.stdout: libbluetooth3 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 2023-07-24T05:43:40.569 INFO:teuthology.orchestra.run.smithi103.stdout: libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 libuuid1 2023-07-24T05:43:40.569 INFO:teuthology.orchestra.run.smithi103.stdout: modemmanager network-manager-pptp postgresql-12 postgresql-client-12 2023-07-24T05:43:40.569 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-client-common ppp pptp-linux usb-modeswitch usb-modeswitch-data 2023-07-24T05:43:40.569 INFO:teuthology.orchestra.run.smithi103.stdout: wpasupplicant 2023-07-24T05:43:40.569 INFO:teuthology.orchestra.run.smithi103.stdout:Suggested packages: 2023-07-24T05:43:40.570 INFO:teuthology.orchestra.run.smithi103.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2023-07-24T05:43:40.570 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2023-07-24T05:43:40.570 INFO:teuthology.orchestra.run.smithi103.stdout: libengine-pkcs11-openssl 2023-07-24T05:43:40.664 INFO:teuthology.orchestra.run.smithi103.stdout:The following NEW packages will be installed: 2023-07-24T05:43:40.665 INFO:teuthology.orchestra.run.smithi103.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-07-24T05:43:40.665 INFO:teuthology.orchestra.run.smithi103.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2023-07-24T05:43:40.666 INFO:teuthology.orchestra.run.smithi103.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-07-24T05:43:40.666 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2023-07-24T05:43:40.666 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2023-07-24T05:43:40.666 INFO:teuthology.orchestra.run.smithi103.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-07-24T05:43:40.667 INFO:teuthology.orchestra.run.smithi103.stdout:The following packages will be upgraded: 2023-07-24T05:43:40.667 INFO:teuthology.orchestra.run.smithi103.stdout: libssl1.1 libuuid1 util-linux uuid-dev 2023-07-24T05:43:40.696 INFO:teuthology.orchestra.run.smithi077.stdout:Reading package lists... 2023-07-24T05:43:40.879 INFO:teuthology.orchestra.run.smithi103.stdout:4 upgraded, 31 newly installed, 0 to remove and 206 not upgraded. 2023-07-24T05:43:40.880 INFO:teuthology.orchestra.run.smithi103.stdout:Need to get 25.1 MB of archives. 2023-07-24T05:43:40.880 INFO:teuthology.orchestra.run.smithi103.stdout:After this operation, 79.9 MB of additional disk space will be used. 2023-07-24T05:43:40.880 INFO:teuthology.orchestra.run.smithi103.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-07-24T05:43:40.892 INFO:teuthology.orchestra.run.smithi077.stdout:Building dependency tree... 2023-07-24T05:43:40.893 INFO:teuthology.orchestra.run.smithi077.stdout:Reading state information... 2023-07-24T05:43:41.064 INFO:teuthology.orchestra.run.smithi077.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-07-24T05:43:41.064 INFO:teuthology.orchestra.run.smithi077.stdout:flex is already the newest version (2.6.4-6.2). 2023-07-24T05:43:41.064 INFO:teuthology.orchestra.run.smithi077.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-07-24T05:43:41.064 INFO:teuthology.orchestra.run.smithi077.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-07-24T05:43:41.065 INFO:teuthology.orchestra.run.smithi077.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-07-24T05:43:41.065 INFO:teuthology.orchestra.run.smithi077.stdout:The following packages were automatically installed and are no longer required: 2023-07-24T05:43:41.066 INFO:teuthology.orchestra.run.smithi077.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-07-24T05:43:41.066 INFO:teuthology.orchestra.run.smithi077.stdout:Use 'sudo apt autoremove' to remove them. 2023-07-24T05:43:41.066 INFO:teuthology.orchestra.run.smithi077.stdout:The following additional packages will be installed: 2023-07-24T05:43:41.066 INFO:teuthology.orchestra.run.smithi077.stdout: libbluetooth3 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 2023-07-24T05:43:41.066 INFO:teuthology.orchestra.run.smithi077.stdout: libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 libuuid1 2023-07-24T05:43:41.066 INFO:teuthology.orchestra.run.smithi077.stdout: modemmanager network-manager-pptp postgresql-12 postgresql-client-12 2023-07-24T05:43:41.066 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-client-common ppp pptp-linux usb-modeswitch usb-modeswitch-data 2023-07-24T05:43:41.067 INFO:teuthology.orchestra.run.smithi077.stdout: wpasupplicant 2023-07-24T05:43:41.067 INFO:teuthology.orchestra.run.smithi077.stdout:Suggested packages: 2023-07-24T05:43:41.067 INFO:teuthology.orchestra.run.smithi077.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2023-07-24T05:43:41.067 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2023-07-24T05:43:41.067 INFO:teuthology.orchestra.run.smithi077.stdout: libengine-pkcs11-openssl 2023-07-24T05:43:41.160 INFO:teuthology.orchestra.run.smithi077.stdout:The following NEW packages will be installed: 2023-07-24T05:43:41.161 INFO:teuthology.orchestra.run.smithi077.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-07-24T05:43:41.161 INFO:teuthology.orchestra.run.smithi077.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2023-07-24T05:43:41.162 INFO:teuthology.orchestra.run.smithi077.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-07-24T05:43:41.162 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2023-07-24T05:43:41.162 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2023-07-24T05:43:41.162 INFO:teuthology.orchestra.run.smithi077.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-07-24T05:43:41.163 INFO:teuthology.orchestra.run.smithi077.stdout:The following packages will be upgraded: 2023-07-24T05:43:41.163 INFO:teuthology.orchestra.run.smithi077.stdout: libssl1.1 libuuid1 util-linux uuid-dev 2023-07-24T05:43:41.445 INFO:teuthology.orchestra.run.smithi077.stdout:4 upgraded, 31 newly installed, 0 to remove and 206 not upgraded. 2023-07-24T05:43:41.445 INFO:teuthology.orchestra.run.smithi077.stdout:Need to get 25.1 MB of archives. 2023-07-24T05:43:41.445 INFO:teuthology.orchestra.run.smithi077.stdout:After this operation, 79.9 MB of additional disk space will be used. 2023-07-24T05:43:41.445 INFO:teuthology.orchestra.run.smithi077.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-07-24T05:43:41.747 INFO:teuthology.orchestra.run.smithi103.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-07-24T05:43:41.750 INFO:teuthology.orchestra.run.smithi103.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-07-24T05:43:41.752 INFO:teuthology.orchestra.run.smithi103.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-07-24T05:43:41.889 INFO:teuthology.orchestra.run.smithi103.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-07-24T05:43:41.892 INFO:teuthology.orchestra.run.smithi103.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-07-24T05:43:41.901 INFO:teuthology.orchestra.run.smithi103.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2023-07-24T05:43:41.907 INFO:teuthology.orchestra.run.smithi103.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-07-24T05:43:41.908 INFO:teuthology.orchestra.run.smithi103.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-07-24T05:43:41.912 INFO:teuthology.orchestra.run.smithi103.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2023-07-24T05:43:41.917 INFO:teuthology.orchestra.run.smithi103.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-07-24T05:43:42.163 INFO:teuthology.orchestra.run.smithi103.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-07-24T05:43:42.291 INFO:teuthology.orchestra.run.smithi103.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-07-24T05:43:42.328 INFO:teuthology.orchestra.run.smithi077.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-07-24T05:43:42.331 INFO:teuthology.orchestra.run.smithi077.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-07-24T05:43:42.333 INFO:teuthology.orchestra.run.smithi077.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-07-24T05:43:42.494 INFO:teuthology.orchestra.run.smithi077.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-07-24T05:43:42.498 INFO:teuthology.orchestra.run.smithi077.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-07-24T05:43:42.509 INFO:teuthology.orchestra.run.smithi077.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2023-07-24T05:43:42.517 INFO:teuthology.orchestra.run.smithi077.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-07-24T05:43:42.517 INFO:teuthology.orchestra.run.smithi077.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-07-24T05:43:42.523 INFO:teuthology.orchestra.run.smithi077.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2023-07-24T05:43:42.528 INFO:teuthology.orchestra.run.smithi077.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-07-24T05:43:42.785 INFO:teuthology.orchestra.run.smithi103.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-07-24T05:43:42.798 INFO:teuthology.orchestra.run.smithi103.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-07-24T05:43:42.816 INFO:teuthology.orchestra.run.smithi077.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-07-24T05:43:42.939 INFO:teuthology.orchestra.run.smithi077.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-07-24T05:43:42.991 INFO:teuthology.orchestra.run.smithi103.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.15-0ubuntu0.20.04.1 [116 kB] 2023-07-24T05:43:43.024 INFO:teuthology.orchestra.run.smithi103.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-07-24T05:43:43.145 INFO:teuthology.orchestra.run.smithi103.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-07-24T05:43:43.145 INFO:teuthology.orchestra.run.smithi103.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-07-24T05:43:43.293 INFO:teuthology.orchestra.run.smithi103.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-07-24T05:43:43.294 INFO:teuthology.orchestra.run.smithi103.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-07-24T05:43:43.350 INFO:teuthology.orchestra.run.smithi103.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-07-24T05:43:43.410 INFO:teuthology.orchestra.run.smithi077.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-07-24T05:43:43.422 INFO:teuthology.orchestra.run.smithi077.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-07-24T05:43:43.624 INFO:teuthology.orchestra.run.smithi077.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.15-0ubuntu0.20.04.1 [116 kB] 2023-07-24T05:43:43.664 INFO:teuthology.orchestra.run.smithi077.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-07-24T05:43:43.682 INFO:teuthology.orchestra.run.smithi103.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-07-24T05:43:43.800 INFO:teuthology.orchestra.run.smithi077.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-07-24T05:43:43.801 INFO:teuthology.orchestra.run.smithi077.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-07-24T05:43:43.989 INFO:teuthology.orchestra.run.smithi077.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-07-24T05:43:43.989 INFO:teuthology.orchestra.run.smithi077.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-07-24T05:43:44.047 INFO:teuthology.orchestra.run.smithi077.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-07-24T05:43:44.305 INFO:teuthology.orchestra.run.smithi077.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-07-24T05:43:44.773 INFO:teuthology.orchestra.run.smithi103.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-07-24T05:43:44.789 INFO:teuthology.orchestra.run.smithi103.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-07-24T05:43:44.791 INFO:teuthology.orchestra.run.smithi103.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-07-24T05:43:44.792 INFO:teuthology.orchestra.run.smithi103.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2023-07-24T05:43:44.794 INFO:teuthology.orchestra.run.smithi103.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.15-0ubuntu0.20.04.1 [1,052 kB] 2023-07-24T05:43:44.859 INFO:teuthology.orchestra.run.smithi103.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2023-07-24T05:43:44.863 INFO:teuthology.orchestra.run.smithi103.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.15-0ubuntu0.20.04.1 [13.5 MB] 2023-07-24T05:43:45.468 INFO:teuthology.orchestra.run.smithi077.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-07-24T05:43:45.489 INFO:teuthology.orchestra.run.smithi077.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-07-24T05:43:45.491 INFO:teuthology.orchestra.run.smithi077.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-07-24T05:43:45.494 INFO:teuthology.orchestra.run.smithi077.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2023-07-24T05:43:45.496 INFO:teuthology.orchestra.run.smithi077.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.15-0ubuntu0.20.04.1 [1,052 kB] 2023-07-24T05:43:45.594 INFO:teuthology.orchestra.run.smithi077.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2023-07-24T05:43:45.603 INFO:teuthology.orchestra.run.smithi077.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.15-0ubuntu0.20.04.1 [13.5 MB] 2023-07-24T05:43:45.615 INFO:teuthology.orchestra.run.smithi103.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2023-07-24T05:43:45.615 INFO:teuthology.orchestra.run.smithi103.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2023-07-24T05:43:45.616 INFO:teuthology.orchestra.run.smithi103.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2023-07-24T05:43:45.845 INFO:teuthology.orchestra.run.smithi103.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-07-24T05:43:46.127 INFO:teuthology.orchestra.run.smithi103.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-07-24T05:43:46.314 INFO:teuthology.orchestra.run.smithi077.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2023-07-24T05:43:46.315 INFO:teuthology.orchestra.run.smithi077.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2023-07-24T05:43:46.315 INFO:teuthology.orchestra.run.smithi077.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2023-07-24T05:43:46.581 INFO:teuthology.orchestra.run.smithi077.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-07-24T05:43:46.775 INFO:teuthology.orchestra.run.smithi103.stdout:Preconfiguring packages ... 2023-07-24T05:43:46.877 INFO:teuthology.orchestra.run.smithi077.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-07-24T05:43:47.001 INFO:teuthology.orchestra.run.smithi103.stdout:Fetched 25.1 MB in 6s (4,511 kB/s) 2023-07-24T05:43:47.327 INFO:teuthology.orchestra.run.smithi103.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118868 files and directories currently installed.) 2023-07-24T05:43:47.330 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-07-24T05:43:47.548 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-07-24T05:43:47.586 INFO:teuthology.orchestra.run.smithi077.stdout:Preconfiguring packages ... 2023-07-24T05:43:47.830 INFO:teuthology.orchestra.run.smithi077.stdout:Fetched 25.1 MB in 6s (4,280 kB/s) 2023-07-24T05:43:48.138 INFO:teuthology.orchestra.run.smithi077.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118868 files and directories currently installed.) 2023-07-24T05:43:48.142 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-07-24T05:43:48.358 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-07-24T05:43:49.158 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-07-24T05:43:49.945 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-07-24T05:43:51.136 INFO:teuthology.orchestra.run.smithi103.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118868 files and directories currently installed.) 2023-07-24T05:43:51.140 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-07-24T05:43:51.296 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-07-24T05:43:51.946 INFO:teuthology.orchestra.run.smithi077.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118868 files and directories currently installed.) 2023-07-24T05:43:51.950 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-07-24T05:43:52.008 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-07-24T05:43:52.106 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-07-24T05:43:52.179 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-07-24T05:43:52.571 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-07-24T05:43:52.801 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-07-24T05:43:52.964 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-07-24T05:43:53.181 INFO:teuthology.orchestra.run.smithi103.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118868 files and directories currently installed.) 2023-07-24T05:43:53.184 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../00-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-07-24T05:43:53.321 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-07-24T05:43:53.360 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-07-24T05:43:53.901 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-07-24T05:43:53.921 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2_amd64.deb ... 2023-07-24T05:43:53.961 INFO:teuthology.orchestra.run.smithi077.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118868 files and directories currently installed.) 2023-07-24T05:43:53.965 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../00-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-07-24T05:43:53.975 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-07-24T05:43:54.105 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-07-24T05:43:54.387 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package dump. 2023-07-24T05:43:54.408 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../02-dump_0.4b46-6_amd64.deb ... 2023-07-24T05:43:54.445 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking dump (0.4b46-6) ... 2023-07-24T05:43:54.643 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-07-24T05:43:54.663 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2_amd64.deb ... 2023-07-24T05:43:54.701 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-07-24T05:43:54.832 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package indent. 2023-07-24T05:43:54.853 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../03-indent_2.2.12-1_amd64.deb ... 2023-07-24T05:43:54.890 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking indent (2.2.12-1) ... 2023-07-24T05:43:55.096 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package dump. 2023-07-24T05:43:55.116 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../02-dump_0.4b46-6_amd64.deb ... 2023-07-24T05:43:55.154 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking dump (0.4b46-6) ... 2023-07-24T05:43:55.260 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-07-24T05:43:55.281 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-5_amd64.deb ... 2023-07-24T05:43:55.327 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-07-24T05:43:55.507 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package indent. 2023-07-24T05:43:55.528 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../03-indent_2.2.12-1_amd64.deb ... 2023-07-24T05:43:55.565 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking indent (2.2.12-1) ... 2023-07-24T05:43:55.705 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-07-24T05:43:55.725 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../05-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-07-24T05:43:55.763 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-07-24T05:43:55.918 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-07-24T05:43:55.939 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-5_amd64.deb ... 2023-07-24T05:43:55.985 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-07-24T05:43:56.100 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-07-24T05:43:56.121 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../06-libelf-dev_0.176-1.1build1_amd64.deb ... 2023-07-24T05:43:56.158 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2023-07-24T05:43:56.389 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-07-24T05:43:56.408 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../05-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-07-24T05:43:56.446 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-07-24T05:43:56.570 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-07-24T05:43:56.590 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../07-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-07-24T05:43:56.628 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-07-24T05:43:56.749 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-07-24T05:43:56.770 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../06-libelf-dev_0.176-1.1build1_amd64.deb ... 2023-07-24T05:43:56.849 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2023-07-24T05:43:56.956 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libmbim-proxy. 2023-07-24T05:43:56.977 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../08-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-07-24T05:43:57.031 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-07-24T05:43:57.227 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-07-24T05:43:57.248 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../07-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-07-24T05:43:57.285 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-07-24T05:43:57.409 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-07-24T05:43:57.429 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../09-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-07-24T05:43:57.466 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-07-24T05:43:57.630 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libmbim-proxy. 2023-07-24T05:43:57.651 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../08-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-07-24T05:43:57.696 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-07-24T05:43:57.904 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libndp0:amd64. 2023-07-24T05:43:57.925 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../10-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-07-24T05:43:57.970 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-07-24T05:43:58.083 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-07-24T05:43:58.103 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../09-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-07-24T05:43:58.141 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-07-24T05:43:58.348 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libnm0:amd64. 2023-07-24T05:43:58.369 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../11-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-07-24T05:43:58.406 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-07-24T05:43:58.527 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libndp0:amd64. 2023-07-24T05:43:58.547 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../10-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-07-24T05:43:58.577 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-07-24T05:43:58.834 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libpq5:amd64. 2023-07-24T05:43:58.855 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../12-libpq5_12.15-0ubuntu0.20.04.1_amd64.deb ... 2023-07-24T05:43:58.901 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libpq5:amd64 (12.15-0ubuntu0.20.04.1) ... 2023-07-24T05:43:58.955 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libnm0:amd64. 2023-07-24T05:43:58.975 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../11-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-07-24T05:43:59.013 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-07-24T05:43:59.312 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-07-24T05:43:59.334 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../13-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-07-24T05:43:59.378 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-07-24T05:43:59.457 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libpq5:amd64. 2023-07-24T05:43:59.476 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../12-libpq5_12.15-0ubuntu0.20.04.1_amd64.deb ... 2023-07-24T05:43:59.515 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libpq5:amd64 (12.15-0ubuntu0.20.04.1) ... 2023-07-24T05:43:59.748 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libqmi-proxy. 2023-07-24T05:43:59.768 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../14-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-07-24T05:43:59.806 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-07-24T05:43:59.902 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-07-24T05:43:59.923 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../13-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-07-24T05:43:59.968 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-07-24T05:44:00.126 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-07-24T05:44:00.146 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../15-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-07-24T05:44:00.192 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-07-24T05:44:00.371 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libqmi-proxy. 2023-07-24T05:44:00.392 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../14-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-07-24T05:44:00.429 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-07-24T05:44:00.740 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-07-24T05:44:00.761 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../15-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-07-24T05:44:00.771 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-07-24T05:44:00.790 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../16-libteamdctl0_1.30-1_amd64.deb ... 2023-07-24T05:44:00.798 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-07-24T05:44:00.862 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-07-24T05:44:01.324 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package modemmanager. 2023-07-24T05:44:01.345 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../17-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-07-24T05:44:01.360 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-07-24T05:44:01.380 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../16-libteamdctl0_1.30-1_amd64.deb ... 2023-07-24T05:44:01.403 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-07-24T05:44:01.409 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-07-24T05:44:01.838 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package modemmanager. 2023-07-24T05:44:01.859 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../17-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-07-24T05:44:01.917 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-07-24T05:44:02.081 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package wpasupplicant. 2023-07-24T05:44:02.101 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../18-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-07-24T05:44:02.172 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-07-24T05:44:02.636 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package wpasupplicant. 2023-07-24T05:44:02.656 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../18-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-07-24T05:44:02.685 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-07-24T05:44:02.770 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package network-manager. 2023-07-24T05:44:02.790 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../19-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-07-24T05:44:02.872 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-07-24T05:44:03.266 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package network-manager. 2023-07-24T05:44:03.284 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../19-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-07-24T05:44:03.376 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-07-24T05:44:03.685 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ppp. 2023-07-24T05:44:03.705 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../20-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-07-24T05:44:04.164 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package ppp. 2023-07-24T05:44:04.184 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../20-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-07-24T05:44:04.193 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-07-24T05:44:04.565 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package pptp-linux. 2023-07-24T05:44:04.585 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../21-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-07-24T05:44:04.640 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-07-24T05:44:04.656 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-07-24T05:44:05.044 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package pptp-linux. 2023-07-24T05:44:05.064 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../21-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-07-24T05:44:05.076 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package network-manager-pptp. 2023-07-24T05:44:05.092 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../22-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-07-24T05:44:05.102 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-07-24T05:44:05.178 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-07-24T05:44:05.547 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package postgresql-client-common. 2023-07-24T05:44:05.549 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package network-manager-pptp. 2023-07-24T05:44:05.566 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../23-postgresql-client-common_214ubuntu0.1_all.deb ... 2023-07-24T05:44:05.568 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../22-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-07-24T05:44:05.605 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2023-07-24T05:44:05.638 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-07-24T05:44:05.976 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package postgresql-client-12. 2023-07-24T05:44:05.977 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package postgresql-client-common. 2023-07-24T05:44:05.996 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../24-postgresql-client-12_12.15-0ubuntu0.20.04.1_amd64.deb ... 2023-07-24T05:44:05.997 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../23-postgresql-client-common_214ubuntu0.1_all.deb ... 2023-07-24T05:44:06.034 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking postgresql-client-12 (12.15-0ubuntu0.20.04.1) ... 2023-07-24T05:44:06.035 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2023-07-24T05:44:06.356 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package postgresql-client-12. 2023-07-24T05:44:06.371 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../24-postgresql-client-12_12.15-0ubuntu0.20.04.1_amd64.deb ... 2023-07-24T05:44:06.439 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking postgresql-client-12 (12.15-0ubuntu0.20.04.1) ... 2023-07-24T05:44:06.681 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package postgresql-common. 2023-07-24T05:44:06.695 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../25-postgresql-common_214ubuntu0.1_all.deb ... 2023-07-24T05:44:06.770 INFO:teuthology.orchestra.run.smithi103.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-07-24T05:44:06.808 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2023-07-24T05:44:07.077 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package postgresql-common. 2023-07-24T05:44:07.098 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../25-postgresql-common_214ubuntu0.1_all.deb ... 2023-07-24T05:44:07.167 INFO:teuthology.orchestra.run.smithi077.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-07-24T05:44:07.197 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2023-07-24T05:44:07.338 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package postgresql-12. 2023-07-24T05:44:07.358 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../26-postgresql-12_12.15-0ubuntu0.20.04.1_amd64.deb ... 2023-07-24T05:44:07.402 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking postgresql-12 (12.15-0ubuntu0.20.04.1) ... 2023-07-24T05:44:07.734 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package postgresql-12. 2023-07-24T05:44:07.754 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../26-postgresql-12_12.15-0ubuntu0.20.04.1_amd64.deb ... 2023-07-24T05:44:07.798 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking postgresql-12 (12.15-0ubuntu0.20.04.1) ... 2023-07-24T05:44:09.024 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package postgresql. 2023-07-24T05:44:09.045 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../27-postgresql_12+214ubuntu0.1_all.deb ... 2023-07-24T05:44:09.082 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2023-07-24T05:44:09.360 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package postgresql-client. 2023-07-24T05:44:09.377 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package postgresql. 2023-07-24T05:44:09.380 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../28-postgresql-client_12+214ubuntu0.1_all.deb ... 2023-07-24T05:44:09.398 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../27-postgresql_12+214ubuntu0.1_all.deb ... 2023-07-24T05:44:09.435 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2023-07-24T05:44:09.443 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2023-07-24T05:44:09.696 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package postgresql-client. 2023-07-24T05:44:09.717 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../28-postgresql-client_12+214ubuntu0.1_all.deb ... 2023-07-24T05:44:09.720 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package postgresql-contrib. 2023-07-24T05:44:09.741 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../29-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2023-07-24T05:44:09.762 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2023-07-24T05:44:09.778 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2023-07-24T05:44:10.057 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package postgresql-contrib. 2023-07-24T05:44:10.077 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../29-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2023-07-24T05:44:10.098 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-07-24T05:44:10.118 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../30-usb-modeswitch-data_20191128-3_all.deb ... 2023-07-24T05:44:10.122 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2023-07-24T05:44:10.155 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-07-24T05:44:10.450 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-07-24T05:44:10.470 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../30-usb-modeswitch-data_20191128-3_all.deb ... 2023-07-24T05:44:10.508 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-07-24T05:44:10.601 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package usb-modeswitch. 2023-07-24T05:44:10.621 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../31-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-07-24T05:44:10.712 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-07-24T05:44:10.953 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package usb-modeswitch. 2023-07-24T05:44:10.974 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../31-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-07-24T05:44:11.035 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-07-24T05:44:11.052 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2023-07-24T05:44:11.307 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-07-24T05:44:11.402 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2023-07-24T05:44:11.609 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-07-24T05:44:11.658 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libpq5:amd64 (12.15-0ubuntu0.20.04.1) ... 2023-07-24T05:44:11.784 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-07-24T05:44:11.952 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-07-24T05:44:12.069 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libpq5:amd64 (12.15-0ubuntu0.20.04.1) ... 2023-07-24T05:44:12.078 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-07-24T05:44:12.219 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-07-24T05:44:12.337 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-07-24T05:44:12.480 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-07-24T05:44:12.509 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-07-24T05:44:12.509 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-07-24T05:44:13.257 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-07-24T05:44:13.257 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-07-24T05:44:13.465 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up postgresql-client-12 (12.15-0ubuntu0.20.04.1) ... 2023-07-24T05:44:14.191 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up postgresql-client-12 (12.15-0ubuntu0.20.04.1) ... 2023-07-24T05:44:15.599 INFO:teuthology.orchestra.run.smithi103.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-07-24T05:44:15.703 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-07-24T05:44:15.863 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-07-24T05:44:15.989 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2023-07-24T05:44:16.287 INFO:teuthology.orchestra.run.smithi077.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-07-24T05:44:16.405 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-07-24T05:44:16.555 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-07-24T05:44:16.681 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2023-07-24T05:44:17.293 INFO:teuthology.orchestra.run.smithi103.stdout:Adding user postgres to group ssl-cert 2023-07-24T05:44:17.769 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-07-24T05:44:17.769 INFO:teuthology.orchestra.run.smithi103.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-07-24T05:44:17.919 INFO:teuthology.orchestra.run.smithi077.stdout:Adding user postgres to group ssl-cert 2023-07-24T05:44:18.290 INFO:teuthology.orchestra.run.smithi103.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-07-24T05:44:18.290 INFO:teuthology.orchestra.run.smithi103.stdout:Removing obsolete dictionary files: 2023-07-24T05:44:18.369 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:44:18.370 INFO:teuthology.orchestra.run.smithi077.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-07-24T05:44:18.867 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-07-24T05:44:18.884 INFO:teuthology.orchestra.run.smithi077.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-07-24T05:44:18.885 INFO:teuthology.orchestra.run.smithi077.stdout:Removing obsolete dictionary files: 2023-07-24T05:44:19.432 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-07-24T05:44:20.316 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-07-24T05:44:20.433 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-07-24T05:44:20.593 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2023-07-24T05:44:20.719 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-07-24T05:44:20.845 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-07-24T05:44:20.857 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-07-24T05:44:20.983 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-07-24T05:44:21.109 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2023-07-24T05:44:21.235 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-07-24T05:44:21.394 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-07-24T05:44:22.077 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-07-24T05:44:22.510 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up dump (0.4b46-6) ... 2023-07-24T05:44:22.598 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-07-24T05:44:22.642 INFO:teuthology.orchestra.run.smithi103.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-07-24T05:44:22.711 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-07-24T05:44:22.851 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-07-24T05:44:22.972 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up indent (2.2.12-1) ... 2023-07-24T05:44:23.016 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up dump (0.4b46-6) ... 2023-07-24T05:44:23.125 INFO:teuthology.orchestra.run.smithi077.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-07-24T05:44:23.131 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-07-24T05:44:23.193 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-07-24T05:44:23.316 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-07-24T05:44:23.360 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-07-24T05:44:23.483 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up postgresql-12 (12.15-0ubuntu0.20.04.1) ... 2023-07-24T05:44:23.486 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up indent (2.2.12-1) ... 2023-07-24T05:44:23.612 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-07-24T05:44:23.830 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-07-24T05:44:23.965 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up postgresql-12 (12.15-0ubuntu0.20.04.1) ... 2023-07-24T05:44:23.988 INFO:teuthology.orchestra.run.smithi103.stdout:Creating new PostgreSQL cluster 12/main ... 2023-07-24T05:44:24.019 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2023-07-24T05:44:24.099 INFO:teuthology.orchestra.run.smithi103.stdout:The files belonging to this database system will be owned by user "postgres". 2023-07-24T05:44:24.099 INFO:teuthology.orchestra.run.smithi103.stdout:This user must also own the server process. 2023-07-24T05:44:24.099 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-07-24T05:44:24.099 INFO:teuthology.orchestra.run.smithi103.stdout:The database cluster will be initialized with locale "en_US". 2023-07-24T05:44:24.099 INFO:teuthology.orchestra.run.smithi103.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-07-24T05:44:24.100 INFO:teuthology.orchestra.run.smithi103.stdout:The default text search configuration will be set to "english". 2023-07-24T05:44:24.100 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-07-24T05:44:24.100 INFO:teuthology.orchestra.run.smithi103.stdout:Data page checksums are disabled. 2023-07-24T05:44:24.100 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-07-24T05:44:24.100 INFO:teuthology.orchestra.run.smithi103.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2023-07-24T05:44:24.103 INFO:teuthology.orchestra.run.smithi103.stdout:creating subdirectories ... ok 2023-07-24T05:44:24.103 INFO:teuthology.orchestra.run.smithi103.stdout:selecting dynamic shared memory implementation ... posix 2023-07-24T05:44:24.139 INFO:teuthology.orchestra.run.smithi103.stdout:selecting default max_connections ... 100 2023-07-24T05:44:24.188 INFO:teuthology.orchestra.run.smithi103.stdout:selecting default shared_buffers ... 128MB 2023-07-24T05:44:24.209 INFO:teuthology.orchestra.run.smithi103.stdout:selecting default time zone ... Etc/UTC 2023-07-24T05:44:24.210 INFO:teuthology.orchestra.run.smithi103.stdout:creating configuration files ... ok 2023-07-24T05:44:24.408 INFO:teuthology.orchestra.run.smithi103.stdout:running bootstrap script ... ok 2023-07-24T05:44:24.486 INFO:teuthology.orchestra.run.smithi077.stdout:Creating new PostgreSQL cluster 12/main ... 2023-07-24T05:44:24.516 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2023-07-24T05:44:24.589 INFO:teuthology.orchestra.run.smithi077.stdout:The files belonging to this database system will be owned by user "postgres". 2023-07-24T05:44:24.589 INFO:teuthology.orchestra.run.smithi077.stdout:This user must also own the server process. 2023-07-24T05:44:24.589 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:44:24.590 INFO:teuthology.orchestra.run.smithi077.stdout:The database cluster will be initialized with locale "en_US". 2023-07-24T05:44:24.590 INFO:teuthology.orchestra.run.smithi077.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-07-24T05:44:24.590 INFO:teuthology.orchestra.run.smithi077.stdout:The default text search configuration will be set to "english". 2023-07-24T05:44:24.590 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:44:24.590 INFO:teuthology.orchestra.run.smithi077.stdout:Data page checksums are disabled. 2023-07-24T05:44:24.590 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:44:24.590 INFO:teuthology.orchestra.run.smithi077.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2023-07-24T05:44:24.593 INFO:teuthology.orchestra.run.smithi077.stdout:creating subdirectories ... ok 2023-07-24T05:44:24.593 INFO:teuthology.orchestra.run.smithi077.stdout:selecting dynamic shared memory implementation ... posix 2023-07-24T05:44:24.631 INFO:teuthology.orchestra.run.smithi077.stdout:selecting default max_connections ... 100 2023-07-24T05:44:24.680 INFO:teuthology.orchestra.run.smithi077.stdout:selecting default shared_buffers ... 128MB 2023-07-24T05:44:24.700 INFO:teuthology.orchestra.run.smithi077.stdout:selecting default time zone ... Etc/UTC 2023-07-24T05:44:24.701 INFO:teuthology.orchestra.run.smithi077.stdout:creating configuration files ... ok 2023-07-24T05:44:24.895 INFO:teuthology.orchestra.run.smithi077.stdout:running bootstrap script ... ok 2023-07-24T05:44:25.026 INFO:teuthology.orchestra.run.smithi103.stdout:performing post-bootstrap initialization ... ok 2023-07-24T05:44:25.514 INFO:teuthology.orchestra.run.smithi077.stdout:performing post-bootstrap initialization ... ok 2023-07-24T05:44:25.574 INFO:teuthology.orchestra.run.smithi103.stdout:syncing data to disk ... ok 2023-07-24T05:44:25.574 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-07-24T05:44:25.575 INFO:teuthology.orchestra.run.smithi103.stdout:Success. You can now start the database server using: 2023-07-24T05:44:25.575 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-07-24T05:44:25.575 INFO:teuthology.orchestra.run.smithi103.stdout: pg_ctlcluster 12 main start 2023-07-24T05:44:25.575 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-07-24T05:44:26.039 INFO:teuthology.orchestra.run.smithi077.stdout:syncing data to disk ... ok 2023-07-24T05:44:26.039 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:44:26.039 INFO:teuthology.orchestra.run.smithi077.stdout:Success. You can now start the database server using: 2023-07-24T05:44:26.040 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:44:26.040 INFO:teuthology.orchestra.run.smithi077.stdout: pg_ctlcluster 12 main start 2023-07-24T05:44:26.040 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:44:26.142 INFO:teuthology.orchestra.run.smithi103.stdout:Ver Cluster Port Status Owner Data directory Log file 2023-07-24T05:44:26.143 INFO:teuthology.orchestra.run.smithi103.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2023-07-24T05:44:26.364 INFO:teuthology.orchestra.run.smithi103.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-07-24T05:44:26.551 INFO:teuthology.orchestra.run.smithi077.stdout:Ver Cluster Port Status Owner Data directory Log file 2023-07-24T05:44:26.551 INFO:teuthology.orchestra.run.smithi077.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2023-07-24T05:44:26.751 INFO:teuthology.orchestra.run.smithi077.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-07-24T05:44:30.034 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-07-24T05:44:30.162 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-07-24T05:44:30.321 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2023-07-24T05:44:30.364 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-07-24T05:44:30.472 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-07-24T05:44:30.490 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-07-24T05:44:30.691 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2023-07-24T05:44:30.817 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-07-24T05:44:31.681 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-07-24T05:44:31.682 INFO:teuthology.orchestra.run.smithi103.stdout:The following network interfaces were found in /etc/network/interfaces 2023-07-24T05:44:31.682 INFO:teuthology.orchestra.run.smithi103.stdout:which means they are currently configured by ifupdown: 2023-07-24T05:44:31.682 INFO:teuthology.orchestra.run.smithi103.stdout:- enp3s0f1 2023-07-24T05:44:31.682 INFO:teuthology.orchestra.run.smithi103.stdout:If you want to manage those interfaces with NetworkManager instead 2023-07-24T05:44:31.682 INFO:teuthology.orchestra.run.smithi103.stdout:remove their configuration from /etc/network/interfaces. 2023-07-24T05:44:31.682 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-07-24T05:44:31.914 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-07-24T05:44:32.017 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:44:32.017 INFO:teuthology.orchestra.run.smithi077.stdout:The following network interfaces were found in /etc/network/interfaces 2023-07-24T05:44:32.017 INFO:teuthology.orchestra.run.smithi077.stdout:which means they are currently configured by ifupdown: 2023-07-24T05:44:32.018 INFO:teuthology.orchestra.run.smithi077.stdout:- enp3s0f1 2023-07-24T05:44:32.018 INFO:teuthology.orchestra.run.smithi077.stdout:If you want to manage those interfaces with NetworkManager instead 2023-07-24T05:44:32.018 INFO:teuthology.orchestra.run.smithi077.stdout:remove their configuration from /etc/network/interfaces. 2023-07-24T05:44:32.018 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:44:32.239 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-07-24T05:44:32.460 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-07-24T05:44:32.764 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-07-24T05:44:33.423 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-07-24T05:44:33.705 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-07-24T05:44:34.401 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-07-24T05:44:34.579 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-07-24T05:44:34.620 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-07-24T05:44:34.753 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2023-07-24T05:44:34.755 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-07-24T05:44:34.879 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2023-07-24T05:44:34.956 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2023-07-24T05:44:35.030 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-07-24T05:44:35.082 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2023-07-24T05:44:35.156 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-07-24T05:44:35.208 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-07-24T05:44:35.282 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-07-24T05:44:35.367 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-07-24T05:44:35.510 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-07-24T05:44:35.600 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-07-24T05:44:35.600 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-07-24T05:44:35.819 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-07-24T05:44:35.820 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-07-24T05:44:36.610 INFO:teuthology.orchestra.run.smithi103.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-07-24T05:44:36.736 INFO:teuthology.orchestra.run.smithi103.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-07-24T05:44:36.803 INFO:teuthology.orchestra.run.smithi077.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-07-24T05:44:36.870 INFO:teuthology.orchestra.run.smithi103.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-07-24T05:44:36.922 INFO:teuthology.orchestra.run.smithi077.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-07-24T05:44:37.030 INFO:teuthology.orchestra.run.smithi103.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-07-24T05:44:37.056 INFO:teuthology.orchestra.run.smithi077.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-07-24T05:44:37.215 INFO:teuthology.orchestra.run.smithi077.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-07-24T05:44:37.548 INFO:teuthology.orchestra.run.smithi103.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-07-24T05:44:37.709 INFO:teuthology.orchestra.run.smithi077.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-07-24T05:44:50.744 INFO:teuthology.orchestra.run.smithi103.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-07-24T05:44:50.861 INFO:teuthology.orchestra.run.smithi103.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-07-24T05:44:50.862 INFO:teuthology.orchestra.run.smithi077.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-07-24T05:44:50.971 INFO:teuthology.orchestra.run.smithi077.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-07-24T05:44:52.105 INFO:teuthology.orchestra.run.smithi103.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-07-24T05:44:52.109 DEBUG:teuthology.parallel:result is None 2023-07-24T05:44:52.187 INFO:teuthology.orchestra.run.smithi077.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-07-24T05:44:52.193 DEBUG:teuthology.parallel:result is None 2023-07-24T05:44:52.194 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=e2c50893bf78471cc8ee960317cc10390300dfd5 2023-07-24T05:44:52.548 DEBUG:teuthology.orchestra.run.smithi077:> dpkg-query -W -f '${Version}' ceph 2023-07-24T05:44:52.583 INFO:teuthology.orchestra.run.smithi077.stdout:18.0.0-5042-ge2c50893-1focal 2023-07-24T05:44:52.583 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5042-ge2c50893-1focal 2023-07-24T05:44:52.584 INFO:teuthology.task.install:The correct ceph version 18.0.0-5042-ge2c50893-1focal is installed. 2023-07-24T05:44:52.584 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=e2c50893bf78471cc8ee960317cc10390300dfd5 2023-07-24T05:44:52.970 DEBUG:teuthology.orchestra.run.smithi103:> dpkg-query -W -f '${Version}' ceph 2023-07-24T05:44:53.007 INFO:teuthology.orchestra.run.smithi103.stdout:18.0.0-5042-ge2c50893-1focal 2023-07-24T05:44:53.007 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5042-ge2c50893-1focal 2023-07-24T05:44:53.007 INFO:teuthology.task.install:The correct ceph version 18.0.0-5042-ge2c50893-1focal is installed. 2023-07-24T05:44:53.008 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-07-24T05:44:53.008 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-07-24T05:44:53.009 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-24T05:44:53.042 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2023-07-24T05:44:53.042 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-24T05:44:53.088 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-07-24T05:44:53.088 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-07-24T05:44:53.088 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/daemon-helper 2023-07-24T05:44:53.121 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-24T05:44:53.200 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2023-07-24T05:44:53.200 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/daemon-helper 2023-07-24T05:44:53.233 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-24T05:44:53.314 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-07-24T05:44:53.314 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-07-24T05:44:53.315 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-24T05:44:53.348 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-24T05:44:53.423 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2023-07-24T05:44:53.424 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-24T05:44:53.457 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-24T05:44:53.533 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-07-24T05:44:53.534 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-07-24T05:44:53.534 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/stdin-killer 2023-07-24T05:44:53.569 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-24T05:44:53.645 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2023-07-24T05:44:53.646 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/stdin-killer 2023-07-24T05:44:53.675 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-24T05:44:53.753 INFO:teuthology.run_tasks:Running task ceph... 2023-07-24T05:44:53.822 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-07-24T05:44:53.822 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 777 /var/log/ceph 2023-07-24T05:44:53.830 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 777 /var/log/ceph 2023-07-24T05:44:53.862 INFO:tasks.ceph:Disabling ceph logrotate... 2023-07-24T05:44:53.862 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-24T05:44:53.906 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-24T05:44:53.938 INFO:tasks.ceph:Creating extra log directories... 2023-07-24T05:44:53.938 DEBUG:teuthology.orchestra.run.smithi077:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-24T05:44:53.983 DEBUG:teuthology.orchestra.run.smithi103:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-24T05:44:54.022 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-07-24T05:44:54.023 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-07-24T05:44:54.023 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-07-24T05:44:54.023 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-07-24T05:44:54.023 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-24T05:44:54.070 DEBUG:teuthology.orchestra.run.smithi077:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-24T05:44:54.199 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2023-07-24T05:44:54.199 DEBUG:teuthology.orchestra.run.smithi103:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-24T05:44:54.215 DEBUG:teuthology.orchestra.run.smithi103:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-24T05:44:54.355 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-07-24T05:44:54.355 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-07-24T05:44:54.356 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-07-24_05:02:48-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi/7349233', 'branch': 'wip-vshankar-testing-20230720.042515', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7349233', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': 'c685da6f56cc77f2cfb9c4221be3960522616caf'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-07-24_05:02:48-fs-wip-vshankar-testing-20230720.042515-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20230720.042515'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'e2c50893bf78471cc8ee960317cc10390300dfd5'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'e2c50893bf78471cc8ee960317cc10390300dfd5'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20230720.042515', 'sha1': 'e2c50893bf78471cc8ee960317cc10390300dfd5'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 632, 'sha1': 'e2c50893bf78471cc8ee960317cc10390300dfd5', 'sleep_before_teardown': 0, 'subset': '14/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20230720.042515', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_e2c50893bf78471cc8ee960317cc10390300dfd5/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'e2c50893bf78471cc8ee960317cc10390300dfd5', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi077.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi103.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': 'c685da6f56cc77f2cfb9c4221be3960522616caf'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'e2c50893bf78471cc8ee960317cc10390300dfd5'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '1426592083662fef3e03bbeec33624331f0fdbc1', 'timestamp': '2023-07-24_05:02:48', 'tube': 'smithi', 'use_shaman': True, 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-07-24T05:44:54.356 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-24T05:44:54.363 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-24T05:44:54.383 DEBUG:teuthology.orchestra.run.smithi077:> sudo install -d -m0777 -- /var/run/ceph 2023-07-24T05:44:54.423 DEBUG:teuthology.orchestra.run.smithi103:> sudo install -d -m0777 -- /var/run/ceph 2023-07-24T05:44:54.460 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-07-24T05:44:54.460 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/scratch_devs of=/dev/stdout 2023-07-24T05:44:54.512 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-24T05:44:54.513 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_1 2023-07-24T05:44:54.575 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-24T05:44:54.575 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-24T05:44:54.575 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 495 Links: 1 2023-07-24T05:44:54.576 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-24T05:44:54.576 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2023-07-24 05:39:08.378427394 +0000 2023-07-24T05:44:54.576 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2023-07-24 05:39:07.894438551 +0000 2023-07-24T05:44:54.576 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2023-07-24 05:39:07.894438551 +0000 2023-07-24T05:44:54.576 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: - 2023-07-24T05:44:54.576 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-24T05:44:54.647 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-07-24T05:44:54.647 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-07-24T05:44:54.647 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000616349 s, 831 kB/s 2023-07-24T05:44:54.649 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-24T05:44:54.720 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_2 2023-07-24T05:44:54.781 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-24T05:44:54.781 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-24T05:44:54.782 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 503 Links: 1 2023-07-24T05:44:54.782 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-24T05:44:54.782 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2023-07-24 05:39:09.130410060 +0000 2023-07-24T05:44:54.782 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2023-07-24 05:39:08.662420848 +0000 2023-07-24T05:44:54.782 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2023-07-24 05:39:08.662420848 +0000 2023-07-24T05:44:54.782 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: - 2023-07-24T05:44:54.783 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-24T05:44:54.854 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-07-24T05:44:54.855 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-07-24T05:44:54.855 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000666912 s, 768 kB/s 2023-07-24T05:44:54.856 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-24T05:44:54.928 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_3 2023-07-24T05:44:54.987 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-24T05:44:54.987 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-24T05:44:54.988 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 510 Links: 1 2023-07-24T05:44:54.988 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-24T05:44:54.988 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2023-07-24 05:39:09.886392635 +0000 2023-07-24T05:44:54.988 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2023-07-24 05:39:09.406403698 +0000 2023-07-24T05:44:54.988 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2023-07-24 05:39:09.406403698 +0000 2023-07-24T05:44:54.988 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: - 2023-07-24T05:44:54.988 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-24T05:44:55.059 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-07-24T05:44:55.059 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-07-24T05:44:55.060 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000699997 s, 731 kB/s 2023-07-24T05:44:55.061 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-24T05:44:55.126 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_4 2023-07-24T05:44:55.185 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-24T05:44:55.185 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-24T05:44:55.185 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 516 Links: 1 2023-07-24T05:44:55.186 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-24T05:44:55.186 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2023-07-24 05:39:10.722373365 +0000 2023-07-24T05:44:55.186 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2023-07-24 05:39:10.246384337 +0000 2023-07-24T05:44:55.186 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2023-07-24 05:39:10.246384337 +0000 2023-07-24T05:44:55.186 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: - 2023-07-24T05:44:55.187 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-24T05:44:55.259 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2023-07-24T05:44:55.259 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2023-07-24T05:44:55.260 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000678721 s, 754 kB/s 2023-07-24T05:44:55.261 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-24T05:44:55.331 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-24T05:44:55.331 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2023-07-24T05:44:55.332 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/scratch_devs of=/dev/stdout 2023-07-24T05:44:55.349 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-24T05:44:55.349 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_1 2023-07-24T05:44:55.408 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-24T05:44:55.408 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-24T05:44:55.408 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 498 Links: 1 2023-07-24T05:44:55.409 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-24T05:44:55.409 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2023-07-24 05:39:08.811160758 +0000 2023-07-24T05:44:55.409 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2023-07-24 05:39:08.323156395 +0000 2023-07-24T05:44:55.409 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2023-07-24 05:39:08.323156395 +0000 2023-07-24T05:44:55.409 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: - 2023-07-24T05:44:55.409 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-24T05:44:55.480 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2023-07-24T05:44:55.480 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2023-07-24T05:44:55.480 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000694508 s, 737 kB/s 2023-07-24T05:44:55.482 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-24T05:44:55.549 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_2 2023-07-24T05:44:55.611 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-24T05:44:55.612 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-24T05:44:55.612 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 502 Links: 1 2023-07-24T05:44:55.612 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-24T05:44:55.612 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2023-07-24 05:39:09.551166826 +0000 2023-07-24T05:44:55.612 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2023-07-24 05:39:09.083163112 +0000 2023-07-24T05:44:55.612 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2023-07-24 05:39:09.083163112 +0000 2023-07-24T05:44:55.613 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: - 2023-07-24T05:44:55.613 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-24T05:44:55.685 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2023-07-24T05:44:55.685 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2023-07-24T05:44:55.685 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000697844 s, 734 kB/s 2023-07-24T05:44:55.687 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-24T05:44:55.752 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_3 2023-07-24T05:44:55.810 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-24T05:44:55.810 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-24T05:44:55.811 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 507 Links: 1 2023-07-24T05:44:55.811 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-24T05:44:55.811 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2023-07-24 05:39:10.335172722 +0000 2023-07-24T05:44:55.811 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2023-07-24 05:39:09.847169176 +0000 2023-07-24T05:44:55.811 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2023-07-24 05:39:09.847169176 +0000 2023-07-24T05:44:55.811 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: - 2023-07-24T05:44:55.812 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-24T05:44:55.888 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2023-07-24T05:44:55.888 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2023-07-24T05:44:55.888 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000687098 s, 745 kB/s 2023-07-24T05:44:55.890 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-24T05:44:55.957 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_4 2023-07-24T05:44:56.016 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-24T05:44:56.016 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-24T05:44:56.016 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 514 Links: 1 2023-07-24T05:44:56.016 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-24T05:44:56.016 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2023-07-24 05:39:11.119178162 +0000 2023-07-24T05:44:56.016 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2023-07-24 05:39:10.635174804 +0000 2023-07-24T05:44:56.017 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2023-07-24 05:39:10.635174804 +0000 2023-07-24T05:44:56.017 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: - 2023-07-24T05:44:56.017 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-24T05:44:56.087 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2023-07-24T05:44:56.088 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2023-07-24T05:44:56.088 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000507616 s, 1.0 MB/s 2023-07-24T05:44:56.089 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-24T05:44:56.157 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-24T05:44:56.158 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi077.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi103.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-24T05:44:56.158 INFO:tasks.ceph:Generating config... 2023-07-24T05:44:56.159 INFO:tasks.ceph:[client] client mount timeout = 600 2023-07-24T05:44:56.159 INFO:tasks.ceph:[client] debug client = 20 2023-07-24T05:44:56.160 INFO:tasks.ceph:[client] debug ms = 1 2023-07-24T05:44:56.160 INFO:tasks.ceph:[client] pid file = 2023-07-24T05:44:56.160 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-07-24T05:44:56.160 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-07-24T05:44:56.160 INFO:tasks.ceph:[mds] debug mds = 20 2023-07-24T05:44:56.161 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-07-24T05:44:56.161 INFO:tasks.ceph:[mds] debug ms = 1 2023-07-24T05:44:56.161 INFO:tasks.ceph:[mds] mds debug frag = True 2023-07-24T05:44:56.161 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-07-24T05:44:56.161 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-07-24T05:44:56.161 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-07-24T05:44:56.162 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-07-24T05:44:56.162 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-07-24T05:44:56.162 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-07-24T05:44:56.162 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-07-24T05:44:56.162 INFO:tasks.ceph:[mgr] debug ms = 1 2023-07-24T05:44:56.163 INFO:tasks.ceph:[mon] debug mon = 20 2023-07-24T05:44:56.163 INFO:tasks.ceph:[mon] debug ms = 1 2023-07-24T05:44:56.163 INFO:tasks.ceph:[mon] debug paxos = 20 2023-07-24T05:44:56.163 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-07-24T05:44:56.163 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-07-24T05:44:56.164 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-07-24T05:44:56.164 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-07-24T05:44:56.164 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-07-24T05:44:56.164 INFO:tasks.ceph:[osd] debug ms = 1 2023-07-24T05:44:56.165 INFO:tasks.ceph:[osd] debug osd = 20 2023-07-24T05:44:56.165 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-07-24T05:44:56.165 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-07-24T05:44:56.166 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-07-24T05:44:56.166 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-07-24T05:44:56.166 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-07-24T05:44:56.167 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-07-24T05:44:56.167 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-07-24T05:44:56.167 INFO:tasks.ceph:Setting up mon.a... 2023-07-24T05:44:56.167 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-07-24T05:44:56.238 INFO:teuthology.orchestra.run.smithi077.stdout:creating /etc/ceph/ceph.keyring 2023-07-24T05:44:56.263 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-07-24T05:44:56.339 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-24T05:44:56.370 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.77'), ('mon.b', '172.21.15.103'), ('mon.c', '[v2:172.21.15.103:3301,v1:172.21.15.103:6790]')] 2023-07-24T05:44:56.370 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.77,172.21.15.103,[v2:172.21.15.103:3301,v1:172.21.15.103:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-07-24T05:44:56.371 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-07-24T05:44:56.371 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-07-24T05:44:56.430 DEBUG:teuthology.orchestra.run.smithi077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.77 --add b 172.21.15.103 --addv c '[v2:172.21.15.103:3301,v1:172.21.15.103:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-07-24T05:44:56.547 INFO:teuthology.orchestra.run.smithi077.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-07-24T05:44:56.548 INFO:teuthology.orchestra.run.smithi077.stdout:monmaptool: generated fsid 5aed5f7b-fb55-4d95-9c02-c6adbb1677b4 2023-07-24T05:44:56.548 INFO:teuthology.orchestra.run.smithi077.stdout:setting min_mon_release = pacific 2023-07-24T05:44:56.548 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 0 2023-07-24T05:44:56.548 INFO:teuthology.orchestra.run.smithi077.stdout:fsid 5aed5f7b-fb55-4d95-9c02-c6adbb1677b4 2023-07-24T05:44:56.548 INFO:teuthology.orchestra.run.smithi077.stdout:last_changed 2023-07-24T05:44:56.546685+0000 2023-07-24T05:44:56.548 INFO:teuthology.orchestra.run.smithi077.stdout:created 2023-07-24T05:44:56.546685+0000 2023-07-24T05:44:56.548 INFO:teuthology.orchestra.run.smithi077.stdout:min_mon_release 16 (pacific) 2023-07-24T05:44:56.549 INFO:teuthology.orchestra.run.smithi077.stdout:election_strategy: 1 2023-07-24T05:44:56.549 INFO:teuthology.orchestra.run.smithi077.stdout:0: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.a 2023-07-24T05:44:56.549 INFO:teuthology.orchestra.run.smithi077.stdout:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2023-07-24T05:44:56.549 INFO:teuthology.orchestra.run.smithi077.stdout:2: [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] mon.c 2023-07-24T05:44:56.549 INFO:teuthology.orchestra.run.smithi077.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-07-24T05:44:56.551 DEBUG:teuthology.orchestra.run.smithi077:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-07-24T05:44:56.569 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 5aed5f7b-fb55-4d95-9c02-c6adbb1677b4... 2023-07-24T05:44:56.570 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-24T05:44:56.618 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-24T05:44:56.691 INFO:teuthology.orchestra.run.smithi077.stdout:[global] 2023-07-24T05:44:56.692 INFO:teuthology.orchestra.run.smithi077.stdout: chdir = "" 2023-07-24T05:44:56.692 INFO:teuthology.orchestra.run.smithi077.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-24T05:44:56.692 INFO:teuthology.orchestra.run.smithi077.stdout: auth supported = cephx 2023-07-24T05:44:56.692 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:44:56.692 INFO:teuthology.orchestra.run.smithi077.stdout: filestore xattr use omap = true 2023-07-24T05:44:56.692 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:44:56.692 INFO:teuthology.orchestra.run.smithi077.stdout: mon clock drift allowed = 1.000 2023-07-24T05:44:56.693 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:44:56.693 INFO:teuthology.orchestra.run.smithi077.stdout: osd crush chooseleaf type = 0 2023-07-24T05:44:56.693 INFO:teuthology.orchestra.run.smithi077.stdout: auth debug = true 2023-07-24T05:44:56.693 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:44:56.693 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on old message = true 2023-07-24T05:44:56.693 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on bug = true 2023-07-24T05:44:56.693 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:44:56.693 INFO:teuthology.orchestra.run.smithi077.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-24T05:44:56.694 INFO:teuthology.orchestra.run.smithi077.stdout: mon pg warn max object skew = 0 2023-07-24T05:44:56.694 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:44:56.694 INFO:teuthology.orchestra.run.smithi077.stdout: # disable pg_autoscaler by default for new pools 2023-07-24T05:44:56.694 INFO:teuthology.orchestra.run.smithi077.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-24T05:44:56.694 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:44:56.694 INFO:teuthology.orchestra.run.smithi077.stdout: osd pool default size = 2 2023-07-24T05:44:56.695 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:44:56.695 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd allow primary affinity = true 2023-07-24T05:44:56.695 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd allow pg remap = true 2023-07-24T05:44:56.695 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on legacy crush tunables = false 2023-07-24T05:44:56.695 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on crush straw calc version zero = false 2023-07-24T05:44:56.695 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on no sortbitwise = false 2023-07-24T05:44:56.695 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on osd down out interval zero = false 2023-07-24T05:44:56.695 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on too few osds = false 2023-07-24T05:44:56.696 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-24T05:44:56.696 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-24T05:44:56.696 INFO:teuthology.orchestra.run.smithi077.stdout: mon_allow_pool_size_one = true 2023-07-24T05:44:56.696 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:44:56.696 INFO:teuthology.orchestra.run.smithi077.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-24T05:44:56.696 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:44:56.696 INFO:teuthology.orchestra.run.smithi077.stdout: osd default data pool replay window = 5 2023-07-24T05:44:56.696 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:44:56.697 INFO:teuthology.orchestra.run.smithi077.stdout: mon allow pool delete = true 2023-07-24T05:44:56.697 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:44:56.697 INFO:teuthology.orchestra.run.smithi077.stdout: mon cluster log file level = debug 2023-07-24T05:44:56.697 INFO:teuthology.orchestra.run.smithi077.stdout: debug asserts on shutdown = true 2023-07-24T05:44:56.697 INFO:teuthology.orchestra.run.smithi077.stdout: mon health detail to clog = false 2023-07-24T05:44:56.697 INFO:teuthology.orchestra.run.smithi077.stdout: mon host = "172.21.15.77,172.21.15.103,[v2:172.21.15.103:3301,v1:172.21.15.103:6790]" 2023-07-24T05:44:56.697 INFO:teuthology.orchestra.run.smithi077.stdout: fsid = 5aed5f7b-fb55-4d95-9c02-c6adbb1677b4 2023-07-24T05:44:56.697 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:44:56.698 INFO:teuthology.orchestra.run.smithi077.stdout:[osd] 2023-07-24T05:44:56.698 INFO:teuthology.orchestra.run.smithi077.stdout: osd journal size = 100 2023-07-24T05:44:56.698 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:44:56.698 INFO:teuthology.orchestra.run.smithi077.stdout: osd scrub load threshold = 5.0 2023-07-24T05:44:56.698 INFO:teuthology.orchestra.run.smithi077.stdout: osd scrub max interval = 600 2023-07-24T05:44:56.698 INFO:teuthology.orchestra.run.smithi077.stdout: osd mclock profile = high_recovery_ops 2023-07-24T05:44:56.698 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:44:56.698 INFO:teuthology.orchestra.run.smithi077.stdout: osd recover clone overlap = true 2023-07-24T05:44:56.699 INFO:teuthology.orchestra.run.smithi077.stdout: osd recovery max chunk = 1048576 2023-07-24T05:44:56.699 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:44:56.699 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug shutdown = true 2023-07-24T05:44:56.699 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug op order = true 2023-07-24T05:44:56.699 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug verify stray on activate = true 2023-07-24T05:44:56.699 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:44:56.699 INFO:teuthology.orchestra.run.smithi077.stdout: osd open classes on start = true 2023-07-24T05:44:56.699 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug pg log writeout = true 2023-07-24T05:44:56.700 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:44:56.700 INFO:teuthology.orchestra.run.smithi077.stdout: osd deep scrub update digest min age = 30 2023-07-24T05:44:56.700 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:44:56.700 INFO:teuthology.orchestra.run.smithi077.stdout: osd map max advance = 10 2023-07-24T05:44:56.700 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:44:56.700 INFO:teuthology.orchestra.run.smithi077.stdout: journal zero on create = true 2023-07-24T05:44:56.700 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:44:56.700 INFO:teuthology.orchestra.run.smithi077.stdout: filestore ondisk finisher threads = 3 2023-07-24T05:44:56.701 INFO:teuthology.orchestra.run.smithi077.stdout: filestore apply finisher threads = 3 2023-07-24T05:44:56.701 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:44:56.701 INFO:teuthology.orchestra.run.smithi077.stdout: bdev debug aio = true 2023-07-24T05:44:56.701 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug misdirected ops = true 2023-07-24T05:44:56.701 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore block size = 96636764160 2023-07-24T05:44:56.701 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore fsck on mount = True 2023-07-24T05:44:56.701 INFO:teuthology.orchestra.run.smithi077.stdout: debug bluefs = 20 2023-07-24T05:44:56.701 INFO:teuthology.orchestra.run.smithi077.stdout: debug bluestore = 20 2023-07-24T05:44:56.702 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2023-07-24T05:44:56.702 INFO:teuthology.orchestra.run.smithi077.stdout: debug osd = 20 2023-07-24T05:44:56.702 INFO:teuthology.orchestra.run.smithi077.stdout: debug rocksdb = 10 2023-07-24T05:44:56.702 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd backfillfull_ratio = 0.85 2023-07-24T05:44:56.702 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd full ratio = 0.9 2023-07-24T05:44:56.702 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd nearfull ratio = 0.8 2023-07-24T05:44:56.702 INFO:teuthology.orchestra.run.smithi077.stdout: osd failsafe full ratio = 0.95 2023-07-24T05:44:56.702 INFO:teuthology.orchestra.run.smithi077.stdout: osd objectstore = bluestore 2023-07-24T05:44:56.703 INFO:teuthology.orchestra.run.smithi077.stdout: osd op complaint time = 180 2023-07-24T05:44:56.703 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:44:56.703 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr] 2023-07-24T05:44:56.703 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2023-07-24T05:44:56.703 INFO:teuthology.orchestra.run.smithi077.stdout: debug mgr = 20 2023-07-24T05:44:56.703 INFO:teuthology.orchestra.run.smithi077.stdout: debug mon = 20 2023-07-24T05:44:56.703 INFO:teuthology.orchestra.run.smithi077.stdout: debug auth = 20 2023-07-24T05:44:56.703 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min pgs per osd = 4 2023-07-24T05:44:56.704 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min bytes per osd = 10 2023-07-24T05:44:56.704 INFO:teuthology.orchestra.run.smithi077.stdout: mgr/telemetry/nag = false 2023-07-24T05:44:56.704 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:44:56.704 INFO:teuthology.orchestra.run.smithi077.stdout:[mon] 2023-07-24T05:44:56.704 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2023-07-24T05:44:56.704 INFO:teuthology.orchestra.run.smithi077.stdout: debug mon = 20 2023-07-24T05:44:56.704 INFO:teuthology.orchestra.run.smithi077.stdout: debug paxos = 20 2023-07-24T05:44:56.704 INFO:teuthology.orchestra.run.smithi077.stdout: debug auth = 20 2023-07-24T05:44:56.705 INFO:teuthology.orchestra.run.smithi077.stdout: mon data avail warn = 5 2023-07-24T05:44:56.705 INFO:teuthology.orchestra.run.smithi077.stdout: mon mgr mkfs grace = 240 2023-07-24T05:44:56.705 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min pgs per osd = 4 2023-07-24T05:44:56.705 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd reporter subtree level = osd 2023-07-24T05:44:56.705 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd prime pg temp = true 2023-07-24T05:44:56.705 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min bytes per osd = 10 2023-07-24T05:44:56.705 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:44:56.705 INFO:teuthology.orchestra.run.smithi077.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-24T05:44:56.706 INFO:teuthology.orchestra.run.smithi077.stdout: auth mon ticket ttl = 660 # 11m 2023-07-24T05:44:56.706 INFO:teuthology.orchestra.run.smithi077.stdout: auth service ticket ttl = 240 # 4m 2023-07-24T05:44:56.706 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:44:56.706 INFO:teuthology.orchestra.run.smithi077.stdout: # don't complain about insecure global_id in the test suite 2023-07-24T05:44:56.706 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-24T05:44:56.706 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-24T05:44:56.706 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:44:56.706 INFO:teuthology.orchestra.run.smithi077.stdout: # 1m isn't quite enough 2023-07-24T05:44:56.707 INFO:teuthology.orchestra.run.smithi077.stdout: mon_down_mkfs_grace = 2m 2023-07-24T05:44:56.707 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:44:56.707 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_filestore_osds = false 2023-07-24T05:44:56.707 INFO:teuthology.orchestra.run.smithi077.stdout: mon op complaint time = 120 2023-07-24T05:44:56.707 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:44:56.707 INFO:teuthology.orchestra.run.smithi077.stdout:[client] 2023-07-24T05:44:56.707 INFO:teuthology.orchestra.run.smithi077.stdout: rgw cache enabled = true 2023-07-24T05:44:56.707 INFO:teuthology.orchestra.run.smithi077.stdout: rgw enable ops log = true 2023-07-24T05:44:56.708 INFO:teuthology.orchestra.run.smithi077.stdout: rgw enable usage log = true 2023-07-24T05:44:56.708 INFO:teuthology.orchestra.run.smithi077.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-24T05:44:56.708 INFO:teuthology.orchestra.run.smithi077.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-24T05:44:56.708 INFO:teuthology.orchestra.run.smithi077.stdout: client mount timeout = 600 2023-07-24T05:44:56.708 INFO:teuthology.orchestra.run.smithi077.stdout: debug client = 20 2023-07-24T05:44:56.708 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2023-07-24T05:44:56.708 INFO:teuthology.orchestra.run.smithi077.stdout: pid file = "" 2023-07-24T05:44:56.708 INFO:teuthology.orchestra.run.smithi077.stdout: rados mon op timeout = 900 2023-07-24T05:44:56.709 INFO:teuthology.orchestra.run.smithi077.stdout: rados osd op timeout = 900 2023-07-24T05:44:56.709 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.a] 2023-07-24T05:44:56.709 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.b] 2023-07-24T05:44:56.709 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.c] 2023-07-24T05:44:56.709 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.a] 2023-07-24T05:44:56.709 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.c] 2023-07-24T05:44:56.709 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.b] 2023-07-24T05:44:56.710 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.d] 2023-07-24T05:44:56.710 INFO:teuthology.orchestra.run.smithi077.stdout:[mds] 2023-07-24T05:44:56.710 INFO:teuthology.orchestra.run.smithi077.stdout: debug mds = 20 2023-07-24T05:44:56.710 INFO:teuthology.orchestra.run.smithi077.stdout: debug mds balancer = 20 2023-07-24T05:44:56.710 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2023-07-24T05:44:56.710 INFO:teuthology.orchestra.run.smithi077.stdout: mds debug frag = True 2023-07-24T05:44:56.710 INFO:teuthology.orchestra.run.smithi077.stdout: mds debug scatterstat = True 2023-07-24T05:44:56.710 INFO:teuthology.orchestra.run.smithi077.stdout: mds op complaint time = 180 2023-07-24T05:44:56.711 INFO:teuthology.orchestra.run.smithi077.stdout: mds verify scatter = True 2023-07-24T05:44:56.711 INFO:teuthology.orchestra.run.smithi077.stdout: osd op complaint time = 180 2023-07-24T05:44:56.711 INFO:teuthology.orchestra.run.smithi077.stdout: rados mon op timeout = 900 2023-07-24T05:44:56.711 INFO:teuthology.orchestra.run.smithi077.stdout: rados osd op timeout = 900 2023-07-24T05:44:56.711 INFO:teuthology.orchestra.run.smithi103.stdout:[global] 2023-07-24T05:44:56.712 INFO:teuthology.orchestra.run.smithi103.stdout: chdir = "" 2023-07-24T05:44:56.712 INFO:teuthology.orchestra.run.smithi103.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-24T05:44:56.712 INFO:teuthology.orchestra.run.smithi103.stdout: auth supported = cephx 2023-07-24T05:44:56.712 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-07-24T05:44:56.712 INFO:teuthology.orchestra.run.smithi103.stdout: filestore xattr use omap = true 2023-07-24T05:44:56.712 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-07-24T05:44:56.712 INFO:teuthology.orchestra.run.smithi103.stdout: mon clock drift allowed = 1.000 2023-07-24T05:44:56.713 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-07-24T05:44:56.713 INFO:teuthology.orchestra.run.smithi103.stdout: osd crush chooseleaf type = 0 2023-07-24T05:44:56.713 INFO:teuthology.orchestra.run.smithi103.stdout: auth debug = true 2023-07-24T05:44:56.713 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-07-24T05:44:56.713 INFO:teuthology.orchestra.run.smithi103.stdout: ms die on old message = true 2023-07-24T05:44:56.713 INFO:teuthology.orchestra.run.smithi103.stdout: ms die on bug = true 2023-07-24T05:44:56.713 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-07-24T05:44:56.713 INFO:teuthology.orchestra.run.smithi103.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-24T05:44:56.714 INFO:teuthology.orchestra.run.smithi103.stdout: mon pg warn max object skew = 0 2023-07-24T05:44:56.714 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-07-24T05:44:56.714 INFO:teuthology.orchestra.run.smithi103.stdout: # disable pg_autoscaler by default for new pools 2023-07-24T05:44:56.714 INFO:teuthology.orchestra.run.smithi103.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-24T05:44:56.714 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-07-24T05:44:56.714 INFO:teuthology.orchestra.run.smithi103.stdout: osd pool default size = 2 2023-07-24T05:44:56.714 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-07-24T05:44:56.714 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd allow primary affinity = true 2023-07-24T05:44:56.715 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd allow pg remap = true 2023-07-24T05:44:56.715 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on legacy crush tunables = false 2023-07-24T05:44:56.715 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on crush straw calc version zero = false 2023-07-24T05:44:56.715 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on no sortbitwise = false 2023-07-24T05:44:56.715 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on osd down out interval zero = false 2023-07-24T05:44:56.715 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on too few osds = false 2023-07-24T05:44:56.715 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-24T05:44:56.715 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-24T05:44:56.716 INFO:teuthology.orchestra.run.smithi103.stdout: mon_allow_pool_size_one = true 2023-07-24T05:44:56.716 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-07-24T05:44:56.716 INFO:teuthology.orchestra.run.smithi103.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-24T05:44:56.716 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-07-24T05:44:56.716 INFO:teuthology.orchestra.run.smithi103.stdout: osd default data pool replay window = 5 2023-07-24T05:44:56.716 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-07-24T05:44:56.716 INFO:teuthology.orchestra.run.smithi103.stdout: mon allow pool delete = true 2023-07-24T05:44:56.717 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-07-24T05:44:56.717 INFO:teuthology.orchestra.run.smithi103.stdout: mon cluster log file level = debug 2023-07-24T05:44:56.717 INFO:teuthology.orchestra.run.smithi103.stdout: debug asserts on shutdown = true 2023-07-24T05:44:56.717 INFO:teuthology.orchestra.run.smithi103.stdout: mon health detail to clog = false 2023-07-24T05:44:56.717 INFO:teuthology.orchestra.run.smithi103.stdout: mon host = "172.21.15.77,172.21.15.103,[v2:172.21.15.103:3301,v1:172.21.15.103:6790]" 2023-07-24T05:44:56.717 INFO:teuthology.orchestra.run.smithi103.stdout: fsid = 5aed5f7b-fb55-4d95-9c02-c6adbb1677b4 2023-07-24T05:44:56.717 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-07-24T05:44:56.717 INFO:teuthology.orchestra.run.smithi103.stdout:[osd] 2023-07-24T05:44:56.718 INFO:teuthology.orchestra.run.smithi103.stdout: osd journal size = 100 2023-07-24T05:44:56.718 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-07-24T05:44:56.718 INFO:teuthology.orchestra.run.smithi103.stdout: osd scrub load threshold = 5.0 2023-07-24T05:44:56.718 INFO:teuthology.orchestra.run.smithi103.stdout: osd scrub max interval = 600 2023-07-24T05:44:56.718 INFO:teuthology.orchestra.run.smithi103.stdout: osd mclock profile = high_recovery_ops 2023-07-24T05:44:56.718 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-07-24T05:44:56.718 INFO:teuthology.orchestra.run.smithi103.stdout: osd recover clone overlap = true 2023-07-24T05:44:56.718 INFO:teuthology.orchestra.run.smithi103.stdout: osd recovery max chunk = 1048576 2023-07-24T05:44:56.719 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-07-24T05:44:56.719 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug shutdown = true 2023-07-24T05:44:56.719 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug op order = true 2023-07-24T05:44:56.719 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug verify stray on activate = true 2023-07-24T05:44:56.719 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-07-24T05:44:56.719 INFO:teuthology.orchestra.run.smithi103.stdout: osd open classes on start = true 2023-07-24T05:44:56.719 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug pg log writeout = true 2023-07-24T05:44:56.719 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-07-24T05:44:56.720 INFO:teuthology.orchestra.run.smithi103.stdout: osd deep scrub update digest min age = 30 2023-07-24T05:44:56.720 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-07-24T05:44:56.720 INFO:teuthology.orchestra.run.smithi103.stdout: osd map max advance = 10 2023-07-24T05:44:56.720 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-07-24T05:44:56.720 INFO:teuthology.orchestra.run.smithi103.stdout: journal zero on create = true 2023-07-24T05:44:56.720 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-07-24T05:44:56.720 INFO:teuthology.orchestra.run.smithi103.stdout: filestore ondisk finisher threads = 3 2023-07-24T05:44:56.720 INFO:teuthology.orchestra.run.smithi103.stdout: filestore apply finisher threads = 3 2023-07-24T05:44:56.721 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-07-24T05:44:56.721 INFO:teuthology.orchestra.run.smithi103.stdout: bdev debug aio = true 2023-07-24T05:44:56.721 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug misdirected ops = true 2023-07-24T05:44:56.721 INFO:teuthology.orchestra.run.smithi103.stdout: bluestore block size = 96636764160 2023-07-24T05:44:56.721 INFO:teuthology.orchestra.run.smithi103.stdout: bluestore fsck on mount = True 2023-07-24T05:44:56.721 INFO:teuthology.orchestra.run.smithi103.stdout: debug bluefs = 20 2023-07-24T05:44:56.721 INFO:teuthology.orchestra.run.smithi103.stdout: debug bluestore = 20 2023-07-24T05:44:56.721 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2023-07-24T05:44:56.722 INFO:teuthology.orchestra.run.smithi103.stdout: debug osd = 20 2023-07-24T05:44:56.722 INFO:teuthology.orchestra.run.smithi103.stdout: debug rocksdb = 10 2023-07-24T05:44:56.722 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd backfillfull_ratio = 0.85 2023-07-24T05:44:56.722 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd full ratio = 0.9 2023-07-24T05:44:56.722 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd nearfull ratio = 0.8 2023-07-24T05:44:56.722 INFO:teuthology.orchestra.run.smithi103.stdout: osd failsafe full ratio = 0.95 2023-07-24T05:44:56.722 INFO:teuthology.orchestra.run.smithi103.stdout: osd objectstore = bluestore 2023-07-24T05:44:56.722 INFO:teuthology.orchestra.run.smithi103.stdout: osd op complaint time = 180 2023-07-24T05:44:56.723 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-07-24T05:44:56.723 INFO:teuthology.orchestra.run.smithi103.stdout:[mgr] 2023-07-24T05:44:56.723 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2023-07-24T05:44:56.723 INFO:teuthology.orchestra.run.smithi103.stdout: debug mgr = 20 2023-07-24T05:44:56.723 INFO:teuthology.orchestra.run.smithi103.stdout: debug mon = 20 2023-07-24T05:44:56.723 INFO:teuthology.orchestra.run.smithi103.stdout: debug auth = 20 2023-07-24T05:44:56.723 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min pgs per osd = 4 2023-07-24T05:44:56.723 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min bytes per osd = 10 2023-07-24T05:44:56.724 INFO:teuthology.orchestra.run.smithi103.stdout: mgr/telemetry/nag = false 2023-07-24T05:44:56.724 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-07-24T05:44:56.724 INFO:teuthology.orchestra.run.smithi103.stdout:[mon] 2023-07-24T05:44:56.724 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2023-07-24T05:44:56.724 INFO:teuthology.orchestra.run.smithi103.stdout: debug mon = 20 2023-07-24T05:44:56.724 INFO:teuthology.orchestra.run.smithi103.stdout: debug paxos = 20 2023-07-24T05:44:56.724 INFO:teuthology.orchestra.run.smithi103.stdout: debug auth = 20 2023-07-24T05:44:56.725 INFO:teuthology.orchestra.run.smithi103.stdout: mon data avail warn = 5 2023-07-24T05:44:56.725 INFO:teuthology.orchestra.run.smithi103.stdout: mon mgr mkfs grace = 240 2023-07-24T05:44:56.725 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min pgs per osd = 4 2023-07-24T05:44:56.725 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd reporter subtree level = osd 2023-07-24T05:44:56.725 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd prime pg temp = true 2023-07-24T05:44:56.725 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min bytes per osd = 10 2023-07-24T05:44:56.725 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-07-24T05:44:56.725 INFO:teuthology.orchestra.run.smithi103.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-24T05:44:56.726 INFO:teuthology.orchestra.run.smithi103.stdout: auth mon ticket ttl = 660 # 11m 2023-07-24T05:44:56.726 INFO:teuthology.orchestra.run.smithi103.stdout: auth service ticket ttl = 240 # 4m 2023-07-24T05:44:56.726 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-07-24T05:44:56.726 INFO:teuthology.orchestra.run.smithi103.stdout: # don't complain about insecure global_id in the test suite 2023-07-24T05:44:56.726 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-24T05:44:56.726 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-24T05:44:56.726 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-07-24T05:44:56.726 INFO:teuthology.orchestra.run.smithi103.stdout: # 1m isn't quite enough 2023-07-24T05:44:56.727 INFO:teuthology.orchestra.run.smithi103.stdout: mon_down_mkfs_grace = 2m 2023-07-24T05:44:56.727 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-07-24T05:44:56.727 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_filestore_osds = false 2023-07-24T05:44:56.727 INFO:teuthology.orchestra.run.smithi103.stdout: mon op complaint time = 120 2023-07-24T05:44:56.727 INFO:teuthology.orchestra.run.smithi103.stdout: 2023-07-24T05:44:56.727 INFO:teuthology.orchestra.run.smithi103.stdout:[client] 2023-07-24T05:44:56.727 INFO:teuthology.orchestra.run.smithi103.stdout: rgw cache enabled = true 2023-07-24T05:44:56.727 INFO:teuthology.orchestra.run.smithi103.stdout: rgw enable ops log = true 2023-07-24T05:44:56.728 INFO:teuthology.orchestra.run.smithi103.stdout: rgw enable usage log = true 2023-07-24T05:44:56.728 INFO:teuthology.orchestra.run.smithi103.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-24T05:44:56.728 INFO:teuthology.orchestra.run.smithi103.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-24T05:44:56.728 INFO:teuthology.orchestra.run.smithi103.stdout: client mount timeout = 600 2023-07-24T05:44:56.728 INFO:teuthology.orchestra.run.smithi103.stdout: debug client = 20 2023-07-24T05:44:56.728 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2023-07-24T05:44:56.728 INFO:teuthology.orchestra.run.smithi103.stdout: pid file = "" 2023-07-24T05:44:56.728 INFO:teuthology.orchestra.run.smithi103.stdout: rados mon op timeout = 900 2023-07-24T05:44:56.729 INFO:teuthology.orchestra.run.smithi103.stdout: rados osd op timeout = 900 2023-07-24T05:44:56.729 INFO:teuthology.orchestra.run.smithi103.stdout:[mon.a] 2023-07-24T05:44:56.729 INFO:teuthology.orchestra.run.smithi103.stdout:[mon.b] 2023-07-24T05:44:56.729 INFO:teuthology.orchestra.run.smithi103.stdout:[mon.c] 2023-07-24T05:44:56.729 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.a] 2023-07-24T05:44:56.729 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.c] 2023-07-24T05:44:56.729 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.b] 2023-07-24T05:44:56.729 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.d] 2023-07-24T05:44:56.730 INFO:teuthology.orchestra.run.smithi103.stdout:[mds] 2023-07-24T05:44:56.730 INFO:teuthology.orchestra.run.smithi103.stdout: debug mds = 20 2023-07-24T05:44:56.730 INFO:teuthology.orchestra.run.smithi103.stdout: debug mds balancer = 20 2023-07-24T05:44:56.730 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2023-07-24T05:44:56.730 INFO:teuthology.orchestra.run.smithi103.stdout: mds debug frag = True 2023-07-24T05:44:56.730 INFO:teuthology.orchestra.run.smithi103.stdout: mds debug scatterstat = True 2023-07-24T05:44:56.730 INFO:teuthology.orchestra.run.smithi103.stdout: mds op complaint time = 180 2023-07-24T05:44:56.730 INFO:teuthology.orchestra.run.smithi103.stdout: mds verify scatter = True 2023-07-24T05:44:56.731 INFO:teuthology.orchestra.run.smithi103.stdout: osd op complaint time = 180 2023-07-24T05:44:56.731 INFO:teuthology.orchestra.run.smithi103.stdout: rados mon op timeout = 900 2023-07-24T05:44:56.731 INFO:teuthology.orchestra.run.smithi103.stdout: rados osd op timeout = 900 2023-07-24T05:44:56.732 INFO:tasks.ceph:Creating admin key on mon.a... 2023-07-24T05:44:56.732 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-07-24T05:44:56.822 INFO:tasks.ceph:Copying monmap to all nodes... 2023-07-24T05:44:56.823 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-07-24T05:44:56.823 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-07-24T05:44:56.838 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-07-24T05:44:56.839 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-07-24T05:44:56.897 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi077.front.sepia.ceph.com 2023-07-24T05:44:56.897 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-07-24T05:44:56.897 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-24T05:44:56.897 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-24T05:44:57.005 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-07-24T05:44:57.005 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-24T05:44:57.064 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi103.front.sepia.ceph.com 2023-07-24T05:44:57.065 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2023-07-24T05:44:57.065 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-24T05:44:57.065 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-24T05:44:57.123 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2023-07-24T05:44:57.124 DEBUG:teuthology.orchestra.run.smithi103:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-24T05:44:57.183 INFO:tasks.ceph:Setting up mon nodes... 2023-07-24T05:44:57.183 INFO:tasks.ceph:Setting up mgr nodes... 2023-07-24T05:44:57.184 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-07-24T05:44:57.286 INFO:teuthology.orchestra.run.smithi077.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-07-24T05:44:57.293 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-07-24T05:44:57.391 INFO:teuthology.orchestra.run.smithi103.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-07-24T05:44:57.410 INFO:tasks.ceph:Setting up mds nodes... 2023-07-24T05:44:57.410 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-07-24T05:44:57.515 INFO:teuthology.orchestra.run.smithi077.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-07-24T05:44:57.521 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-07-24T05:44:57.552 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-07-24T05:44:57.697 INFO:teuthology.orchestra.run.smithi077.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-07-24T05:44:57.704 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-07-24T05:44:57.736 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-07-24T05:44:57.833 INFO:teuthology.orchestra.run.smithi103.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-07-24T05:44:57.840 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-07-24T05:44:57.872 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-07-24T05:44:58.013 INFO:teuthology.orchestra.run.smithi103.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-07-24T05:44:58.020 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-07-24T05:44:58.051 INFO:tasks.ceph_client:Setting up client nodes... 2023-07-24T05:44:58.052 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-07-24T05:44:58.130 INFO:teuthology.orchestra.run.smithi077.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-07-24T05:44:58.158 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-07-24T05:44:58.233 INFO:teuthology.orchestra.run.smithi077.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-07-24T05:44:58.262 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-07-24T05:44:58.336 INFO:teuthology.orchestra.run.smithi103.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-07-24T05:44:58.364 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-07-24T05:44:58.435 INFO:teuthology.orchestra.run.smithi103.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-07-24T05:44:58.462 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-07-24T05:44:58.462 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi077.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi103.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-24T05:44:58.462 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-07-24T05:44:58.497 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-24T05:44:58.497 INFO:tasks.ceph:role: osd.0 2023-07-24T05:44:58.497 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi077.front.sepia.ceph.com 2023-07-24T05:44:58.497 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-24T05:44:59.094 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-24T05:44:59.094 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-24T05:44:59.094 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-24T05:44:59.095 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 2023-07-24T05:44:59.095 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-24T05:44:59.095 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2023-07-24T05:44:59.095 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-24T05:44:59.095 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-24T05:44:59.095 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-24T05:44:59.095 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-24T05:44:59.099 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2023-07-24T05:44:59.099 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-07-24T05:44:59.231 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-07-24T05:44:59.251 INFO:teuthology.orchestra.run.smithi077.stderr:sudo: /sbin/restorecon: command not found 2023-07-24T05:44:59.251 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-24T05:44:59.252 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-07-24T05:44:59.330 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-24T05:44:59.331 INFO:tasks.ceph:role: osd.1 2023-07-24T05:44:59.331 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi077.front.sepia.ceph.com 2023-07-24T05:44:59.331 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-24T05:44:59.856 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-24T05:44:59.856 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-24T05:44:59.856 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-24T05:44:59.857 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 2023-07-24T05:44:59.857 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-24T05:44:59.857 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2023-07-24T05:44:59.857 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-24T05:44:59.857 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-24T05:44:59.857 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-24T05:44:59.857 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-24T05:44:59.859 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2023-07-24T05:44:59.860 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-07-24T05:44:59.927 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-07-24T05:44:59.950 INFO:teuthology.orchestra.run.smithi077.stderr:sudo: /sbin/restorecon: command not found 2023-07-24T05:44:59.951 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-24T05:44:59.952 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-07-24T05:45:00.030 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-24T05:45:00.031 INFO:tasks.ceph:role: osd.2 2023-07-24T05:45:00.031 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi077.front.sepia.ceph.com 2023-07-24T05:45:00.031 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-24T05:45:00.600 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-24T05:45:00.600 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-24T05:45:00.600 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-24T05:45:00.600 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 2023-07-24T05:45:00.600 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-24T05:45:00.600 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2023-07-24T05:45:00.601 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-24T05:45:00.601 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-24T05:45:00.601 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-24T05:45:00.601 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-24T05:45:00.604 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2023-07-24T05:45:00.604 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-07-24T05:45:00.730 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-07-24T05:45:00.752 INFO:teuthology.orchestra.run.smithi077.stderr:sudo: /sbin/restorecon: command not found 2023-07-24T05:45:00.752 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-24T05:45:00.753 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-07-24T05:45:00.836 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-24T05:45:00.836 INFO:tasks.ceph:role: osd.3 2023-07-24T05:45:00.836 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi077.front.sepia.ceph.com 2023-07-24T05:45:00.836 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-24T05:45:01.418 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-24T05:45:01.419 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-24T05:45:01.419 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-24T05:45:01.419 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 2023-07-24T05:45:01.419 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-24T05:45:01.419 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2023-07-24T05:45:01.419 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-24T05:45:01.419 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-24T05:45:01.420 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-24T05:45:01.420 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-24T05:45:01.423 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2023-07-24T05:45:01.423 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-07-24T05:45:01.631 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-07-24T05:45:01.655 INFO:teuthology.orchestra.run.smithi077.stderr:sudo: /sbin/restorecon: command not found 2023-07-24T05:45:01.656 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-24T05:45:01.656 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-24T05:45:01.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:01.820+0000 7f8505431700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-07-24T05:45:01.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:01.824+0000 7f8505431700 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-07-24T05:45:01.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:01.824+0000 7f8505431700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-24T05:45:01.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:01.824+0000 7f8505431700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-24T05:45:01.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:01.824+0000 7f8505431700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-24T05:45:01.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:01.828+0000 7f8505431700 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-07-24T05:45:04.913 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-07-24T05:45:04.943 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-24T05:45:05.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:05.064+0000 7f9e16338700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-07-24T05:45:05.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:05.064+0000 7f9e16338700 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-07-24T05:45:05.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:05.064+0000 7f9e16338700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-24T05:45:05.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:05.064+0000 7f9e16338700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-24T05:45:05.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:05.064+0000 7f9e16338700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-24T05:45:05.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:05.068+0000 7f9e16338700 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-07-24T05:45:08.131 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-07-24T05:45:08.166 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-24T05:45:08.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:08.284+0000 7f17a2c62700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-07-24T05:45:08.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:08.288+0000 7f17a2c62700 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-07-24T05:45:08.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:08.288+0000 7f17a2c62700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-24T05:45:08.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:08.288+0000 7f17a2c62700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-24T05:45:08.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:08.288+0000 7f17a2c62700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-24T05:45:08.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:08.288+0000 7f17a2c62700 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-07-24T05:45:11.349 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-07-24T05:45:11.380 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-24T05:45:11.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:11.500+0000 7fb1b615e700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-07-24T05:45:11.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:11.504+0000 7fb1b615e700 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-07-24T05:45:11.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:11.504+0000 7fb1b615e700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-24T05:45:11.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:11.504+0000 7fb1b615e700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-24T05:45:11.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:11.504+0000 7fb1b615e700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-24T05:45:11.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:11.504+0000 7fb1b615e700 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-07-24T05:45:14.568 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-07-24T05:45:14.603 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-07-24T05:45:14.639 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-24T05:45:14.639 INFO:tasks.ceph:role: osd.4 2023-07-24T05:45:14.639 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi103.front.sepia.ceph.com 2023-07-24T05:45:14.640 DEBUG:teuthology.orchestra.run.smithi103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-24T05:45:15.239 INFO:teuthology.orchestra.run.smithi103.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-24T05:45:15.239 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-24T05:45:15.239 INFO:teuthology.orchestra.run.smithi103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-24T05:45:15.239 INFO:teuthology.orchestra.run.smithi103.stdout: = reflink=1 2023-07-24T05:45:15.240 INFO:teuthology.orchestra.run.smithi103.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-24T05:45:15.240 INFO:teuthology.orchestra.run.smithi103.stdout: = sunit=0 swidth=0 blks 2023-07-24T05:45:15.240 INFO:teuthology.orchestra.run.smithi103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-24T05:45:15.240 INFO:teuthology.orchestra.run.smithi103.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-24T05:45:15.240 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-24T05:45:15.240 INFO:teuthology.orchestra.run.smithi103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-24T05:45:15.245 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi103.front.sepia.ceph.com -o noatime 2023-07-24T05:45:15.246 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-07-24T05:45:15.384 DEBUG:teuthology.orchestra.run.smithi103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-07-24T05:45:15.407 INFO:teuthology.orchestra.run.smithi103.stderr:sudo: /sbin/restorecon: command not found 2023-07-24T05:45:15.408 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-24T05:45:15.409 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-07-24T05:45:15.486 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-24T05:45:15.486 INFO:tasks.ceph:role: osd.5 2023-07-24T05:45:15.487 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi103.front.sepia.ceph.com 2023-07-24T05:45:15.487 DEBUG:teuthology.orchestra.run.smithi103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-24T05:45:16.001 INFO:teuthology.orchestra.run.smithi103.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-24T05:45:16.002 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-24T05:45:16.002 INFO:teuthology.orchestra.run.smithi103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-24T05:45:16.002 INFO:teuthology.orchestra.run.smithi103.stdout: = reflink=1 2023-07-24T05:45:16.002 INFO:teuthology.orchestra.run.smithi103.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-24T05:45:16.002 INFO:teuthology.orchestra.run.smithi103.stdout: = sunit=0 swidth=0 blks 2023-07-24T05:45:16.002 INFO:teuthology.orchestra.run.smithi103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-24T05:45:16.003 INFO:teuthology.orchestra.run.smithi103.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-24T05:45:16.003 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-24T05:45:16.003 INFO:teuthology.orchestra.run.smithi103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-24T05:45:16.007 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi103.front.sepia.ceph.com -o noatime 2023-07-24T05:45:16.007 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-07-24T05:45:16.078 DEBUG:teuthology.orchestra.run.smithi103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-07-24T05:45:16.099 INFO:teuthology.orchestra.run.smithi103.stderr:sudo: /sbin/restorecon: command not found 2023-07-24T05:45:16.100 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-24T05:45:16.101 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-07-24T05:45:16.183 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-24T05:45:16.184 INFO:tasks.ceph:role: osd.6 2023-07-24T05:45:16.184 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi103.front.sepia.ceph.com 2023-07-24T05:45:16.184 DEBUG:teuthology.orchestra.run.smithi103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-24T05:45:16.744 INFO:teuthology.orchestra.run.smithi103.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-24T05:45:16.745 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-24T05:45:16.745 INFO:teuthology.orchestra.run.smithi103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-24T05:45:16.745 INFO:teuthology.orchestra.run.smithi103.stdout: = reflink=1 2023-07-24T05:45:16.745 INFO:teuthology.orchestra.run.smithi103.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-24T05:45:16.745 INFO:teuthology.orchestra.run.smithi103.stdout: = sunit=0 swidth=0 blks 2023-07-24T05:45:16.745 INFO:teuthology.orchestra.run.smithi103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-24T05:45:16.746 INFO:teuthology.orchestra.run.smithi103.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-24T05:45:16.746 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-24T05:45:16.746 INFO:teuthology.orchestra.run.smithi103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-24T05:45:16.749 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi103.front.sepia.ceph.com -o noatime 2023-07-24T05:45:16.750 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-07-24T05:45:16.890 DEBUG:teuthology.orchestra.run.smithi103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-07-24T05:45:16.909 INFO:teuthology.orchestra.run.smithi103.stderr:sudo: /sbin/restorecon: command not found 2023-07-24T05:45:16.910 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-24T05:45:16.910 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-07-24T05:45:16.990 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-24T05:45:16.991 INFO:tasks.ceph:role: osd.7 2023-07-24T05:45:16.991 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi103.front.sepia.ceph.com 2023-07-24T05:45:16.991 DEBUG:teuthology.orchestra.run.smithi103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-24T05:45:17.561 INFO:teuthology.orchestra.run.smithi103.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-24T05:45:17.561 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-24T05:45:17.561 INFO:teuthology.orchestra.run.smithi103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-24T05:45:17.561 INFO:teuthology.orchestra.run.smithi103.stdout: = reflink=1 2023-07-24T05:45:17.562 INFO:teuthology.orchestra.run.smithi103.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-24T05:45:17.562 INFO:teuthology.orchestra.run.smithi103.stdout: = sunit=0 swidth=0 blks 2023-07-24T05:45:17.562 INFO:teuthology.orchestra.run.smithi103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-24T05:45:17.562 INFO:teuthology.orchestra.run.smithi103.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-24T05:45:17.562 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-24T05:45:17.562 INFO:teuthology.orchestra.run.smithi103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-24T05:45:17.565 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi103.front.sepia.ceph.com -o noatime 2023-07-24T05:45:17.566 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-07-24T05:45:17.671 DEBUG:teuthology.orchestra.run.smithi103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-07-24T05:45:17.691 INFO:teuthology.orchestra.run.smithi103.stderr:sudo: /sbin/restorecon: command not found 2023-07-24T05:45:17.692 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-24T05:45:17.693 DEBUG:teuthology.orchestra.run.smithi103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-24T05:45:17.858 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:17.857+0000 7f3c1f969700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-07-24T05:45:17.862 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:17.861+0000 7f3c1f969700 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-07-24T05:45:17.862 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:17.861+0000 7f3c1f969700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-24T05:45:17.862 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:17.861+0000 7f3c1f969700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-24T05:45:17.863 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:17.861+0000 7f3c1f969700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-24T05:45:17.865 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:17.865+0000 7f3c1f969700 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-07-24T05:45:20.955 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-07-24T05:45:20.991 DEBUG:teuthology.orchestra.run.smithi103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-24T05:45:21.116 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:21.113+0000 7f034c401700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-07-24T05:45:21.117 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:21.117+0000 7f034c401700 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-07-24T05:45:21.118 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:21.117+0000 7f034c401700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-24T05:45:21.118 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:21.117+0000 7f034c401700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-24T05:45:21.118 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:21.117+0000 7f034c401700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-24T05:45:21.120 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:21.117+0000 7f034c401700 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-07-24T05:45:24.170 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-07-24T05:45:24.206 DEBUG:teuthology.orchestra.run.smithi103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-24T05:45:24.335 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:24.333+0000 7f1fb5f7c700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-07-24T05:45:24.336 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:24.333+0000 7f1fb5f7c700 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-07-24T05:45:24.336 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:24.333+0000 7f1fb5f7c700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-24T05:45:24.337 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:24.333+0000 7f1fb5f7c700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-24T05:45:24.337 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:24.333+0000 7f1fb5f7c700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-24T05:45:24.338 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:24.337+0000 7f1fb5f7c700 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-07-24T05:45:24.358 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:45:24.366 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:45:27.379 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-07-24T05:45:27.412 DEBUG:teuthology.orchestra.run.smithi103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-24T05:45:27.540 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:27.537+0000 7efdb4323700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-07-24T05:45:27.541 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:27.541+0000 7efdb4323700 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-07-24T05:45:27.541 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:27.541+0000 7efdb4323700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-24T05:45:27.542 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:27.541+0000 7efdb4323700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-24T05:45:27.542 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:27.541+0000 7efdb4323700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-24T05:45:27.544 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:27.541+0000 7efdb4323700 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-07-24T05:45:30.592 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-07-24T05:45:30.626 INFO:tasks.ceph:Reading keys from all nodes... 2023-07-24T05:45:30.626 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-07-24T05:45:30.627 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-07-24T05:45:30.662 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-07-24T05:45:30.662 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-07-24T05:45:30.743 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-07-24T05:45:30.743 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-07-24T05:45:30.816 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-07-24T05:45:30.817 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-07-24T05:45:30.893 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-07-24T05:45:30.893 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-07-24T05:45:30.969 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-07-24T05:45:30.969 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-07-24T05:45:31.045 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-07-24T05:45:31.046 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-07-24T05:45:31.125 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2023-07-24T05:45:31.125 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-07-24T05:45:31.160 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2023-07-24T05:45:31.160 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-07-24T05:45:31.233 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2023-07-24T05:45:31.233 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-07-24T05:45:31.313 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2023-07-24T05:45:31.313 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-07-24T05:45:31.389 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2023-07-24T05:45:31.390 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-07-24T05:45:31.468 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2023-07-24T05:45:31.469 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-07-24T05:45:31.545 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2023-07-24T05:45:31.545 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-07-24T05:45:31.621 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-07-24T05:45:31.621 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-07-24T05:45:31.639 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-07-24T05:45:31.639 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-07-24T05:45:31.698 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2023-07-24T05:45:31.698 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-07-24T05:45:31.718 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2023-07-24T05:45:31.718 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-07-24T05:45:31.782 INFO:tasks.ceph:Adding keys to all mons... 2023-07-24T05:45:31.783 DEBUG:teuthology.orchestra.run.smithi077:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-24T05:45:31.789 DEBUG:teuthology.orchestra.run.smithi103:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-24T05:45:31.832 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr.y] 2023-07-24T05:45:31.832 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDZD75kyzQHERAAXNMpCEKlSx8tG5obur9x8A== 2023-07-24T05:45:31.832 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.a] 2023-07-24T05:45:31.832 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDZD75kyrimHhAA9e4pjzVTIl81nh9mOuzLTQ== 2023-07-24T05:45:31.832 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.c] 2023-07-24T05:45:31.832 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDZD75kb4SAKRAApZSXVDdsSXVc/5MNaHd6Eg== 2023-07-24T05:45:31.833 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.0] 2023-07-24T05:45:31.833 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDdD75kP/pGMRAA7m3kivqywo82g3CxnxBMWQ== 2023-07-24T05:45:31.833 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.1] 2023-07-24T05:45:31.833 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDhD75ksbkuBBAAtwyQCB8BPs1EvpWUXxcJVw== 2023-07-24T05:45:31.833 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.2] 2023-07-24T05:45:31.833 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDkD75k5UJYERAADTemwoGGKi2hv+EO7spgjw== 2023-07-24T05:45:31.833 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.3] 2023-07-24T05:45:31.833 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDnD75kX3g0HhAADGimfbP+bY3lLHIo+AhgvQ== 2023-07-24T05:45:31.834 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr.x] 2023-07-24T05:45:31.834 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDZD75kFr5NFxAAtdZZnyzOfnc3qbEl7xIFQQ== 2023-07-24T05:45:31.834 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.b] 2023-07-24T05:45:31.834 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDZD75klhavMRAAHUGKT/W/E4MYK0fiFr8big== 2023-07-24T05:45:31.834 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.d] 2023-07-24T05:45:31.834 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDaD75kTLPEABAABZvTNIYWM9rnWr0UzTZt5w== 2023-07-24T05:45:31.834 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.4] 2023-07-24T05:45:31.834 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDtD75kZXMvMxAAtWJy1bRiI4KGgg/zwHdvug== 2023-07-24T05:45:31.835 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.5] 2023-07-24T05:45:31.835 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDxD75kazj9BhAAUZtCi+AYYw9qy817fJhhjw== 2023-07-24T05:45:31.835 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.6] 2023-07-24T05:45:31.835 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQD0D75kRMUIFBAAVRjqGfPu49i+tmbxM4Ofkw== 2023-07-24T05:45:31.835 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.7] 2023-07-24T05:45:31.835 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQD3D75kSFY/IBAAS4QWZXMRq4TspsxAzB9/LQ== 2023-07-24T05:45:31.835 INFO:teuthology.orchestra.run.smithi077.stdout:[client.0] 2023-07-24T05:45:31.835 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDaD75kFKS1BxAA0KR0wkYow59oiBtAVGaXrQ== 2023-07-24T05:45:31.836 INFO:teuthology.orchestra.run.smithi077.stdout:[client.2] 2023-07-24T05:45:31.836 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDaD75kMW/iDRAAl/iArAQLiih575SlR0Wavg== 2023-07-24T05:45:31.836 INFO:teuthology.orchestra.run.smithi077.stdout:[client.1] 2023-07-24T05:45:31.836 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDaD75kHmsMFBAAOs6CcawB5trFW+S7lrlJ6A== 2023-07-24T05:45:31.836 INFO:teuthology.orchestra.run.smithi077.stdout:[client.3] 2023-07-24T05:45:31.836 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDaD75kvo34GRAAwzA4zjIfycj/5gUY25WlvA== 2023-07-24T05:45:31.855 INFO:teuthology.orchestra.run.smithi103.stdout:[mgr.y] 2023-07-24T05:45:31.855 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDZD75kyzQHERAAXNMpCEKlSx8tG5obur9x8A== 2023-07-24T05:45:31.855 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.a] 2023-07-24T05:45:31.856 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDZD75kyrimHhAA9e4pjzVTIl81nh9mOuzLTQ== 2023-07-24T05:45:31.856 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.c] 2023-07-24T05:45:31.856 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDZD75kb4SAKRAApZSXVDdsSXVc/5MNaHd6Eg== 2023-07-24T05:45:31.856 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.0] 2023-07-24T05:45:31.856 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDdD75kP/pGMRAA7m3kivqywo82g3CxnxBMWQ== 2023-07-24T05:45:31.856 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.1] 2023-07-24T05:45:31.856 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDhD75ksbkuBBAAtwyQCB8BPs1EvpWUXxcJVw== 2023-07-24T05:45:31.857 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.2] 2023-07-24T05:45:31.857 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDkD75k5UJYERAADTemwoGGKi2hv+EO7spgjw== 2023-07-24T05:45:31.857 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.3] 2023-07-24T05:45:31.857 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDnD75kX3g0HhAADGimfbP+bY3lLHIo+AhgvQ== 2023-07-24T05:45:31.857 INFO:teuthology.orchestra.run.smithi103.stdout:[mgr.x] 2023-07-24T05:45:31.857 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDZD75kFr5NFxAAtdZZnyzOfnc3qbEl7xIFQQ== 2023-07-24T05:45:31.857 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.b] 2023-07-24T05:45:31.858 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDZD75klhavMRAAHUGKT/W/E4MYK0fiFr8big== 2023-07-24T05:45:31.858 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.d] 2023-07-24T05:45:31.858 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDaD75kTLPEABAABZvTNIYWM9rnWr0UzTZt5w== 2023-07-24T05:45:31.858 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.4] 2023-07-24T05:45:31.858 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDtD75kZXMvMxAAtWJy1bRiI4KGgg/zwHdvug== 2023-07-24T05:45:31.858 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.5] 2023-07-24T05:45:31.858 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDxD75kazj9BhAAUZtCi+AYYw9qy817fJhhjw== 2023-07-24T05:45:31.858 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.6] 2023-07-24T05:45:31.859 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQD0D75kRMUIFBAAVRjqGfPu49i+tmbxM4Ofkw== 2023-07-24T05:45:31.859 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.7] 2023-07-24T05:45:31.859 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQD3D75kSFY/IBAAS4QWZXMRq4TspsxAzB9/LQ== 2023-07-24T05:45:31.859 INFO:teuthology.orchestra.run.smithi103.stdout:[client.0] 2023-07-24T05:45:31.859 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDaD75kFKS1BxAA0KR0wkYow59oiBtAVGaXrQ== 2023-07-24T05:45:31.859 INFO:teuthology.orchestra.run.smithi103.stdout:[client.2] 2023-07-24T05:45:31.859 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDaD75kMW/iDRAAl/iArAQLiih575SlR0Wavg== 2023-07-24T05:45:31.859 INFO:teuthology.orchestra.run.smithi103.stdout:[client.1] 2023-07-24T05:45:31.860 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDaD75kHmsMFBAAOs6CcawB5trFW+S7lrlJ6A== 2023-07-24T05:45:31.860 INFO:teuthology.orchestra.run.smithi103.stdout:[client.3] 2023-07-24T05:45:31.860 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQDaD75kvo34GRAAwzA4zjIfycj/5gUY25WlvA== 2023-07-24T05:45:31.861 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-24T05:45:31.887 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-24T05:45:31.991 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-24T05:45:31.997 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-24T05:45:32.079 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-24T05:45:32.085 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-24T05:45:32.167 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-24T05:45:32.173 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-24T05:45:32.252 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-24T05:45:32.258 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-24T05:45:32.341 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-24T05:45:32.347 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-24T05:45:32.426 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-24T05:45:32.433 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-24T05:45:32.513 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-24T05:45:32.519 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-24T05:45:32.601 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-24T05:45:32.607 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-24T05:45:32.694 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-24T05:45:32.700 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-24T05:45:32.782 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-24T05:45:32.788 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-24T05:45:32.871 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-24T05:45:32.877 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-24T05:45:32.958 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-24T05:45:32.964 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-24T05:45:33.045 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-24T05:45:33.051 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-24T05:45:33.129 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-24T05:45:33.136 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-24T05:45:33.221 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-24T05:45:33.227 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-24T05:45:33.313 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-24T05:45:33.319 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-24T05:45:33.406 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-24T05:45:33.412 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-24T05:45:33.497 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-07-24T05:45:33.497 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-07-24T05:45:33.532 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-24T05:45:33.676 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-07-24T05:45:33.709 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-07-24T05:45:33.743 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-24T05:45:33.892 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-07-24T05:45:33.924 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-07-24T05:45:33.997 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-24T05:45:34.145 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-07-24T05:45:34.180 DEBUG:teuthology.orchestra.run.smithi077:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-24T05:45:34.187 DEBUG:teuthology.orchestra.run.smithi103:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-24T05:45:34.240 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-07-24T05:45:34.241 INFO:tasks.ceph.mon.a:Restarting daemon 2023-07-24T05:45:34.241 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-07-24T05:45:34.251 INFO:tasks.ceph.mon.a:Started 2023-07-24T05:45:34.251 INFO:tasks.ceph.mon.b:Restarting daemon 2023-07-24T05:45:34.251 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-07-24T05:45:34.287 INFO:tasks.ceph.mon.b:Started 2023-07-24T05:45:34.287 INFO:tasks.ceph.mon.c:Restarting daemon 2023-07-24T05:45:34.287 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-07-24T05:45:34.293 INFO:tasks.ceph.mon.c:Started 2023-07-24T05:45:34.294 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-07-24T05:45:34.294 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-07-24T05:45:34.294 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-07-24T05:45:34.301 INFO:tasks.ceph.mgr.y:Started 2023-07-24T05:45:34.302 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-07-24T05:45:34.302 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-07-24T05:45:34.308 INFO:tasks.ceph.mgr.x:Started 2023-07-24T05:45:34.308 INFO:tasks.ceph:Setting crush tunables to default 2023-07-24T05:45:34.309 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd crush tunables default 2023-07-24T05:45:34.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:34.471+0000 7f9bb9107700 1 Processor -- start 2023-07-24T05:45:34.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:34.471+0000 7f9bb9107700 1 -- start start 2023-07-24T05:45:34.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:34.475+0000 7f9bb9107700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9bb406bb60 0x7f9bb40ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:34.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:34.475+0000 7f9bb9107700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb406c1d0 con 0x7f9bb4159840 2023-07-24T05:45:34.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:34.475+0000 7f9bb9107700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb40c92c0 con 0x7f9bb40ced80 2023-07-24T05:45:34.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:34.475+0000 7f9bb9107700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bb406daa0 con 0x7f9bb406bb60 2023-07-24T05:45:34.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:34.475+0000 7f9bb3fff700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f9bb4159840 0x7f9bb406fc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:50154/0 (socket says 172.21.15.77:50154) 2023-07-24T05:45:34.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:34.475+0000 7f9bb3fff700 1 -- 172.21.15.77:0/3783536334 learned_addr learned my addr 172.21.15.77:0/3783536334 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:45:34.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:34.475+0000 7f9bab7fe700 1 --2- 172.21.15.77:0/3783536334 >> v2:172.21.15.77:3300/0 conn(0x7f9bb406bb60 0x7f9bb40ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:34.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:34.475+0000 7f9bab7fe700 1 -- 172.21.15.77:0/3783536334 >> v2:172.21.15.77:3300/0 conn(0x7f9bb406bb60 msgr2=0x7f9bb40ca2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-07-24T05:45:34.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:34.475+0000 7f9bab7fe700 1 -- 172.21.15.77:0/3783536334 >> v2:172.21.15.77:3300/0 conn(0x7f9bb406bb60 msgr2=0x7f9bb40ca2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-24T05:45:34.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:34.475+0000 7f9bab7fe700 1 --2- 172.21.15.77:0/3783536334 >> v2:172.21.15.77:3300/0 conn(0x7f9bb406bb60 0x7f9bb40ca2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-24T05:45:34.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:34.475+0000 7f9bab7fe700 1 --2- 172.21.15.77:0/3783536334 >> v2:172.21.15.77:3300/0 conn(0x7f9bb406bb60 0x7f9bb40ca2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-24T05:45:34.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:34.679+0000 7f9bab7fe700 1 --2- 172.21.15.77:0/3783536334 >> v2:172.21.15.77:3300/0 conn(0x7f9bb406bb60 0x7f9bb40ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:34.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:34.683+0000 7f9bab7fe700 1 -- 172.21.15.77:0/3783536334 >> v2:172.21.15.77:3300/0 conn(0x7f9bb406bb60 msgr2=0x7f9bb40ca2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-07-24T05:45:34.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:34.683+0000 7f9bab7fe700 1 -- 172.21.15.77:0/3783536334 >> v2:172.21.15.77:3300/0 conn(0x7f9bb406bb60 msgr2=0x7f9bb40ca2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-24T05:45:34.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:34.683+0000 7f9bab7fe700 1 --2- 172.21.15.77:0/3783536334 >> v2:172.21.15.77:3300/0 conn(0x7f9bb406bb60 0x7f9bb40ca2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-24T05:45:34.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:34.683+0000 7f9bab7fe700 1 --2- 172.21.15.77:0/3783536334 >> v2:172.21.15.77:3300/0 conn(0x7f9bb406bb60 0x7f9bb40ca2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-24T05:45:35.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:35.087+0000 7f9bab7fe700 1 --2- 172.21.15.77:0/3783536334 >> v2:172.21.15.77:3300/0 conn(0x7f9bb406bb60 0x7f9bb40ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:35.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:35.087+0000 7f9bab7fe700 1 -- 172.21.15.77:0/3783536334 >> v2:172.21.15.77:3300/0 conn(0x7f9bb406bb60 msgr2=0x7f9bb40ca2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-07-24T05:45:35.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:35.087+0000 7f9bab7fe700 1 -- 172.21.15.77:0/3783536334 >> v2:172.21.15.77:3300/0 conn(0x7f9bb406bb60 msgr2=0x7f9bb40ca2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-24T05:45:35.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:35.087+0000 7f9bab7fe700 1 --2- 172.21.15.77:0/3783536334 >> v2:172.21.15.77:3300/0 conn(0x7f9bb406bb60 0x7f9bb40ca2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-24T05:45:35.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:35.087+0000 7f9bab7fe700 1 --2- 172.21.15.77:0/3783536334 >> v2:172.21.15.77:3300/0 conn(0x7f9bb406bb60 0x7f9bb40ca2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-24T05:45:35.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:35.891+0000 7f9bab7fe700 1 --2- 172.21.15.77:0/3783536334 >> v2:172.21.15.77:3300/0 conn(0x7f9bb406bb60 0x7f9bb40ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:35.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:35.891+0000 7f9bab7fe700 1 -- 172.21.15.77:0/3783536334 >> v2:172.21.15.77:3300/0 conn(0x7f9bb406bb60 msgr2=0x7f9bb40ca2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-07-24T05:45:35.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:35.891+0000 7f9bab7fe700 1 -- 172.21.15.77:0/3783536334 >> v2:172.21.15.77:3300/0 conn(0x7f9bb406bb60 msgr2=0x7f9bb40ca2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-24T05:45:35.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:35.891+0000 7f9bab7fe700 1 --2- 172.21.15.77:0/3783536334 >> v2:172.21.15.77:3300/0 conn(0x7f9bb406bb60 0x7f9bb40ca2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-24T05:45:35.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:35.891+0000 7f9bab7fe700 1 --2- 172.21.15.77:0/3783536334 >> v2:172.21.15.77:3300/0 conn(0x7f9bb406bb60 0x7f9bb40ca2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-24T05:45:37.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:37.479+0000 7f9bb27fc700 1 -- 172.21.15.77:0/3783536334 >> v2:172.21.15.77:3300/0 conn(0x7f9bb406bb60 msgr2=0x7f9bb40ca2d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-24T05:45:37.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:37.479+0000 7f9bb27fc700 1 --2- 172.21.15.77:0/3783536334 >> v2:172.21.15.77:3300/0 conn(0x7f9bb406bb60 0x7f9bb40ca2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:37.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:37.479+0000 7f9bb27fc700 1 -- 172.21.15.77:0/3783536334 >> v1:172.21.15.103:6789/0 conn(0x7f9bb40ced80 legacy=0x7f9bb4070360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:37.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:37.479+0000 7f9bb27fc700 1 -- 172.21.15.77:0/3783536334 >> v1:172.21.15.77:6789/0 conn(0x7f9bb4159840 legacy=0x7f9bb406fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:37.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:37.479+0000 7f9bb27fc700 1 --2- 172.21.15.77:0/3783536334 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b940037b0 0x7f9b94005be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:37.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:37.479+0000 7f9bb27fc700 1 --2- 172.21.15.77:0/3783536334 >> v2:172.21.15.103:3300/0 conn(0x7f9b94006270 0x7f9b94008730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:37.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:37.479+0000 7f9bb27fc700 1 -- 172.21.15.77:0/3783536334 --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b94008db0 con 0x7f9b94006270 2023-07-24T05:45:37.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:37.479+0000 7f9bb27fc700 1 -- 172.21.15.77:0/3783536334 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b94008f20 con 0x7f9b940037b0 2023-07-24T05:45:37.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:37.479+0000 7f9bab7fe700 1 --2- 172.21.15.77:0/3783536334 >> v2:172.21.15.103:3300/0 conn(0x7f9b94006270 0x7f9b94008730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:37.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:37.479+0000 7f9bab7fe700 1 -- 172.21.15.77:0/3783536334 >> v2:172.21.15.103:3300/0 conn(0x7f9b94006270 msgr2=0x7f9b94008730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-24T05:45:37.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:37.479+0000 7f9bab7fe700 1 -- 172.21.15.77:0/3783536334 >> v2:172.21.15.103:3300/0 conn(0x7f9b94006270 msgr2=0x7f9b94008730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-24T05:45:37.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:37.479+0000 7f9bab7fe700 1 --2- 172.21.15.77:0/3783536334 >> v2:172.21.15.103:3300/0 conn(0x7f9b94006270 0x7f9b94008730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-24T05:45:37.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:37.479+0000 7f9bab7fe700 1 --2- 172.21.15.77:0/3783536334 >> v2:172.21.15.103:3300/0 conn(0x7f9b94006270 0x7f9b94008730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-24T05:45:37.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:37.479+0000 7f9bb3fff700 1 --2- 172.21.15.77:0/3783536334 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b940037b0 0x7f9b94005be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:37.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:37.479+0000 7f9bb3fff700 1 -- 172.21.15.77:0/3783536334 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b940037b0 msgr2=0x7f9b94005be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-07-24T05:45:37.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:37.479+0000 7f9bb3fff700 1 -- 172.21.15.77:0/3783536334 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b940037b0 msgr2=0x7f9b94005be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-24T05:45:37.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:37.479+0000 7f9bb3fff700 1 --2- 172.21.15.77:0/3783536334 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b940037b0 0x7f9b94005be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-24T05:45:37.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:37.479+0000 7f9bb3fff700 1 --2- 172.21.15.77:0/3783536334 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b940037b0 0x7f9b94005be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-24T05:45:37.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:37.683+0000 7f9bb3fff700 1 --2- 172.21.15.77:0/3783536334 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b940037b0 0x7f9b94005be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:37.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:37.683+0000 7f9bab7fe700 1 --2- 172.21.15.77:0/3783536334 >> v2:172.21.15.103:3300/0 conn(0x7f9b94006270 0x7f9b94008730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:37.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:37.683+0000 7f9bb3fff700 1 -- 172.21.15.77:0/3783536334 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b940037b0 msgr2=0x7f9b94005be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-24T05:45:37.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:37.683+0000 7f9bab7fe700 1 -- 172.21.15.77:0/3783536334 >> v2:172.21.15.103:3300/0 conn(0x7f9b94006270 msgr2=0x7f9b94008730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-07-24T05:45:37.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:37.683+0000 7f9bb3fff700 1 -- 172.21.15.77:0/3783536334 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b940037b0 msgr2=0x7f9b94005be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-24T05:45:37.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:37.683+0000 7f9bab7fe700 1 -- 172.21.15.77:0/3783536334 >> v2:172.21.15.103:3300/0 conn(0x7f9b94006270 msgr2=0x7f9b94008730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-24T05:45:37.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:37.683+0000 7f9bab7fe700 1 --2- 172.21.15.77:0/3783536334 >> v2:172.21.15.103:3300/0 conn(0x7f9b94006270 0x7f9b94008730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-24T05:45:37.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:37.683+0000 7f9bb3fff700 1 --2- 172.21.15.77:0/3783536334 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b940037b0 0x7f9b94005be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-24T05:45:37.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:37.683+0000 7f9bab7fe700 1 --2- 172.21.15.77:0/3783536334 >> v2:172.21.15.103:3300/0 conn(0x7f9b94006270 0x7f9b94008730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-24T05:45:37.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:37.683+0000 7f9bb3fff700 1 --2- 172.21.15.77:0/3783536334 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b940037b0 0x7f9b94005be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-24T05:45:38.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:38.087+0000 7f9bb3fff700 1 --2- 172.21.15.77:0/3783536334 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b940037b0 0x7f9b94005be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:38.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:38.087+0000 7f9bab7fe700 1 --2- 172.21.15.77:0/3783536334 >> v2:172.21.15.103:3300/0 conn(0x7f9b94006270 0x7f9b94008730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:38.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:38.087+0000 7f9bab7fe700 1 -- 172.21.15.77:0/3783536334 >> v2:172.21.15.103:3300/0 conn(0x7f9b94006270 msgr2=0x7f9b94008730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-24T05:45:38.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:38.087+0000 7f9bab7fe700 1 -- 172.21.15.77:0/3783536334 >> v2:172.21.15.103:3300/0 conn(0x7f9b94006270 msgr2=0x7f9b94008730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-24T05:45:38.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:38.087+0000 7f9bab7fe700 1 --2- 172.21.15.77:0/3783536334 >> v2:172.21.15.103:3300/0 conn(0x7f9b94006270 0x7f9b94008730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-24T05:45:38.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:38.087+0000 7f9bab7fe700 1 --2- 172.21.15.77:0/3783536334 >> v2:172.21.15.103:3300/0 conn(0x7f9b94006270 0x7f9b94008730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-24T05:45:38.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:38.087+0000 7f9bb3fff700 1 -- 172.21.15.77:0/3783536334 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b940037b0 msgr2=0x7f9b94005be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-07-24T05:45:38.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:38.087+0000 7f9bb3fff700 1 -- 172.21.15.77:0/3783536334 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b940037b0 msgr2=0x7f9b94005be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-24T05:45:38.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:38.087+0000 7f9bb3fff700 1 --2- 172.21.15.77:0/3783536334 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b940037b0 0x7f9b94005be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-24T05:45:38.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:38.087+0000 7f9bb3fff700 1 --2- 172.21.15.77:0/3783536334 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b940037b0 0x7f9b94005be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-24T05:45:38.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:38.891+0000 7f9bb3fff700 1 --2- 172.21.15.77:0/3783536334 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b940037b0 0x7f9b94005be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:38.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:38.891+0000 7f9bab7fe700 1 --2- 172.21.15.77:0/3783536334 >> v2:172.21.15.103:3300/0 conn(0x7f9b94006270 0x7f9b94008730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:38.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:38.891+0000 7f9bab7fe700 1 -- 172.21.15.77:0/3783536334 >> v2:172.21.15.103:3300/0 conn(0x7f9b94006270 msgr2=0x7f9b94008730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-07-24T05:45:38.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:38.891+0000 7f9bab7fe700 1 -- 172.21.15.77:0/3783536334 >> v2:172.21.15.103:3300/0 conn(0x7f9b94006270 msgr2=0x7f9b94008730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-24T05:45:38.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:38.891+0000 7f9bab7fe700 1 --2- 172.21.15.77:0/3783536334 >> v2:172.21.15.103:3300/0 conn(0x7f9b94006270 0x7f9b94008730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-24T05:45:38.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:38.891+0000 7f9bab7fe700 1 --2- 172.21.15.77:0/3783536334 >> v2:172.21.15.103:3300/0 conn(0x7f9b94006270 0x7f9b94008730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-24T05:45:38.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:38.891+0000 7f9bb3fff700 1 -- 172.21.15.77:0/3783536334 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b940037b0 msgr2=0x7f9b94005be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-07-24T05:45:38.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:38.891+0000 7f9bb3fff700 1 -- 172.21.15.77:0/3783536334 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b940037b0 msgr2=0x7f9b94005be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-24T05:45:38.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:38.891+0000 7f9bb3fff700 1 --2- 172.21.15.77:0/3783536334 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b940037b0 0x7f9b94005be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-24T05:45:38.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:38.891+0000 7f9bb3fff700 1 --2- 172.21.15.77:0/3783536334 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b940037b0 0x7f9b94005be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-24T05:45:40.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.479+0000 7f9bb27fc700 1 -- 172.21.15.77:0/3783536334 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b940037b0 msgr2=0x7f9b94005be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-24T05:45:40.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.479+0000 7f9bb27fc700 1 --2- 172.21.15.77:0/3783536334 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b940037b0 0x7f9b94005be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:40.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.479+0000 7f9bb27fc700 1 -- 172.21.15.77:0/3783536334 >> v2:172.21.15.103:3300/0 conn(0x7f9b94006270 msgr2=0x7f9b94008730 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-24T05:45:40.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.479+0000 7f9bb27fc700 1 --2- 172.21.15.77:0/3783536334 >> v2:172.21.15.103:3300/0 conn(0x7f9b94006270 0x7f9b94008730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:40.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.479+0000 7f9bb27fc700 1 --2- 172.21.15.77:0/3783536334 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b94009320 0x7f9b9400b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:40.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.479+0000 7f9bb8906700 1 -- 172.21.15.77:0/3783536334 reap_dead start 2023-07-24T05:45:40.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.479+0000 7f9bb27fc700 1 --2- 172.21.15.77:0/3783536334 >> v2:172.21.15.103:3300/0 conn(0x7f9b94003b90 0x7f9b9400bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:40.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.479+0000 7f9bb27fc700 1 -- 172.21.15.77:0/3783536334 --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb40c9e40 con 0x7f9bb40ced80 2023-07-24T05:45:40.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.479+0000 7f9bb27fc700 1 -- 172.21.15.77:0/3783536334 --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b94008db0 con 0x7f9b94003b90 2023-07-24T05:45:40.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.479+0000 7f9bb27fc700 1 -- 172.21.15.77:0/3783536334 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b94008f20 con 0x7f9b94009320 2023-07-24T05:45:40.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.479+0000 7f9bb3fff700 1 --2- 172.21.15.77:0/3783536334 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b94009320 0x7f9b9400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:40.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.479+0000 7f9bab7fe700 1 --2- 172.21.15.77:0/3783536334 >> v2:172.21.15.103:3300/0 conn(0x7f9b94003b90 0x7f9b9400bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:40.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.479+0000 7f9bb37fe700 1 -- 172.21.15.77:0/3783536334 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2679454468 0 0) 0x7f9bb40c9e40 con 0x7f9bb40ced80 2023-07-24T05:45:40.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.479+0000 7f9bb37fe700 1 -- 172.21.15.77:0/3783536334 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ba00035d0 con 0x7f9bb40ced80 2023-07-24T05:45:40.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.479+0000 7f9bb3fff700 1 -- 172.21.15.77:0/3783536334 >> v2:172.21.15.103:3300/0 conn(0x7f9b94003b90 msgr2=0x7f9b9400bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:45:40.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.479+0000 7f9bb3fff700 1 --2- 172.21.15.77:0/3783536334 >> v2:172.21.15.103:3300/0 conn(0x7f9b94003b90 0x7f9b9400bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:40.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.479+0000 7f9bb3fff700 1 -- 172.21.15.77:0/3783536334 >> v1:172.21.15.103:6789/0 conn(0x7f9bb40ced80 legacy=0x7f9b9400c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:40.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.479+0000 7f9bb3fff700 1 -- 172.21.15.77:0/3783536334 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b94008940 con 0x7f9b94009320 2023-07-24T05:45:40.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.483+0000 7f9bb3fff700 1 --2- 172.21.15.77:0/3783536334 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b94009320 0x7f9b9400b750 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9b940036d0 tx=0x7f9ba4007330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe91e6debf54b0b9 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:40.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.483+0000 7f9bb37fe700 1 -- 172.21.15.77:0/3783536334 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba4005e30 con 0x7f9b94009320 2023-07-24T05:45:40.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.483+0000 7f9bb37fe700 1 -- 172.21.15.77:0/3783536334 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba4017460 con 0x7f9b94009320 2023-07-24T05:45:40.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.483+0000 7f9bb37fe700 1 -- 172.21.15.77:0/3783536334 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba4017810 con 0x7f9b94009320 2023-07-24T05:45:40.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.483+0000 7f9bb9107700 1 -- 172.21.15.77:0/3783536334 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b94009320 msgr2=0x7f9b9400b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:40.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.483+0000 7f9bb9107700 1 --2- 172.21.15.77:0/3783536334 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b94009320 0x7f9b9400b750 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9b940036d0 tx=0x7f9ba4007330 comp rx=0 tx=0).stop 2023-07-24T05:45:40.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.483+0000 7f9bb9107700 1 -- 172.21.15.77:0/3783536334 shutdown_connections 2023-07-24T05:45:40.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.483+0000 7f9bb9107700 1 --2- 172.21.15.77:0/3783536334 >> v2:172.21.15.103:3300/0 conn(0x7f9b94003b90 0x7f9b9400bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:40.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.483+0000 7f9bb9107700 1 --2- 172.21.15.77:0/3783536334 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b94009320 0x7f9b9400b750 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:40.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.483+0000 7f9bb9107700 1 -- 172.21.15.77:0/3783536334 >> 172.21.15.77:0/3783536334 conn(0x7f9bb40ce260 msgr2=0x7f9bb40ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:40.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.483+0000 7f9bb9107700 1 -- 172.21.15.77:0/3783536334 shutdown_connections 2023-07-24T05:45:40.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.483+0000 7f9bb9107700 1 -- 172.21.15.77:0/3783536334 wait complete. 2023-07-24T05:45:40.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.487+0000 7f9bb9107700 1 Processor -- start 2023-07-24T05:45:40.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.487+0000 7f9bb9107700 1 -- start start 2023-07-24T05:45:40.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.491+0000 7f9bb9107700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b94003b90 0x7f9bb40c7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:40.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.491+0000 7f9bb9107700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b94009320 0x7f9bb41f1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:40.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.491+0000 7f9bb9107700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bb40ced80 0x7f9bb4070cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:40.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.491+0000 7f9bb9107700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb40c7890 con 0x7f9bb40ced80 2023-07-24T05:45:40.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.491+0000 7f9bb9107700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb40ae980 con 0x7f9b94003b90 2023-07-24T05:45:40.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.491+0000 7f9bb9107700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb40c6870 con 0x7f9b94009320 2023-07-24T05:45:40.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.491+0000 7f9bb8906700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bb40ced80 0x7f9bb4070cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:40.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.491+0000 7f9bb8906700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bb40ced80 0x7f9bb4070cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55298/0 (socket says 172.21.15.77:55298) 2023-07-24T05:45:40.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.491+0000 7f9bb8906700 1 -- 172.21.15.77:0/809657834 learned_addr learned my addr 172.21.15.77:0/809657834 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:45:40.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.491+0000 7f9bab7fe700 1 --2- 172.21.15.77:0/809657834 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b94009320 0x7f9bb41f1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:40.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.491+0000 7f9bb3fff700 1 --2- 172.21.15.77:0/809657834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b94003b90 0x7f9bb40c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:40.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.491+0000 7f9bb8906700 1 -- 172.21.15.77:0/809657834 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b94009320 msgr2=0x7f9bb41f1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:40.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.491+0000 7f9bb8906700 1 --2- 172.21.15.77:0/809657834 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b94009320 0x7f9bb41f1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:40.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.491+0000 7f9bb8906700 1 -- 172.21.15.77:0/809657834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b94003b90 msgr2=0x7f9bb40c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:40.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.491+0000 7f9bb8906700 1 --2- 172.21.15.77:0/809657834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b94003b90 0x7f9bb40c7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:40.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.491+0000 7f9bb8906700 1 -- 172.21.15.77:0/809657834 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba400f040 con 0x7f9bb40ced80 2023-07-24T05:45:40.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.491+0000 7f9bb3fff700 1 --2- 172.21.15.77:0/809657834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b94003b90 0x7f9bb40c7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:45:40.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.491+0000 7f9bb8906700 1 --2- 172.21.15.77:0/809657834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bb40ced80 0x7f9bb4070cd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9bb406bab0 tx=0x7f9bac00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:40.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.495+0000 7f9bb17fa700 1 -- 172.21.15.77:0/809657834 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac00a970 con 0x7f9bb40ced80 2023-07-24T05:45:40.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.495+0000 7f9bb17fa700 1 -- 172.21.15.77:0/809657834 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bac00aad0 con 0x7f9bb40ced80 2023-07-24T05:45:40.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.495+0000 7f9bb9107700 1 -- 172.21.15.77:0/809657834 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb40c6b50 con 0x7f9bb40ced80 2023-07-24T05:45:40.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.495+0000 7f9bb17fa700 1 -- 172.21.15.77:0/809657834 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac007070 con 0x7f9bb40ced80 2023-07-24T05:45:40.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.495+0000 7f9bb9107700 1 -- 172.21.15.77:0/809657834 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb40aec60 con 0x7f9bb40ced80 2023-07-24T05:45:40.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.495+0000 7f9bb17fa700 1 -- 172.21.15.77:0/809657834 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9bac0074d0 con 0x7f9bb40ced80 2023-07-24T05:45:40.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.495+0000 7f9bb17fa700 1 -- 172.21.15.77:0/809657834 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9bac01cc60 con 0x7f9bb40ced80 2023-07-24T05:45:40.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.495+0000 7f9bb9107700 1 -- 172.21.15.77:0/809657834 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bb40c7070 con 0x7f9bb40ced80 2023-07-24T05:45:40.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.499+0000 7f9bb17fa700 1 -- 172.21.15.77:0/809657834 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f9bb40c7070 con 0x7f9bb40ced80 2023-07-24T05:45:40.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.575+0000 7f9bb9107700 1 -- 172.21.15.77:0/809657834 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f9bb40c97a0 con 0x7f9bb40ced80 2023-07-24T05:45:40.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.583+0000 7f9bb17fa700 1 -- 172.21.15.77:0/809657834 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f9bac017070 con 0x7f9bb40ced80 2023-07-24T05:45:40.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.587+0000 7f9bb9107700 1 -- 172.21.15.77:0/809657834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bb40ced80 msgr2=0x7f9bb4070cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:40.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.587+0000 7f9bb9107700 1 --2- 172.21.15.77:0/809657834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bb40ced80 0x7f9bb4070cd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9bb406bab0 tx=0x7f9bac00cd50 comp rx=0 tx=0).stop 2023-07-24T05:45:40.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.587+0000 7f9bb9107700 1 -- 172.21.15.77:0/809657834 shutdown_connections 2023-07-24T05:45:40.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.587+0000 7f9bb9107700 1 --2- 172.21.15.77:0/809657834 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9bb40ced80 0x7f9bb4070cd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:40.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.587+0000 7f9bb9107700 1 --2- 172.21.15.77:0/809657834 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9b94009320 0x7f9bb41f1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:40.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.587+0000 7f9bb9107700 1 --2- 172.21.15.77:0/809657834 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b94003b90 0x7f9bb40c7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:40.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.587+0000 7f9bb9107700 1 -- 172.21.15.77:0/809657834 >> 172.21.15.77:0/809657834 conn(0x7f9bb40ce260 msgr2=0x7f9bb406adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:40.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.587+0000 7f9bb9107700 1 -- 172.21.15.77:0/809657834 shutdown_connections 2023-07-24T05:45:40.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:40.587+0000 7f9bb9107700 1 -- 172.21.15.77:0/809657834 wait complete. 2023-07-24T05:45:40.591 INFO:teuthology.orchestra.run.smithi077.stderr:adjusted tunables profile to default 2023-07-24T05:45:40.611 INFO:tasks.ceph:check_enable_crimson: False 2023-07-24T05:45:40.611 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-07-24T05:45:40.611 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-07-24T05:45:40.612 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-07-24T05:45:40.643 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-07-24T05:45:40.643 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-07-24T05:45:40.676 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-07-24T05:45:40.671+0000 7ff3d14c32c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-24T05:45:40.707 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-07-24T05:45:40.707 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-07-24T05:45:40.713 INFO:tasks.ceph.mgr.x.smithi103.stderr:2023-07-24T05:45:40.712+0000 7f8a4db022c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-24T05:45:40.779 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-07-24T05:45:40.780 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-07-24T05:45:40.852 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2023-07-24T05:45:40.852 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-07-24T05:45:40.883 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2023-07-24T05:45:40.884 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-07-24T05:45:40.951 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2023-07-24T05:45:40.952 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-07-24T05:45:41.023 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2023-07-24T05:45:41.023 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-07-24T05:45:41.094 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd new ffa0d496-461a-4053-b764-0627d969521b 0 2023-07-24T05:45:41.301 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.300+0000 7f902b427700 1 Processor -- start 2023-07-24T05:45:41.301 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.300+0000 7f902b427700 1 -- start start 2023-07-24T05:45:41.305 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.300+0000 7f902b427700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9024159a70 0x7f902415d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:41.305 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.300+0000 7f902b427700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f902415d9f0 0x7f90240cd990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:41.305 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.300+0000 7f902b427700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90240caf60 con 0x7f90240cc890 2023-07-24T05:45:41.305 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.304+0000 7f902b427700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f902415d060 con 0x7f9024159a70 2023-07-24T05:45:41.305 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.304+0000 7f902b427700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90240ccc70 con 0x7f902415d9f0 2023-07-24T05:45:41.306 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.304+0000 7f902ac26700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f902415d9f0 0x7f90240cd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:41.306 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.304+0000 7f902ac26700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f902415d9f0 0x7f90240cd990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.103:44154/0 (socket says 172.21.15.103:44154) 2023-07-24T05:45:41.306 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.304+0000 7f902ac26700 1 -- 172.21.15.103:0/1241417948 learned_addr learned my addr 172.21.15.103:0/1241417948 (peer_addr_for_me v2:172.21.15.103:0/0) 2023-07-24T05:45:41.307 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.304+0000 7f9029c24700 1 --2- 172.21.15.103:0/1241417948 >> v2:172.21.15.77:3300/0 conn(0x7f9024159a70 0x7f902415d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:41.307 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.304+0000 7f902ac26700 1 -- 172.21.15.103:0/1241417948 >> v2:172.21.15.77:3300/0 conn(0x7f9024159a70 msgr2=0x7f902415d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:45:41.307 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.304+0000 7f902ac26700 1 --2- 172.21.15.103:0/1241417948 >> v2:172.21.15.77:3300/0 conn(0x7f9024159a70 0x7f902415d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:41.307 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.304+0000 7f902ac26700 1 -- 172.21.15.103:0/1241417948 >> v1:172.21.15.77:6789/0 conn(0x7f90240cc890 legacy=0x7f90240ca850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:41.307 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.304+0000 7f902ac26700 1 -- 172.21.15.103:0/1241417948 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f902406c970 con 0x7f902415d9f0 2023-07-24T05:45:41.308 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.304+0000 7f902ac26700 1 --2- 172.21.15.103:0/1241417948 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f902415d9f0 0x7f90240cd990 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f901c009e50 tx=0x7f901c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34aa5859e4745156 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:41.308 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.304+0000 7f9029423700 1 -- 172.21.15.103:0/1241417948 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901c00e070 con 0x7f902415d9f0 2023-07-24T05:45:41.308 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.304+0000 7f9029423700 1 -- 172.21.15.103:0/1241417948 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f901c00b9c0 con 0x7f902415d9f0 2023-07-24T05:45:41.308 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.304+0000 7f9029423700 1 -- 172.21.15.103:0/1241417948 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901c00bd70 con 0x7f902415d9f0 2023-07-24T05:45:41.309 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.304+0000 7f902b427700 1 -- 172.21.15.103:0/1241417948 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f902415d9f0 msgr2=0x7f90240cd990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:41.309 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.304+0000 7f902b427700 1 --2- 172.21.15.103:0/1241417948 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f902415d9f0 0x7f90240cd990 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f901c009e50 tx=0x7f901c00b330 comp rx=0 tx=0).stop 2023-07-24T05:45:41.309 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.304+0000 7f902b427700 1 -- 172.21.15.103:0/1241417948 shutdown_connections 2023-07-24T05:45:41.309 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.304+0000 7f902b427700 1 --2- 172.21.15.103:0/1241417948 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f902415d9f0 0x7f90240cd990 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:41.309 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.304+0000 7f902b427700 1 --2- 172.21.15.103:0/1241417948 >> v2:172.21.15.77:3300/0 conn(0x7f9024159a70 0x7f902415d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:41.309 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.304+0000 7f902b427700 1 -- 172.21.15.103:0/1241417948 >> 172.21.15.103:0/1241417948 conn(0x7f90240b0f70 msgr2=0x7f90240b1350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:41.310 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.304+0000 7f902b427700 1 -- 172.21.15.103:0/1241417948 shutdown_connections 2023-07-24T05:45:41.310 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.304+0000 7f902b427700 1 -- 172.21.15.103:0/1241417948 wait complete. 2023-07-24T05:45:41.312 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.308+0000 7f902b427700 1 Processor -- start 2023-07-24T05:45:41.312 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.308+0000 7f902b427700 1 -- start start 2023-07-24T05:45:41.315 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.312+0000 7f902b427700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f90240cc890 0x7f90241ed1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:41.315 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.312+0000 7f902b427700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9024159a70 0x7f90240b2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:41.315 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.312+0000 7f902b427700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f902415d9f0 0x7f90240b2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:41.315 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.312+0000 7f902b427700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90240b2020 con 0x7f902415d9f0 2023-07-24T05:45:41.315 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.312+0000 7f902b427700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90241522c0 con 0x7f9024159a70 2023-07-24T05:45:41.315 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.312+0000 7f902b427700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90241525a0 con 0x7f90240cc890 2023-07-24T05:45:41.315 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.312+0000 7f902a425700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f90240cc890 0x7f90241ed1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:41.316 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.312+0000 7f9029c24700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9024159a70 0x7f90240b2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:41.317 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.312+0000 7f902a425700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f90240cc890 0x7f90241ed1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.103:44162/0 (socket says 172.21.15.103:44162) 2023-07-24T05:45:41.317 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.312+0000 7f9029c24700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9024159a70 0x7f90240b2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44248/0 (socket says 172.21.15.103:44248) 2023-07-24T05:45:41.317 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.312+0000 7f902a425700 1 -- 172.21.15.103:0/522176059 learned_addr learned my addr 172.21.15.103:0/522176059 (peer_addr_for_me v2:172.21.15.103:0/0) 2023-07-24T05:45:41.317 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.312+0000 7f902ac26700 1 --2- 172.21.15.103:0/522176059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f902415d9f0 0x7f90240b2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:41.317 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.312+0000 7f902a425700 1 -- 172.21.15.103:0/522176059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9024159a70 msgr2=0x7f90240b2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:41.317 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.312+0000 7f902a425700 1 --2- 172.21.15.103:0/522176059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9024159a70 0x7f90240b2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:41.318 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.312+0000 7f902a425700 1 -- 172.21.15.103:0/522176059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f902415d9f0 msgr2=0x7f90240b2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:41.318 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.312+0000 7f902a425700 1 --2- 172.21.15.103:0/522176059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f902415d9f0 0x7f90240b2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:41.318 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.312+0000 7f902a425700 1 -- 172.21.15.103:0/522176059 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f901c009b30 con 0x7f90240cc890 2023-07-24T05:45:41.318 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.312+0000 7f902a425700 1 --2- 172.21.15.103:0/522176059 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f90240cc890 0x7f90241ed1e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f902000c500 tx=0x7f902000c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:41.318 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.312+0000 7f901affd700 1 -- 172.21.15.103:0/522176059 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90200052d0 con 0x7f90240cc890 2023-07-24T05:45:41.318 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.312+0000 7f901affd700 1 -- 172.21.15.103:0/522176059 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9020005430 con 0x7f90240cc890 2023-07-24T05:45:41.318 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.312+0000 7f901affd700 1 -- 172.21.15.103:0/522176059 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90200055a0 con 0x7f90240cc890 2023-07-24T05:45:41.318 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.312+0000 7f902b427700 1 -- 172.21.15.103:0/522176059 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90240b2230 con 0x7f90240cc890 2023-07-24T05:45:41.319 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.312+0000 7f902b427700 1 -- 172.21.15.103:0/522176059 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90241ed720 con 0x7f90240cc890 2023-07-24T05:45:41.319 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.312+0000 7f901affd700 1 -- 172.21.15.103:0/522176059 <== mon.2 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9020003be0 con 0x7f90240cc890 2023-07-24T05:45:41.319 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.316+0000 7f901affd700 1 -- 172.21.15.103:0/522176059 <== mon.2 v2:172.21.15.103:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f902001c780 con 0x7f90240cc890 2023-07-24T05:45:41.319 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.316+0000 7f902b427700 1 -- 172.21.15.103:0/522176059 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9024153940 con 0x7f90240cc890 2023-07-24T05:45:41.324 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.320+0000 7f901affd700 1 -- 172.21.15.103:0/522176059 <== mon.2 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f9020021060 con 0x7f90240cc890 2023-07-24T05:45:41.413 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-07-24T05:45:41.411+0000 7ff3d14c32c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-24T05:45:41.424 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.420+0000 7f902b427700 1 -- 172.21.15.103:0/522176059 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ffa0d496-461a-4053-b764-0627d969521b", "id": 0} v 0) v1 -- 0x7f90241ed8b0 con 0x7f90240cc890 2023-07-24T05:45:41.428 INFO:tasks.ceph.mgr.x.smithi103.stderr:2023-07-24T05:45:41.424+0000 7f8a4db022c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-24T05:45:41.436 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.432+0000 7f901affd700 1 -- 172.21.15.103:0/522176059 <== mon.2 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ffa0d496-461a-4053-b764-0627d969521b", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9020017070 con 0x7f90240cc890 2023-07-24T05:45:41.436 INFO:teuthology.orchestra.run.smithi103.stdout:0 2023-07-24T05:45:41.438 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.436+0000 7f902b427700 1 -- 172.21.15.103:0/522176059 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f90240cc890 msgr2=0x7f90241ed1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:41.438 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.436+0000 7f902b427700 1 --2- 172.21.15.103:0/522176059 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f90240cc890 0x7f90241ed1e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f902000c500 tx=0x7f902000c810 comp rx=0 tx=0).stop 2023-07-24T05:45:41.438 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.436+0000 7f902b427700 1 -- 172.21.15.103:0/522176059 shutdown_connections 2023-07-24T05:45:41.439 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.436+0000 7f902b427700 1 --2- 172.21.15.103:0/522176059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f902415d9f0 0x7f90240b2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:41.439 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.436+0000 7f902b427700 1 --2- 172.21.15.103:0/522176059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9024159a70 0x7f90240b2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:41.439 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.436+0000 7f902b427700 1 --2- 172.21.15.103:0/522176059 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f90240cc890 0x7f90241ed1e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:41.439 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.436+0000 7f902b427700 1 -- 172.21.15.103:0/522176059 >> 172.21.15.103:0/522176059 conn(0x7f90240b0f70 msgr2=0x7f90240cb0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:41.439 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.436+0000 7f902b427700 1 -- 172.21.15.103:0/522176059 shutdown_connections 2023-07-24T05:45:41.439 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.436+0000 7f902b427700 1 -- 172.21.15.103:0/522176059 wait complete. 2023-07-24T05:45:41.458 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd new 9f595e5e-5c43-49bc-8ce4-ee70575c90da 1 2023-07-24T05:45:41.494 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-07-24T05:45:41.491+0000 7ff3d14c32c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-24T05:45:41.510 INFO:tasks.ceph.mgr.x.smithi103.stderr:2023-07-24T05:45:41.508+0000 7f8a4db022c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-24T05:45:41.612 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.608+0000 7f77b5908700 1 Processor -- start 2023-07-24T05:45:41.612 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.608+0000 7f77b5908700 1 -- start start 2023-07-24T05:45:41.614 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.612+0000 7f77b5908700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f77b00b01e0 0x7f77b00b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:41.614 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.612+0000 7f77b5908700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f77b0070890 0x7f77b015b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:41.614 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.612+0000 7f77b5908700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77b00b4400 con 0x7f77b015bea0 2023-07-24T05:45:41.614 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.612+0000 7f77b5908700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77b0070d70 con 0x7f77b0070890 2023-07-24T05:45:41.614 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.612+0000 7f77b5908700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b00b3ed0 con 0x7f77b00b01e0 2023-07-24T05:45:41.615 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.612+0000 7f77aeffd700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f77b00b01e0 0x7f77b00b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:41.616 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.612+0000 7f77aeffd700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f77b00b01e0 0x7f77b00b05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.103:44176/0 (socket says 172.21.15.103:44176) 2023-07-24T05:45:41.616 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.612+0000 7f77aeffd700 1 -- 172.21.15.103:0/806101545 learned_addr learned my addr 172.21.15.103:0/806101545 (peer_addr_for_me v2:172.21.15.103:0/0) 2023-07-24T05:45:41.616 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.612+0000 7f77a67fc700 1 --2- 172.21.15.103:0/806101545 >> v2:172.21.15.77:3300/0 conn(0x7f77b0070890 0x7f77b015b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:41.616 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.612+0000 7f77aeffd700 1 -- 172.21.15.103:0/806101545 >> v2:172.21.15.77:3300/0 conn(0x7f77b0070890 msgr2=0x7f77b015b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:45:41.616 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.612+0000 7f77aeffd700 1 --2- 172.21.15.103:0/806101545 >> v2:172.21.15.77:3300/0 conn(0x7f77b0070890 0x7f77b015b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:41.616 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.612+0000 7f77aeffd700 1 -- 172.21.15.103:0/806101545 >> v1:172.21.15.77:6789/0 conn(0x7f77b015bea0 legacy=0x7f77b00c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:41.616 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.612+0000 7f77aeffd700 1 -- 172.21.15.103:0/806101545 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b00b0b00 con 0x7f77b00b01e0 2023-07-24T05:45:41.617 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.612+0000 7f77aeffd700 1 --2- 172.21.15.103:0/806101545 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f77b00b01e0 0x7f77b00b05c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f77a0009910 tx=0x7f77a0009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0e25e2ad7a2b098 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:41.617 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.612+0000 7f77ae7fc700 1 -- 172.21.15.103:0/806101545 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a000ba60 con 0x7f77b00b01e0 2023-07-24T05:45:41.617 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.612+0000 7f77ae7fc700 1 -- 172.21.15.103:0/806101545 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a000bbc0 con 0x7f77b00b01e0 2023-07-24T05:45:41.618 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.612+0000 7f77ae7fc700 1 -- 172.21.15.103:0/806101545 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a0009e60 con 0x7f77b00b01e0 2023-07-24T05:45:41.618 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.616+0000 7f77b5908700 1 -- 172.21.15.103:0/806101545 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f77b00b01e0 msgr2=0x7f77b00b05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:41.618 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.616+0000 7f77b5908700 1 --2- 172.21.15.103:0/806101545 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f77b00b01e0 0x7f77b00b05c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f77a0009910 tx=0x7f77a0009c20 comp rx=0 tx=0).stop 2023-07-24T05:45:41.618 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.616+0000 7f77b5908700 1 -- 172.21.15.103:0/806101545 shutdown_connections 2023-07-24T05:45:41.618 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.616+0000 7f77b5908700 1 --2- 172.21.15.103:0/806101545 >> v2:172.21.15.77:3300/0 conn(0x7f77b0070890 0x7f77b015b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:41.618 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.616+0000 7f77b5908700 1 --2- 172.21.15.103:0/806101545 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f77b00b01e0 0x7f77b00b05c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:41.618 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.616+0000 7f77b5908700 1 -- 172.21.15.103:0/806101545 >> 172.21.15.103:0/806101545 conn(0x7f77b00cb350 msgr2=0x7f77b00cb760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:41.619 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.616+0000 7f77b5908700 1 -- 172.21.15.103:0/806101545 shutdown_connections 2023-07-24T05:45:41.619 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.616+0000 7f77b5908700 1 -- 172.21.15.103:0/806101545 wait complete. 2023-07-24T05:45:41.619 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.616+0000 7f77b5908700 1 Processor -- start 2023-07-24T05:45:41.620 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.616+0000 7f77b5908700 1 -- start start 2023-07-24T05:45:41.622 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.620+0000 7f77b5908700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f77b0070890 0x7f77b01efcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:41.622 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.620+0000 7f77b5908700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77b00b01e0 0x7f77b00c5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:41.622 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.620+0000 7f77b5908700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77b015bea0 0x7f77b00c3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:41.622 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.620+0000 7f77b5908700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b0151920 con 0x7f77b015bea0 2023-07-24T05:45:41.622 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.620+0000 7f77b5908700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b01515f0 con 0x7f77b00b01e0 2023-07-24T05:45:41.622 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.620+0000 7f77b5908700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b00c6930 con 0x7f77b0070890 2023-07-24T05:45:41.624 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.620+0000 7f77a67fc700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77b00b01e0 0x7f77b00c5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:41.624 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.620+0000 7f77a67fc700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77b00b01e0 0x7f77b00c5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44252/0 (socket says 172.21.15.103:44252) 2023-07-24T05:45:41.624 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.620+0000 7f77a67fc700 1 -- 172.21.15.103:0/2834636617 learned_addr learned my addr 172.21.15.103:0/2834636617 (peer_addr_for_me v2:172.21.15.103:0/0) 2023-07-24T05:45:41.624 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.620+0000 7f77aeffd700 1 --2- 172.21.15.103:0/2834636617 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f77b0070890 0x7f77b01efcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:41.624 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.620+0000 7f77af7fe700 1 --2- 172.21.15.103:0/2834636617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77b015bea0 0x7f77b00c3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:41.624 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.620+0000 7f77a67fc700 1 -- 172.21.15.103:0/2834636617 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f77b0070890 msgr2=0x7f77b01efcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:41.624 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.620+0000 7f77a67fc700 1 --2- 172.21.15.103:0/2834636617 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f77b0070890 0x7f77b01efcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:41.625 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.620+0000 7f77a67fc700 1 -- 172.21.15.103:0/2834636617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77b015bea0 msgr2=0x7f77b00c3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:41.625 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.620+0000 7f77a67fc700 1 --2- 172.21.15.103:0/2834636617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77b015bea0 0x7f77b00c3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:41.625 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.620+0000 7f77a67fc700 1 -- 172.21.15.103:0/2834636617 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a0009570 con 0x7f77b00b01e0 2023-07-24T05:45:41.625 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.620+0000 7f77af7fe700 1 --2- 172.21.15.103:0/2834636617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77b015bea0 0x7f77b00c3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:45:41.625 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.620+0000 7f77a67fc700 1 --2- 172.21.15.103:0/2834636617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77b00b01e0 0x7f77b00c5fc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f779800d800 tx=0x7f779800db10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:41.625 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.620+0000 7f77acff9700 1 -- 172.21.15.103:0/2834636617 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77980125f0 con 0x7f77b00b01e0 2023-07-24T05:45:41.625 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.620+0000 7f77acff9700 1 -- 172.21.15.103:0/2834636617 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7798012750 con 0x7f77b00b01e0 2023-07-24T05:45:41.625 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.620+0000 7f77b5908700 1 -- 172.21.15.103:0/2834636617 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77b00c6c10 con 0x7f77b00b01e0 2023-07-24T05:45:41.626 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.620+0000 7f77acff9700 1 -- 172.21.15.103:0/2834636617 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7798012b00 con 0x7f77b00b01e0 2023-07-24T05:45:41.626 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.620+0000 7f77b5908700 1 -- 172.21.15.103:0/2834636617 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77b00c6500 con 0x7f77b00b01e0 2023-07-24T05:45:41.626 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.620+0000 7f77acff9700 1 -- 172.21.15.103:0/2834636617 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f779801e460 con 0x7f77b00b01e0 2023-07-24T05:45:41.626 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.620+0000 7f77acff9700 1 -- 172.21.15.103:0/2834636617 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f7798014900 con 0x7f77b00b01e0 2023-07-24T05:45:41.627 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.624+0000 7f77b5908700 1 -- 172.21.15.103:0/2834636617 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77b00c7130 con 0x7f77b00b01e0 2023-07-24T05:45:41.629 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.628+0000 7f77acff9700 1 -- 172.21.15.103:0/2834636617 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f77b00c7130 con 0x7f77b00b01e0 2023-07-24T05:45:41.681 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-07-24T05:45:41.679+0000 7ff3d14c32c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-24T05:45:41.690 INFO:tasks.ceph.mgr.x.smithi103.stderr:2023-07-24T05:45:41.688+0000 7f8a4db022c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-24T05:45:41.737 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.736+0000 7f77b5908700 1 -- 172.21.15.103:0/2834636617 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9f595e5e-5c43-49bc-8ce4-ee70575c90da", "id": 1} v 0) v1 -- 0x7f77b0151a90 con 0x7f77b00b01e0 2023-07-24T05:45:41.748 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.744+0000 7f77acff9700 1 -- 172.21.15.103:0/2834636617 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9f595e5e-5c43-49bc-8ce4-ee70575c90da", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7798014bf0 con 0x7f77b00b01e0 2023-07-24T05:45:41.748 INFO:teuthology.orchestra.run.smithi103.stdout:1 2023-07-24T05:45:41.750 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.748+0000 7f77b5908700 1 -- 172.21.15.103:0/2834636617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77b00b01e0 msgr2=0x7f77b00c5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:41.750 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.748+0000 7f77b5908700 1 --2- 172.21.15.103:0/2834636617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77b00b01e0 0x7f77b00c5fc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f779800d800 tx=0x7f779800db10 comp rx=0 tx=0).stop 2023-07-24T05:45:41.751 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.748+0000 7f77b5908700 1 -- 172.21.15.103:0/2834636617 shutdown_connections 2023-07-24T05:45:41.751 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.748+0000 7f77b5908700 1 --2- 172.21.15.103:0/2834636617 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77b015bea0 0x7f77b00c3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:41.751 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.748+0000 7f77b5908700 1 --2- 172.21.15.103:0/2834636617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77b00b01e0 0x7f77b00c5fc0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:41.751 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.748+0000 7f77b5908700 1 --2- 172.21.15.103:0/2834636617 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f77b0070890 0x7f77b01efcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:41.751 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.748+0000 7f77b5908700 1 -- 172.21.15.103:0/2834636617 >> 172.21.15.103:0/2834636617 conn(0x7f77b00cb350 msgr2=0x7f77b0069b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:41.752 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.748+0000 7f77b5908700 1 -- 172.21.15.103:0/2834636617 shutdown_connections 2023-07-24T05:45:41.752 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.748+0000 7f77b5908700 1 -- 172.21.15.103:0/2834636617 wait complete. 2023-07-24T05:45:41.775 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd new 2ac177aa-4d7d-4262-bd54-d2b9f29f4c3c 2 2023-07-24T05:45:41.937 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.936+0000 7fa5ccb36700 1 Processor -- start 2023-07-24T05:45:41.938 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.936+0000 7fa5ccb36700 1 -- start start 2023-07-24T05:45:41.941 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.936+0000 7fa5ccb36700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa5c806bb60 0x7fa5c806d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:41.941 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.936+0000 7fa5ccb36700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa5c80cf5c0 0x7fa5c80cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:41.941 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.940+0000 7fa5ccb36700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5c80cff30 con 0x7fa5c815c9a0 2023-07-24T05:45:41.941 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.940+0000 7fa5ccb36700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5c80cf170 con 0x7fa5c806bb60 2023-07-24T05:45:41.941 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.940+0000 7fa5ccb36700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c806b4d0 con 0x7fa5c80cf5c0 2023-07-24T05:45:41.942 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.940+0000 7fa5c7fff700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa5c80cf5c0 0x7fa5c80cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:41.942 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.940+0000 7fa5c7fff700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa5c80cf5c0 0x7fa5c80cf9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.103:44180/0 (socket says 172.21.15.103:44180) 2023-07-24T05:45:41.943 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.940+0000 7fa5c7fff700 1 -- 172.21.15.103:0/772528906 learned_addr learned my addr 172.21.15.103:0/772528906 (peer_addr_for_me v2:172.21.15.103:0/0) 2023-07-24T05:45:41.943 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.940+0000 7fa5c6ffd700 1 --2- 172.21.15.103:0/772528906 >> v2:172.21.15.77:3300/0 conn(0x7fa5c806bb60 0x7fa5c806d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:41.943 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.940+0000 7fa5c7fff700 1 -- 172.21.15.103:0/772528906 >> v2:172.21.15.77:3300/0 conn(0x7fa5c806bb60 msgr2=0x7fa5c806d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:45:41.943 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.940+0000 7fa5c7fff700 1 --2- 172.21.15.103:0/772528906 >> v2:172.21.15.77:3300/0 conn(0x7fa5c806bb60 0x7fa5c806d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:41.943 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.940+0000 7fa5c7fff700 1 -- 172.21.15.103:0/772528906 >> v1:172.21.15.77:6789/0 conn(0x7fa5c815c9a0 legacy=0x7fa5c80d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:41.943 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.940+0000 7fa5c7fff700 1 -- 172.21.15.103:0/772528906 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c806ac30 con 0x7fa5c80cf5c0 2023-07-24T05:45:41.943 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.940+0000 7fa5c67fc700 1 -- 172.21.15.103:0/772528906 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2272479317 0 0) 0x7fa5c80cff30 con 0x7fa5c815c9a0 2023-07-24T05:45:41.944 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.940+0000 7fa5c7fff700 1 --2- 172.21.15.103:0/772528906 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa5c80cf5c0 0x7fa5c80cf9f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0009e50 tx=0x7fa5c000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=557d4f7ad5e648d8 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:41.944 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.940+0000 7fa5c67fc700 1 -- 172.21.15.103:0/772528906 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c000e070 con 0x7fa5c80cf5c0 2023-07-24T05:45:41.945 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.940+0000 7fa5c67fc700 1 -- 172.21.15.103:0/772528906 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c000b9c0 con 0x7fa5c80cf5c0 2023-07-24T05:45:41.945 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.940+0000 7fa5c67fc700 1 -- 172.21.15.103:0/772528906 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c000bd70 con 0x7fa5c80cf5c0 2023-07-24T05:45:41.945 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.940+0000 7fa5ccb36700 1 -- 172.21.15.103:0/772528906 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa5c80cf5c0 msgr2=0x7fa5c80cf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:41.945 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.940+0000 7fa5ccb36700 1 --2- 172.21.15.103:0/772528906 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa5c80cf5c0 0x7fa5c80cf9f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0009e50 tx=0x7fa5c000b330 comp rx=0 tx=0).stop 2023-07-24T05:45:41.945 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.940+0000 7fa5ccb36700 1 -- 172.21.15.103:0/772528906 shutdown_connections 2023-07-24T05:45:41.945 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.940+0000 7fa5ccb36700 1 --2- 172.21.15.103:0/772528906 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa5c80cf5c0 0x7fa5c80cf9f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:41.946 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.940+0000 7fa5ccb36700 1 --2- 172.21.15.103:0/772528906 >> v2:172.21.15.77:3300/0 conn(0x7fa5c806bb60 0x7fa5c806d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:41.946 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.940+0000 7fa5ccb36700 1 -- 172.21.15.103:0/772528906 >> 172.21.15.103:0/772528906 conn(0x7fa5c80b5610 msgr2=0x7fa5c80b5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:41.946 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.940+0000 7fa5ccb36700 1 -- 172.21.15.103:0/772528906 shutdown_connections 2023-07-24T05:45:41.946 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.940+0000 7fa5ccb36700 1 -- 172.21.15.103:0/772528906 wait complete. 2023-07-24T05:45:41.947 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.944+0000 7fa5ccb36700 1 Processor -- start 2023-07-24T05:45:41.947 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.944+0000 7fa5ccb36700 1 -- start start 2023-07-24T05:45:41.949 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.948+0000 7fa5ccb36700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5c806bb60 0x7fa5c81f2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:41.949 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.948+0000 7fa5ccb36700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa5c80cf5c0 0x7fa5c815de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:41.949 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.948+0000 7fa5ccb36700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5c815c9a0 0x7fa5c815a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:41.950 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.948+0000 7fa5ccb36700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c815fd90 con 0x7fa5c815c9a0 2023-07-24T05:45:41.950 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.948+0000 7fa5ccb36700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c81f28e0 con 0x7fa5c806bb60 2023-07-24T05:45:41.950 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.948+0000 7fa5ccb36700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c81f6350 con 0x7fa5c80cf5c0 2023-07-24T05:45:41.951 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.948+0000 7fa5c6ffd700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa5c80cf5c0 0x7fa5c815de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:41.951 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.948+0000 7fa5c77fe700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5c806bb60 0x7fa5c81f2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:41.951 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.948+0000 7fa5c6ffd700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa5c80cf5c0 0x7fa5c815de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.103:44194/0 (socket says 172.21.15.103:44194) 2023-07-24T05:45:41.952 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.948+0000 7fa5c6ffd700 1 -- 172.21.15.103:0/3412408870 learned_addr learned my addr 172.21.15.103:0/3412408870 (peer_addr_for_me v2:172.21.15.103:0/0) 2023-07-24T05:45:41.952 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.948+0000 7fa5c7fff700 1 --2- 172.21.15.103:0/3412408870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5c815c9a0 0x7fa5c815a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:41.952 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.948+0000 7fa5c6ffd700 1 -- 172.21.15.103:0/3412408870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5c806bb60 msgr2=0x7fa5c81f2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:41.952 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.948+0000 7fa5c6ffd700 1 --2- 172.21.15.103:0/3412408870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5c806bb60 0x7fa5c81f2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:41.952 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.948+0000 7fa5c6ffd700 1 -- 172.21.15.103:0/3412408870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5c815c9a0 msgr2=0x7fa5c815a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:41.952 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.948+0000 7fa5c6ffd700 1 --2- 172.21.15.103:0/3412408870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5c815c9a0 0x7fa5c815a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:41.952 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.948+0000 7fa5c6ffd700 1 -- 172.21.15.103:0/3412408870 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c0009b30 con 0x7fa5c80cf5c0 2023-07-24T05:45:41.953 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.948+0000 7fa5c7fff700 1 --2- 172.21.15.103:0/3412408870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5c815c9a0 0x7fa5c815a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:45:41.953 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.948+0000 7fa5c6ffd700 1 --2- 172.21.15.103:0/3412408870 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa5c80cf5c0 0x7fa5c815de60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc00e810 tx=0x7fa5bc00eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:41.953 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.948+0000 7fa5affff700 1 -- 172.21.15.103:0/3412408870 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc013610 con 0x7fa5c80cf5c0 2023-07-24T05:45:41.953 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.948+0000 7fa5affff700 1 -- 172.21.15.103:0/3412408870 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5bc013770 con 0x7fa5c80cf5c0 2023-07-24T05:45:41.953 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.948+0000 7fa5ccb36700 1 -- 172.21.15.103:0/3412408870 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c81f6630 con 0x7fa5c80cf5c0 2023-07-24T05:45:41.953 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.948+0000 7fa5affff700 1 -- 172.21.15.103:0/3412408870 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc013b20 con 0x7fa5c80cf5c0 2023-07-24T05:45:41.954 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.948+0000 7fa5ccb36700 1 -- 172.21.15.103:0/3412408870 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c81f2570 con 0x7fa5c80cf5c0 2023-07-24T05:45:41.954 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.948+0000 7fa5affff700 1 -- 172.21.15.103:0/3412408870 <== mon.2 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa5bc01c450 con 0x7fa5c80cf5c0 2023-07-24T05:45:41.954 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.948+0000 7fa5affff700 1 -- 172.21.15.103:0/3412408870 <== mon.2 v2:172.21.15.103:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fa5bc01cb20 con 0x7fa5c80cf5c0 2023-07-24T05:45:41.954 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.948+0000 7fa5ccb36700 1 -- 172.21.15.103:0/3412408870 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5c8072490 con 0x7fa5c80cf5c0 2023-07-24T05:45:41.955 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:41.952+0000 7fa5affff700 1 -- 172.21.15.103:0/3412408870 <== mon.2 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fa5bc021060 con 0x7fa5c80cf5c0 2023-07-24T05:45:41.962 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-07-24T05:45:41.959+0000 7ff3d14c32c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-24T05:45:41.964 INFO:tasks.ceph.mgr.x.smithi103.stderr:2023-07-24T05:45:41.960+0000 7f8a4db022c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-24T05:45:42.037 INFO:tasks.ceph.mgr.x.smithi103.stderr:2023-07-24T05:45:42.036+0000 7f8a4db022c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-24T05:45:42.046 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-07-24T05:45:42.043+0000 7ff3d14c32c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-24T05:45:42.056 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.052+0000 7fa5ccb36700 1 -- 172.21.15.103:0/3412408870 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2ac177aa-4d7d-4262-bd54-d2b9f29f4c3c", "id": 2} v 0) v1 -- 0x7fa5c806c050 con 0x7fa5c80cf5c0 2023-07-24T05:45:42.066 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.064+0000 7fa5affff700 1 -- 172.21.15.103:0/3412408870 <== mon.2 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2ac177aa-4d7d-4262-bd54-d2b9f29f4c3c", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa5bc017070 con 0x7fa5c80cf5c0 2023-07-24T05:45:42.067 INFO:teuthology.orchestra.run.smithi103.stdout:2 2023-07-24T05:45:42.068 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.064+0000 7fa5ccb36700 1 -- 172.21.15.103:0/3412408870 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa5c80cf5c0 msgr2=0x7fa5c815de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:42.068 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.064+0000 7fa5ccb36700 1 --2- 172.21.15.103:0/3412408870 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa5c80cf5c0 0x7fa5c815de60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc00e810 tx=0x7fa5bc00eb20 comp rx=0 tx=0).stop 2023-07-24T05:45:42.068 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.064+0000 7fa5ccb36700 1 -- 172.21.15.103:0/3412408870 shutdown_connections 2023-07-24T05:45:42.068 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.064+0000 7fa5ccb36700 1 --2- 172.21.15.103:0/3412408870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa5c815c9a0 0x7fa5c815a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:42.068 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.064+0000 7fa5ccb36700 1 --2- 172.21.15.103:0/3412408870 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa5c80cf5c0 0x7fa5c815de60 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:42.069 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.064+0000 7fa5ccb36700 1 --2- 172.21.15.103:0/3412408870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa5c806bb60 0x7fa5c81f2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:42.069 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.064+0000 7fa5ccb36700 1 -- 172.21.15.103:0/3412408870 >> 172.21.15.103:0/3412408870 conn(0x7fa5c80b5610 msgr2=0x7fa5c80b0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:42.069 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.064+0000 7fa5ccb36700 1 -- 172.21.15.103:0/3412408870 shutdown_connections 2023-07-24T05:45:42.069 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.064+0000 7fa5ccb36700 1 -- 172.21.15.103:0/3412408870 wait complete. 2023-07-24T05:45:42.088 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd new 17d7a251-19e8-484c-8172-a578ab3da153 3 2023-07-24T05:45:42.245 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.244+0000 7fe535344700 1 Processor -- start 2023-07-24T05:45:42.245 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.244+0000 7fe535344700 1 -- start start 2023-07-24T05:45:42.247 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.244+0000 7fe535344700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe53015cac0 0x7fe53006ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:42.247 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.244+0000 7fe535344700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe53006b260 0x7fe5300d0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:42.248 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.244+0000 7fe535344700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe53006d3c0 con 0x7fe5300b5fa0 2023-07-24T05:45:42.248 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.244+0000 7fe535344700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5300b64d0 con 0x7fe53015cac0 2023-07-24T05:45:42.248 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.244+0000 7fe535344700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe53006d660 con 0x7fe53006b260 2023-07-24T05:45:42.248 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.244+0000 7fe52e7fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe53006b260 0x7fe5300d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:42.249 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.244+0000 7fe52f7fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe5300b5fa0 0x7fe530160890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:38282/0 (socket says 172.21.15.103:38282) 2023-07-24T05:45:42.249 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.244+0000 7fe52effd700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe53015cac0 0x7fe53006ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:42.249 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.244+0000 7fe52f7fe700 1 -- 172.21.15.103:0/3906811271 learned_addr learned my addr 172.21.15.103:0/3906811271 (peer_addr_for_me v1:172.21.15.103:0/0) 2023-07-24T05:45:42.250 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.248+0000 7fe52effd700 1 -- 172.21.15.103:0/3906811271 >> v2:172.21.15.103:3300/0 conn(0x7fe53006b260 msgr2=0x7fe5300d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:45:42.250 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.248+0000 7fe52effd700 1 --2- 172.21.15.103:0/3906811271 >> v2:172.21.15.103:3300/0 conn(0x7fe53006b260 0x7fe5300d0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:42.250 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.248+0000 7fe52effd700 1 -- 172.21.15.103:0/3906811271 >> v1:172.21.15.103:6789/0 conn(0x7fe5300b5fa0 legacy=0x7fe530160890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:42.250 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.248+0000 7fe52dffb700 1 -- 172.21.15.103:0/3906811271 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2598065057 0 0) 0x7fe53006d3c0 con 0x7fe5300b5fa0 2023-07-24T05:45:42.250 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.248+0000 7fe52effd700 1 -- 172.21.15.103:0/3906811271 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe53006d940 con 0x7fe53015cac0 2023-07-24T05:45:42.250 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.248+0000 7fe52effd700 1 --2- 172.21.15.103:0/3906811271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe53015cac0 0x7fe53006ad20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe520009840 tx=0x7fe520009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6370a7f1e482ce8d server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:42.251 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.248+0000 7fe52dffb700 1 -- 172.21.15.103:0/3906811271 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe520005e50 con 0x7fe53015cac0 2023-07-24T05:45:42.251 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.248+0000 7fe52dffb700 1 -- 172.21.15.103:0/3906811271 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe520006030 con 0x7fe53015cac0 2023-07-24T05:45:42.251 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.248+0000 7fe52dffb700 1 -- 172.21.15.103:0/3906811271 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5200063c0 con 0x7fe53015cac0 2023-07-24T05:45:42.251 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.248+0000 7fe535344700 1 -- 172.21.15.103:0/3906811271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe53015cac0 msgr2=0x7fe53006ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:42.252 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.248+0000 7fe535344700 1 --2- 172.21.15.103:0/3906811271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe53015cac0 0x7fe53006ad20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe520009840 tx=0x7fe520009b50 comp rx=0 tx=0).stop 2023-07-24T05:45:42.252 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.248+0000 7fe535344700 1 -- 172.21.15.103:0/3906811271 shutdown_connections 2023-07-24T05:45:42.252 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.248+0000 7fe535344700 1 --2- 172.21.15.103:0/3906811271 >> v2:172.21.15.103:3300/0 conn(0x7fe53006b260 0x7fe5300d0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:42.252 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.248+0000 7fe535344700 1 --2- 172.21.15.103:0/3906811271 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe53015cac0 0x7fe53006ad20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:42.252 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.248+0000 7fe535344700 1 -- 172.21.15.103:0/3906811271 >> 172.21.15.103:0/3906811271 conn(0x7fe53009bb90 msgr2=0x7fe5300b5890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:42.252 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.248+0000 7fe535344700 1 -- 172.21.15.103:0/3906811271 shutdown_connections 2023-07-24T05:45:42.253 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.248+0000 7fe535344700 1 -- 172.21.15.103:0/3906811271 wait complete. 2023-07-24T05:45:42.253 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.252+0000 7fe535344700 1 Processor -- start 2023-07-24T05:45:42.254 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.252+0000 7fe535344700 1 -- start start 2023-07-24T05:45:42.255 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.252+0000 7fe535344700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe53006b260 0x7fe5300ca420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:42.255 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.252+0000 7fe535344700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe5300b5fa0 0x7fe5300cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:42.255 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.252+0000 7fe535344700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe53015cac0 0x7fe530159b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:42.255 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.252+0000 7fe535344700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe53009e940 con 0x7fe53015cac0 2023-07-24T05:45:42.255 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.252+0000 7fe535344700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5300a05e0 con 0x7fe53006b260 2023-07-24T05:45:42.255 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.252+0000 7fe535344700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5300a0300 con 0x7fe5300b5fa0 2023-07-24T05:45:42.257 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.252+0000 7fe52e7fc700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe5300b5fa0 0x7fe5300cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:42.257 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.252+0000 7fe52e7fc700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe5300b5fa0 0x7fe5300cbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.103:44200/0 (socket says 172.21.15.103:44200) 2023-07-24T05:45:42.257 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.252+0000 7fe52e7fc700 1 -- 172.21.15.103:0/1911056486 learned_addr learned my addr 172.21.15.103:0/1911056486 (peer_addr_for_me v2:172.21.15.103:0/0) 2023-07-24T05:45:42.257 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.252+0000 7fe52effd700 1 --2- 172.21.15.103:0/1911056486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe53006b260 0x7fe5300ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:42.257 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.252+0000 7fe52f7fe700 1 --2- 172.21.15.103:0/1911056486 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe53015cac0 0x7fe530159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:42.258 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.252+0000 7fe52e7fc700 1 -- 172.21.15.103:0/1911056486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe53006b260 msgr2=0x7fe5300ca420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:42.258 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.252+0000 7fe52e7fc700 1 --2- 172.21.15.103:0/1911056486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe53006b260 0x7fe5300ca420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:42.258 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.252+0000 7fe52e7fc700 1 -- 172.21.15.103:0/1911056486 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe53015cac0 msgr2=0x7fe530159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:42.258 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.252+0000 7fe52e7fc700 1 --2- 172.21.15.103:0/1911056486 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe53015cac0 0x7fe530159b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:42.258 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.252+0000 7fe52e7fc700 1 -- 172.21.15.103:0/1911056486 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe520009450 con 0x7fe5300b5fa0 2023-07-24T05:45:42.258 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.252+0000 7fe52effd700 1 --2- 172.21.15.103:0/1911056486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe53006b260 0x7fe5300ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:45:42.258 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.252+0000 7fe52e7fc700 1 --2- 172.21.15.103:0/1911056486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe5300b5fa0 0x7fe5300cbd10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe52400e870 tx=0x7fe52400eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:42.258 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.252+0000 7fe5177fe700 1 -- 172.21.15.103:0/1911056486 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5240095a0 con 0x7fe5300b5fa0 2023-07-24T05:45:42.259 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.256+0000 7fe5177fe700 1 -- 172.21.15.103:0/1911056486 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe524013680 con 0x7fe5300b5fa0 2023-07-24T05:45:42.259 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.256+0000 7fe5177fe700 1 -- 172.21.15.103:0/1911056486 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5240139f0 con 0x7fe5300b5fa0 2023-07-24T05:45:42.259 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.256+0000 7fe535344700 1 -- 172.21.15.103:0/1911056486 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe53009e280 con 0x7fe5300b5fa0 2023-07-24T05:45:42.259 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.256+0000 7fe5177fe700 1 -- 172.21.15.103:0/1911056486 <== mon.2 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe52401c450 con 0x7fe5300b5fa0 2023-07-24T05:45:42.259 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.256+0000 7fe535344700 1 -- 172.21.15.103:0/1911056486 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe53009fff0 con 0x7fe5300b5fa0 2023-07-24T05:45:42.260 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.256+0000 7fe5177fe700 1 -- 172.21.15.103:0/1911056486 <== mon.2 v2:172.21.15.103:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fe52401cb90 con 0x7fe5300b5fa0 2023-07-24T05:45:42.260 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.256+0000 7fe535344700 1 -- 172.21.15.103:0/1911056486 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe53009ea80 con 0x7fe5300b5fa0 2023-07-24T05:45:42.261 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.260+0000 7fe5177fe700 1 -- 172.21.15.103:0/1911056486 <== mon.2 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fe53009ea80 con 0x7fe5300b5fa0 2023-07-24T05:45:42.291 INFO:tasks.ceph.mgr.x.smithi103.stderr:2023-07-24T05:45:42.288+0000 7f8a4db022c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-24T05:45:42.295 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-07-24T05:45:42.291+0000 7ff3d14c32c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-24T05:45:42.366 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.364+0000 7fe535344700 1 -- 172.21.15.103:0/1911056486 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "osd new", "uuid": "17d7a251-19e8-484c-8172-a578ab3da153", "id": 3} v 0) v1 -- 0x7fe53004df10 con 0x7fe5300b5fa0 2023-07-24T05:45:42.376 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.372+0000 7fe5177fe700 1 -- 172.21.15.103:0/1911056486 <== mon.2 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "17d7a251-19e8-484c-8172-a578ab3da153", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe52402a020 con 0x7fe5300b5fa0 2023-07-24T05:45:42.376 INFO:teuthology.orchestra.run.smithi103.stdout:3 2023-07-24T05:45:42.377 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.376+0000 7fe535344700 1 -- 172.21.15.103:0/1911056486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe5300b5fa0 msgr2=0x7fe5300cbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:42.378 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.376+0000 7fe535344700 1 --2- 172.21.15.103:0/1911056486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe5300b5fa0 0x7fe5300cbd10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe52400e870 tx=0x7fe52400eb80 comp rx=0 tx=0).stop 2023-07-24T05:45:42.378 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.376+0000 7fe535344700 1 -- 172.21.15.103:0/1911056486 shutdown_connections 2023-07-24T05:45:42.378 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.376+0000 7fe535344700 1 --2- 172.21.15.103:0/1911056486 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe53015cac0 0x7fe530159b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:42.378 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.376+0000 7fe535344700 1 --2- 172.21.15.103:0/1911056486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe5300b5fa0 0x7fe5300cbd10 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:42.379 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.376+0000 7fe535344700 1 --2- 172.21.15.103:0/1911056486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe53006b260 0x7fe5300ca420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:42.379 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.376+0000 7fe535344700 1 -- 172.21.15.103:0/1911056486 >> 172.21.15.103:0/1911056486 conn(0x7fe53009bb90 msgr2=0x7fe5300af4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:42.379 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.376+0000 7fe535344700 1 -- 172.21.15.103:0/1911056486 shutdown_connections 2023-07-24T05:45:42.379 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.376+0000 7fe535344700 1 -- 172.21.15.103:0/1911056486 wait complete. 2023-07-24T05:45:42.379 INFO:tasks.ceph.mgr.x.smithi103.stderr:2023-07-24T05:45:42.376+0000 7f8a4db022c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-24T05:45:42.389 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-07-24T05:45:42.387+0000 7ff3d14c32c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-24T05:45:42.399 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd new bf63ca05-f06d-4e0f-ac44-2a416c70b919 4 2023-07-24T05:45:42.470 INFO:tasks.ceph.mgr.x.smithi103.stderr:2023-07-24T05:45:42.468+0000 7f8a4db022c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-24T05:45:42.488 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-07-24T05:45:42.483+0000 7ff3d14c32c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-24T05:45:42.559 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.556+0000 7f33e6ee9700 1 Processor -- start 2023-07-24T05:45:42.560 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.556+0000 7f33e6ee9700 1 -- start start 2023-07-24T05:45:42.562 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.560+0000 7f33e6ee9700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f33e015c6d0 0x7f33e006b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:42.562 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.560+0000 7f33e6ee9700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33e00b2770 0x7f33e00cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:42.562 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.560+0000 7f33e6ee9700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e006bbb0 con 0x7f33e015cab0 2023-07-24T05:45:42.562 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.560+0000 7f33e6ee9700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33e006c170 con 0x7f33e015c6d0 2023-07-24T05:45:42.562 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.560+0000 7f33e6ee9700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e00cea60 con 0x7f33e00b2770 2023-07-24T05:45:42.563 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.560+0000 7f33e66e8700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33e00b2770 0x7f33e00cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:42.563 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.560+0000 7f33e66e8700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33e00b2770 0x7f33e00cbb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.103:44212/0 (socket says 172.21.15.103:44212) 2023-07-24T05:45:42.564 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.560+0000 7f33e66e8700 1 -- 172.21.15.103:0/694979476 learned_addr learned my addr 172.21.15.103:0/694979476 (peer_addr_for_me v2:172.21.15.103:0/0) 2023-07-24T05:45:42.564 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.560+0000 7f33e5ee7700 1 --2- 172.21.15.103:0/694979476 >> v2:172.21.15.77:3300/0 conn(0x7f33e015c6d0 0x7f33e006b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:42.564 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.560+0000 7f33e66e8700 1 -- 172.21.15.103:0/694979476 >> v2:172.21.15.77:3300/0 conn(0x7f33e015c6d0 msgr2=0x7f33e006b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:45:42.564 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.560+0000 7f33e66e8700 1 --2- 172.21.15.103:0/694979476 >> v2:172.21.15.77:3300/0 conn(0x7f33e015c6d0 0x7f33e006b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:42.564 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.560+0000 7f33e66e8700 1 -- 172.21.15.103:0/694979476 >> v1:172.21.15.77:6789/0 conn(0x7f33e015cab0 legacy=0x7f33e00b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:42.564 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.560+0000 7f33e66e8700 1 -- 172.21.15.103:0/694979476 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e006be90 con 0x7f33e00b2770 2023-07-24T05:45:42.564 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.560+0000 7f33e5ee7700 1 --2- 172.21.15.103:0/694979476 >> v2:172.21.15.77:3300/0 conn(0x7f33e015c6d0 0x7f33e006b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:45:42.565 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.560+0000 7f33e66e8700 1 --2- 172.21.15.103:0/694979476 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33e00b2770 0x7f33e00cbb20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f33d8009e50 tx=0x7f33d800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d89719c1edeaf29 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:42.565 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.560+0000 7f33e4ee5700 1 -- 172.21.15.103:0/694979476 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d800e070 con 0x7f33e00b2770 2023-07-24T05:45:42.565 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.560+0000 7f33e4ee5700 1 -- 172.21.15.103:0/694979476 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d800b9c0 con 0x7f33e00b2770 2023-07-24T05:45:42.565 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.560+0000 7f33e4ee5700 1 -- 172.21.15.103:0/694979476 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d800bd70 con 0x7f33e00b2770 2023-07-24T05:45:42.566 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.564+0000 7f33e6ee9700 1 -- 172.21.15.103:0/694979476 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33e00b2770 msgr2=0x7f33e00cbb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:42.566 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.564+0000 7f33e6ee9700 1 --2- 172.21.15.103:0/694979476 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33e00b2770 0x7f33e00cbb20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f33d8009e50 tx=0x7f33d800b330 comp rx=0 tx=0).stop 2023-07-24T05:45:42.566 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.564+0000 7f33e6ee9700 1 -- 172.21.15.103:0/694979476 shutdown_connections 2023-07-24T05:45:42.566 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.564+0000 7f33e6ee9700 1 --2- 172.21.15.103:0/694979476 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33e00b2770 0x7f33e00cbb20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:42.567 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.564+0000 7f33e6ee9700 1 --2- 172.21.15.103:0/694979476 >> v2:172.21.15.77:3300/0 conn(0x7f33e015c6d0 0x7f33e006b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:42.567 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.564+0000 7f33e6ee9700 1 -- 172.21.15.103:0/694979476 >> 172.21.15.103:0/694979476 conn(0x7f33e00cd060 msgr2=0x7f33e00cd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:42.567 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.564+0000 7f33e6ee9700 1 -- 172.21.15.103:0/694979476 shutdown_connections 2023-07-24T05:45:42.567 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.564+0000 7f33e6ee9700 1 -- 172.21.15.103:0/694979476 wait complete. 2023-07-24T05:45:42.569 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.568+0000 7f33e6ee9700 1 Processor -- start 2023-07-24T05:45:42.569 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.568+0000 7f33e6ee9700 1 -- start start 2023-07-24T05:45:42.572 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.568+0000 7f33e6ee9700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33e00b2770 0x7f33e0153bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:42.572 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.568+0000 7f33e6ee9700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33e015c6d0 0x7f33e015e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:42.572 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.568+0000 7f33e6ee9700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33e015cab0 0x7f33e015ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:42.572 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.568+0000 7f33e6ee9700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e0155230 con 0x7f33e015c6d0 2023-07-24T05:45:42.572 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.568+0000 7f33e6ee9700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e0154380 con 0x7f33e015cab0 2023-07-24T05:45:42.572 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.568+0000 7f33e6ee9700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e0154620 con 0x7f33e00b2770 2023-07-24T05:45:42.574 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.568+0000 7f33e5ee7700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33e00b2770 0x7f33e0153bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:42.574 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.568+0000 7f33e66e8700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33e015cab0 0x7f33e015ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:42.574 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.568+0000 7f33e5ee7700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33e00b2770 0x7f33e0153bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.103:44218/0 (socket says 172.21.15.103:44218) 2023-07-24T05:45:42.574 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.568+0000 7f33e5ee7700 1 -- 172.21.15.103:0/796082320 learned_addr learned my addr 172.21.15.103:0/796082320 (peer_addr_for_me v2:172.21.15.103:0/0) 2023-07-24T05:45:42.574 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.568+0000 7f33e56e6700 1 --2- 172.21.15.103:0/796082320 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33e015c6d0 0x7f33e015e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:42.574 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.572+0000 7f33e66e8700 1 -- 172.21.15.103:0/796082320 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33e00b2770 msgr2=0x7f33e0153bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:42.574 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.572+0000 7f33e66e8700 1 --2- 172.21.15.103:0/796082320 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33e00b2770 0x7f33e0153bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:42.575 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.572+0000 7f33e66e8700 1 -- 172.21.15.103:0/796082320 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33e015c6d0 msgr2=0x7f33e015e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:42.575 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.572+0000 7f33e66e8700 1 --2- 172.21.15.103:0/796082320 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33e015c6d0 0x7f33e015e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:42.575 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.572+0000 7f33e66e8700 1 -- 172.21.15.103:0/796082320 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d8009b30 con 0x7f33e015cab0 2023-07-24T05:45:42.575 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.572+0000 7f33e66e8700 1 --2- 172.21.15.103:0/796082320 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33e015cab0 0x7f33e015ec30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f33d8015000 tx=0x7f33d8004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:42.575 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.572+0000 7f33d67fc700 1 -- 172.21.15.103:0/796082320 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d80048b0 con 0x7f33e015cab0 2023-07-24T05:45:42.575 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.572+0000 7f33d67fc700 1 -- 172.21.15.103:0/796082320 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d80099b0 con 0x7f33e015cab0 2023-07-24T05:45:42.575 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.572+0000 7f33e6ee9700 1 -- 172.21.15.103:0/796082320 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33e0154900 con 0x7f33e015cab0 2023-07-24T05:45:42.576 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.572+0000 7f33d67fc700 1 -- 172.21.15.103:0/796082320 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d801c680 con 0x7f33e015cab0 2023-07-24T05:45:42.576 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.572+0000 7f33e6ee9700 1 -- 172.21.15.103:0/796082320 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e0154ec0 con 0x7f33e015cab0 2023-07-24T05:45:42.576 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.572+0000 7f33d67fc700 1 -- 172.21.15.103:0/796082320 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f33d801cae0 con 0x7f33e015cab0 2023-07-24T05:45:42.576 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.572+0000 7f33d67fc700 1 -- 172.21.15.103:0/796082320 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f33d8025e10 con 0x7f33e015cab0 2023-07-24T05:45:42.577 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.572+0000 7f33e6ee9700 1 -- 172.21.15.103:0/796082320 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33e0072490 con 0x7f33e015cab0 2023-07-24T05:45:42.579 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.576+0000 7f33d67fc700 1 -- 172.21.15.103:0/796082320 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f33d8043b00 con 0x7f33e015cab0 2023-07-24T05:45:42.703 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.700+0000 7f33e6ee9700 1 -- 172.21.15.103:0/796082320 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bf63ca05-f06d-4e0f-ac44-2a416c70b919", "id": 4} v 0) v1 -- 0x7f33e00ce650 con 0x7f33e015cab0 2023-07-24T05:45:42.713 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.708+0000 7f33d67fc700 1 -- 172.21.15.103:0/796082320 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bf63ca05-f06d-4e0f-ac44-2a416c70b919", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f33d8032030 con 0x7f33e015cab0 2023-07-24T05:45:42.713 INFO:teuthology.orchestra.run.smithi103.stdout:4 2023-07-24T05:45:42.714 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.712+0000 7f33e6ee9700 1 -- 172.21.15.103:0/796082320 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33e015cab0 msgr2=0x7f33e015ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:42.714 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.712+0000 7f33e6ee9700 1 --2- 172.21.15.103:0/796082320 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33e015cab0 0x7f33e015ec30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f33d8015000 tx=0x7f33d8004af0 comp rx=0 tx=0).stop 2023-07-24T05:45:42.715 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.712+0000 7f33e6ee9700 1 -- 172.21.15.103:0/796082320 shutdown_connections 2023-07-24T05:45:42.715 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.712+0000 7f33e6ee9700 1 --2- 172.21.15.103:0/796082320 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33e015cab0 0x7f33e015ec30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:42.715 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.712+0000 7f33e6ee9700 1 --2- 172.21.15.103:0/796082320 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33e015c6d0 0x7f33e015e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:42.716 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.712+0000 7f33e6ee9700 1 --2- 172.21.15.103:0/796082320 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33e00b2770 0x7f33e0153bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:42.716 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.712+0000 7f33e6ee9700 1 -- 172.21.15.103:0/796082320 >> 172.21.15.103:0/796082320 conn(0x7f33e00cd060 msgr2=0x7f33e00b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:42.716 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.712+0000 7f33e6ee9700 1 -- 172.21.15.103:0/796082320 shutdown_connections 2023-07-24T05:45:42.716 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.712+0000 7f33e6ee9700 1 -- 172.21.15.103:0/796082320 wait complete. 2023-07-24T05:45:42.735 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd new 65a11a35-9e9f-4b3c-9fe3-b658d62b9318 5 2023-07-24T05:45:42.902 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.900+0000 7fb5712c4700 1 Processor -- start 2023-07-24T05:45:42.902 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.900+0000 7fb5712c4700 1 -- start start 2023-07-24T05:45:42.904 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.900+0000 7fb5712c4700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb56c15cc50 0x7fb56c0b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:42.904 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.900+0000 7fb5712c4700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb56c06a520 0x7fb56c0b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:42.904 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.900+0000 7fb5712c4700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb56c06aaa0 con 0x7fb56c15c870 2023-07-24T05:45:42.904 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.900+0000 7fb5712c4700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb56c06ad80 con 0x7fb56c06a520 2023-07-24T05:45:42.904 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.900+0000 7fb5712c4700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb56c06b060 con 0x7fb56c15cc50 2023-07-24T05:45:42.905 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.900+0000 7fb56b7fe700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb56c15cc50 0x7fb56c0b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:42.905 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.900+0000 7fb56bfff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fb56c15c870 0x7fb56c0cefe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.103:38284/0 (socket says 172.21.15.103:38284) 2023-07-24T05:45:42.905 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.900+0000 7fb56bfff700 1 -- 172.21.15.103:0/1195884579 learned_addr learned my addr 172.21.15.103:0/1195884579 (peer_addr_for_me v1:172.21.15.103:0/0) 2023-07-24T05:45:42.906 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.900+0000 7fb570ac3700 1 --2- 172.21.15.103:0/1195884579 >> v2:172.21.15.77:3300/0 conn(0x7fb56c06a520 0x7fb56c0b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:42.906 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.904+0000 7fb56b7fe700 1 -- 172.21.15.103:0/1195884579 >> v2:172.21.15.77:3300/0 conn(0x7fb56c06a520 msgr2=0x7fb56c0b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:45:42.906 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.904+0000 7fb56b7fe700 1 --2- 172.21.15.103:0/1195884579 >> v2:172.21.15.77:3300/0 conn(0x7fb56c06a520 0x7fb56c0b2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:42.906 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.904+0000 7fb56b7fe700 1 -- 172.21.15.103:0/1195884579 >> v1:172.21.15.103:6789/0 conn(0x7fb56c15c870 legacy=0x7fb56c0cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:42.906 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.904+0000 7fb56b7fe700 1 -- 172.21.15.103:0/1195884579 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb56c06b340 con 0x7fb56c15cc50 2023-07-24T05:45:42.907 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.904+0000 7fb56b7fe700 1 --2- 172.21.15.103:0/1195884579 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb56c15cc50 0x7fb56c0b1b20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb560009850 tx=0x7fb560009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d48e00801b510f84 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:42.907 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.904+0000 7fb56affd700 1 -- 172.21.15.103:0/1195884579 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb560011830 con 0x7fb56c15cc50 2023-07-24T05:45:42.907 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.904+0000 7fb56affd700 1 -- 172.21.15.103:0/1195884579 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb560011990 con 0x7fb56c15cc50 2023-07-24T05:45:42.908 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.904+0000 7fb56affd700 1 -- 172.21.15.103:0/1195884579 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb560011d40 con 0x7fb56c15cc50 2023-07-24T05:45:42.908 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.904+0000 7fb5712c4700 1 -- 172.21.15.103:0/1195884579 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb56c15cc50 msgr2=0x7fb56c0b1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:42.908 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.904+0000 7fb5712c4700 1 --2- 172.21.15.103:0/1195884579 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb56c15cc50 0x7fb56c0b1b20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb560009850 tx=0x7fb560009b60 comp rx=0 tx=0).stop 2023-07-24T05:45:42.908 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.904+0000 7fb5712c4700 1 -- 172.21.15.103:0/1195884579 shutdown_connections 2023-07-24T05:45:42.908 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.904+0000 7fb5712c4700 1 --2- 172.21.15.103:0/1195884579 >> v2:172.21.15.77:3300/0 conn(0x7fb56c06a520 0x7fb56c0b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:42.908 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.904+0000 7fb5712c4700 1 --2- 172.21.15.103:0/1195884579 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb56c15cc50 0x7fb56c0b1b20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:42.908 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.904+0000 7fb5712c4700 1 -- 172.21.15.103:0/1195884579 >> 172.21.15.103:0/1195884579 conn(0x7fb56c089f80 msgr2=0x7fb56c09b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:42.909 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.904+0000 7fb5712c4700 1 -- 172.21.15.103:0/1195884579 shutdown_connections 2023-07-24T05:45:42.909 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.904+0000 7fb5712c4700 1 -- 172.21.15.103:0/1195884579 wait complete. 2023-07-24T05:45:42.910 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.908+0000 7fb5712c4700 1 Processor -- start 2023-07-24T05:45:42.910 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.908+0000 7fb5712c4700 1 -- start start 2023-07-24T05:45:42.912 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.908+0000 7fb5712c4700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb56c06a520 0x7fb56c0aff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:42.912 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.908+0000 7fb5712c4700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb56c15c870 0x7fb56c14f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:42.912 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.908+0000 7fb5712c4700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb56c15cc50 0x7fb56c14fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:42.912 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.908+0000 7fb5712c4700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb56c1513b0 con 0x7fb56c15cc50 2023-07-24T05:45:42.912 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.908+0000 7fb5712c4700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb56c14f990 con 0x7fb56c15c870 2023-07-24T05:45:42.913 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.908+0000 7fb5712c4700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb56c150410 con 0x7fb56c06a520 2023-07-24T05:45:42.913 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.908+0000 7fb56bfff700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb56c06a520 0x7fb56c0aff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:42.914 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.908+0000 7fb56b7fe700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb56c15c870 0x7fb56c14f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:42.914 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.908+0000 7fb56b7fe700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb56c15c870 0x7fb56c14f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44292/0 (socket says 172.21.15.103:44292) 2023-07-24T05:45:42.914 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.908+0000 7fb56b7fe700 1 -- 172.21.15.103:0/2913170447 learned_addr learned my addr 172.21.15.103:0/2913170447 (peer_addr_for_me v2:172.21.15.103:0/0) 2023-07-24T05:45:42.914 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.908+0000 7fb56bfff700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb56c06a520 0x7fb56c0aff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.103:44236/0 (socket says 172.21.15.103:44236) 2023-07-24T05:45:42.914 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.912+0000 7fb570ac3700 1 --2- 172.21.15.103:0/2913170447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb56c15cc50 0x7fb56c14fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:42.914 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.912+0000 7fb56b7fe700 1 -- 172.21.15.103:0/2913170447 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb56c06a520 msgr2=0x7fb56c0aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:42.914 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.912+0000 7fb56b7fe700 1 --2- 172.21.15.103:0/2913170447 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb56c06a520 0x7fb56c0aff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:42.915 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.912+0000 7fb56b7fe700 1 -- 172.21.15.103:0/2913170447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb56c15cc50 msgr2=0x7fb56c14fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:42.915 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.912+0000 7fb56b7fe700 1 --2- 172.21.15.103:0/2913170447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb56c15cc50 0x7fb56c14fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:42.915 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.912+0000 7fb56b7fe700 1 -- 172.21.15.103:0/2913170447 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5600094b0 con 0x7fb56c15c870 2023-07-24T05:45:42.915 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.912+0000 7fb56bfff700 1 --2- 172.21.15.103:0/2913170447 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb56c06a520 0x7fb56c0aff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:45:42.916 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.912+0000 7fb56b7fe700 1 --2- 172.21.15.103:0/2913170447 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb56c15c870 0x7fb56c14f450 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb5600090b0 tx=0x7fb560004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:42.916 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.912+0000 7fb568ff9700 1 -- 172.21.15.103:0/2913170447 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb560004610 con 0x7fb56c15c870 2023-07-24T05:45:42.916 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.912+0000 7fb568ff9700 1 -- 172.21.15.103:0/2913170447 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56001e070 con 0x7fb56c15c870 2023-07-24T05:45:42.916 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.912+0000 7fb568ff9700 1 -- 172.21.15.103:0/2913170447 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb560003920 con 0x7fb56c15c870 2023-07-24T05:45:42.916 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.912+0000 7fb5712c4700 1 -- 172.21.15.103:0/2913170447 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb56c1506f0 con 0x7fb56c15c870 2023-07-24T05:45:42.917 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.912+0000 7fb5712c4700 1 -- 172.21.15.103:0/2913170447 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb56c150cb0 con 0x7fb56c15c870 2023-07-24T05:45:42.917 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.912+0000 7fb568ff9700 1 -- 172.21.15.103:0/2913170447 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb560025480 con 0x7fb56c15c870 2023-07-24T05:45:42.917 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.912+0000 7fb568ff9700 1 -- 172.21.15.103:0/2913170447 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fb560020070 con 0x7fb56c15c870 2023-07-24T05:45:42.917 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.912+0000 7fb5712c4700 1 -- 172.21.15.103:0/2913170447 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb56c072490 con 0x7fb56c15c870 2023-07-24T05:45:42.920 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:42.916+0000 7fb568ff9700 1 -- 172.21.15.103:0/2913170447 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fb56002a020 con 0x7fb56c15c870 2023-07-24T05:45:42.968 INFO:tasks.ceph.mgr.x.smithi103.stderr:2023-07-24T05:45:42.964+0000 7f8a4db022c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-24T05:45:42.999 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-07-24T05:45:42.995+0000 7ff3d14c32c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-24T05:45:43.027 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.024+0000 7fb5712c4700 1 -- 172.21.15.103:0/2913170447 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd new", "uuid": "65a11a35-9e9f-4b3c-9fe3-b658d62b9318", "id": 5} v 0) v1 -- 0x7fb56c0cd990 con 0x7fb56c15c870 2023-07-24T05:45:43.037 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.036+0000 7fb568ff9700 1 -- 172.21.15.103:0/2913170447 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "65a11a35-9e9f-4b3c-9fe3-b658d62b9318", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb560015020 con 0x7fb56c15c870 2023-07-24T05:45:43.038 INFO:teuthology.orchestra.run.smithi103.stdout:5 2023-07-24T05:45:43.039 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.036+0000 7fb5712c4700 1 -- 172.21.15.103:0/2913170447 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb56c15c870 msgr2=0x7fb56c14f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:43.039 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.036+0000 7fb5712c4700 1 --2- 172.21.15.103:0/2913170447 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb56c15c870 0x7fb56c14f450 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb5600090b0 tx=0x7fb560004770 comp rx=0 tx=0).stop 2023-07-24T05:45:43.039 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.036+0000 7fb5712c4700 1 -- 172.21.15.103:0/2913170447 shutdown_connections 2023-07-24T05:45:43.040 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.036+0000 7fb5712c4700 1 --2- 172.21.15.103:0/2913170447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb56c15cc50 0x7fb56c14fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:43.040 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.036+0000 7fb5712c4700 1 --2- 172.21.15.103:0/2913170447 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb56c15c870 0x7fb56c14f450 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:43.040 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.036+0000 7fb5712c4700 1 --2- 172.21.15.103:0/2913170447 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb56c06a520 0x7fb56c0aff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:43.040 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.036+0000 7fb5712c4700 1 -- 172.21.15.103:0/2913170447 >> 172.21.15.103:0/2913170447 conn(0x7fb56c089f80 msgr2=0x7fb56c0cecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:43.040 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.036+0000 7fb5712c4700 1 -- 172.21.15.103:0/2913170447 shutdown_connections 2023-07-24T05:45:43.041 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.036+0000 7fb5712c4700 1 -- 172.21.15.103:0/2913170447 wait complete. 2023-07-24T05:45:43.061 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd new 750c1f87-686c-40b4-94a1-1a299dc78f3d 6 2023-07-24T05:45:43.138 INFO:tasks.ceph.mgr.x.smithi103.stderr:2023-07-24T05:45:43.136+0000 7f8a4db022c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-24T05:45:43.178 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-07-24T05:45:43.175+0000 7ff3d14c32c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-24T05:45:43.213 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.212+0000 7f733a1af700 1 Processor -- start 2023-07-24T05:45:43.214 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.212+0000 7f733a1af700 1 -- start start 2023-07-24T05:45:43.215 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.212+0000 7f733a1af700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f733415c9a0 0x7f733406d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:43.215 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.212+0000 7f733a1af700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f733406bb60 0x7f73340d0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:43.216 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.212+0000 7f733a1af700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f73340d07d0 0x7f73340cf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:43.216 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.212+0000 7f733a1af700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73340cf170 con 0x7f733406bb60 2023-07-24T05:45:43.216 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.212+0000 7f733a1af700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f733406b4d0 con 0x7f733415c9a0 2023-07-24T05:45:43.216 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.212+0000 7f733a1af700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f733406ac30 con 0x7f73340d07d0 2023-07-24T05:45:43.217 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.212+0000 7f73399ae700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f73340d07d0 0x7f73340cf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:43.217 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.212+0000 7f73399ae700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f73340d07d0 0x7f73340cf5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.103:44246/0 (socket says 172.21.15.103:44246) 2023-07-24T05:45:43.217 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.212+0000 7f73399ae700 1 -- 172.21.15.103:0/250731531 learned_addr learned my addr 172.21.15.103:0/250731531 (peer_addr_for_me v2:172.21.15.103:0/0) 2023-07-24T05:45:43.218 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.212+0000 7f73391ad700 1 --2- 172.21.15.103:0/250731531 >> v2:172.21.15.103:3300/0 conn(0x7f733415c9a0 0x7f733406d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:43.218 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.212+0000 7f73389ac700 1 --2- 172.21.15.103:0/250731531 >> v2:172.21.15.77:3300/0 conn(0x7f733406bb60 0x7f73340d0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:43.218 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.212+0000 7f73399ae700 1 -- 172.21.15.103:0/250731531 >> v2:172.21.15.103:3300/0 conn(0x7f733415c9a0 msgr2=0x7f733406d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:45:43.218 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.212+0000 7f73399ae700 1 --2- 172.21.15.103:0/250731531 >> v2:172.21.15.103:3300/0 conn(0x7f733415c9a0 0x7f733406d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:43.218 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.212+0000 7f73399ae700 1 -- 172.21.15.103:0/250731531 >> v2:172.21.15.77:3300/0 conn(0x7f733406bb60 msgr2=0x7f73340d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:45:43.218 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.212+0000 7f73399ae700 1 --2- 172.21.15.103:0/250731531 >> v2:172.21.15.77:3300/0 conn(0x7f733406bb60 0x7f73340d0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:43.218 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.212+0000 7f73399ae700 1 -- 172.21.15.103:0/250731531 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f733406af10 con 0x7f73340d07d0 2023-07-24T05:45:43.219 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.212+0000 7f73391ad700 1 --2- 172.21.15.103:0/250731531 >> v2:172.21.15.103:3300/0 conn(0x7f733415c9a0 0x7f733406d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:45:43.219 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.216+0000 7f73399ae700 1 --2- 172.21.15.103:0/250731531 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f73340d07d0 0x7f73340cf5c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7334072e60 tx=0x7f732c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a109224e39379ac server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:43.219 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.216+0000 7f732bfff700 1 -- 172.21.15.103:0/250731531 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732c00e070 con 0x7f73340d07d0 2023-07-24T05:45:43.219 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.216+0000 7f732bfff700 1 -- 172.21.15.103:0/250731531 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f732c00b9c0 con 0x7f73340d07d0 2023-07-24T05:45:43.219 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.216+0000 7f732bfff700 1 -- 172.21.15.103:0/250731531 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732c00bd70 con 0x7f73340d07d0 2023-07-24T05:45:43.220 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.216+0000 7f733a1af700 1 -- 172.21.15.103:0/250731531 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f73340d07d0 msgr2=0x7f73340cf5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:43.220 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.216+0000 7f733a1af700 1 --2- 172.21.15.103:0/250731531 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f73340d07d0 0x7f73340cf5c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7334072e60 tx=0x7f732c00b330 comp rx=0 tx=0).stop 2023-07-24T05:45:43.220 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.216+0000 7f733a1af700 1 -- 172.21.15.103:0/250731531 shutdown_connections 2023-07-24T05:45:43.220 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.216+0000 7f733a1af700 1 --2- 172.21.15.103:0/250731531 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f73340d07d0 0x7f73340cf5c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:43.221 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.216+0000 7f733a1af700 1 --2- 172.21.15.103:0/250731531 >> v2:172.21.15.77:3300/0 conn(0x7f733406bb60 0x7f73340d0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:43.221 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.216+0000 7f733a1af700 1 --2- 172.21.15.103:0/250731531 >> v2:172.21.15.103:3300/0 conn(0x7f733415c9a0 0x7f733406d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:43.221 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.216+0000 7f733a1af700 1 -- 172.21.15.103:0/250731531 >> 172.21.15.103:0/250731531 conn(0x7f73340b5610 msgr2=0x7f73340b5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:43.221 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.216+0000 7f733a1af700 1 -- 172.21.15.103:0/250731531 shutdown_connections 2023-07-24T05:45:43.221 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.216+0000 7f733a1af700 1 -- 172.21.15.103:0/250731531 wait complete. 2023-07-24T05:45:43.221 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.216+0000 7f733a1af700 1 Processor -- start 2023-07-24T05:45:43.223 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.216+0000 7f733a1af700 1 -- start start 2023-07-24T05:45:43.223 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.220+0000 7f733a1af700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f733406bb60 0x7f73341f17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:43.223 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.220+0000 7f733a1af700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73340d07d0 0x7f73340c6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:43.223 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.220+0000 7f733a1af700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f733415c9a0 0x7f73340afd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:43.223 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.220+0000 7f733a1af700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733414f9a0 con 0x7f733406bb60 2023-07-24T05:45:43.223 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.220+0000 7f733a1af700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73340c74c0 con 0x7f73340d07d0 2023-07-24T05:45:43.224 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.220+0000 7f733a1af700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73340b3170 con 0x7f733415c9a0 2023-07-24T05:45:43.224 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.220+0000 7f73399ae700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f733415c9a0 0x7f73340afd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:43.224 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.220+0000 7f73399ae700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f733415c9a0 0x7f73340afd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.103:44252/0 (socket says 172.21.15.103:44252) 2023-07-24T05:45:43.224 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.220+0000 7f73399ae700 1 -- 172.21.15.103:0/3671457747 learned_addr learned my addr 172.21.15.103:0/3671457747 (peer_addr_for_me v2:172.21.15.103:0/0) 2023-07-24T05:45:43.224 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.220+0000 7f73391ad700 1 --2- 172.21.15.103:0/3671457747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f733406bb60 0x7f73341f17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:43.224 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.220+0000 7f73399ae700 1 -- 172.21.15.103:0/3671457747 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73340d07d0 msgr2=0x7f73340c6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:43.224 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.220+0000 7f73389ac700 1 --2- 172.21.15.103:0/3671457747 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73340d07d0 0x7f73340c6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:43.224 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.220+0000 7f73399ae700 1 --2- 172.21.15.103:0/3671457747 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73340d07d0 0x7f73340c6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:43.225 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.220+0000 7f73399ae700 1 -- 172.21.15.103:0/3671457747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f733406bb60 msgr2=0x7f73341f17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:43.225 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.220+0000 7f73399ae700 1 --2- 172.21.15.103:0/3671457747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f733406bb60 0x7f73341f17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:43.225 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.220+0000 7f73399ae700 1 -- 172.21.15.103:0/3671457747 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f732c009b30 con 0x7f733415c9a0 2023-07-24T05:45:43.225 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.220+0000 7f73391ad700 1 --2- 172.21.15.103:0/3671457747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f733406bb60 0x7f73341f17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:45:43.225 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.220+0000 7f73389ac700 1 --2- 172.21.15.103:0/3671457747 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73340d07d0 0x7f73340c6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:45:43.225 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.220+0000 7f73399ae700 1 --2- 172.21.15.103:0/3671457747 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f733415c9a0 0x7f73340afd20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f733406ad70 tx=0x7f732c004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:43.225 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.220+0000 7f7329ffb700 1 -- 172.21.15.103:0/3671457747 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732c004250 con 0x7f733415c9a0 2023-07-24T05:45:43.226 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.220+0000 7f7329ffb700 1 -- 172.21.15.103:0/3671457747 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f732c0043d0 con 0x7f733415c9a0 2023-07-24T05:45:43.226 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.220+0000 7f733a1af700 1 -- 172.21.15.103:0/3671457747 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73340b3450 con 0x7f733415c9a0 2023-07-24T05:45:43.226 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.220+0000 7f7329ffb700 1 -- 172.21.15.103:0/3671457747 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732c004780 con 0x7f733415c9a0 2023-07-24T05:45:43.226 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.220+0000 7f733a1af700 1 -- 172.21.15.103:0/3671457747 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73340b3a10 con 0x7f733415c9a0 2023-07-24T05:45:43.227 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.220+0000 7f7329ffb700 1 -- 172.21.15.103:0/3671457747 <== mon.2 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f732c01c740 con 0x7f733415c9a0 2023-07-24T05:45:43.227 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.220+0000 7f7329ffb700 1 -- 172.21.15.103:0/3671457747 <== mon.2 v2:172.21.15.103:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f732c0048e0 con 0x7f733415c9a0 2023-07-24T05:45:43.227 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.224+0000 7f733a1af700 1 -- 172.21.15.103:0/3671457747 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7334072490 con 0x7f733415c9a0 2023-07-24T05:45:43.227 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.224+0000 7f7329ffb700 1 -- 172.21.15.103:0/3671457747 <== mon.2 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f732c020030 con 0x7f733415c9a0 2023-07-24T05:45:43.330 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.328+0000 7f733a1af700 1 -- 172.21.15.103:0/3671457747 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "osd new", "uuid": "750c1f87-686c-40b4-94a1-1a299dc78f3d", "id": 6} v 0) v1 -- 0x7f733415b7b0 con 0x7f733415c9a0 2023-07-24T05:45:43.340 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.336+0000 7f7329ffb700 1 -- 172.21.15.103:0/3671457747 <== mon.2 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "750c1f87-686c-40b4-94a1-1a299dc78f3d", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f732c01cac0 con 0x7f733415c9a0 2023-07-24T05:45:43.341 INFO:teuthology.orchestra.run.smithi103.stdout:6 2023-07-24T05:45:43.343 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.340+0000 7f733a1af700 1 -- 172.21.15.103:0/3671457747 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f733415c9a0 msgr2=0x7f73340afd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:43.343 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.340+0000 7f733a1af700 1 --2- 172.21.15.103:0/3671457747 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f733415c9a0 0x7f73340afd20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f733406ad70 tx=0x7f732c004af0 comp rx=0 tx=0).stop 2023-07-24T05:45:43.343 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.340+0000 7f733a1af700 1 -- 172.21.15.103:0/3671457747 shutdown_connections 2023-07-24T05:45:43.343 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.340+0000 7f733a1af700 1 --2- 172.21.15.103:0/3671457747 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f733415c9a0 0x7f73340afd20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:43.343 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.340+0000 7f733a1af700 1 --2- 172.21.15.103:0/3671457747 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73340d07d0 0x7f73340c6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:43.344 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.340+0000 7f733a1af700 1 --2- 172.21.15.103:0/3671457747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f733406bb60 0x7f73341f17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:43.344 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.340+0000 7f733a1af700 1 -- 172.21.15.103:0/3671457747 >> 172.21.15.103:0/3671457747 conn(0x7f73340b5610 msgr2=0x7f73340b0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:43.344 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.340+0000 7f733a1af700 1 -- 172.21.15.103:0/3671457747 shutdown_connections 2023-07-24T05:45:43.344 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.340+0000 7f733a1af700 1 -- 172.21.15.103:0/3671457747 wait complete. 2023-07-24T05:45:43.363 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd new d5fe4fb6-2e09-4158-885b-403803c85822 7 2023-07-24T05:45:43.498 INFO:tasks.ceph.mgr.x.smithi103.stderr:2023-07-24T05:45:43.496+0000 7f8a4db022c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-24T05:45:43.523 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.520+0000 7f654adea700 1 Processor -- start 2023-07-24T05:45:43.524 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.520+0000 7f654adea700 1 -- start start 2023-07-24T05:45:43.526 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.524+0000 7f654adea700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f65440b5fa0 0x7f65440d0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:43.526 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.524+0000 7f654adea700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f654415cea0 0x7f65440d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:43.526 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.524+0000 7f654adea700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f654406d3c0 con 0x7f654415cac0 2023-07-24T05:45:43.526 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.524+0000 7f654adea700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65440b64d0 con 0x7f65440b5fa0 2023-07-24T05:45:43.526 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.524+0000 7f654adea700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f654406d660 con 0x7f654415cea0 2023-07-24T05:45:43.527 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.524+0000 7f6549387700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f654415cea0 0x7f65440d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:43.527 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.524+0000 7f6549387700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f654415cea0 0x7f65440d0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44324/0 (socket says 172.21.15.103:44324) 2023-07-24T05:45:43.527 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.524+0000 7f6549387700 1 -- 172.21.15.103:0/1646475453 learned_addr learned my addr 172.21.15.103:0/1646475453 (peer_addr_for_me v2:172.21.15.103:0/0) 2023-07-24T05:45:43.528 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.524+0000 7f6543fff700 1 --2- 172.21.15.103:0/1646475453 >> v2:172.21.15.77:3300/0 conn(0x7f65440b5fa0 0x7f65440d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:43.528 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.524+0000 7f6549387700 1 -- 172.21.15.103:0/1646475453 >> v2:172.21.15.77:3300/0 conn(0x7f65440b5fa0 msgr2=0x7f65440d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:45:43.528 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.524+0000 7f6549387700 1 --2- 172.21.15.103:0/1646475453 >> v2:172.21.15.77:3300/0 conn(0x7f65440b5fa0 0x7f65440d0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:43.528 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.524+0000 7f6549387700 1 -- 172.21.15.103:0/1646475453 >> v1:172.21.15.103:6789/0 conn(0x7f654415cac0 legacy=0x7f654406ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:45:43.528 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.524+0000 7f6549387700 1 -- 172.21.15.103:0/1646475453 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f654406d940 con 0x7f654415cea0 2023-07-24T05:45:43.529 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.524+0000 7f6549387700 1 --2- 172.21.15.103:0/1646475453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f654415cea0 0x7f65440d0a50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f654406c0d0 tx=0x7f653c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e95ebbd4ef8e0c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:43.529 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.524+0000 7f65437fe700 1 -- 172.21.15.103:0/1646475453 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653c00e070 con 0x7f654415cea0 2023-07-24T05:45:43.529 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.524+0000 7f65437fe700 1 -- 172.21.15.103:0/1646475453 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f653c00b910 con 0x7f654415cea0 2023-07-24T05:45:43.529 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.524+0000 7f65437fe700 1 -- 172.21.15.103:0/1646475453 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653c00bcc0 con 0x7f654415cea0 2023-07-24T05:45:43.530 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.528+0000 7f654adea700 1 -- 172.21.15.103:0/1646475453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f654415cea0 msgr2=0x7f65440d0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:43.530 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.528+0000 7f654adea700 1 --2- 172.21.15.103:0/1646475453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f654415cea0 0x7f65440d0a50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f654406c0d0 tx=0x7f653c00b330 comp rx=0 tx=0).stop 2023-07-24T05:45:43.530 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.528+0000 7f654adea700 1 -- 172.21.15.103:0/1646475453 shutdown_connections 2023-07-24T05:45:43.531 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.528+0000 7f654adea700 1 --2- 172.21.15.103:0/1646475453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f654415cea0 0x7f65440d0a50 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:43.531 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.528+0000 7f654adea700 1 --2- 172.21.15.103:0/1646475453 >> v2:172.21.15.77:3300/0 conn(0x7f65440b5fa0 0x7f65440d0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:43.531 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.528+0000 7f654adea700 1 -- 172.21.15.103:0/1646475453 >> 172.21.15.103:0/1646475453 conn(0x7f654409bb90 msgr2=0x7f65440b5890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:43.531 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.528+0000 7f654adea700 1 -- 172.21.15.103:0/1646475453 shutdown_connections 2023-07-24T05:45:43.531 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.528+0000 7f654adea700 1 -- 172.21.15.103:0/1646475453 wait complete. 2023-07-24T05:45:43.532 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.528+0000 7f654adea700 1 Processor -- start 2023-07-24T05:45:43.532 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.528+0000 7f654adea700 1 -- start start 2023-07-24T05:45:43.533 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.532+0000 7f654adea700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65440b5fa0 0x7f65440d1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:43.533 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.532+0000 7f654adea700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f654415cac0 0x7f65440d1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:43.534 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.532+0000 7f654adea700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f654415cea0 0x7f65440c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:43.534 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.532+0000 7f654adea700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654414ee50 con 0x7f65440b5fa0 2023-07-24T05:45:43.534 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.532+0000 7f654adea700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654414f2e0 con 0x7f654415cea0 2023-07-24T05:45:43.534 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.532+0000 7f654adea700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f654414e240 con 0x7f654415cac0 2023-07-24T05:45:43.534 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.532+0000 7f6543fff700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f654415cac0 0x7f65440d1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:43.534 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.532+0000 7f6543fff700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f654415cac0 0x7f65440d1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.103:44260/0 (socket says 172.21.15.103:44260) 2023-07-24T05:45:43.534 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.532+0000 7f6543fff700 1 -- 172.21.15.103:0/3900256483 learned_addr learned my addr 172.21.15.103:0/3900256483 (peer_addr_for_me v2:172.21.15.103:0/0) 2023-07-24T05:45:43.535 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.532+0000 7f6549387700 1 --2- 172.21.15.103:0/3900256483 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f654415cea0 0x7f65440c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:43.536 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.532+0000 7f6548b86700 1 --2- 172.21.15.103:0/3900256483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65440b5fa0 0x7f65440d1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:43.536 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.532+0000 7f6543fff700 1 -- 172.21.15.103:0/3900256483 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f654415cea0 msgr2=0x7f65440c74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:43.536 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.532+0000 7f6543fff700 1 --2- 172.21.15.103:0/3900256483 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f654415cea0 0x7f65440c74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:43.536 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.532+0000 7f6543fff700 1 -- 172.21.15.103:0/3900256483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65440b5fa0 msgr2=0x7f65440d1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:43.536 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.532+0000 7f6543fff700 1 --2- 172.21.15.103:0/3900256483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65440b5fa0 0x7f65440d1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:43.536 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.532+0000 7f6543fff700 1 -- 172.21.15.103:0/3900256483 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f653c009b30 con 0x7f654415cac0 2023-07-24T05:45:43.537 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.532+0000 7f6548b86700 1 --2- 172.21.15.103:0/3900256483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65440b5fa0 0x7f65440d1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:45:43.537 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.532+0000 7f6543fff700 1 --2- 172.21.15.103:0/3900256483 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f654415cac0 0x7f65440d1bb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f653000e9d0 tx=0x7f653000ed90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:43.537 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.532+0000 7f65417fa700 1 -- 172.21.15.103:0/3900256483 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6530009720 con 0x7f654415cac0 2023-07-24T05:45:43.537 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.532+0000 7f65417fa700 1 -- 172.21.15.103:0/3900256483 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f653000c850 con 0x7f654415cac0 2023-07-24T05:45:43.537 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.532+0000 7f654adea700 1 -- 172.21.15.103:0/3900256483 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f654414e520 con 0x7f654415cac0 2023-07-24T05:45:43.537 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.532+0000 7f65417fa700 1 -- 172.21.15.103:0/3900256483 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653000cbc0 con 0x7f654415cac0 2023-07-24T05:45:43.537 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.532+0000 7f654adea700 1 -- 172.21.15.103:0/3900256483 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f654414eae0 con 0x7f654415cac0 2023-07-24T05:45:43.538 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.532+0000 7f65417fa700 1 -- 172.21.15.103:0/3900256483 <== mon.2 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6530005d40 con 0x7f654415cac0 2023-07-24T05:45:43.538 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.532+0000 7f65417fa700 1 -- 172.21.15.103:0/3900256483 <== mon.2 v2:172.21.15.103:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f653000cd20 con 0x7f654415cac0 2023-07-24T05:45:43.538 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.532+0000 7f654adea700 1 -- 172.21.15.103:0/3900256483 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f654404df10 con 0x7f654415cac0 2023-07-24T05:45:43.538 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.536+0000 7f65417fa700 1 -- 172.21.15.103:0/3900256483 <== mon.2 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f6530021060 con 0x7f654415cac0 2023-07-24T05:45:43.557 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-07-24T05:45:43.555+0000 7ff3d14c32c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-24T05:45:43.642 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.640+0000 7f654adea700 1 -- 172.21.15.103:0/3900256483 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d5fe4fb6-2e09-4158-885b-403803c85822", "id": 7} v 0) v1 -- 0x7f654409c070 con 0x7f654415cac0 2023-07-24T05:45:43.653 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.652+0000 7f65417fa700 1 -- 172.21.15.103:0/3900256483 <== mon.2 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d5fe4fb6-2e09-4158-885b-403803c85822", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6530017070 con 0x7f654415cac0 2023-07-24T05:45:43.653 INFO:teuthology.orchestra.run.smithi103.stdout:7 2023-07-24T05:45:43.654 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.652+0000 7f654adea700 1 -- 172.21.15.103:0/3900256483 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f654415cac0 msgr2=0x7f65440d1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:43.654 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.652+0000 7f654adea700 1 --2- 172.21.15.103:0/3900256483 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f654415cac0 0x7f65440d1bb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f653000e9d0 tx=0x7f653000ed90 comp rx=0 tx=0).stop 2023-07-24T05:45:43.655 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.652+0000 7f654adea700 1 -- 172.21.15.103:0/3900256483 shutdown_connections 2023-07-24T05:45:43.655 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.652+0000 7f654adea700 1 --2- 172.21.15.103:0/3900256483 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f654415cea0 0x7f65440c74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:43.655 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.652+0000 7f654adea700 1 --2- 172.21.15.103:0/3900256483 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f654415cac0 0x7f65440d1bb0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:43.656 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.652+0000 7f654adea700 1 --2- 172.21.15.103:0/3900256483 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65440b5fa0 0x7f65440d1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:43.656 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.652+0000 7f654adea700 1 -- 172.21.15.103:0/3900256483 >> 172.21.15.103:0/3900256483 conn(0x7f654409bb90 msgr2=0x7f65440b4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:43.656 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.652+0000 7f654adea700 1 -- 172.21.15.103:0/3900256483 shutdown_connections 2023-07-24T05:45:43.656 INFO:teuthology.orchestra.run.smithi103.stderr:2023-07-24T05:45:43.652+0000 7f654adea700 1 -- 172.21.15.103:0/3900256483 wait complete. 2023-07-24T05:45:43.673 INFO:tasks.ceph.osd.0:Restarting daemon 2023-07-24T05:45:43.673 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-07-24T05:45:43.679 INFO:tasks.ceph.osd.0:Started 2023-07-24T05:45:43.680 INFO:tasks.ceph.osd.1:Restarting daemon 2023-07-24T05:45:43.680 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-07-24T05:45:43.685 INFO:tasks.ceph.osd.1:Started 2023-07-24T05:45:43.685 INFO:tasks.ceph.osd.2:Restarting daemon 2023-07-24T05:45:43.685 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-07-24T05:45:43.690 INFO:tasks.ceph.osd.2:Started 2023-07-24T05:45:43.690 INFO:tasks.ceph.osd.3:Restarting daemon 2023-07-24T05:45:43.690 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-07-24T05:45:43.695 INFO:tasks.ceph.osd.3:Started 2023-07-24T05:45:43.696 INFO:tasks.ceph.osd.4:Restarting daemon 2023-07-24T05:45:43.696 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-07-24T05:45:43.703 INFO:tasks.ceph.osd.4:Started 2023-07-24T05:45:43.703 INFO:tasks.ceph.osd.5:Restarting daemon 2023-07-24T05:45:43.703 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-07-24T05:45:43.709 INFO:tasks.ceph.osd.5:Started 2023-07-24T05:45:43.709 INFO:tasks.ceph.osd.6:Restarting daemon 2023-07-24T05:45:43.710 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-07-24T05:45:43.713 INFO:tasks.ceph.osd.6:Started 2023-07-24T05:45:43.713 INFO:tasks.ceph.osd.7:Restarting daemon 2023-07-24T05:45:43.714 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-07-24T05:45:43.719 INFO:tasks.ceph.osd.7:Started 2023-07-24T05:45:43.719 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-24T05:45:43.729 INFO:tasks.ceph.mgr.x.smithi103.stderr:2023-07-24T05:45:43.728+0000 7f8a4db022c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-24T05:45:43.814 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-07-24T05:45:43.811+0000 7ff3d14c32c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-24T05:45:43.822 INFO:tasks.ceph.mgr.x.smithi103.stderr:2023-07-24T05:45:43.820+0000 7f8a4db022c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-24T05:45:43.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.891+0000 7f06b1588700 1 Processor -- start 2023-07-24T05:45:43.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.891+0000 7f06b1588700 1 -- start start 2023-07-24T05:45:43.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.891+0000 7f06b1588700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f06ac0a4580 0x7f06ac06fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:43.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.891+0000 7f06b1588700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f06ac069b10 0x7f06ac069fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:43.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.891+0000 7f06b1588700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06ac0adc40 con 0x7f06ac0b13c0 2023-07-24T05:45:43.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.891+0000 7f06b1588700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06ac06a4e0 con 0x7f06ac0a4580 2023-07-24T05:45:43.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.891+0000 7f06b1588700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac0adee0 con 0x7f06ac069b10 2023-07-24T05:45:43.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.891+0000 7f06a3fff700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f06ac0a4580 0x7f06ac06fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:43.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.891+0000 7f06a3fff700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f06ac0a4580 0x7f06ac06fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46612/0 (socket says 172.21.15.77:46612) 2023-07-24T05:45:43.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.891+0000 7f06a3fff700 1 -- 172.21.15.77:0/4071634059 learned_addr learned my addr 172.21.15.77:0/4071634059 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:45:43.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.891+0000 7f06abfff700 1 --1- 172.21.15.77:0/4071634059 >> v1:172.21.15.77:6789/0 conn(0x7f06ac0b13c0 0x7f06ac06adf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:39534/0 (socket says 172.21.15.77:39534) 2023-07-24T05:45:43.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.891+0000 7f06b0d87700 1 --2- 172.21.15.77:0/4071634059 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f06ac069b10 0x7f06ac069fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:43.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.891+0000 7f06a3fff700 1 -- 172.21.15.77:0/4071634059 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f06ac069b10 msgr2=0x7f06ac069fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:45:43.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.891+0000 7f06a3fff700 1 --2- 172.21.15.77:0/4071634059 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f06ac069b10 0x7f06ac069fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:43.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.891+0000 7f06a3fff700 1 -- 172.21.15.77:0/4071634059 >> v1:172.21.15.77:6789/0 conn(0x7f06ac0b13c0 legacy=0x7f06ac06adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:43.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.891+0000 7f06a3fff700 1 -- 172.21.15.77:0/4071634059 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ac0ae1c0 con 0x7f06ac0a4580 2023-07-24T05:45:43.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.891+0000 7f06b0d87700 1 --2- 172.21.15.77:0/4071634059 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f06ac069b10 0x7f06ac069fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:45:43.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.895+0000 7f06a3fff700 1 --2- 172.21.15.77:0/4071634059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06ac0a4580 0x7f06ac06fbe0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0694009910 tx=0x7f0694009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd6394d553f87b9 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:43.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.895+0000 7f06ab7fe700 1 -- 172.21.15.77:0/4071634059 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069400ba60 con 0x7f06ac0a4580 2023-07-24T05:45:43.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.895+0000 7f06ab7fe700 1 -- 172.21.15.77:0/4071634059 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069400bbc0 con 0x7f06ac0a4580 2023-07-24T05:45:43.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.895+0000 7f06ab7fe700 1 -- 172.21.15.77:0/4071634059 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0694009e60 con 0x7f06ac0a4580 2023-07-24T05:45:43.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.895+0000 7f06b1588700 1 -- 172.21.15.77:0/4071634059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06ac0a4580 msgr2=0x7f06ac06fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:43.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.895+0000 7f06b1588700 1 --2- 172.21.15.77:0/4071634059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06ac0a4580 0x7f06ac06fbe0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0694009910 tx=0x7f0694009c20 comp rx=0 tx=0).stop 2023-07-24T05:45:43.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.895+0000 7f06b1588700 1 -- 172.21.15.77:0/4071634059 shutdown_connections 2023-07-24T05:45:43.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.895+0000 7f06b1588700 1 --2- 172.21.15.77:0/4071634059 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f06ac069b10 0x7f06ac069fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:43.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.895+0000 7f06b1588700 1 --2- 172.21.15.77:0/4071634059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06ac0a4580 0x7f06ac06fbe0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:43.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.895+0000 7f06b1588700 1 -- 172.21.15.77:0/4071634059 >> 172.21.15.77:0/4071634059 conn(0x7f06ac0cacc0 msgr2=0x7f06ac0cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:43.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.895+0000 7f06b1588700 1 -- 172.21.15.77:0/4071634059 shutdown_connections 2023-07-24T05:45:43.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.895+0000 7f06b1588700 1 -- 172.21.15.77:0/4071634059 wait complete. 2023-07-24T05:45:43.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.899+0000 7f06b1588700 1 Processor -- start 2023-07-24T05:45:43.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.899+0000 7f06b1588700 1 -- start start 2023-07-24T05:45:43.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.899+0000 7f06b1588700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f06ac069b10 0x7f06ac0cc820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:43.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.899+0000 7f06b1588700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06ac0a4580 0x7f06ac1f4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:43.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.899+0000 7f06b1588700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06ac0b13c0 0x7f06ac070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:43.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.899+0000 7f06b1588700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac0ccd60 con 0x7f06ac0b13c0 2023-07-24T05:45:43.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.899+0000 7f06b1588700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac09a480 con 0x7f06ac0a4580 2023-07-24T05:45:43.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.899+0000 7f06b1588700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac098eb0 con 0x7f06ac069b10 2023-07-24T05:45:43.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.899+0000 7f06b0d87700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06ac0b13c0 0x7f06ac070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:43.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.899+0000 7f06b0d87700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06ac0b13c0 0x7f06ac070b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46622/0 (socket says 172.21.15.77:46622) 2023-07-24T05:45:43.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.899+0000 7f06b0d87700 1 -- 172.21.15.77:0/1368712786 learned_addr learned my addr 172.21.15.77:0/1368712786 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:45:43.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.899+0000 7f06abfff700 1 --2- 172.21.15.77:0/1368712786 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f06ac069b10 0x7f06ac0cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:43.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.899+0000 7f06a3fff700 1 --2- 172.21.15.77:0/1368712786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06ac0a4580 0x7f06ac1f4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:43.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.899+0000 7f06b0d87700 1 -- 172.21.15.77:0/1368712786 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f06ac069b10 msgr2=0x7f06ac0cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:43.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.899+0000 7f06b0d87700 1 --2- 172.21.15.77:0/1368712786 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f06ac069b10 0x7f06ac0cc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:43.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.899+0000 7f06b0d87700 1 -- 172.21.15.77:0/1368712786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06ac0a4580 msgr2=0x7f06ac1f4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:43.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.899+0000 7f06b0d87700 1 --2- 172.21.15.77:0/1368712786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06ac0a4580 0x7f06ac1f4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:43.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.899+0000 7f06b0d87700 1 -- 172.21.15.77:0/1368712786 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0694009570 con 0x7f06ac0b13c0 2023-07-24T05:45:43.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.899+0000 7f06a3fff700 1 --2- 172.21.15.77:0/1368712786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06ac0a4580 0x7f06ac1f4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:45:43.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.899+0000 7f06b0d87700 1 --2- 172.21.15.77:0/1368712786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06ac0b13c0 0x7f06ac070b30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f06a400cd50 tx=0x7f06a400a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:43.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.899+0000 7f06a97fa700 1 -- 172.21.15.77:0/1368712786 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a400cea0 con 0x7f06ac0b13c0 2023-07-24T05:45:43.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.899+0000 7f06a97fa700 1 -- 172.21.15.77:0/1368712786 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a400f480 con 0x7f06ac0b13c0 2023-07-24T05:45:43.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.899+0000 7f06a97fa700 1 -- 172.21.15.77:0/1368712786 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a400f810 con 0x7f06ac0b13c0 2023-07-24T05:45:43.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.899+0000 7f06b1588700 1 -- 172.21.15.77:0/1368712786 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06ac099190 con 0x7f06ac0b13c0 2023-07-24T05:45:43.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.903+0000 7f06b1588700 1 -- 172.21.15.77:0/1368712786 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06ac099750 con 0x7f06ac0b13c0 2023-07-24T05:45:43.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.903+0000 7f06a97fa700 1 -- 172.21.15.77:0/1368712786 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f06a400b040 con 0x7f06ac0b13c0 2023-07-24T05:45:43.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.903+0000 7f06a97fa700 1 -- 172.21.15.77:0/1368712786 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f06a4018ca0 con 0x7f06ac0b13c0 2023-07-24T05:45:43.908 INFO:tasks.ceph.mgr.x.smithi103.stderr:2023-07-24T05:45:43.904+0000 7f8a4db022c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-24T05:45:43.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.903+0000 7f06b1588700 1 -- 172.21.15.77:0/1368712786 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06ac0ae480 con 0x7f06ac0b13c0 2023-07-24T05:45:43.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.907+0000 7f06a97fa700 1 -- 172.21.15.77:0/1368712786 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f06ac0ae480 con 0x7f06ac0b13c0 2023-07-24T05:45:43.917 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-07-24T05:45:43.911+0000 7ff3d14c32c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-24T05:45:43.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.975+0000 7f06b1588700 1 -- 172.21.15.77:0/1368712786 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06ac072490 con 0x7f06ac0b13c0 2023-07-24T05:45:43.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.975+0000 7f06a97fa700 1 -- 172.21.15.77:0/1368712786 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f06a4018e60 con 0x7f06ac0b13c0 2023-07-24T05:45:43.979 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:45:43.979 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":10,"fsid":"5aed5f7b-fb55-4d95-9c02-c6adbb1677b4","created":"2023-07-24T05:45:39.639731+0000","modified":"2023-07-24T05:45:43.643277+0000","last_up_change":"0.000000","last_in_change":"2023-07-24T05:45:43.643277+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ffa0d496-461a-4053-b764-0627d969521b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9f595e5e-5c43-49bc-8ce4-ee70575c90da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2ac177aa-4d7d-4262-bd54-d2b9f29f4c3c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"17d7a251-19e8-484c-8172-a578ab3da153","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"bf63ca05-f06d-4e0f-ac44-2a416c70b919","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"65a11a35-9e9f-4b3c-9fe3-b658d62b9318","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"750c1f87-686c-40b4-94a1-1a299dc78f3d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d5fe4fb6-2e09-4158-885b-403803c85822","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-24T05:45:43.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.975+0000 7f06b1588700 1 -- 172.21.15.77:0/1368712786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06ac0b13c0 msgr2=0x7f06ac070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:43.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.975+0000 7f06b1588700 1 --2- 172.21.15.77:0/1368712786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06ac0b13c0 0x7f06ac070b30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f06a400cd50 tx=0x7f06a400a560 comp rx=0 tx=0).stop 2023-07-24T05:45:43.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.975+0000 7f06b1588700 1 -- 172.21.15.77:0/1368712786 shutdown_connections 2023-07-24T05:45:43.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.975+0000 7f06b1588700 1 --2- 172.21.15.77:0/1368712786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06ac0b13c0 0x7f06ac070b30 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:43.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.975+0000 7f06b1588700 1 --2- 172.21.15.77:0/1368712786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06ac0a4580 0x7f06ac1f4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:43.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.975+0000 7f06b1588700 1 --2- 172.21.15.77:0/1368712786 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f06ac069b10 0x7f06ac0cc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:43.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.979+0000 7f06b1588700 1 -- 172.21.15.77:0/1368712786 >> 172.21.15.77:0/1368712786 conn(0x7f06ac0cacc0 msgr2=0x7f06ac06ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:43.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.979+0000 7f06b1588700 1 -- 172.21.15.77:0/1368712786 shutdown_connections 2023-07-24T05:45:43.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:43.979+0000 7f06b1588700 1 -- 172.21.15.77:0/1368712786 wait complete. 2023-07-24T05:45:43.997 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-07-24T05:45:43.995+0000 7ff3d14c32c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-24T05:45:44.004 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-07-24T05:45:44.004 INFO:tasks.ceph:Waiting for OSDs to come up 2023-07-24T05:45:44.359 INFO:tasks.ceph.osd.1.smithi077.stderr:2023-07-24T05:45:44.355+0000 7fedeb5a9700 -1 Falling back to public interface 2023-07-24T05:45:44.376 INFO:tasks.ceph.osd.7.smithi103.stderr:2023-07-24T05:45:44.372+0000 7f5b51d5f700 -1 Falling back to public interface 2023-07-24T05:45:44.376 INFO:tasks.ceph.osd.0.smithi077.stderr:2023-07-24T05:45:44.371+0000 7f70a04bf700 -1 Falling back to public interface 2023-07-24T05:45:44.377 INFO:tasks.ceph.osd.3.smithi077.stderr:2023-07-24T05:45:44.371+0000 7f28476f5700 -1 Falling back to public interface 2023-07-24T05:45:44.377 INFO:tasks.ceph.osd.2.smithi077.stderr:2023-07-24T05:45:44.371+0000 7fd310e6a700 -1 Falling back to public interface 2023-07-24T05:45:44.377 INFO:tasks.ceph.osd.0.smithi077.stderr:2023-07-24T05:45:44.375+0000 7f709f48a700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6809/0: (98) Address already in use 2023-07-24T05:45:44.387 INFO:tasks.ceph.osd.6.smithi103.stderr:2023-07-24T05:45:44.384+0000 7f548c749700 -1 Falling back to public interface 2023-07-24T05:45:44.387 INFO:tasks.ceph.osd.5.smithi103.stderr:2023-07-24T05:45:44.384+0000 7f21f0ef2700 -1 Falling back to public interface 2023-07-24T05:45:44.403 INFO:tasks.ceph.osd.4.smithi103.stderr:2023-07-24T05:45:44.400+0000 7f7101472700 -1 Falling back to public interface 2023-07-24T05:45:44.763 INFO:tasks.ceph.mgr.x.smithi103.stderr:2023-07-24T05:45:44.760+0000 7f8a4db022c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-24T05:45:44.808 DEBUG:teuthology.orchestra.run.smithi077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-24T05:45:44.858 INFO:tasks.ceph.mgr.x.smithi103.stderr:2023-07-24T05:45:44.856+0000 7f8a4db022c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-24T05:45:44.861 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-07-24T05:45:44.855+0000 7ff3d14c32c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-24T05:45:44.949 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-07-24T05:45:44.947+0000 7ff3d14c32c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-24T05:45:44.957 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.955+0000 7fe3d5a03700 1 Processor -- start 2023-07-24T05:45:44.957 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.955+0000 7fe3d5a03700 1 -- start start 2023-07-24T05:45:44.959 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.955+0000 7fe3d5a03700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe3d015cc10 0x7fe3d00d1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:44.959 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.955+0000 7fe3d5a03700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3d00b1950 0x7fe3d00cf080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:44.960 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.955+0000 7fe3d5a03700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3d00b82a0 con 0x7fe3d015cff0 2023-07-24T05:45:44.960 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.955+0000 7fe3d5a03700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3d00b7690 con 0x7fe3d015cc10 2023-07-24T05:45:44.960 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.955+0000 7fe3d5a03700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d00b7970 con 0x7fe3d00b1950 2023-07-24T05:45:44.960 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.955+0000 7fe3d4a01700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe3d015cc10 0x7fe3d00d1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:44.961 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.955+0000 7fe3d4a01700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe3d015cc10 0x7fe3d00d1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46638/0 (socket says 172.21.15.77:46638) 2023-07-24T05:45:44.961 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.955+0000 7fe3d4a01700 1 -- 172.21.15.77:0/3927289545 learned_addr learned my addr 172.21.15.77:0/3927289545 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:45:44.961 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.955+0000 7fe3d5202700 1 --2- 172.21.15.77:0/3927289545 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3d00b1950 0x7fe3d00cf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:44.962 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.955+0000 7fe3d4a01700 1 -- 172.21.15.77:0/3927289545 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3d00b1950 msgr2=0x7fe3d00cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:45:44.962 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.955+0000 7fe3d4a01700 1 --2- 172.21.15.77:0/3927289545 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3d00b1950 0x7fe3d00cf080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:44.962 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.959+0000 7fe3d4a01700 1 -- 172.21.15.77:0/3927289545 >> v1:172.21.15.103:6789/0 conn(0x7fe3d015cff0 legacy=0x7fe3d00b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:44.962 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.959+0000 7fe3d4a01700 1 -- 172.21.15.77:0/3927289545 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3d00b7c50 con 0x7fe3d015cc10 2023-07-24T05:45:44.962 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.959+0000 7fe3d5202700 1 --2- 172.21.15.77:0/3927289545 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3d00b1950 0x7fe3d00cf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:45:44.962 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.959+0000 7fe3d4a01700 1 --2- 172.21.15.77:0/3927289545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3d015cc10 0x7fe3d00d1d90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4009900 tx=0x7fe3c4009c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e01ccaed042da787 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:44.962 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.959+0000 7fe3cf7fe700 1 -- 172.21.15.77:0/3927289545 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c400ba60 con 0x7fe3d015cc10 2023-07-24T05:45:44.963 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.959+0000 7fe3cf7fe700 1 -- 172.21.15.77:0/3927289545 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c400bbc0 con 0x7fe3d015cc10 2023-07-24T05:45:44.963 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.959+0000 7fe3cf7fe700 1 -- 172.21.15.77:0/3927289545 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c4009e50 con 0x7fe3d015cc10 2023-07-24T05:45:44.963 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.959+0000 7fe3d5a03700 1 -- 172.21.15.77:0/3927289545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3d015cc10 msgr2=0x7fe3d00d1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:44.964 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.959+0000 7fe3d5a03700 1 --2- 172.21.15.77:0/3927289545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3d015cc10 0x7fe3d00d1d90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4009900 tx=0x7fe3c4009c10 comp rx=0 tx=0).stop 2023-07-24T05:45:44.964 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.959+0000 7fe3d5a03700 1 -- 172.21.15.77:0/3927289545 shutdown_connections 2023-07-24T05:45:44.964 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.959+0000 7fe3d5a03700 1 --2- 172.21.15.77:0/3927289545 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3d00b1950 0x7fe3d00cf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:44.964 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.959+0000 7fe3d5a03700 1 --2- 172.21.15.77:0/3927289545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3d015cc10 0x7fe3d00d1d90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:44.964 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.959+0000 7fe3d5a03700 1 -- 172.21.15.77:0/3927289545 >> 172.21.15.77:0/3927289545 conn(0x7fe3d00d26f0 msgr2=0x7fe3d00d2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:44.964 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.959+0000 7fe3d5a03700 1 -- 172.21.15.77:0/3927289545 shutdown_connections 2023-07-24T05:45:44.964 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.959+0000 7fe3d5a03700 1 -- 172.21.15.77:0/3927289545 wait complete. 2023-07-24T05:45:44.966 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.963+0000 7fe3d5a03700 1 Processor -- start 2023-07-24T05:45:44.966 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.963+0000 7fe3d5a03700 1 -- start start 2023-07-24T05:45:44.968 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.963+0000 7fe3d5a03700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3d00b1950 0x7fe3d015b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:44.969 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.963+0000 7fe3d5a03700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3d015cc10 0x7fe3d00cae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:44.969 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.963+0000 7fe3d5a03700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3d015cff0 0x7fe3d00c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:44.969 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.963+0000 7fe3d5a03700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d015b580 con 0x7fe3d00b1950 2023-07-24T05:45:44.969 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.963+0000 7fe3d5a03700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d00c90b0 con 0x7fe3d015cc10 2023-07-24T05:45:44.969 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.963+0000 7fe3d5a03700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3d00c8dd0 con 0x7fe3d015cff0 2023-07-24T05:45:44.970 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.967+0000 7fe3d4a01700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3d00b1950 0x7fe3d015b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:44.970 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.967+0000 7fe3d5202700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3d015cff0 0x7fe3d00c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:44.970 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.967+0000 7fe3d4a01700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3d00b1950 0x7fe3d015b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46646/0 (socket says 172.21.15.77:46646) 2023-07-24T05:45:44.970 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.967+0000 7fe3d4a01700 1 -- 172.21.15.77:0/4156769387 learned_addr learned my addr 172.21.15.77:0/4156769387 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:45:44.971 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.967+0000 7fe3cffff700 1 --2- 172.21.15.77:0/4156769387 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3d015cc10 0x7fe3d00cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:44.971 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.967+0000 7fe3d4a01700 1 -- 172.21.15.77:0/4156769387 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3d015cff0 msgr2=0x7fe3d00c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:44.971 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.967+0000 7fe3d4a01700 1 --2- 172.21.15.77:0/4156769387 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3d015cff0 0x7fe3d00c83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:44.971 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.967+0000 7fe3d4a01700 1 -- 172.21.15.77:0/4156769387 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3d015cc10 msgr2=0x7fe3d00cae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:44.971 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.967+0000 7fe3d4a01700 1 --2- 172.21.15.77:0/4156769387 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3d015cc10 0x7fe3d00cae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:44.971 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.967+0000 7fe3d4a01700 1 -- 172.21.15.77:0/4156769387 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c4009510 con 0x7fe3d00b1950 2023-07-24T05:45:44.971 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.967+0000 7fe3d5202700 1 --2- 172.21.15.77:0/4156769387 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3d015cff0 0x7fe3d00c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:45:44.972 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.967+0000 7fe3d4a01700 1 --2- 172.21.15.77:0/4156769387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3d00b1950 0x7fe3d015b040 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4009c50 tx=0x7fe3c4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:44.973 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.967+0000 7fe3cd7fa700 1 -- 172.21.15.77:0/4156769387 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c4011970 con 0x7fe3d00b1950 2023-07-24T05:45:44.973 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.967+0000 7fe3cd7fa700 1 -- 172.21.15.77:0/4156769387 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c401f070 con 0x7fe3d00b1950 2023-07-24T05:45:44.973 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.967+0000 7fe3d5a03700 1 -- 172.21.15.77:0/4156769387 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3d00c6350 con 0x7fe3d00b1950 2023-07-24T05:45:44.973 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.967+0000 7fe3cd7fa700 1 -- 172.21.15.77:0/4156769387 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c4011d10 con 0x7fe3d00b1950 2023-07-24T05:45:44.973 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.967+0000 7fe3d5a03700 1 -- 172.21.15.77:0/4156769387 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3d00c6910 con 0x7fe3d00b1950 2023-07-24T05:45:44.973 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.967+0000 7fe3cd7fa700 1 -- 172.21.15.77:0/4156769387 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe3c4026780 con 0x7fe3d00b1950 2023-07-24T05:45:44.973 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.967+0000 7fe3cd7fa700 1 -- 172.21.15.77:0/4156769387 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fe3c4021070 con 0x7fe3d00b1950 2023-07-24T05:45:44.973 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.967+0000 7fe3d5a03700 1 -- 172.21.15.77:0/4156769387 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3d004e7b0 con 0x7fe3d00b1950 2023-07-24T05:45:44.975 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:44.971+0000 7fe3cd7fa700 1 -- 172.21.15.77:0/4156769387 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fe3c4046b00 con 0x7fe3d00b1950 2023-07-24T05:45:45.040 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:45.035+0000 7fe3d5a03700 1 -- 172.21.15.77:0/4156769387 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3d004df10 con 0x7fe3d00b1950 2023-07-24T05:45:45.041 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:45.039+0000 7fe3cd7fa700 1 -- 172.21.15.77:0/4156769387 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fe3c4035030 con 0x7fe3d00b1950 2023-07-24T05:45:45.041 INFO:teuthology.misc.health.smithi077.stdout: 2023-07-24T05:45:45.041 INFO:teuthology.misc.health.smithi077.stdout:{"epoch":10,"fsid":"5aed5f7b-fb55-4d95-9c02-c6adbb1677b4","created":"2023-07-24T05:45:39.639731+0000","modified":"2023-07-24T05:45:43.643277+0000","last_up_change":"0.000000","last_in_change":"2023-07-24T05:45:43.643277+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ffa0d496-461a-4053-b764-0627d969521b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9f595e5e-5c43-49bc-8ce4-ee70575c90da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2ac177aa-4d7d-4262-bd54-d2b9f29f4c3c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"17d7a251-19e8-484c-8172-a578ab3da153","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"bf63ca05-f06d-4e0f-ac44-2a416c70b919","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"65a11a35-9e9f-4b3c-9fe3-b658d62b9318","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"750c1f87-686c-40b4-94a1-1a299dc78f3d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d5fe4fb6-2e09-4158-885b-403803c85822","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-24T05:45:45.042 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:45.039+0000 7fe3d5a03700 1 -- 172.21.15.77:0/4156769387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3d00b1950 msgr2=0x7fe3d015b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:45.042 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:45.039+0000 7fe3d5a03700 1 --2- 172.21.15.77:0/4156769387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3d00b1950 0x7fe3d015b040 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4009c50 tx=0x7fe3c4004770 comp rx=0 tx=0).stop 2023-07-24T05:45:45.043 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:45.039+0000 7fe3d5a03700 1 -- 172.21.15.77:0/4156769387 shutdown_connections 2023-07-24T05:45:45.043 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:45.039+0000 7fe3d5a03700 1 --2- 172.21.15.77:0/4156769387 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3d015cff0 0x7fe3d00c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:45.043 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:45.039+0000 7fe3d5a03700 1 --2- 172.21.15.77:0/4156769387 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3d015cc10 0x7fe3d00cae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:45.043 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:45.039+0000 7fe3d5a03700 1 --2- 172.21.15.77:0/4156769387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3d00b1950 0x7fe3d015b040 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:45.043 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:45.039+0000 7fe3d5a03700 1 -- 172.21.15.77:0/4156769387 >> 172.21.15.77:0/4156769387 conn(0x7fe3d00d26f0 msgr2=0x7fe3d015bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:45.043 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:45.039+0000 7fe3d5a03700 1 -- 172.21.15.77:0/4156769387 shutdown_connections 2023-07-24T05:45:45.043 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:45.039+0000 7fe3d5a03700 1 -- 172.21.15.77:0/4156769387 wait complete. 2023-07-24T05:45:45.051 INFO:tasks.ceph.mgr.x.smithi103.stderr:2023-07-24T05:45:45.048+0000 7f8a4db022c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-24T05:45:45.058 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-07-24T05:45:45.123 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-07-24T05:45:45.119+0000 7ff3d14c32c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-24T05:45:45.141 INFO:tasks.ceph.mgr.x.smithi103.stderr:2023-07-24T05:45:45.140+0000 7f8a4db022c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-24T05:45:45.205 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-07-24T05:45:45.203+0000 7ff3d14c32c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-24T05:45:45.241 INFO:tasks.ceph.mgr.x.smithi103.stderr:2023-07-24T05:45:45.240+0000 7f8a4db022c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-24T05:45:45.301 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-07-24T05:45:45.299+0000 7ff3d14c32c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-24T05:45:45.463 INFO:tasks.ceph.mgr.x.smithi103.stderr:2023-07-24T05:45:45.460+0000 7f8a4db022c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-24T05:45:45.502 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-07-24T05:45:45.499+0000 7ff3d14c32c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-24T05:45:45.720 INFO:tasks.ceph.mgr.x.smithi103.stderr:2023-07-24T05:45:45.716+0000 7f8a4db022c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-24T05:45:45.750 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-07-24T05:45:45.747+0000 7ff3d14c32c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-24T05:45:46.498 INFO:tasks.ceph.mgr.x.smithi103.stderr:2023-07-24T05:45:46.496+0000 7f8a4db022c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-24T05:45:46.546 INFO:tasks.ceph.mgr.y.smithi077.stderr:2023-07-24T05:45:46.543+0000 7ff3d14c32c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-24T05:45:47.537 INFO:tasks.ceph.mgr.x.smithi103.stderr:2023-07-24T05:45:47.536+0000 7f8a34d32700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-07-24T05:45:47.538 INFO:tasks.ceph.mgr.x.smithi103.stderr:2023-07-24T05:45:47.536+0000 7f8a34d32700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-07-24T05:45:48.165 INFO:tasks.ceph.osd.7.smithi103.stderr:2023-07-24T05:45:48.160+0000 7f5b51d5f700 -1 osd.7 0 log_to_monitors true 2023-07-24T05:45:48.171 INFO:tasks.ceph.osd.1.smithi077.stderr:2023-07-24T05:45:48.167+0000 7fedeb5a9700 -1 osd.1 0 log_to_monitors true 2023-07-24T05:45:48.269 INFO:tasks.ceph.osd.6.smithi103.stderr:2023-07-24T05:45:48.268+0000 7f548c749700 -1 osd.6 0 log_to_monitors true 2023-07-24T05:45:48.338 INFO:tasks.ceph.osd.4.smithi103.stderr:2023-07-24T05:45:48.336+0000 7f7101472700 -1 osd.4 0 log_to_monitors true 2023-07-24T05:45:48.350 INFO:tasks.ceph.osd.5.smithi103.stderr:2023-07-24T05:45:48.348+0000 7f21f0ef2700 -1 osd.5 0 log_to_monitors true 2023-07-24T05:45:48.440 INFO:tasks.ceph.osd.2.smithi077.stderr:2023-07-24T05:45:48.435+0000 7fd310e6a700 -1 osd.2 0 log_to_monitors true 2023-07-24T05:45:48.606 INFO:tasks.ceph.osd.0.smithi077.stderr:2023-07-24T05:45:48.603+0000 7f70a04bf700 -1 osd.0 0 log_to_monitors true 2023-07-24T05:45:48.656 INFO:tasks.ceph.osd.3.smithi077.stderr:2023-07-24T05:45:48.651+0000 7f28476f5700 -1 osd.3 0 log_to_monitors true 2023-07-24T05:45:51.317 INFO:tasks.ceph.osd.2.smithi077.stderr:2023-07-24T05:45:51.315+0000 7fd30cca9700 -1 osd.2 0 waiting for initial osdmap 2023-07-24T05:45:51.341 INFO:tasks.ceph.osd.2.smithi077.stderr:2023-07-24T05:45:51.339+0000 7fd3045f0700 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-24T05:45:51.361 INFO:tasks.ceph.osd.1.smithi077.stderr:2023-07-24T05:45:51.359+0000 7fede73e8700 -1 osd.1 0 waiting for initial osdmap 2023-07-24T05:45:51.377 INFO:tasks.ceph.osd.1.smithi077.stderr:2023-07-24T05:45:51.371+0000 7feddedf0700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-24T05:45:51.863 DEBUG:teuthology.orchestra.run.smithi077:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-24T05:45:51.892 INFO:tasks.ceph.osd.5.smithi103.stderr:2023-07-24T05:45:51.888+0000 7f21ecd31700 -1 osd.5 0 waiting for initial osdmap 2023-07-24T05:45:51.908 INFO:tasks.ceph.osd.5.smithi103.stderr:2023-07-24T05:45:51.904+0000 7f21e47f0700 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-24T05:45:51.950 INFO:tasks.ceph.osd.6.smithi103.stderr:2023-07-24T05:45:51.944+0000 7f5488588700 -1 osd.6 0 waiting for initial osdmap 2023-07-24T05:45:51.970 INFO:tasks.ceph.osd.6.smithi103.stderr:2023-07-24T05:45:51.968+0000 7f547fff0700 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-24T05:45:52.047 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.043+0000 7f905759e700 1 Processor -- start 2023-07-24T05:45:52.047 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.043+0000 7f905759e700 1 -- start start 2023-07-24T05:45:52.048 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.047+0000 7f905759e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f905816dd60 0x7f90580afdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:52.049 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.047+0000 7f905759e700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90580adb80 con 0x7f90580b16c0 2023-07-24T05:45:52.049 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.047+0000 7f905759e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90580ade60 con 0x7f90580afa10 2023-07-24T05:45:52.050 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.047+0000 7f905759e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9058089c90 con 0x7f905816dd60 2023-07-24T05:45:52.050 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.047+0000 7f9056d9d700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f90580b16c0 0x7f90580b1ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:39538/0 (socket says 172.21.15.77:39538) 2023-07-24T05:45:52.050 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.047+0000 7f9056d9d700 1 -- 172.21.15.77:0/1951568358 learned_addr learned my addr 172.21.15.77:0/1951568358 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:45:52.050 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.047+0000 7f9055d9b700 1 --2- 172.21.15.77:0/1951568358 >> v2:172.21.15.103:3300/0 conn(0x7f905816dd60 0x7f90580afdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:52.050 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.047+0000 7f9055d9b700 1 -- 172.21.15.77:0/1951568358 >> v1:172.21.15.103:6789/0 conn(0x7f90580afa10 legacy=0x7f90580abfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:45:52.051 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.047+0000 7f9055d9b700 1 -- 172.21.15.77:0/1951568358 >> v1:172.21.15.77:6789/0 conn(0x7f90580b16c0 legacy=0x7f90580b1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:52.051 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.047+0000 7f9055d9b700 1 -- 172.21.15.77:0/1951568358 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90580ae140 con 0x7f905816dd60 2023-07-24T05:45:52.051 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.047+0000 7f9055d9b700 1 --2- 172.21.15.77:0/1951568358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f905816dd60 0x7f90580afdf0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f904c009850 tx=0x7f904c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68bfa76d5a14e032 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:52.051 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.047+0000 7f905559a700 1 -- 172.21.15.77:0/1951568358 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904c004230 con 0x7f905816dd60 2023-07-24T05:45:52.052 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.047+0000 7f905559a700 1 -- 172.21.15.77:0/1951568358 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f904c004390 con 0x7f905816dd60 2023-07-24T05:45:52.052 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.047+0000 7f905559a700 1 -- 172.21.15.77:0/1951568358 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904c0036c0 con 0x7f905816dd60 2023-07-24T05:45:52.053 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.051+0000 7f905759e700 1 -- 172.21.15.77:0/1951568358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f905816dd60 msgr2=0x7f90580afdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:52.053 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.051+0000 7f905759e700 1 --2- 172.21.15.77:0/1951568358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f905816dd60 0x7f90580afdf0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f904c009850 tx=0x7f904c009b60 comp rx=0 tx=0).stop 2023-07-24T05:45:52.053 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.051+0000 7f905759e700 1 -- 172.21.15.77:0/1951568358 shutdown_connections 2023-07-24T05:45:52.053 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.051+0000 7f905759e700 1 --2- 172.21.15.77:0/1951568358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f905816dd60 0x7f90580afdf0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:52.054 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.051+0000 7f905759e700 1 -- 172.21.15.77:0/1951568358 >> 172.21.15.77:0/1951568358 conn(0x7f90580b3940 msgr2=0x7f90580caca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:52.054 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.051+0000 7f905759e700 1 -- 172.21.15.77:0/1951568358 shutdown_connections 2023-07-24T05:45:52.054 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.051+0000 7f905759e700 1 -- 172.21.15.77:0/1951568358 wait complete. 2023-07-24T05:45:52.056 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.051+0000 7f905759e700 1 Processor -- start 2023-07-24T05:45:52.056 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.051+0000 7f905759e700 1 -- start start 2023-07-24T05:45:52.058 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.055+0000 7f905759e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f90580afa10 0x7f90581feea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:52.059 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.055+0000 7f905759e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90580b16c0 0x7f905809a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:52.059 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.055+0000 7f905759e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f905816dd60 0x7f905809aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:52.059 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.055+0000 7f905759e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90580ae800 con 0x7f90580b16c0 2023-07-24T05:45:52.059 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.055+0000 7f905759e700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90581ff7a0 con 0x7f905816dd60 2023-07-24T05:45:52.060 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.055+0000 7f905759e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90581ffa80 con 0x7f90580afa10 2023-07-24T05:45:52.060 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.055+0000 7f9055d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90580b16c0 0x7f905809a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:52.061 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.055+0000 7f9055d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90580b16c0 0x7f905809a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46702/0 (socket says 172.21.15.77:46702) 2023-07-24T05:45:52.061 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.055+0000 7f9055d9b700 1 -- 172.21.15.77:0/3480133419 learned_addr learned my addr 172.21.15.77:0/3480133419 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:45:52.061 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.055+0000 7f905659c700 1 --2- 172.21.15.77:0/3480133419 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f90580afa10 0x7f90581feea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:52.061 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.055+0000 7f9056d9d700 1 --2- 172.21.15.77:0/3480133419 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f905816dd60 0x7f905809aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:52.061 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.055+0000 7f9055d9b700 1 -- 172.21.15.77:0/3480133419 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f90580afa10 msgr2=0x7f90581feea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:52.061 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.055+0000 7f9055d9b700 1 --2- 172.21.15.77:0/3480133419 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f90580afa10 0x7f90581feea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:52.062 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.055+0000 7f9055d9b700 1 -- 172.21.15.77:0/3480133419 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f905816dd60 msgr2=0x7f905809aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:52.062 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.055+0000 7f9055d9b700 1 --2- 172.21.15.77:0/3480133419 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f905816dd60 0x7f905809aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:52.062 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.055+0000 7f9055d9b700 1 -- 172.21.15.77:0/3480133419 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f904c0094b0 con 0x7f90580b16c0 2023-07-24T05:45:52.062 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.055+0000 7f9055d9b700 1 --2- 172.21.15.77:0/3480133419 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90580b16c0 0x7f905809a960 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f904c000c00 tx=0x7f904c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:52.062 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.059+0000 7f9046ffd700 1 -- 172.21.15.77:0/3480133419 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904c011830 con 0x7f90580b16c0 2023-07-24T05:45:52.062 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.059+0000 7f905759e700 1 -- 172.21.15.77:0/3480133419 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90581ffd60 con 0x7f90580b16c0 2023-07-24T05:45:52.062 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.059+0000 7f9046ffd700 1 -- 172.21.15.77:0/3480133419 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f904c0119b0 con 0x7f90580b16c0 2023-07-24T05:45:52.062 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.059+0000 7f9046ffd700 1 -- 172.21.15.77:0/3480133419 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904c011d60 con 0x7f90580b16c0 2023-07-24T05:45:52.063 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.059+0000 7f905759e700 1 -- 172.21.15.77:0/3480133419 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90580c2030 con 0x7f90580b16c0 2023-07-24T05:45:52.063 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.059+0000 7f905759e700 1 -- 172.21.15.77:0/3480133419 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f905804df10 con 0x7f90580b16c0 2023-07-24T05:45:52.063 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.059+0000 7f9046ffd700 1 -- 172.21.15.77:0/3480133419 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 4) v1 ==== 85602+0+0 (secure 0 0 0) 0x7f904c01c420 con 0x7f90580b16c0 2023-07-24T05:45:52.064 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.059+0000 7f9046ffd700 1 --2- 172.21.15.77:0/3480133419 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f9038066260 0x7f9038068720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:52.065 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.059+0000 7f9046ffd700 1 -- 172.21.15.77:0/3480133419 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f904c084060 con 0x7f90580b16c0 2023-07-24T05:45:52.065 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.063+0000 7f905659c700 1 --2- 172.21.15.77:0/3480133419 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f9038066260 0x7f9038068720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:52.066 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.063+0000 7f905659c700 1 --2- 172.21.15.77:0/3480133419 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f9038066260 0x7f9038068720 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f905816b560 tx=0x7f9048009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:52.072 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.067+0000 7f9046ffd700 1 -- 172.21.15.77:0/3480133419 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f904c0524a0 con 0x7f90580b16c0 2023-07-24T05:45:52.140 INFO:tasks.ceph.osd.7.smithi103.stderr:2023-07-24T05:45:52.136+0000 7f5b4db9e700 -1 osd.7 0 waiting for initial osdmap 2023-07-24T05:45:52.140 INFO:tasks.ceph.osd.4.smithi103.stderr:2023-07-24T05:45:52.136+0000 7f70fd2b1700 -1 osd.4 0 waiting for initial osdmap 2023-07-24T05:45:52.149 INFO:tasks.ceph.osd.7.smithi103.stderr:2023-07-24T05:45:52.144+0000 7f5b455f0700 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-24T05:45:52.150 INFO:tasks.ceph.osd.4.smithi103.stderr:2023-07-24T05:45:52.148+0000 7f70f4bf0700 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-24T05:45:52.248 INFO:tasks.ceph.osd.0.smithi077.stderr:2023-07-24T05:45:52.243+0000 7f709c2fe700 -1 osd.0 0 waiting for initial osdmap 2023-07-24T05:45:52.260 INFO:tasks.ceph.osd.0.smithi077.stderr:2023-07-24T05:45:52.255+0000 7f7093bf0700 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-24T05:45:52.297 INFO:tasks.ceph.osd.3.smithi077.stderr:2023-07-24T05:45:52.295+0000 7f2843534700 -1 osd.3 0 waiting for initial osdmap 2023-07-24T05:45:52.310 INFO:tasks.ceph.osd.3.smithi077.stderr:2023-07-24T05:45:52.307+0000 7f283aff0700 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-24T05:45:52.328 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.323+0000 7f905759e700 1 -- 172.21.15.77:0/3480133419 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f905809a740 con 0x7f90580b16c0 2023-07-24T05:45:52.331 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.327+0000 7f9046ffd700 1 -- 172.21.15.77:0/3480133419 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10896 (secure 0 0 0) 0x7f904c016090 con 0x7f90580b16c0 2023-07-24T05:45:52.331 INFO:teuthology.misc.health.smithi077.stdout: 2023-07-24T05:45:52.331 INFO:teuthology.misc.health.smithi077.stdout:{"epoch":14,"fsid":"5aed5f7b-fb55-4d95-9c02-c6adbb1677b4","created":"2023-07-24T05:45:39.639731+0000","modified":"2023-07-24T05:45:52.319670+0000","last_up_change":"2023-07-24T05:45:52.319670+0000","last_in_change":"2023-07-24T05:45:43.643277+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ffa0d496-461a-4053-b764-0627d969521b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6812","nonce":825987196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6817","nonce":825987196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6831","nonce":825987196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6824","nonce":825987196}]},"public_addr":"172.21.15.77:6812/825987196","cluster_addr":"172.21.15.77:6817/825987196","heartbeat_back_addr":"172.21.15.77:6831/825987196","heartbeat_front_addr":"172.21.15.77:6824/825987196","state":["exists","up"]},{"osd":1,"uuid":"9f595e5e-5c43-49bc-8ce4-ee70575c90da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6801","nonce":4133026815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6803","nonce":4133026815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6807","nonce":4133026815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6805","nonce":4133026815}]},"public_addr":"172.21.15.77:6801/4133026815","cluster_addr":"172.21.15.77:6803/4133026815","heartbeat_back_addr":"172.21.15.77:6807/4133026815","heartbeat_front_addr":"172.21.15.77:6805/4133026815","state":["exists","up"]},{"osd":2,"uuid":"2ac177aa-4d7d-4262-bd54-d2b9f29f4c3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6811","nonce":2394142159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6819","nonce":2394142159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6830","nonce":2394142159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6825","nonce":2394142159}]},"public_addr":"172.21.15.77:6811/2394142159","cluster_addr":"172.21.15.77:6819/2394142159","heartbeat_back_addr":"172.21.15.77:6830/2394142159","heartbeat_front_addr":"172.21.15.77:6825/2394142159","state":["exists","up"]},{"osd":3,"uuid":"17d7a251-19e8-484c-8172-a578ab3da153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6813","nonce":1492113982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6818","nonce":1492113982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6829","nonce":1492113982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6823","nonce":1492113982}]},"public_addr":"172.21.15.77:6813/1492113982","cluster_addr":"172.21.15.77:6818/1492113982","heartbeat_back_addr":"172.21.15.77:6829/1492113982","heartbeat_front_addr":"172.21.15.77:6823/1492113982","state":["exists","up"]},{"osd":4,"uuid":"bf63ca05-f06d-4e0f-ac44-2a416c70b919","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6825","nonce":1080481057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6827","nonce":1080481057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6831","nonce":1080481057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6829","nonce":1080481057}]},"public_addr":"172.21.15.103:6825/1080481057","cluster_addr":"172.21.15.103:6827/1080481057","heartbeat_back_addr":"172.21.15.103:6831/1080481057","heartbeat_front_addr":"172.21.15.103:6829/1080481057","state":["exists","up"]},{"osd":5,"uuid":"65a11a35-9e9f-4b3c-9fe3-b658d62b9318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6811","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6813","nonce":2756677504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6818","nonce":2756677504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6823","nonce":2756677504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6821","nonce":2756677504}]},"public_addr":"172.21.15.103:6813/2756677504","cluster_addr":"172.21.15.103:6818/2756677504","heartbeat_back_addr":"172.21.15.103:6823/2756677504","heartbeat_front_addr":"172.21.15.103:6821/2756677504","state":["exists","up"]},{"osd":6,"uuid":"750c1f87-686c-40b4-94a1-1a299dc78f3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6809","nonce":568977764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6812","nonce":568977764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6819","nonce":568977764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6815","nonce":568977764}]},"public_addr":"172.21.15.103:6809/568977764","cluster_addr":"172.21.15.103:6812/568977764","heartbeat_back_addr":"172.21.15.103:6819/568977764","heartbeat_front_addr":"172.21.15.103:6815/568977764","state":["exists","up"]},{"osd":7,"uuid":"d5fe4fb6-2e09-4158-885b-403803c85822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6801","nonce":1074557176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6803","nonce":1074557176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6807","nonce":1074557176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6805","nonce":1074557176}]},"public_addr":"172.21.15.103:6801/1074557176","cluster_addr":"172.21.15.103:6803/1074557176","heartbeat_back_addr":"172.21.15.103:6807/1074557176","heartbeat_front_addr":"172.21.15.103:6805/1074557176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-24T05:45:52.335 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.331+0000 7f905759e700 1 -- 172.21.15.77:0/3480133419 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f9038066260 msgr2=0x7f9038068720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:52.335 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.331+0000 7f905759e700 1 --2- 172.21.15.77:0/3480133419 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f9038066260 0x7f9038068720 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f905816b560 tx=0x7f9048009040 comp rx=0 tx=0).stop 2023-07-24T05:45:52.335 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.331+0000 7f905759e700 1 -- 172.21.15.77:0/3480133419 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90580b16c0 msgr2=0x7f905809a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:52.336 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.331+0000 7f905759e700 1 --2- 172.21.15.77:0/3480133419 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90580b16c0 0x7f905809a960 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f904c000c00 tx=0x7f904c004770 comp rx=0 tx=0).stop 2023-07-24T05:45:52.336 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.331+0000 7f905759e700 1 -- 172.21.15.77:0/3480133419 shutdown_connections 2023-07-24T05:45:52.336 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.331+0000 7f905759e700 1 --2- 172.21.15.77:0/3480133419 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f905816dd60 0x7f905809aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:52.336 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.331+0000 7f905759e700 1 --2- 172.21.15.77:0/3480133419 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f90580b16c0 0x7f905809a960 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:52.336 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.331+0000 7f905759e700 1 --2- 172.21.15.77:0/3480133419 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f9038066260 0x7f9038068720 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:52.336 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.331+0000 7f905759e700 1 --2- 172.21.15.77:0/3480133419 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f90580afa10 0x7f90581feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:52.336 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.331+0000 7f905759e700 1 -- 172.21.15.77:0/3480133419 >> 172.21.15.77:0/3480133419 conn(0x7f90580b3940 msgr2=0x7f905816c410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:52.337 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.331+0000 7f905759e700 1 -- 172.21.15.77:0/3480133419 shutdown_connections 2023-07-24T05:45:52.337 INFO:teuthology.misc.health.smithi077.stderr:2023-07-24T05:45:52.331+0000 7f905759e700 1 -- 172.21.15.77:0/3480133419 wait complete. 2023-07-24T05:45:52.350 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-07-24T05:45:52.351 INFO:tasks.ceph:Creating RBD pool 2023-07-24T05:45:52.351 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd pool create rbd 8 2023-07-24T05:45:52.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.507+0000 7fd799268700 1 Processor -- start 2023-07-24T05:45:52.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.507+0000 7fd799268700 1 -- start start 2023-07-24T05:45:52.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.511+0000 7fd799268700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd79415c9a0 0x7fd79406d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:52.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.511+0000 7fd799268700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd79406bb60 0x7fd7940d0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:52.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.511+0000 7fd799268700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd7940d07d0 0x7fd7940cf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:52.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.511+0000 7fd799268700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7940cf170 con 0x7fd79415c9a0 2023-07-24T05:45:52.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.511+0000 7fd799268700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd79406b4d0 con 0x7fd7940d07d0 2023-07-24T05:45:52.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.511+0000 7fd799268700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd79406ac30 con 0x7fd79406bb60 2023-07-24T05:45:52.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.511+0000 7fd793fff700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd79415c9a0 0x7fd79406d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:52.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.511+0000 7fd793fff700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd79415c9a0 0x7fd79406d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46706/0 (socket says 172.21.15.77:46706) 2023-07-24T05:45:52.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.511+0000 7fd793fff700 1 -- 172.21.15.77:0/977158291 learned_addr learned my addr 172.21.15.77:0/977158291 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:45:52.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.511+0000 7fd7937fe700 1 --2- 172.21.15.77:0/977158291 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd79406bb60 0x7fd7940d0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:52.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.511+0000 7fd798a67700 1 --2- 172.21.15.77:0/977158291 >> v2:172.21.15.103:3300/0 conn(0x7fd7940d07d0 0x7fd7940cf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:52.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.511+0000 7fd793fff700 1 -- 172.21.15.77:0/977158291 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd79406bb60 msgr2=0x7fd7940d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:45:52.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.511+0000 7fd793fff700 1 --2- 172.21.15.77:0/977158291 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd79406bb60 0x7fd7940d0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:52.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.511+0000 7fd793fff700 1 -- 172.21.15.77:0/977158291 >> v2:172.21.15.103:3300/0 conn(0x7fd7940d07d0 msgr2=0x7fd7940cf5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:45:52.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.511+0000 7fd793fff700 1 --2- 172.21.15.77:0/977158291 >> v2:172.21.15.103:3300/0 conn(0x7fd7940d07d0 0x7fd7940cf5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:52.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.511+0000 7fd793fff700 1 -- 172.21.15.77:0/977158291 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd79406af10 con 0x7fd79415c9a0 2023-07-24T05:45:52.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.511+0000 7fd793fff700 1 --2- 172.21.15.77:0/977158291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd79415c9a0 0x7fd79406d2d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd7940b4140 tx=0x7fd784009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcada0b86372b427 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:52.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.511+0000 7fd792ffd700 1 -- 172.21.15.77:0/977158291 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd784011830 con 0x7fd79415c9a0 2023-07-24T05:45:52.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.515+0000 7fd792ffd700 1 -- 172.21.15.77:0/977158291 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd784011990 con 0x7fd79415c9a0 2023-07-24T05:45:52.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.515+0000 7fd792ffd700 1 -- 172.21.15.77:0/977158291 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd784011d20 con 0x7fd79415c9a0 2023-07-24T05:45:52.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.515+0000 7fd799268700 1 -- 172.21.15.77:0/977158291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd79415c9a0 msgr2=0x7fd79406d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:52.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.515+0000 7fd799268700 1 --2- 172.21.15.77:0/977158291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd79415c9a0 0x7fd79406d2d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd7940b4140 tx=0x7fd784009bf0 comp rx=0 tx=0).stop 2023-07-24T05:45:52.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.515+0000 7fd799268700 1 -- 172.21.15.77:0/977158291 shutdown_connections 2023-07-24T05:45:52.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.515+0000 7fd799268700 1 --2- 172.21.15.77:0/977158291 >> v2:172.21.15.103:3300/0 conn(0x7fd7940d07d0 0x7fd7940cf5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:52.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.515+0000 7fd799268700 1 --2- 172.21.15.77:0/977158291 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd79406bb60 0x7fd7940d0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:52.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.515+0000 7fd799268700 1 --2- 172.21.15.77:0/977158291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd79415c9a0 0x7fd79406d2d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:52.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.515+0000 7fd799268700 1 -- 172.21.15.77:0/977158291 >> 172.21.15.77:0/977158291 conn(0x7fd7940b5610 msgr2=0x7fd7940b5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:52.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.515+0000 7fd799268700 1 -- 172.21.15.77:0/977158291 shutdown_connections 2023-07-24T05:45:52.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.515+0000 7fd799268700 1 -- 172.21.15.77:0/977158291 wait complete. 2023-07-24T05:45:52.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.519+0000 7fd799268700 1 Processor -- start 2023-07-24T05:45:52.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.519+0000 7fd799268700 1 -- start start 2023-07-24T05:45:52.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.519+0000 7fd799268700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd79406bb60 0x7fd79415ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:52.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.519+0000 7fd799268700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7940d07d0 0x7fd794151d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:52.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.519+0000 7fd799268700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd79415c9a0 0x7fd7940c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:52.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.519+0000 7fd799268700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd79415eaa0 con 0x7fd79415c9a0 2023-07-24T05:45:52.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.519+0000 7fd799268700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7940c6c90 con 0x7fd7940d07d0 2023-07-24T05:45:52.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.519+0000 7fd799268700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7940c6f70 con 0x7fd79406bb60 2023-07-24T05:45:52.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.523+0000 7fd798a67700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd79415c9a0 0x7fd7940c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:52.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.523+0000 7fd798a67700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd79415c9a0 0x7fd7940c61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46722/0 (socket says 172.21.15.77:46722) 2023-07-24T05:45:52.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.523+0000 7fd798a67700 1 -- 172.21.15.77:0/2758426538 learned_addr learned my addr 172.21.15.77:0/2758426538 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:45:52.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.523+0000 7fd793fff700 1 --2- 172.21.15.77:0/2758426538 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd79406bb60 0x7fd79415ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:52.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.523+0000 7fd7937fe700 1 --2- 172.21.15.77:0/2758426538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7940d07d0 0x7fd794151d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:52.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.523+0000 7fd798a67700 1 -- 172.21.15.77:0/2758426538 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd79406bb60 msgr2=0x7fd79415ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:52.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.523+0000 7fd798a67700 1 --2- 172.21.15.77:0/2758426538 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd79406bb60 0x7fd79415ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:52.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.523+0000 7fd798a67700 1 -- 172.21.15.77:0/2758426538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7940d07d0 msgr2=0x7fd794151d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:52.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.523+0000 7fd798a67700 1 --2- 172.21.15.77:0/2758426538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7940d07d0 0x7fd794151d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:52.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.523+0000 7fd798a67700 1 -- 172.21.15.77:0/2758426538 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd784009570 con 0x7fd79415c9a0 2023-07-24T05:45:52.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.523+0000 7fd798a67700 1 --2- 172.21.15.77:0/2758426538 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd79415c9a0 0x7fd7940c61d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd78c00efc0 tx=0x7fd78c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:52.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.523+0000 7fd790ff9700 1 -- 172.21.15.77:0/2758426538 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c00cc90 con 0x7fd79415c9a0 2023-07-24T05:45:52.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.523+0000 7fd790ff9700 1 -- 172.21.15.77:0/2758426538 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd78c00f040 con 0x7fd79415c9a0 2023-07-24T05:45:52.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.523+0000 7fd799268700 1 -- 172.21.15.77:0/2758426538 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd79415e450 con 0x7fd79415c9a0 2023-07-24T05:45:52.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.523+0000 7fd790ff9700 1 -- 172.21.15.77:0/2758426538 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c0146c0 con 0x7fd79415c9a0 2023-07-24T05:45:52.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.523+0000 7fd799268700 1 -- 172.21.15.77:0/2758426538 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7941522a0 con 0x7fd79415c9a0 2023-07-24T05:45:52.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.527+0000 7fd799268700 1 -- 172.21.15.77:0/2758426538 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd794072490 con 0x7fd79415c9a0 2023-07-24T05:45:52.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.527+0000 7fd790ff9700 1 -- 172.21.15.77:0/2758426538 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 4) v1 ==== 85602+0+0 (secure 0 0 0) 0x7fd78c014820 con 0x7fd79415c9a0 2023-07-24T05:45:52.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.531+0000 7fd790ff9700 1 --2- 172.21.15.77:0/2758426538 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd780066260 0x7fd780068720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:52.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.531+0000 7fd790ff9700 1 -- 172.21.15.77:0/2758426538 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fd78c084230 con 0x7fd79415c9a0 2023-07-24T05:45:52.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.531+0000 7fd793fff700 1 --2- 172.21.15.77:0/2758426538 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd780066260 0x7fd780068720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:52.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.531+0000 7fd793fff700 1 --2- 172.21.15.77:0/2758426538 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd780066260 0x7fd780068720 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd784014040 tx=0x7fd784008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:52.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.535+0000 7fd790ff9700 1 -- 172.21.15.77:0/2758426538 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd78c051db0 con 0x7fd79415c9a0 2023-07-24T05:45:52.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:52.711+0000 7fd799268700 1 -- 172.21.15.77:0/2758426538 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fd79415ebe0 con 0x7fd79415c9a0 2023-07-24T05:45:53.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.331+0000 7fd790ff9700 1 -- 172.21.15.77:0/2758426538 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) v1 ==== 109+0+0 (secure 0 0 0) 0x7fd78c009ca0 con 0x7fd79415c9a0 2023-07-24T05:45:53.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.335+0000 7fd799268700 1 -- 172.21.15.77:0/2758426538 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd780066260 msgr2=0x7fd780068720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:53.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.335+0000 7fd799268700 1 --2- 172.21.15.77:0/2758426538 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd780066260 0x7fd780068720 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd784014040 tx=0x7fd784008030 comp rx=0 tx=0).stop 2023-07-24T05:45:53.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.335+0000 7fd799268700 1 -- 172.21.15.77:0/2758426538 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd79415c9a0 msgr2=0x7fd7940c61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:53.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.335+0000 7fd799268700 1 --2- 172.21.15.77:0/2758426538 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd79415c9a0 0x7fd7940c61d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd78c00efc0 tx=0x7fd78c00c3a0 comp rx=0 tx=0).stop 2023-07-24T05:45:53.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.335+0000 7fd799268700 1 -- 172.21.15.77:0/2758426538 shutdown_connections 2023-07-24T05:45:53.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.335+0000 7fd799268700 1 --2- 172.21.15.77:0/2758426538 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd79415c9a0 0x7fd7940c61d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:53.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.335+0000 7fd799268700 1 --2- 172.21.15.77:0/2758426538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7940d07d0 0x7fd794151d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:53.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.335+0000 7fd799268700 1 --2- 172.21.15.77:0/2758426538 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd780066260 0x7fd780068720 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:53.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.335+0000 7fd799268700 1 --2- 172.21.15.77:0/2758426538 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd79406bb60 0x7fd79415ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:53.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.335+0000 7fd799268700 1 -- 172.21.15.77:0/2758426538 >> 172.21.15.77:0/2758426538 conn(0x7fd7940b5610 msgr2=0x7fd7940b4860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:53.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.335+0000 7fd799268700 1 -- 172.21.15.77:0/2758426538 shutdown_connections 2023-07-24T05:45:53.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.335+0000 7fd799268700 1 -- 172.21.15.77:0/2758426538 wait complete. 2023-07-24T05:45:53.342 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'rbd' created 2023-07-24T05:45:53.362 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-07-24T05:45:53.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.531+0000 7f3c7fd2d700 1 Processor -- start 2023-07-24T05:45:53.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.531+0000 7f3c7fd2d700 1 -- start start 2023-07-24T05:45:53.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.531+0000 7f3c7fd2d700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3c7815cda0 0x7f3c7806d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:53.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.531+0000 7f3c7fd2d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3c780d2eb0 0x7f3c780b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:53.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.531+0000 7f3c7fd2d700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c780d0240 con 0x7f3c7815c9c0 2023-07-24T05:45:53.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.531+0000 7f3c7fd2d700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c780cfa70 con 0x7f3c7815cda0 2023-07-24T05:45:53.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.531+0000 7f3c7fd2d700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c7806aef0 con 0x7f3c780d2eb0 2023-07-24T05:45:53.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.531+0000 7f3c7dac9700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f3c7815c9c0 0x7f3c780d27a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:50842/0 (socket says 172.21.15.77:50842) 2023-07-24T05:45:53.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.531+0000 7f3c7dac9700 1 -- 172.21.15.77:0/3422821190 learned_addr learned my addr 172.21.15.77:0/3422821190 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:45:53.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.531+0000 7f3c7d2c8700 1 --2- 172.21.15.77:0/3422821190 >> v2:172.21.15.77:3300/0 conn(0x7f3c7815cda0 0x7f3c7806d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:53.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.531+0000 7f3c7e2ca700 1 --2- 172.21.15.77:0/3422821190 >> v2:172.21.15.103:3300/0 conn(0x7f3c780d2eb0 0x7f3c780b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:53.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.531+0000 7f3c7cac7700 1 -- 172.21.15.77:0/3422821190 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3311822011 0 0) 0x7f3c780d0240 con 0x7f3c7815c9c0 2023-07-24T05:45:53.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.531+0000 7f3c7cac7700 1 -- 172.21.15.77:0/3422821190 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c640035d0 con 0x7f3c7815c9c0 2023-07-24T05:45:53.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.535+0000 7f3c7cac7700 1 -- 172.21.15.77:0/3422821190 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 890778094 0 0) 0x7f3c640035d0 con 0x7f3c7815c9c0 2023-07-24T05:45:53.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.535+0000 7f3c7cac7700 1 -- 172.21.15.77:0/3422821190 >> v2:172.21.15.103:3300/0 conn(0x7f3c780d2eb0 msgr2=0x7f3c780b4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:45:53.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.535+0000 7f3c7cac7700 1 --2- 172.21.15.77:0/3422821190 >> v2:172.21.15.103:3300/0 conn(0x7f3c780d2eb0 0x7f3c780b4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:53.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.535+0000 7f3c7cac7700 1 -- 172.21.15.77:0/3422821190 >> v2:172.21.15.77:3300/0 conn(0x7f3c7815cda0 msgr2=0x7f3c7806d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:45:53.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.535+0000 7f3c7cac7700 1 --2- 172.21.15.77:0/3422821190 >> v2:172.21.15.77:3300/0 conn(0x7f3c7815cda0 0x7f3c7806d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:53.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.535+0000 7f3c7cac7700 1 -- 172.21.15.77:0/3422821190 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c780d1420 con 0x7f3c7815c9c0 2023-07-24T05:45:53.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.535+0000 7f3c7cac7700 1 -- 172.21.15.77:0/3422821190 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4109865209 0 0) 0x7f3c74001670 con 0x7f3c7815c9c0 2023-07-24T05:45:53.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.535+0000 7f3c7cac7700 1 -- 172.21.15.77:0/3422821190 >> v1:172.21.15.77:6789/0 conn(0x7f3c7815c9c0 legacy=0x7f3c780d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:53.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.535+0000 7f3c7cac7700 1 --2- 172.21.15.77:0/3422821190 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c64003a20 0x7f3c64003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:53.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.535+0000 7f3c7cac7700 1 --2- 172.21.15.77:0/3422821190 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c64004870 0x7f3c64004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:53.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.535+0000 7f3c7cac7700 1 --2- 172.21.15.77:0/3422821190 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c64005230 0x7f3c6400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:53.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.535+0000 7f3c7cac7700 1 -- 172.21.15.77:0/3422821190 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c780cfa70 con 0x7f3c64005230 2023-07-24T05:45:53.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.535+0000 7f3c7cac7700 1 -- 172.21.15.77:0/3422821190 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7806aef0 con 0x7f3c64003a20 2023-07-24T05:45:53.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.535+0000 7f3c7cac7700 1 -- 172.21.15.77:0/3422821190 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6400c070 con 0x7f3c64004870 2023-07-24T05:45:53.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.535+0000 7f3c7e2ca700 1 --2- 172.21.15.77:0/3422821190 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c64005230 0x7f3c6400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:53.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.535+0000 7f3c7d2c8700 1 --2- 172.21.15.77:0/3422821190 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c64004870 0x7f3c64004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:53.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.535+0000 7f3c7dac9700 1 --2- 172.21.15.77:0/3422821190 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c64003a20 0x7f3c64003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:53.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.535+0000 7f3c7e2ca700 1 -- 172.21.15.77:0/3422821190 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c64004870 msgr2=0x7f3c64004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:45:53.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.535+0000 7f3c7e2ca700 1 --2- 172.21.15.77:0/3422821190 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c64004870 0x7f3c64004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:53.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.535+0000 7f3c7e2ca700 1 -- 172.21.15.77:0/3422821190 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c64003a20 msgr2=0x7f3c64003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:45:53.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.535+0000 7f3c7e2ca700 1 --2- 172.21.15.77:0/3422821190 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c64003a20 0x7f3c64003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:53.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.535+0000 7f3c7e2ca700 1 -- 172.21.15.77:0/3422821190 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c640035d0 con 0x7f3c64005230 2023-07-24T05:45:53.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.535+0000 7f3c7e2ca700 1 -- 172.21.15.77:0/3422821190 reap_dead start 2023-07-24T05:45:53.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.535+0000 7f3c7e2ca700 1 --2- 172.21.15.77:0/3422821190 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c64005230 0x7f3c6400ba30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3c70009f90 tx=0x7f3c640058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66fdbe839dd80e66 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:53.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.535+0000 7f3c7cac7700 1 -- 172.21.15.77:0/3422821190 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7000ec30 con 0x7f3c64005230 2023-07-24T05:45:53.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.535+0000 7f3c7cac7700 1 -- 172.21.15.77:0/3422821190 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7000f040 con 0x7f3c64005230 2023-07-24T05:45:53.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.535+0000 7f3c7cac7700 1 -- 172.21.15.77:0/3422821190 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c70014480 con 0x7f3c64005230 2023-07-24T05:45:53.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.539+0000 7f3c7fd2d700 1 -- 172.21.15.77:0/3422821190 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c64005230 msgr2=0x7f3c6400ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:53.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.539+0000 7f3c7fd2d700 1 --2- 172.21.15.77:0/3422821190 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c64005230 0x7f3c6400ba30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3c70009f90 tx=0x7f3c640058a0 comp rx=0 tx=0).stop 2023-07-24T05:45:53.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.539+0000 7f3c7fd2d700 1 -- 172.21.15.77:0/3422821190 shutdown_connections 2023-07-24T05:45:53.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.539+0000 7f3c7fd2d700 1 --2- 172.21.15.77:0/3422821190 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c64005230 0x7f3c6400ba30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:53.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.539+0000 7f3c7fd2d700 1 -- 172.21.15.77:0/3422821190 >> 172.21.15.77:0/3422821190 conn(0x7f3c780b8120 msgr2=0x7f3c7809bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:53.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.539+0000 7f3c7fd2d700 1 -- 172.21.15.77:0/3422821190 shutdown_connections 2023-07-24T05:45:53.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.539+0000 7f3c7fd2d700 1 -- 172.21.15.77:0/3422821190 wait complete. 2023-07-24T05:45:53.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.539+0000 7f3c7fd2d700 1 Processor -- start 2023-07-24T05:45:53.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.539+0000 7f3c7fd2d700 1 -- start start 2023-07-24T05:45:53.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.543+0000 7f3c7fd2d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c64005230 0x7f3c7815e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:53.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.543+0000 7f3c7fd2d700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c780b3d80 0x7f3c7814bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:53.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.543+0000 7f3c7fd2d700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c780d15b0 0x7f3c780d1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:53.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.543+0000 7f3c7fd2d700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7815e9e0 con 0x7f3c64005230 2023-07-24T05:45:53.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.543+0000 7f3c7fd2d700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c780d1f80 con 0x7f3c780d15b0 2023-07-24T05:45:53.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.543+0000 7f3c7fd2d700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c780b4260 con 0x7f3c780b3d80 2023-07-24T05:45:53.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.543+0000 7f3c7dac9700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c64005230 0x7f3c7815e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:53.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.543+0000 7f3c7dac9700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c64005230 0x7f3c7815e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46946/0 (socket says 172.21.15.77:46946) 2023-07-24T05:45:53.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.543+0000 7f3c7dac9700 1 -- 172.21.15.77:0/3762084726 learned_addr learned my addr 172.21.15.77:0/3762084726 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:45:53.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.543+0000 7f3c7d2c8700 1 --2- 172.21.15.77:0/3762084726 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c780b3d80 0x7f3c7814bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:53.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.543+0000 7f3c7e2ca700 1 --2- 172.21.15.77:0/3762084726 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c780d15b0 0x7f3c780d1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:53.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.543+0000 7f3c7dac9700 1 -- 172.21.15.77:0/3762084726 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c780b3d80 msgr2=0x7f3c7814bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:53.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.543+0000 7f3c7dac9700 1 --2- 172.21.15.77:0/3762084726 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c780b3d80 0x7f3c7814bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:53.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.543+0000 7f3c7dac9700 1 -- 172.21.15.77:0/3762084726 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c780d15b0 msgr2=0x7f3c780d1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:53.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.543+0000 7f3c7dac9700 1 --2- 172.21.15.77:0/3762084726 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c780d15b0 0x7f3c780d1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:53.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.543+0000 7f3c7dac9700 1 -- 172.21.15.77:0/3762084726 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c7814c1b0 con 0x7f3c64005230 2023-07-24T05:45:53.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.543+0000 7f3c7dac9700 1 --2- 172.21.15.77:0/3762084726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c64005230 0x7f3c7815e4a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3c74007370 tx=0x7f3c74007730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:53.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.543+0000 7f3c6e7fc700 1 -- 172.21.15.77:0/3762084726 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c74007e40 con 0x7f3c64005230 2023-07-24T05:45:53.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.543+0000 7f3c6e7fc700 1 -- 172.21.15.77:0/3762084726 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7400f870 con 0x7f3c64005230 2023-07-24T05:45:53.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.543+0000 7f3c7fd2d700 1 -- 172.21.15.77:0/3762084726 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c780c8d90 con 0x7f3c64005230 2023-07-24T05:45:53.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.543+0000 7f3c6e7fc700 1 -- 172.21.15.77:0/3762084726 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7400fc00 con 0x7f3c64005230 2023-07-24T05:45:53.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.543+0000 7f3c7fd2d700 1 -- 172.21.15.77:0/3762084726 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c780c8740 con 0x7f3c64005230 2023-07-24T05:45:53.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.547+0000 7f3c7fd2d700 1 -- 172.21.15.77:0/3762084726 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c7804df80 con 0x7f3c64005230 2023-07-24T05:45:53.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.547+0000 7f3c6e7fc700 1 -- 172.21.15.77:0/3762084726 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 4) v1 ==== 85602+0+0 (secure 0 0 0) 0x7f3c7400fd60 con 0x7f3c64005230 2023-07-24T05:45:53.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.551+0000 7f3c6e7fc700 1 --2- 172.21.15.77:0/3762084726 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3c5c066260 0x7f3c5c068720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:53.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.551+0000 7f3c6e7fc700 1 -- 172.21.15.77:0/3762084726 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5188+0+0 (secure 0 0 0) 0x7f3c74084390 con 0x7f3c64005230 2023-07-24T05:45:53.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.551+0000 7f3c7d2c8700 1 --2- 172.21.15.77:0/3762084726 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3c5c066260 0x7f3c5c068720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:53.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.551+0000 7f3c7d2c8700 1 --2- 172.21.15.77:0/3762084726 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3c5c066260 0x7f3c5c068720 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3c780b5020 tx=0x7f3c68008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:53.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.555+0000 7f3c6e7fc700 1 -- 172.21.15.77:0/3762084726 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3c74051c30 con 0x7f3c64005230 2023-07-24T05:45:53.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:53.731+0000 7f3c7fd2d700 1 -- 172.21.15.77:0/3762084726 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3c78066420 con 0x7f3c64005230 2023-07-24T05:45:54.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.335+0000 7f3c6e7fc700 1 -- 172.21.15.77:0/3762084726 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v16) v1 ==== 173+0+0 (secure 0 0 0) 0x7f3c74055250 con 0x7f3c64005230 2023-07-24T05:45:54.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.343+0000 7f3c7fd2d700 1 -- 172.21.15.77:0/3762084726 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3c5c066260 msgr2=0x7f3c5c068720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:54.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.343+0000 7f3c7fd2d700 1 --2- 172.21.15.77:0/3762084726 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3c5c066260 0x7f3c5c068720 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3c780b5020 tx=0x7f3c68008040 comp rx=0 tx=0).stop 2023-07-24T05:45:54.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.343+0000 7f3c7fd2d700 1 -- 172.21.15.77:0/3762084726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c64005230 msgr2=0x7f3c7815e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:54.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.343+0000 7f3c7fd2d700 1 --2- 172.21.15.77:0/3762084726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c64005230 0x7f3c7815e4a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3c74007370 tx=0x7f3c74007730 comp rx=0 tx=0).stop 2023-07-24T05:45:54.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.343+0000 7f3c7fd2d700 1 -- 172.21.15.77:0/3762084726 shutdown_connections 2023-07-24T05:45:54.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.343+0000 7f3c7fd2d700 1 --2- 172.21.15.77:0/3762084726 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c780d15b0 0x7f3c780d1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:54.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.343+0000 7f3c7fd2d700 1 --2- 172.21.15.77:0/3762084726 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3c5c066260 0x7f3c5c068720 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:54.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.343+0000 7f3c7fd2d700 1 --2- 172.21.15.77:0/3762084726 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c780b3d80 0x7f3c7814bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:54.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.343+0000 7f3c7fd2d700 1 --2- 172.21.15.77:0/3762084726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c64005230 0x7f3c7815e4a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:54.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.343+0000 7f3c7fd2d700 1 -- 172.21.15.77:0/3762084726 >> 172.21.15.77:0/3762084726 conn(0x7f3c780b8120 msgr2=0x7f3c780b5bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:54.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.343+0000 7f3c7fd2d700 1 -- 172.21.15.77:0/3762084726 shutdown_connections 2023-07-24T05:45:54.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.343+0000 7f3c7fd2d700 1 -- 172.21.15.77:0/3762084726 wait complete. 2023-07-24T05:45:54.350 INFO:teuthology.orchestra.run.smithi077.stderr:enabled application 'rbd' on pool 'rbd' 2023-07-24T05:45:54.370 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-07-24T05:45:54.370 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-24T05:45:54.370 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-24T05:45:54.374 INFO:tasks.ceph.mds.a:Started 2023-07-24T05:45:54.374 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-24T05:45:54.375 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-24T05:45:54.378 INFO:tasks.ceph.mds.c:Started 2023-07-24T05:45:54.379 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-24T05:45:54.379 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-24T05:45:54.384 INFO:tasks.ceph.mds.b:Started 2023-07-24T05:45:54.384 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-24T05:45:54.385 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-24T05:45:54.388 INFO:tasks.ceph.mds.d:Started 2023-07-24T05:45:54.389 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-07-24T05:45:54.389 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-24T05:45:54.495 INFO:tasks.ceph.mds.c.smithi077.stdout:starting mds.c at 2023-07-24T05:45:54.495 INFO:tasks.ceph.mds.a.smithi077.stdout:starting mds.a at 2023-07-24T05:45:54.513 INFO:tasks.ceph.mds.b.smithi103.stdout:starting mds.b at 2023-07-24T05:45:54.519 INFO:tasks.ceph.mds.d.smithi103.stdout:starting mds.d at 2023-07-24T05:45:54.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.563+0000 7f212dfca700 1 Processor -- start 2023-07-24T05:45:54.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.563+0000 7f212dfca700 1 -- start start 2023-07-24T05:45:54.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.563+0000 7f212dfca700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2128069b10 0x7f2128069fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:54.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.563+0000 7f212dfca700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21280702f0 con 0x7f21280b13c0 2023-07-24T05:45:54.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.563+0000 7f212dfca700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21280adc40 con 0x7f21280a4580 2023-07-24T05:45:54.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.563+0000 7f212dfca700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f212806a4e0 con 0x7f2128069b10 2023-07-24T05:45:54.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.563+0000 7f2127fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f21280a4580 0x7f212806fbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.77:36330/0 (socket says 172.21.15.77:36330) 2023-07-24T05:45:54.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.563+0000 7f2127fff700 1 -- 172.21.15.77:0/1006326690 learned_addr learned my addr 172.21.15.77:0/1006326690 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:45:54.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.563+0000 7f212d7c9700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2128069b10 0x7f2128069fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:54.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.563+0000 7f21277fe700 1 -- 172.21.15.77:0/1006326690 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1845348581 0 0) 0x7f21280adc40 con 0x7f21280a4580 2023-07-24T05:45:54.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.563+0000 7f21277fe700 1 -- 172.21.15.77:0/1006326690 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21100035d0 con 0x7f21280a4580 2023-07-24T05:45:54.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.563+0000 7f212d7c9700 1 -- 172.21.15.77:0/1006326690 >> v1:172.21.15.103:6789/0 conn(0x7f21280a4580 legacy=0x7f212806fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:54.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.563+0000 7f212d7c9700 1 -- 172.21.15.77:0/1006326690 >> v1:172.21.15.77:6789/0 conn(0x7f21280b13c0 legacy=0x7f212806adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:54.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.563+0000 7f21277fe700 1 -- 172.21.15.77:0/1006326690 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1381445011 0 0) 0x7f21280702f0 con 0x7f21280b13c0 2023-07-24T05:45:54.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.563+0000 7f212d7c9700 1 -- 172.21.15.77:0/1006326690 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21280adee0 con 0x7f2128069b10 2023-07-24T05:45:54.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.567+0000 7f212d7c9700 1 --2- 172.21.15.77:0/1006326690 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2128069b10 0x7f2128069fa0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2120009dc0 tx=0x7f212000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be64976b8292980f server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:54.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.567+0000 7f21277fe700 1 -- 172.21.15.77:0/1006326690 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212000e070 con 0x7f2128069b10 2023-07-24T05:45:54.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.567+0000 7f21277fe700 1 -- 172.21.15.77:0/1006326690 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212000bb20 con 0x7f2128069b10 2023-07-24T05:45:54.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.567+0000 7f21277fe700 1 -- 172.21.15.77:0/1006326690 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212000bed0 con 0x7f2128069b10 2023-07-24T05:45:54.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.567+0000 7f212dfca700 1 -- 172.21.15.77:0/1006326690 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2128069b10 msgr2=0x7f2128069fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:54.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.567+0000 7f212dfca700 1 --2- 172.21.15.77:0/1006326690 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2128069b10 0x7f2128069fa0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2120009dc0 tx=0x7f212000b330 comp rx=0 tx=0).stop 2023-07-24T05:45:54.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.567+0000 7f212dfca700 1 -- 172.21.15.77:0/1006326690 shutdown_connections 2023-07-24T05:45:54.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.567+0000 7f212dfca700 1 --2- 172.21.15.77:0/1006326690 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2128069b10 0x7f2128069fa0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:54.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.567+0000 7f212dfca700 1 -- 172.21.15.77:0/1006326690 >> 172.21.15.77:0/1006326690 conn(0x7f21280cacc0 msgr2=0x7f21280cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:54.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.567+0000 7f212dfca700 1 -- 172.21.15.77:0/1006326690 shutdown_connections 2023-07-24T05:45:54.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.567+0000 7f212dfca700 1 -- 172.21.15.77:0/1006326690 wait complete. 2023-07-24T05:45:54.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.567+0000 7f212dfca700 1 Processor -- start 2023-07-24T05:45:54.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.567+0000 7f212dfca700 1 -- start start 2023-07-24T05:45:54.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.571+0000 7f212dfca700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2128069b10 0x7f212815da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:54.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.571+0000 7f212dfca700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21280a4580 0x7f2128158520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:54.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.571+0000 7f212dfca700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21280b13c0 0x7f21280c9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:54.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.571+0000 7f212dfca700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212809a980 con 0x7f21280b13c0 2023-07-24T05:45:54.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.571+0000 7f212dfca700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212809ac60 con 0x7f2128069b10 2023-07-24T05:45:54.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.571+0000 7f212dfca700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f212809af40 con 0x7f21280a4580 2023-07-24T05:45:54.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.571+0000 7f212d7c9700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21280b13c0 0x7f21280c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:54.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.571+0000 7f212d7c9700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21280b13c0 0x7f21280c9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46994/0 (socket says 172.21.15.77:46994) 2023-07-24T05:45:54.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.571+0000 7f212d7c9700 1 -- 172.21.15.77:0/229117384 learned_addr learned my addr 172.21.15.77:0/229117384 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:45:54.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.571+0000 7f212cfc8700 1 --2- 172.21.15.77:0/229117384 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2128069b10 0x7f212815da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:54.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.571+0000 7f212d7c9700 1 -- 172.21.15.77:0/229117384 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21280a4580 msgr2=0x7f2128158520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:54.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.571+0000 7f2127fff700 1 --2- 172.21.15.77:0/229117384 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21280a4580 0x7f2128158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:54.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.571+0000 7f212d7c9700 1 --2- 172.21.15.77:0/229117384 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21280a4580 0x7f2128158520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:54.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.571+0000 7f212d7c9700 1 -- 172.21.15.77:0/229117384 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2128069b10 msgr2=0x7f212815da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:54.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.571+0000 7f212d7c9700 1 --2- 172.21.15.77:0/229117384 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2128069b10 0x7f212815da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:54.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.571+0000 7f212d7c9700 1 -- 172.21.15.77:0/229117384 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2120009a70 con 0x7f21280b13c0 2023-07-24T05:45:54.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.571+0000 7f212cfc8700 1 --2- 172.21.15.77:0/229117384 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2128069b10 0x7f212815da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:45:54.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.571+0000 7f212d7c9700 1 --2- 172.21.15.77:0/229117384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21280b13c0 0x7f21280c9720 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2120009f30 tx=0x7f2120004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:54.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.571+0000 7f21257fa700 1 -- 172.21.15.77:0/229117384 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212001b810 con 0x7f21280b13c0 2023-07-24T05:45:54.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.571+0000 7f21257fa700 1 -- 172.21.15.77:0/229117384 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2120020070 con 0x7f21280b13c0 2023-07-24T05:45:54.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.571+0000 7f212dfca700 1 -- 172.21.15.77:0/229117384 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f212809b220 con 0x7f21280b13c0 2023-07-24T05:45:54.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.571+0000 7f21257fa700 1 -- 172.21.15.77:0/229117384 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212001bbb0 con 0x7f21280b13c0 2023-07-24T05:45:54.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.571+0000 7f212dfca700 1 -- 172.21.15.77:0/229117384 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21280c9c60 con 0x7f21280b13c0 2023-07-24T05:45:54.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.575+0000 7f212dfca700 1 -- 172.21.15.77:0/229117384 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21280cbe10 con 0x7f21280b13c0 2023-07-24T05:45:54.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.575+0000 7f21257fa700 1 -- 172.21.15.77:0/229117384 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 4) v1 ==== 85602+0+0 (secure 0 0 0) 0x7f212001bd10 con 0x7f21280b13c0 2023-07-24T05:45:54.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.579+0000 7f21257fa700 1 --2- 172.21.15.77:0/229117384 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2114066260 0x7f2114068720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:54.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.579+0000 7f21257fa700 1 -- 172.21.15.77:0/229117384 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2120022070 con 0x7f21280b13c0 2023-07-24T05:45:54.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.579+0000 7f212cfc8700 1 --2- 172.21.15.77:0/229117384 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2114066260 0x7f2114068720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:54.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.579+0000 7f212cfc8700 1 --2- 172.21.15.77:0/229117384 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2114066260 0x7f2114068720 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f211c000f60 tx=0x7f211c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:54.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.583+0000 7f21257fa700 1 -- 172.21.15.77:0/229117384 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f21280cbe10 con 0x7f21280b13c0 2023-07-24T05:45:54.659 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:45:54.666 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:45:54.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.767+0000 7f212dfca700 1 -- 172.21.15.77:0/229117384 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21280cbe10 con 0x7f21280b13c0 2023-07-24T05:45:54.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.767+0000 7f21257fa700 1 -- 172.21.15.77:0/229117384 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+14650 (secure 0 0 0) 0x7f21280cbe10 con 0x7f21280b13c0 2023-07-24T05:45:54.772 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:45:54.773 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":16,"fsid":"5aed5f7b-fb55-4d95-9c02-c6adbb1677b4","created":"2023-07-24T05:45:39.639731+0000","modified":"2023-07-24T05:45:54.327753+0000","last_up_change":"2023-07-24T05:45:52.319670+0000","last_in_change":"2023-07-24T05:45:43.643277+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-24T05:45:52.610430+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-24T05:45:52.773787+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ffa0d496-461a-4053-b764-0627d969521b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6812","nonce":825987196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6817","nonce":825987196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6831","nonce":825987196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6824","nonce":825987196}]},"public_addr":"172.21.15.77:6812/825987196","cluster_addr":"172.21.15.77:6817/825987196","heartbeat_back_addr":"172.21.15.77:6831/825987196","heartbeat_front_addr":"172.21.15.77:6824/825987196","state":["exists","up"]},{"osd":1,"uuid":"9f595e5e-5c43-49bc-8ce4-ee70575c90da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6801","nonce":4133026815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6803","nonce":4133026815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6807","nonce":4133026815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6805","nonce":4133026815}]},"public_addr":"172.21.15.77:6801/4133026815","cluster_addr":"172.21.15.77:6803/4133026815","heartbeat_back_addr":"172.21.15.77:6807/4133026815","heartbeat_front_addr":"172.21.15.77:6805/4133026815","state":["exists","up"]},{"osd":2,"uuid":"2ac177aa-4d7d-4262-bd54-d2b9f29f4c3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6811","nonce":2394142159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6819","nonce":2394142159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6830","nonce":2394142159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6825","nonce":2394142159}]},"public_addr":"172.21.15.77:6811/2394142159","cluster_addr":"172.21.15.77:6819/2394142159","heartbeat_back_addr":"172.21.15.77:6830/2394142159","heartbeat_front_addr":"172.21.15.77:6825/2394142159","state":["exists","up"]},{"osd":3,"uuid":"17d7a251-19e8-484c-8172-a578ab3da153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6813","nonce":1492113982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6818","nonce":1492113982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6829","nonce":1492113982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6823","nonce":1492113982}]},"public_addr":"172.21.15.77:6813/1492113982","cluster_addr":"172.21.15.77:6818/1492113982","heartbeat_back_addr":"172.21.15.77:6829/1492113982","heartbeat_front_addr":"172.21.15.77:6823/1492113982","state":["exists","up"]},{"osd":4,"uuid":"bf63ca05-f06d-4e0f-ac44-2a416c70b919","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6825","nonce":1080481057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6827","nonce":1080481057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6831","nonce":1080481057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6829","nonce":1080481057}]},"public_addr":"172.21.15.103:6825/1080481057","cluster_addr":"172.21.15.103:6827/1080481057","heartbeat_back_addr":"172.21.15.103:6831/1080481057","heartbeat_front_addr":"172.21.15.103:6829/1080481057","state":["exists","up"]},{"osd":5,"uuid":"65a11a35-9e9f-4b3c-9fe3-b658d62b9318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6811","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6813","nonce":2756677504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6818","nonce":2756677504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6823","nonce":2756677504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6821","nonce":2756677504}]},"public_addr":"172.21.15.103:6813/2756677504","cluster_addr":"172.21.15.103:6818/2756677504","heartbeat_back_addr":"172.21.15.103:6823/2756677504","heartbeat_front_addr":"172.21.15.103:6821/2756677504","state":["exists","up"]},{"osd":6,"uuid":"750c1f87-686c-40b4-94a1-1a299dc78f3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6809","nonce":568977764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6812","nonce":568977764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6819","nonce":568977764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6815","nonce":568977764}]},"public_addr":"172.21.15.103:6809/568977764","cluster_addr":"172.21.15.103:6812/568977764","heartbeat_back_addr":"172.21.15.103:6819/568977764","heartbeat_front_addr":"172.21.15.103:6815/568977764","state":["exists","up"]},{"osd":7,"uuid":"d5fe4fb6-2e09-4158-885b-403803c85822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6801","nonce":1074557176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6803","nonce":1074557176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6807","nonce":1074557176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6805","nonce":1074557176}]},"public_addr":"172.21.15.103:6801/1074557176","cluster_addr":"172.21.15.103:6803/1074557176","heartbeat_back_addr":"172.21.15.103:6807/1074557176","heartbeat_front_addr":"172.21.15.103:6805/1074557176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.631032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.154109+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.398587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.679089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.311218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.353726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.314372+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.126212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-24T05:45:54.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.771+0000 7f212dfca700 1 -- 172.21.15.77:0/229117384 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2114066260 msgr2=0x7f2114068720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:54.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.771+0000 7f212dfca700 1 --2- 172.21.15.77:0/229117384 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2114066260 0x7f2114068720 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f211c000f60 tx=0x7f211c009040 comp rx=0 tx=0).stop 2023-07-24T05:45:54.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.771+0000 7f212dfca700 1 -- 172.21.15.77:0/229117384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21280b13c0 msgr2=0x7f21280c9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:54.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.771+0000 7f212dfca700 1 --2- 172.21.15.77:0/229117384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21280b13c0 0x7f21280c9720 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2120009f30 tx=0x7f2120004af0 comp rx=0 tx=0).stop 2023-07-24T05:45:54.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.771+0000 7f212dfca700 1 -- 172.21.15.77:0/229117384 shutdown_connections 2023-07-24T05:45:54.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.771+0000 7f212dfca700 1 --2- 172.21.15.77:0/229117384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21280b13c0 0x7f21280c9720 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:54.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.771+0000 7f212dfca700 1 --2- 172.21.15.77:0/229117384 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2114066260 0x7f2114068720 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:54.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.771+0000 7f212dfca700 1 --2- 172.21.15.77:0/229117384 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21280a4580 0x7f2128158520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:54.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.771+0000 7f212dfca700 1 --2- 172.21.15.77:0/229117384 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2128069b10 0x7f212815da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:54.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.771+0000 7f212dfca700 1 -- 172.21.15.77:0/229117384 >> 172.21.15.77:0/229117384 conn(0x7f21280cacc0 msgr2=0x7f21280ae8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:54.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.771+0000 7f212dfca700 1 -- 172.21.15.77:0/229117384 shutdown_connections 2023-07-24T05:45:54.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.771+0000 7f212dfca700 1 -- 172.21.15.77:0/229117384 wait complete. 2023-07-24T05:45:54.795 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-24T05:45:52.610430+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-24T05:45:52.773787+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-24T05:45:54.795 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-24T05:45:54.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.959+0000 7f2a6efca700 1 Processor -- start 2023-07-24T05:45:54.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.959+0000 7f2a6efca700 1 -- start start 2023-07-24T05:45:54.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.963+0000 7f2a6efca700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2a6815c870 0x7f2a680cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:54.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.963+0000 7f2a6efca700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2a680b2230 0x7f2a680cd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:54.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.963+0000 7f2a6efca700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a680cf520 con 0x7f2a6815cc50 2023-07-24T05:45:54.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.963+0000 7f2a6efca700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a6806aaa0 con 0x7f2a6815c870 2023-07-24T05:45:54.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.963+0000 7f2a6efca700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6806ad80 con 0x7f2a680b2230 2023-07-24T05:45:54.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.963+0000 7f2a6d7c7700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f2a6815cc50 0x7f2a680b1b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:50874/0 (socket says 172.21.15.77:50874) 2023-07-24T05:45:54.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.963+0000 7f2a6d7c7700 1 -- 172.21.15.77:0/1795034458 learned_addr learned my addr 172.21.15.77:0/1795034458 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:45:54.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.963+0000 7f2a6dfc8700 1 --2- 172.21.15.77:0/1795034458 >> v2:172.21.15.103:3300/0 conn(0x7f2a6815c870 0x7f2a680cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:54.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.963+0000 7f2a6e7c9700 1 --2- 172.21.15.77:0/1795034458 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2a680b2230 0x7f2a680cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:54.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.963+0000 7f2a6cfc6700 1 -- 172.21.15.77:0/1795034458 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1201085459 0 0) 0x7f2a680cf520 con 0x7f2a6815cc50 2023-07-24T05:45:54.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.963+0000 7f2a6cfc6700 1 -- 172.21.15.77:0/1795034458 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a540035d0 con 0x7f2a6815cc50 2023-07-24T05:45:54.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.963+0000 7f2a6cfc6700 1 -- 172.21.15.77:0/1795034458 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 147155616 0 0) 0x7f2a540035d0 con 0x7f2a6815cc50 2023-07-24T05:45:54.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.963+0000 7f2a6e7c9700 1 -- 172.21.15.77:0/1795034458 >> v2:172.21.15.103:3300/0 conn(0x7f2a6815c870 msgr2=0x7f2a680cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:45:54.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.963+0000 7f2a6e7c9700 1 --2- 172.21.15.77:0/1795034458 >> v2:172.21.15.103:3300/0 conn(0x7f2a6815c870 0x7f2a680cefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:54.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.963+0000 7f2a6e7c9700 1 -- 172.21.15.77:0/1795034458 >> v1:172.21.15.77:6789/0 conn(0x7f2a6815cc50 legacy=0x7f2a680b1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:54.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.963+0000 7f2a6e7c9700 1 -- 172.21.15.77:0/1795034458 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a6806b060 con 0x7f2a680b2230 2023-07-24T05:45:54.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.963+0000 7f2a6e7c9700 1 --2- 172.21.15.77:0/1795034458 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2a680b2230 0x7f2a680cd090 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2a60009d90 tx=0x7f2a6000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e30bf7b7413bfaed server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:54.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.963+0000 7f2a6cfc6700 1 -- 172.21.15.77:0/1795034458 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6000e070 con 0x7f2a680b2230 2023-07-24T05:45:54.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.963+0000 7f2a6cfc6700 1 -- 172.21.15.77:0/1795034458 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a60003a40 con 0x7f2a680b2230 2023-07-24T05:45:54.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.963+0000 7f2a6cfc6700 1 -- 172.21.15.77:0/1795034458 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a58001670 con 0x7f2a680b2230 2023-07-24T05:45:54.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.967+0000 7f2a6efca700 1 -- 172.21.15.77:0/1795034458 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2a680b2230 msgr2=0x7f2a680cd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:54.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.967+0000 7f2a6efca700 1 --2- 172.21.15.77:0/1795034458 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2a680b2230 0x7f2a680cd090 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2a60009d90 tx=0x7f2a6000b330 comp rx=0 tx=0).stop 2023-07-24T05:45:54.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.967+0000 7f2a6efca700 1 -- 172.21.15.77:0/1795034458 shutdown_connections 2023-07-24T05:45:54.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.967+0000 7f2a6efca700 1 --2- 172.21.15.77:0/1795034458 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2a680b2230 0x7f2a680cd090 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:54.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.967+0000 7f2a6efca700 1 --2- 172.21.15.77:0/1795034458 >> v2:172.21.15.103:3300/0 conn(0x7f2a6815c870 0x7f2a680cefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:54.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.967+0000 7f2a6efca700 1 -- 172.21.15.77:0/1795034458 >> 172.21.15.77:0/1795034458 conn(0x7f2a68089f80 msgr2=0x7f2a6809b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:54.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.967+0000 7f2a6efca700 1 -- 172.21.15.77:0/1795034458 shutdown_connections 2023-07-24T05:45:54.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.967+0000 7f2a6efca700 1 -- 172.21.15.77:0/1795034458 wait complete. 2023-07-24T05:45:54.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.967+0000 7f2a6efca700 1 Processor -- start 2023-07-24T05:45:54.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.967+0000 7f2a6efca700 1 -- start start 2023-07-24T05:45:54.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.971+0000 7f2a6efca700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a680b2230 0x7f2a68150690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:54.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.971+0000 7f2a6efca700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2a6815c870 0x7f2a680c6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:54.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.971+0000 7f2a6efca700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a6815cc50 0x7f2a680b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:54.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.971+0000 7f2a6efca700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a680c8650 con 0x7f2a680b2230 2023-07-24T05:45:54.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.971+0000 7f2a6efca700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a680c66d0 con 0x7f2a6815cc50 2023-07-24T05:45:54.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.971+0000 7f2a6efca700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a680b4930 con 0x7f2a6815c870 2023-07-24T05:45:54.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.971+0000 7f2a6dfc8700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a680b2230 0x7f2a68150690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:54.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.971+0000 7f2a6dfc8700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a680b2230 0x7f2a68150690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47006/0 (socket says 172.21.15.77:47006) 2023-07-24T05:45:54.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.971+0000 7f2a6dfc8700 1 -- 172.21.15.77:0/1549325440 learned_addr learned my addr 172.21.15.77:0/1549325440 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:45:54.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.971+0000 7f2a6d7c7700 1 --2- 172.21.15.77:0/1549325440 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2a6815c870 0x7f2a680c6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:54.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.971+0000 7f2a6e7c9700 1 --2- 172.21.15.77:0/1549325440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a6815cc50 0x7f2a680b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:54.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.971+0000 7f2a6dfc8700 1 -- 172.21.15.77:0/1549325440 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2a6815c870 msgr2=0x7f2a680c6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:54.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.971+0000 7f2a6dfc8700 1 --2- 172.21.15.77:0/1549325440 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2a6815c870 0x7f2a680c6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:54.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.971+0000 7f2a6dfc8700 1 -- 172.21.15.77:0/1549325440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a6815cc50 msgr2=0x7f2a680b40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:54.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.971+0000 7f2a6dfc8700 1 --2- 172.21.15.77:0/1549325440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a6815cc50 0x7f2a680b40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:54.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.971+0000 7f2a6dfc8700 1 -- 172.21.15.77:0/1549325440 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a60009a70 con 0x7f2a680b2230 2023-07-24T05:45:54.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.971+0000 7f2a6e7c9700 1 --2- 172.21.15.77:0/1549325440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a6815cc50 0x7f2a680b40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:45:54.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.971+0000 7f2a6dfc8700 1 --2- 172.21.15.77:0/1549325440 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a680b2230 0x7f2a68150690 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2a6400e9b0 tx=0x7f2a6400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:54.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.971+0000 7f2a5e7fc700 1 -- 172.21.15.77:0/1549325440 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a64009710 con 0x7f2a680b2230 2023-07-24T05:45:54.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.971+0000 7f2a5e7fc700 1 -- 172.21.15.77:0/1549325440 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a6400c850 con 0x7f2a680b2230 2023-07-24T05:45:54.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.971+0000 7f2a6efca700 1 -- 172.21.15.77:0/1549325440 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a680b4c10 con 0x7f2a680b2230 2023-07-24T05:45:54.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.971+0000 7f2a5e7fc700 1 -- 172.21.15.77:0/1549325440 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6400cbc0 con 0x7f2a680b2230 2023-07-24T05:45:54.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.971+0000 7f2a6efca700 1 -- 172.21.15.77:0/1549325440 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a68151880 con 0x7f2a680b2230 2023-07-24T05:45:54.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.975+0000 7f2a6efca700 1 -- 172.21.15.77:0/1549325440 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a68151a10 con 0x7f2a680b2230 2023-07-24T05:45:54.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.975+0000 7f2a5e7fc700 1 -- 172.21.15.77:0/1549325440 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 4) v1 ==== 85602+0+0 (secure 0 0 0) 0x7f2a6400cd20 con 0x7f2a680b2230 2023-07-24T05:45:54.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.975+0000 7f2a5e7fc700 1 --2- 172.21.15.77:0/1549325440 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2a4c066260 0x7f2a4c068720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:54.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.975+0000 7f2a5e7fc700 1 -- 172.21.15.77:0/1549325440 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2a64083dd0 con 0x7f2a680b2230 2023-07-24T05:45:54.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.975+0000 7f2a6d7c7700 1 --2- 172.21.15.77:0/1549325440 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2a4c066260 0x7f2a4c068720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:54.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.979+0000 7f2a6d7c7700 1 --2- 172.21.15.77:0/1549325440 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2a4c066260 0x7f2a4c068720 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2a68150bd0 tx=0x7f2a58007a40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:54.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:54.983+0000 7f2a5e7fc700 1 -- 172.21.15.77:0/1549325440 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2a640515f0 con 0x7f2a680b2230 2023-07-24T05:45:55.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.155+0000 7f2a6efca700 1 -- 172.21.15.77:0/1549325440 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2a68072490 con 0x7f2a680b2230 2023-07-24T05:45:55.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.155+0000 7f2a5e7fc700 1 -- 172.21.15.77:0/1549325440 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2a64054c10 con 0x7f2a680b2230 2023-07-24T05:45:55.158 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-07-24T05:45:55.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.155+0000 7f2a6efca700 1 -- 172.21.15.77:0/1549325440 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2a4c066260 msgr2=0x7f2a4c068720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:55.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.155+0000 7f2a6efca700 1 --2- 172.21.15.77:0/1549325440 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2a4c066260 0x7f2a4c068720 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2a68150bd0 tx=0x7f2a58007a40 comp rx=0 tx=0).stop 2023-07-24T05:45:55.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.155+0000 7f2a6efca700 1 -- 172.21.15.77:0/1549325440 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a680b2230 msgr2=0x7f2a68150690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:55.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.155+0000 7f2a6efca700 1 --2- 172.21.15.77:0/1549325440 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a680b2230 0x7f2a68150690 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2a6400e9b0 tx=0x7f2a6400ed70 comp rx=0 tx=0).stop 2023-07-24T05:45:55.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.155+0000 7f2a6efca700 1 -- 172.21.15.77:0/1549325440 shutdown_connections 2023-07-24T05:45:55.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.155+0000 7f2a6efca700 1 --2- 172.21.15.77:0/1549325440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2a6815cc50 0x7f2a680b40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:55.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.155+0000 7f2a6efca700 1 --2- 172.21.15.77:0/1549325440 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2a4c066260 0x7f2a4c068720 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:55.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.155+0000 7f2a6efca700 1 --2- 172.21.15.77:0/1549325440 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2a6815c870 0x7f2a680c6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:55.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.155+0000 7f2a6efca700 1 --2- 172.21.15.77:0/1549325440 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a680b2230 0x7f2a68150690 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:55.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.155+0000 7f2a6efca700 1 -- 172.21.15.77:0/1549325440 >> 172.21.15.77:0/1549325440 conn(0x7f2a68089f80 msgr2=0x7f2a68154f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:55.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.155+0000 7f2a6efca700 1 -- 172.21.15.77:0/1549325440 shutdown_connections 2023-07-24T05:45:55.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.155+0000 7f2a6efca700 1 -- 172.21.15.77:0/1549325440 wait complete. 2023-07-24T05:45:55.184 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-24T05:45:55.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.351+0000 7f74bdb26700 1 Processor -- start 2023-07-24T05:45:55.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.351+0000 7f74bdb26700 1 -- start start 2023-07-24T05:45:55.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.351+0000 7f74bdb26700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f74b8071640 0x7f74b80ce770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:55.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.351+0000 7f74bdb26700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f74b80cecb0 0x7f74b815d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:55.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.351+0000 7f74bdb26700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b806c330 con 0x7f74b81574f0 2023-07-24T05:45:55.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.351+0000 7f74bdb26700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b80cd220 con 0x7f74b80cecb0 2023-07-24T05:45:55.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.351+0000 7f74bdb26700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b80cf4a0 con 0x7f74b8071640 2023-07-24T05:45:55.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.355+0000 7f74b6ffd700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f74b8071640 0x7f74b80ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:55.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.355+0000 7f74b77fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f74b81574f0 0x7f74b8070f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.77:36336/0 (socket says 172.21.15.77:36336) 2023-07-24T05:45:55.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.355+0000 7f74b77fe700 1 -- 172.21.15.77:0/963841493 learned_addr learned my addr 172.21.15.77:0/963841493 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:45:55.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.355+0000 7f74b7fff700 1 --2- 172.21.15.77:0/963841493 >> v2:172.21.15.103:3300/0 conn(0x7f74b80cecb0 0x7f74b815d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:55.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.355+0000 7f74b6ffd700 1 -- 172.21.15.77:0/963841493 >> v2:172.21.15.103:3300/0 conn(0x7f74b80cecb0 msgr2=0x7f74b815d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:45:55.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.355+0000 7f74b6ffd700 1 --2- 172.21.15.77:0/963841493 >> v2:172.21.15.103:3300/0 conn(0x7f74b80cecb0 0x7f74b815d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:55.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.355+0000 7f74b6ffd700 1 -- 172.21.15.77:0/963841493 >> v1:172.21.15.103:6789/0 conn(0x7f74b81574f0 legacy=0x7f74b8070f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:55.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.355+0000 7f74b6ffd700 1 -- 172.21.15.77:0/963841493 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b81578d0 con 0x7f74b8071640 2023-07-24T05:45:55.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.355+0000 7f74b7fff700 1 --2- 172.21.15.77:0/963841493 >> v2:172.21.15.103:3300/0 conn(0x7f74b80cecb0 0x7f74b815d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:45:55.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.355+0000 7f74b6ffd700 1 --2- 172.21.15.77:0/963841493 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f74b8071640 0x7f74b80ce770 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f74ac009850 tx=0x7f74ac009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e7fab2b457f2e6c server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:55.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.355+0000 7f74b67fc700 1 -- 172.21.15.77:0/963841493 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac011830 con 0x7f74b8071640 2023-07-24T05:45:55.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.355+0000 7f74b67fc700 1 -- 172.21.15.77:0/963841493 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ac011990 con 0x7f74b8071640 2023-07-24T05:45:55.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.355+0000 7f74b67fc700 1 -- 172.21.15.77:0/963841493 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac011d20 con 0x7f74b8071640 2023-07-24T05:45:55.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.355+0000 7f74bdb26700 1 -- 172.21.15.77:0/963841493 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f74b8071640 msgr2=0x7f74b80ce770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:55.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.355+0000 7f74bdb26700 1 --2- 172.21.15.77:0/963841493 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f74b8071640 0x7f74b80ce770 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f74ac009850 tx=0x7f74ac009b60 comp rx=0 tx=0).stop 2023-07-24T05:45:55.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.355+0000 7f74bdb26700 1 -- 172.21.15.77:0/963841493 shutdown_connections 2023-07-24T05:45:55.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.355+0000 7f74bdb26700 1 --2- 172.21.15.77:0/963841493 >> v2:172.21.15.103:3300/0 conn(0x7f74b80cecb0 0x7f74b815d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:55.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.355+0000 7f74bdb26700 1 --2- 172.21.15.77:0/963841493 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f74b8071640 0x7f74b80ce770 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:55.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.355+0000 7f74bdb26700 1 -- 172.21.15.77:0/963841493 >> 172.21.15.77:0/963841493 conn(0x7f74b80cf650 msgr2=0x7f74b80cfa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:55.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.355+0000 7f74bdb26700 1 -- 172.21.15.77:0/963841493 shutdown_connections 2023-07-24T05:45:55.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.355+0000 7f74bdb26700 1 -- 172.21.15.77:0/963841493 wait complete. 2023-07-24T05:45:55.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.359+0000 7f74bdb26700 1 Processor -- start 2023-07-24T05:45:55.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.359+0000 7f74bdb26700 1 -- start start 2023-07-24T05:45:55.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.359+0000 7f74bdb26700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74b8071640 0x7f74b814a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:55.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.359+0000 7f74bdb26700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74b80cecb0 0x7f74b81563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:55.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.359+0000 7f74bdb26700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f74b81574f0 0x7f74b815b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:55.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.359+0000 7f74bdb26700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b80aee50 con 0x7f74b80cecb0 2023-07-24T05:45:55.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.359+0000 7f74bdb26700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b80af0a0 con 0x7f74b8071640 2023-07-24T05:45:55.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.359+0000 7f74bdb26700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b80af380 con 0x7f74b81574f0 2023-07-24T05:45:55.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.359+0000 7f74b6ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74b80cecb0 0x7f74b81563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:55.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.359+0000 7f74b6ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74b80cecb0 0x7f74b81563b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47014/0 (socket says 172.21.15.77:47014) 2023-07-24T05:45:55.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.359+0000 7f74b6ffd700 1 -- 172.21.15.77:0/659607427 learned_addr learned my addr 172.21.15.77:0/659607427 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:45:55.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.359+0000 7f74b77fe700 1 --2- 172.21.15.77:0/659607427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74b8071640 0x7f74b814a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:55.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.359+0000 7f74b7fff700 1 --2- 172.21.15.77:0/659607427 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f74b81574f0 0x7f74b815b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:55.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.359+0000 7f74b6ffd700 1 -- 172.21.15.77:0/659607427 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f74b81574f0 msgr2=0x7f74b815b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:55.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.359+0000 7f74b6ffd700 1 --2- 172.21.15.77:0/659607427 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f74b81574f0 0x7f74b815b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:55.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.359+0000 7f74b6ffd700 1 -- 172.21.15.77:0/659607427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74b8071640 msgr2=0x7f74b814a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:55.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.359+0000 7f74b6ffd700 1 --2- 172.21.15.77:0/659607427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74b8071640 0x7f74b814a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:55.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.359+0000 7f74b6ffd700 1 -- 172.21.15.77:0/659607427 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ac0094b0 con 0x7f74b80cecb0 2023-07-24T05:45:55.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.359+0000 7f74b6ffd700 1 --2- 172.21.15.77:0/659607427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74b80cecb0 0x7f74b81563b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f74ac000c00 tx=0x7f74ac004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:55.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.363+0000 7f749ffff700 1 -- 172.21.15.77:0/659607427 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac004400 con 0x7f74b80cecb0 2023-07-24T05:45:55.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.363+0000 7f749ffff700 1 -- 172.21.15.77:0/659607427 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ac01f070 con 0x7f74b80cecb0 2023-07-24T05:45:55.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.363+0000 7f74bdb26700 1 -- 172.21.15.77:0/659607427 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b80af660 con 0x7f74b80cecb0 2023-07-24T05:45:55.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.363+0000 7f749ffff700 1 -- 172.21.15.77:0/659607427 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac003900 con 0x7f74b80cecb0 2023-07-24T05:45:55.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.363+0000 7f74bdb26700 1 -- 172.21.15.77:0/659607427 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b81568f0 con 0x7f74b80cecb0 2023-07-24T05:45:55.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.363+0000 7f74bdb26700 1 -- 172.21.15.77:0/659607427 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b80afb80 con 0x7f74b80cecb0 2023-07-24T05:45:55.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.363+0000 7f749ffff700 1 -- 172.21.15.77:0/659607427 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 4) v1 ==== 85602+0+0 (secure 0 0 0) 0x7f74ac021030 con 0x7f74b80cecb0 2023-07-24T05:45:55.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.367+0000 7f749ffff700 1 --2- 172.21.15.77:0/659607427 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f74a4066260 0x7f74a4068720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:55.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.367+0000 7f749ffff700 1 -- 172.21.15.77:0/659607427 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f74ac084cd0 con 0x7f74b80cecb0 2023-07-24T05:45:55.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.367+0000 7f74b77fe700 1 --2- 172.21.15.77:0/659607427 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f74a4066260 0x7f74a4068720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:55.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.367+0000 7f74b77fe700 1 --2- 172.21.15.77:0/659607427 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f74a4066260 0x7f74a4068720 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f74a8005930 tx=0x7f74a8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:55.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.371+0000 7f749ffff700 1 -- 172.21.15.77:0/659607427 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f74b80afb80 con 0x7f74b80cecb0 2023-07-24T05:45:55.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.411+0000 7f749ffff700 1 -- 172.21.15.77:0/659607427 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f74ac0528c0 con 0x7f74b80cecb0 2023-07-24T05:45:55.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.543+0000 7f74bdb26700 1 -- 172.21.15.77:0/659607427 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f74b80afb80 con 0x7f74b80cecb0 2023-07-24T05:45:55.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.543+0000 7f749ffff700 1 -- 172.21.15.77:0/659607427 <== mon.0 v2:172.21.15.77:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f74b80afb80 con 0x7f74b80cecb0 2023-07-24T05:45:55.546 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 8 2023-07-24T05:45:55.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.547+0000 7f74bdb26700 1 -- 172.21.15.77:0/659607427 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f74a4066260 msgr2=0x7f74a4068720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:55.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.547+0000 7f74bdb26700 1 --2- 172.21.15.77:0/659607427 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f74a4066260 0x7f74a4068720 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f74a8005930 tx=0x7f74a8009040 comp rx=0 tx=0).stop 2023-07-24T05:45:55.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.547+0000 7f74bdb26700 1 -- 172.21.15.77:0/659607427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74b80cecb0 msgr2=0x7f74b81563b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:55.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.547+0000 7f74bdb26700 1 --2- 172.21.15.77:0/659607427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74b80cecb0 0x7f74b81563b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f74ac000c00 tx=0x7f74ac004770 comp rx=0 tx=0).stop 2023-07-24T05:45:55.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.547+0000 7f74bdb26700 1 -- 172.21.15.77:0/659607427 shutdown_connections 2023-07-24T05:45:55.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.547+0000 7f74bdb26700 1 --2- 172.21.15.77:0/659607427 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f74a4066260 0x7f74a4068720 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:55.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.547+0000 7f74bdb26700 1 --2- 172.21.15.77:0/659607427 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f74b81574f0 0x7f74b815b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:55.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.547+0000 7f74bdb26700 1 --2- 172.21.15.77:0/659607427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74b80cecb0 0x7f74b81563b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:55.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.547+0000 7f74bdb26700 1 --2- 172.21.15.77:0/659607427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74b8071640 0x7f74b814a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:55.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.547+0000 7f74bdb26700 1 -- 172.21.15.77:0/659607427 >> 172.21.15.77:0/659607427 conn(0x7f74b80cf650 msgr2=0x7f74b814cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:55.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.547+0000 7f74bdb26700 1 -- 172.21.15.77:0/659607427 shutdown_connections 2023-07-24T05:45:55.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.547+0000 7f74bdb26700 1 -- 172.21.15.77:0/659607427 wait complete. 2023-07-24T05:45:55.573 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-24T05:45:55.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.747+0000 7fb1b96d1700 1 Processor -- start 2023-07-24T05:45:55.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.747+0000 7fb1b96d1700 1 -- start start 2023-07-24T05:45:55.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.747+0000 7fb1b96d1700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb1b40b0d60 0x7fb1b40702f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:55.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.747+0000 7fb1b96d1700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1b415ce70 con 0x7fb1b415a390 2023-07-24T05:45:55.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.747+0000 7fb1b96d1700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1b415d130 con 0x7fb1b40cdfd0 2023-07-24T05:45:55.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.747+0000 7fb1b96d1700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1b415d410 con 0x7fb1b40b0d60 2023-07-24T05:45:55.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.751+0000 7fb1b3fff700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb1b415a390 0x7fb1b40b0650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:50884/0 (socket says 172.21.15.77:50884) 2023-07-24T05:45:55.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.751+0000 7fb1b3fff700 1 -- 172.21.15.77:0/2323901913 learned_addr learned my addr 172.21.15.77:0/2323901913 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:45:55.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.751+0000 7fb1ab7fe700 1 --2- 172.21.15.77:0/2323901913 >> v2:172.21.15.77:3300/0 conn(0x7fb1b40b0d60 0x7fb1b40702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:55.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.751+0000 7fb1b37fe700 1 -- 172.21.15.77:0/2323901913 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1022074453 0 0) 0x7fb1b415ce70 con 0x7fb1b415a390 2023-07-24T05:45:55.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.751+0000 7fb1ab7fe700 1 -- 172.21.15.77:0/2323901913 >> v1:172.21.15.103:6789/0 conn(0x7fb1b40cdfd0 legacy=0x7fb1b4160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:55.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.751+0000 7fb1ab7fe700 1 -- 172.21.15.77:0/2323901913 >> v1:172.21.15.77:6789/0 conn(0x7fb1b415a390 legacy=0x7fb1b40b0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:55.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.751+0000 7fb1ab7fe700 1 -- 172.21.15.77:0/2323901913 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b415d6f0 con 0x7fb1b40b0d60 2023-07-24T05:45:55.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.751+0000 7fb1ab7fe700 1 --2- 172.21.15.77:0/2323901913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b40b0d60 0x7fb1b40702f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb19c0097d0 tx=0x7fb19c009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e1713cc21ced623 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:55.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.751+0000 7fb1b37fe700 1 -- 172.21.15.77:0/2323901913 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c004230 con 0x7fb1b40b0d60 2023-07-24T05:45:55.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.751+0000 7fb1b37fe700 1 -- 172.21.15.77:0/2323901913 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb19c004390 con 0x7fb1b40b0d60 2023-07-24T05:45:55.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.751+0000 7fb1b37fe700 1 -- 172.21.15.77:0/2323901913 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c0036c0 con 0x7fb1b40b0d60 2023-07-24T05:45:55.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.751+0000 7fb1b96d1700 1 -- 172.21.15.77:0/2323901913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b40b0d60 msgr2=0x7fb1b40702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:55.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.751+0000 7fb1b96d1700 1 --2- 172.21.15.77:0/2323901913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b40b0d60 0x7fb1b40702f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb19c0097d0 tx=0x7fb19c009ae0 comp rx=0 tx=0).stop 2023-07-24T05:45:55.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.751+0000 7fb1b96d1700 1 -- 172.21.15.77:0/2323901913 shutdown_connections 2023-07-24T05:45:55.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.751+0000 7fb1b96d1700 1 --2- 172.21.15.77:0/2323901913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b40b0d60 0x7fb1b40702f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:55.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.751+0000 7fb1b96d1700 1 -- 172.21.15.77:0/2323901913 >> 172.21.15.77:0/2323901913 conn(0x7fb1b40ced00 msgr2=0x7fb1b40cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:55.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.751+0000 7fb1b96d1700 1 -- 172.21.15.77:0/2323901913 shutdown_connections 2023-07-24T05:45:55.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.751+0000 7fb1b96d1700 1 -- 172.21.15.77:0/2323901913 wait complete. 2023-07-24T05:45:55.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.755+0000 7fb1b96d1700 1 Processor -- start 2023-07-24T05:45:55.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.755+0000 7fb1b96d1700 1 -- start start 2023-07-24T05:45:55.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.755+0000 7fb1b96d1700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1b40b0d60 0x7fb1b41444e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:55.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.755+0000 7fb1b96d1700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb1b40cdfd0 0x7fb1b4153b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:55.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.755+0000 7fb1b96d1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b415a390 0x7fb1b40c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:55.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.755+0000 7fb1b96d1700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b41544e0 con 0x7fb1b415a390 2023-07-24T05:45:55.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.755+0000 7fb1b96d1700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b4145770 con 0x7fb1b40b0d60 2023-07-24T05:45:55.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.755+0000 7fb1b96d1700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b4145c00 con 0x7fb1b40cdfd0 2023-07-24T05:45:55.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.755+0000 7fb1b8ed0700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b415a390 0x7fb1b40c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:55.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.755+0000 7fb1b8ed0700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b415a390 0x7fb1b40c90c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47022/0 (socket says 172.21.15.77:47022) 2023-07-24T05:45:55.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.755+0000 7fb1b8ed0700 1 -- 172.21.15.77:0/2980576830 learned_addr learned my addr 172.21.15.77:0/2980576830 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:45:55.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.755+0000 7fb1b3fff700 1 --2- 172.21.15.77:0/2980576830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1b40b0d60 0x7fb1b41444e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:55.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.755+0000 7fb1ab7fe700 1 --2- 172.21.15.77:0/2980576830 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb1b40cdfd0 0x7fb1b4153b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:55.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.755+0000 7fb1b8ed0700 1 -- 172.21.15.77:0/2980576830 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb1b40cdfd0 msgr2=0x7fb1b4153b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:55.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.755+0000 7fb1b8ed0700 1 --2- 172.21.15.77:0/2980576830 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb1b40cdfd0 0x7fb1b4153b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:55.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.755+0000 7fb1b8ed0700 1 -- 172.21.15.77:0/2980576830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1b40b0d60 msgr2=0x7fb1b41444e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:55.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.755+0000 7fb1b8ed0700 1 --2- 172.21.15.77:0/2980576830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1b40b0d60 0x7fb1b41444e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:55.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.755+0000 7fb1b8ed0700 1 -- 172.21.15.77:0/2980576830 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb19c0094b0 con 0x7fb1b415a390 2023-07-24T05:45:55.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.755+0000 7fb1b3fff700 1 --2- 172.21.15.77:0/2980576830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1b40b0d60 0x7fb1b41444e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:45:55.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.759+0000 7fb1b8ed0700 1 --2- 172.21.15.77:0/2980576830 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b415a390 0x7fb1b40c90c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac002040 tx=0x7fb1ac00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:55.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.759+0000 7fb1b17fa700 1 -- 172.21.15.77:0/2980576830 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac003e50 con 0x7fb1b415a390 2023-07-24T05:45:55.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.759+0000 7fb1b17fa700 1 -- 172.21.15.77:0/2980576830 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1ac00a930 con 0x7fb1b415a390 2023-07-24T05:45:55.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.759+0000 7fb1b96d1700 1 -- 172.21.15.77:0/2980576830 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b4144e40 con 0x7fb1b415a390 2023-07-24T05:45:55.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.759+0000 7fb1b17fa700 1 -- 172.21.15.77:0/2980576830 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac00acc0 con 0x7fb1b415a390 2023-07-24T05:45:55.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.759+0000 7fb1b96d1700 1 -- 172.21.15.77:0/2980576830 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b4145400 con 0x7fb1b415a390 2023-07-24T05:45:55.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.759+0000 7fb1b96d1700 1 -- 172.21.15.77:0/2980576830 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1b40719c0 con 0x7fb1b415a390 2023-07-24T05:45:55.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.763+0000 7fb1b17fa700 1 -- 172.21.15.77:0/2980576830 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb1ac005070 con 0x7fb1b415a390 2023-07-24T05:45:55.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.763+0000 7fb1b17fa700 1 --2- 172.21.15.77:0/2980576830 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb194066320 0x7fb1940687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:55.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.763+0000 7fb1b17fa700 1 -- 172.21.15.77:0/2980576830 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb1ac083540 con 0x7fb1b415a390 2023-07-24T05:45:55.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.763+0000 7fb1b3fff700 1 --2- 172.21.15.77:0/2980576830 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb194066320 0x7fb1940687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:55.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.763+0000 7fb1b3fff700 1 --2- 172.21.15.77:0/2980576830 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb194066320 0x7fb1940687e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4000f60 tx=0x7fb1a4007cc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:55.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.771+0000 7fb1b17fa700 1 -- 172.21.15.77:0/2980576830 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb1ac050da0 con 0x7fb1b415a390 2023-07-24T05:45:55.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.979+0000 7fb1b96d1700 1 -- 172.21.15.77:0/2980576830 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb1b41458e0 con 0x7fb1b415a390 2023-07-24T05:45:55.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.979+0000 7fb1b17fa700 1 -- 172.21.15.77:0/2980576830 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3527 (secure 0 0 0) 0x7fb1ac017090 con 0x7fb1b415a390 2023-07-24T05:45:55.984 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:45:55.984 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/4201639271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4201639271},{"type":"v1","addr":"172.21.15.77:6834","nonce":4201639271}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/993116623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":993116623},{"type":"v1","addr":"172.21.15.103:6835","nonce":993116623}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/1196529067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":1196529067},{"type":"v1","addr":"172.21.15.103:6837","nonce":1196529067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2428690206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2428690206},{"type":"v1","addr":"172.21.15.77:6835","nonce":2428690206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-07-24T05:45:55.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.983+0000 7fb1b96d1700 1 -- 172.21.15.77:0/2980576830 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb194066320 msgr2=0x7fb1940687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:55.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.983+0000 7fb1b96d1700 1 --2- 172.21.15.77:0/2980576830 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb194066320 0x7fb1940687e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4000f60 tx=0x7fb1a4007cc0 comp rx=0 tx=0).stop 2023-07-24T05:45:55.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.983+0000 7fb1b96d1700 1 -- 172.21.15.77:0/2980576830 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b415a390 msgr2=0x7fb1b40c90c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:55.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.983+0000 7fb1b96d1700 1 --2- 172.21.15.77:0/2980576830 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b415a390 0x7fb1b40c90c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac002040 tx=0x7fb1ac00a340 comp rx=0 tx=0).stop 2023-07-24T05:45:55.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.983+0000 7fb1b96d1700 1 -- 172.21.15.77:0/2980576830 shutdown_connections 2023-07-24T05:45:55.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.983+0000 7fb1b96d1700 1 --2- 172.21.15.77:0/2980576830 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1b415a390 0x7fb1b40c90c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:55.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.983+0000 7fb1b96d1700 1 --2- 172.21.15.77:0/2980576830 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb194066320 0x7fb1940687e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:55.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.983+0000 7fb1b96d1700 1 --2- 172.21.15.77:0/2980576830 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb1b40cdfd0 0x7fb1b4153b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:55.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.983+0000 7fb1b96d1700 1 --2- 172.21.15.77:0/2980576830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1b40b0d60 0x7fb1b41444e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:55.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.983+0000 7fb1b96d1700 1 -- 172.21.15.77:0/2980576830 >> 172.21.15.77:0/2980576830 conn(0x7fb1b40ced00 msgr2=0x7fb1b40702f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:55.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.983+0000 7fb1b96d1700 1 -- 172.21.15.77:0/2980576830 shutdown_connections 2023-07-24T05:45:55.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:55.983+0000 7fb1b96d1700 1 -- 172.21.15.77:0/2980576830 wait complete. 2023-07-24T05:45:55.990 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 3 2023-07-24T05:45:56.010 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-24T05:45:56.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.179+0000 7f6124b3f700 1 Processor -- start 2023-07-24T05:45:56.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.179+0000 7f6124b3f700 1 -- start start 2023-07-24T05:45:56.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.183+0000 7f6124b3f700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6120154e20 0x7f61200cef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:56.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.183+0000 7f6124b3f700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f612015e390 0x7f612015e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:56.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.183+0000 7f6124b3f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f612006cbd0 0x7f612006d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:56.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.183+0000 7f6124b3f700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f612006d5a0 con 0x7f6120154e20 2023-07-24T05:45:56.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.183+0000 7f6124b3f700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6120155200 con 0x7f612006cbd0 2023-07-24T05:45:56.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.183+0000 7f6124b3f700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f612015b0f0 con 0x7f612015e390 2023-07-24T05:45:56.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.183+0000 7f611e59c700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6120154e20 0x7f61200cef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:56.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.183+0000 7f611ed9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f612006cbd0 0x7f612006d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:56.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.183+0000 7f611dd9b700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f612015e390 0x7f612015e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:56.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.183+0000 7f611e59c700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6120154e20 0x7f61200cef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47036/0 (socket says 172.21.15.77:47036) 2023-07-24T05:45:56.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.183+0000 7f611ed9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f612006cbd0 0x7f612006d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:37678/0 (socket says 172.21.15.77:37678) 2023-07-24T05:45:56.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.183+0000 7f611e59c700 1 -- 172.21.15.77:0/3141518054 learned_addr learned my addr 172.21.15.77:0/3141518054 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:45:56.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.183+0000 7f611e59c700 1 -- 172.21.15.77:0/3141518054 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f612015e390 msgr2=0x7f612015e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:45:56.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.183+0000 7f611e59c700 1 --2- 172.21.15.77:0/3141518054 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f612015e390 0x7f612015e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:56.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.183+0000 7f611e59c700 1 -- 172.21.15.77:0/3141518054 >> v2:172.21.15.103:3300/0 conn(0x7f612006cbd0 msgr2=0x7f612006d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:45:56.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.183+0000 7f611e59c700 1 --2- 172.21.15.77:0/3141518054 >> v2:172.21.15.103:3300/0 conn(0x7f612006cbd0 0x7f612006d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:56.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.183+0000 7f611e59c700 1 -- 172.21.15.77:0/3141518054 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f612015ef00 con 0x7f6120154e20 2023-07-24T05:45:56.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.183+0000 7f611ed9d700 1 --2- 172.21.15.77:0/3141518054 >> v2:172.21.15.103:3300/0 conn(0x7f612006cbd0 0x7f612006d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:45:56.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.187+0000 7f611e59c700 1 --2- 172.21.15.77:0/3141518054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6120154e20 0x7f61200cef40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f61200c54d0 tx=0x7f611000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a2b8d5bb9ee01a0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:56.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.187+0000 7f611d59a700 1 -- 172.21.15.77:0/3141518054 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611000e070 con 0x7f6120154e20 2023-07-24T05:45:56.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.187+0000 7f611d59a700 1 -- 172.21.15.77:0/3141518054 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611000b910 con 0x7f6120154e20 2023-07-24T05:45:56.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.187+0000 7f611d59a700 1 -- 172.21.15.77:0/3141518054 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611000bcc0 con 0x7f6120154e20 2023-07-24T05:45:56.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.187+0000 7f6124b3f700 1 -- 172.21.15.77:0/3141518054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6120154e20 msgr2=0x7f61200cef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:56.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.187+0000 7f6124b3f700 1 --2- 172.21.15.77:0/3141518054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6120154e20 0x7f61200cef40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f61200c54d0 tx=0x7f611000b330 comp rx=0 tx=0).stop 2023-07-24T05:45:56.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.187+0000 7f6124b3f700 1 -- 172.21.15.77:0/3141518054 shutdown_connections 2023-07-24T05:45:56.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.187+0000 7f6124b3f700 1 --2- 172.21.15.77:0/3141518054 >> v2:172.21.15.103:3300/0 conn(0x7f612006cbd0 0x7f612006d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:56.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.187+0000 7f6124b3f700 1 --2- 172.21.15.77:0/3141518054 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f612015e390 0x7f612015e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:56.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.187+0000 7f6124b3f700 1 --2- 172.21.15.77:0/3141518054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6120154e20 0x7f61200cef40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:56.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.187+0000 7f6124b3f700 1 -- 172.21.15.77:0/3141518054 >> 172.21.15.77:0/3141518054 conn(0x7f61200b3450 msgr2=0x7f61200b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:56.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.187+0000 7f6124b3f700 1 -- 172.21.15.77:0/3141518054 shutdown_connections 2023-07-24T05:45:56.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.187+0000 7f6124b3f700 1 -- 172.21.15.77:0/3141518054 wait complete. 2023-07-24T05:45:56.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.191+0000 7f6124b3f700 1 Processor -- start 2023-07-24T05:45:56.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.191+0000 7f6124b3f700 1 -- start start 2023-07-24T05:45:56.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.191+0000 7f6124b3f700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f612006cbd0 0x7f61200c1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:56.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.191+0000 7f6124b3f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6120154e20 0x7f6120096360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:56.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.191+0000 7f6124b3f700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f612015e390 0x7f612015d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:56.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.191+0000 7f6124b3f700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61200c1570 con 0x7f6120154e20 2023-07-24T05:45:56.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.191+0000 7f6124b3f700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6120097950 con 0x7f612015e390 2023-07-24T05:45:56.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.191+0000 7f6124b3f700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6120096d40 con 0x7f612006cbd0 2023-07-24T05:45:56.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.191+0000 7f611dd9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6120154e20 0x7f6120096360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:56.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.191+0000 7f611dd9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6120154e20 0x7f6120096360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47042/0 (socket says 172.21.15.77:47042) 2023-07-24T05:45:56.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.191+0000 7f611dd9b700 1 -- 172.21.15.77:0/3269940452 learned_addr learned my addr 172.21.15.77:0/3269940452 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:45:56.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.191+0000 7f611ed9d700 1 --2- 172.21.15.77:0/3269940452 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f612015e390 0x7f612015d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:56.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.191+0000 7f611e59c700 1 --2- 172.21.15.77:0/3269940452 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f612006cbd0 0x7f61200c1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:56.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.191+0000 7f611dd9b700 1 -- 172.21.15.77:0/3269940452 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f612006cbd0 msgr2=0x7f61200c1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:56.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.191+0000 7f611dd9b700 1 --2- 172.21.15.77:0/3269940452 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f612006cbd0 0x7f61200c1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:56.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.191+0000 7f611dd9b700 1 -- 172.21.15.77:0/3269940452 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f612015e390 msgr2=0x7f612015d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:56.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.191+0000 7f611dd9b700 1 --2- 172.21.15.77:0/3269940452 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f612015e390 0x7f612015d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:56.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.191+0000 7f611dd9b700 1 -- 172.21.15.77:0/3269940452 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61180094b0 con 0x7f6120154e20 2023-07-24T05:45:56.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.191+0000 7f611e59c700 1 --2- 172.21.15.77:0/3269940452 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f612006cbd0 0x7f61200c1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:45:56.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.191+0000 7f611ed9d700 1 --2- 172.21.15.77:0/3269940452 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f612015e390 0x7f612015d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:45:56.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.191+0000 7f611dd9b700 1 --2- 172.21.15.77:0/3269940452 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6120154e20 0x7f6120096360 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f611400ebe0 tx=0x7f6114009e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:56.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.191+0000 7f610effd700 1 -- 172.21.15.77:0/3269940452 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6114009740 con 0x7f6120154e20 2023-07-24T05:45:56.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.191+0000 7f610effd700 1 -- 172.21.15.77:0/3269940452 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611400c7f0 con 0x7f6120154e20 2023-07-24T05:45:56.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.191+0000 7f6124b3f700 1 -- 172.21.15.77:0/3269940452 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6110009b30 con 0x7f6120154e20 2023-07-24T05:45:56.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.191+0000 7f610effd700 1 -- 172.21.15.77:0/3269940452 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611400cba0 con 0x7f6120154e20 2023-07-24T05:45:56.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.191+0000 7f6124b3f700 1 -- 172.21.15.77:0/3269940452 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6120097300 con 0x7f6120154e20 2023-07-24T05:45:56.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.195+0000 7f6124b3f700 1 -- 172.21.15.77:0/3269940452 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6120097a90 con 0x7f6120154e20 2023-07-24T05:45:56.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.195+0000 7f610effd700 1 -- 172.21.15.77:0/3269940452 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f611400cd00 con 0x7f6120154e20 2023-07-24T05:45:56.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.199+0000 7f610effd700 1 --2- 172.21.15.77:0/3269940452 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f61000662f0 0x7f61000687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:56.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.199+0000 7f610effd700 1 -- 172.21.15.77:0/3269940452 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6114083ef0 con 0x7f6120154e20 2023-07-24T05:45:56.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.199+0000 7f611e59c700 1 --2- 172.21.15.77:0/3269940452 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f61000662f0 0x7f61000687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:56.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.199+0000 7f611e59c700 1 --2- 172.21.15.77:0/3269940452 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f61000662f0 0x7f61000687b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6110000f80 tx=0x7f6110009000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:56.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.203+0000 7f610effd700 1 -- 172.21.15.77:0/3269940452 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f61140550b0 con 0x7f6120154e20 2023-07-24T05:45:56.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.379+0000 7f6124b3f700 1 -- 172.21.15.77:0/3269940452 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f612004df10 con 0x7f6120154e20 2023-07-24T05:45:56.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.379+0000 7f610effd700 1 -- 172.21.15.77:0/3269940452 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+14624 (secure 0 0 0) 0x7f6114054c40 con 0x7f6120154e20 2023-07-24T05:45:56.384 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:45:56.385 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":17,"fsid":"5aed5f7b-fb55-4d95-9c02-c6adbb1677b4","created":"2023-07-24T05:45:39.639731+0000","modified":"2023-07-24T05:45:55.332067+0000","last_up_change":"2023-07-24T05:45:52.319670+0000","last_in_change":"2023-07-24T05:45:43.643277+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-24T05:45:52.610430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-24T05:45:52.773787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ffa0d496-461a-4053-b764-0627d969521b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6812","nonce":825987196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6817","nonce":825987196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6831","nonce":825987196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6824","nonce":825987196}]},"public_addr":"172.21.15.77:6812/825987196","cluster_addr":"172.21.15.77:6817/825987196","heartbeat_back_addr":"172.21.15.77:6831/825987196","heartbeat_front_addr":"172.21.15.77:6824/825987196","state":["exists","up"]},{"osd":1,"uuid":"9f595e5e-5c43-49bc-8ce4-ee70575c90da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6801","nonce":4133026815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6803","nonce":4133026815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6807","nonce":4133026815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6805","nonce":4133026815}]},"public_addr":"172.21.15.77:6801/4133026815","cluster_addr":"172.21.15.77:6803/4133026815","heartbeat_back_addr":"172.21.15.77:6807/4133026815","heartbeat_front_addr":"172.21.15.77:6805/4133026815","state":["exists","up"]},{"osd":2,"uuid":"2ac177aa-4d7d-4262-bd54-d2b9f29f4c3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6811","nonce":2394142159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6819","nonce":2394142159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6830","nonce":2394142159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6825","nonce":2394142159}]},"public_addr":"172.21.15.77:6811/2394142159","cluster_addr":"172.21.15.77:6819/2394142159","heartbeat_back_addr":"172.21.15.77:6830/2394142159","heartbeat_front_addr":"172.21.15.77:6825/2394142159","state":["exists","up"]},{"osd":3,"uuid":"17d7a251-19e8-484c-8172-a578ab3da153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6813","nonce":1492113982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6818","nonce":1492113982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6829","nonce":1492113982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6823","nonce":1492113982}]},"public_addr":"172.21.15.77:6813/1492113982","cluster_addr":"172.21.15.77:6818/1492113982","heartbeat_back_addr":"172.21.15.77:6829/1492113982","heartbeat_front_addr":"172.21.15.77:6823/1492113982","state":["exists","up"]},{"osd":4,"uuid":"bf63ca05-f06d-4e0f-ac44-2a416c70b919","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6825","nonce":1080481057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6827","nonce":1080481057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6831","nonce":1080481057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6829","nonce":1080481057}]},"public_addr":"172.21.15.103:6825/1080481057","cluster_addr":"172.21.15.103:6827/1080481057","heartbeat_back_addr":"172.21.15.103:6831/1080481057","heartbeat_front_addr":"172.21.15.103:6829/1080481057","state":["exists","up"]},{"osd":5,"uuid":"65a11a35-9e9f-4b3c-9fe3-b658d62b9318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6811","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6813","nonce":2756677504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6818","nonce":2756677504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6823","nonce":2756677504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6821","nonce":2756677504}]},"public_addr":"172.21.15.103:6813/2756677504","cluster_addr":"172.21.15.103:6818/2756677504","heartbeat_back_addr":"172.21.15.103:6823/2756677504","heartbeat_front_addr":"172.21.15.103:6821/2756677504","state":["exists","up"]},{"osd":6,"uuid":"750c1f87-686c-40b4-94a1-1a299dc78f3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6809","nonce":568977764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6812","nonce":568977764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6819","nonce":568977764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6815","nonce":568977764}]},"public_addr":"172.21.15.103:6809/568977764","cluster_addr":"172.21.15.103:6812/568977764","heartbeat_back_addr":"172.21.15.103:6819/568977764","heartbeat_front_addr":"172.21.15.103:6815/568977764","state":["exists","up"]},{"osd":7,"uuid":"d5fe4fb6-2e09-4158-885b-403803c85822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6801","nonce":1074557176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6803","nonce":1074557176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6807","nonce":1074557176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6805","nonce":1074557176}]},"public_addr":"172.21.15.103:6801/1074557176","cluster_addr":"172.21.15.103:6803/1074557176","heartbeat_back_addr":"172.21.15.103:6807/1074557176","heartbeat_front_addr":"172.21.15.103:6805/1074557176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.631032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.154109+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.398587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.679089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.311218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.353726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.314372+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.126212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-24T05:45:56.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.383+0000 7f6124b3f700 1 -- 172.21.15.77:0/3269940452 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f61000662f0 msgr2=0x7f61000687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:56.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.383+0000 7f6124b3f700 1 --2- 172.21.15.77:0/3269940452 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f61000662f0 0x7f61000687b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6110000f80 tx=0x7f6110009000 comp rx=0 tx=0).stop 2023-07-24T05:45:56.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.383+0000 7f6124b3f700 1 -- 172.21.15.77:0/3269940452 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6120154e20 msgr2=0x7f6120096360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:56.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.383+0000 7f6124b3f700 1 --2- 172.21.15.77:0/3269940452 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6120154e20 0x7f6120096360 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f611400ebe0 tx=0x7f6114009e00 comp rx=0 tx=0).stop 2023-07-24T05:45:56.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.383+0000 7f6124b3f700 1 -- 172.21.15.77:0/3269940452 shutdown_connections 2023-07-24T05:45:56.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.383+0000 7f6124b3f700 1 --2- 172.21.15.77:0/3269940452 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f612015e390 0x7f612015d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:56.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.383+0000 7f6124b3f700 1 --2- 172.21.15.77:0/3269940452 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6120154e20 0x7f6120096360 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:56.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.383+0000 7f6124b3f700 1 --2- 172.21.15.77:0/3269940452 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f61000662f0 0x7f61000687b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:56.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.383+0000 7f6124b3f700 1 --2- 172.21.15.77:0/3269940452 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f612006cbd0 0x7f61200c1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:56.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.383+0000 7f6124b3f700 1 -- 172.21.15.77:0/3269940452 >> 172.21.15.77:0/3269940452 conn(0x7f61200b3450 msgr2=0x7f6120070c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:56.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.383+0000 7f6124b3f700 1 -- 172.21.15.77:0/3269940452 shutdown_connections 2023-07-24T05:45:56.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.383+0000 7f6124b3f700 1 -- 172.21.15.77:0/3269940452 wait complete. 2023-07-24T05:45:56.409 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-24T05:45:52.610430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-24T05:45:52.773787+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-24T05:45:56.409 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-24T05:45:56.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.583+0000 7fa2ef093700 1 Processor -- start 2023-07-24T05:45:56.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.583+0000 7fa2ef093700 1 -- start start 2023-07-24T05:45:56.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.583+0000 7fa2ef093700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa2e80d2fc0 0x7fa2e80b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:56.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.583+0000 7fa2ef093700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e80d0360 con 0x7fa2e815db20 2023-07-24T05:45:56.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.583+0000 7fa2ef093700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e8160fa0 con 0x7fa2e806afc0 2023-07-24T05:45:56.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.583+0000 7fa2ef093700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e80b20b0 con 0x7fa2e80d2fc0 2023-07-24T05:45:56.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.587+0000 7fa2ed630700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fa2e815db20 0x7fa2e80d1520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:50890/0 (socket says 172.21.15.77:50890) 2023-07-24T05:45:56.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.587+0000 7fa2ed630700 1 -- 172.21.15.77:0/2335353825 learned_addr learned my addr 172.21.15.77:0/2335353825 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:45:56.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.587+0000 7fa2e7fff700 1 --2- 172.21.15.77:0/2335353825 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa2e80d2fc0 0x7fa2e80b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:56.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.587+0000 7fa2e77fe700 1 -- 172.21.15.77:0/2335353825 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3718136087 0 0) 0x7fa2e80d0360 con 0x7fa2e815db20 2023-07-24T05:45:56.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.587+0000 7fa2e77fe700 1 -- 172.21.15.77:0/2335353825 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2d80035d0 con 0x7fa2e815db20 2023-07-24T05:45:56.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.587+0000 7fa2e77fe700 1 -- 172.21.15.77:0/2335353825 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2244995240 0 0) 0x7fa2e8160fa0 con 0x7fa2e806afc0 2023-07-24T05:45:56.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.587+0000 7fa2e77fe700 1 -- 172.21.15.77:0/2335353825 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2e80d0360 con 0x7fa2e806afc0 2023-07-24T05:45:56.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.587+0000 7fa2e7fff700 1 -- 172.21.15.77:0/2335353825 >> v1:172.21.15.103:6789/0 conn(0x7fa2e806afc0 legacy=0x7fa2e80d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:56.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.587+0000 7fa2e7fff700 1 -- 172.21.15.77:0/2335353825 >> v1:172.21.15.77:6789/0 conn(0x7fa2e815db20 legacy=0x7fa2e80d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:56.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.587+0000 7fa2e7fff700 1 -- 172.21.15.77:0/2335353825 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e8160670 con 0x7fa2e80d2fc0 2023-07-24T05:45:56.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.587+0000 7fa2e7fff700 1 --2- 172.21.15.77:0/2335353825 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa2e80d2fc0 0x7fa2e80b1a20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4009880 tx=0x7fa2d4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5492352b4379fe6c server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:56.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.587+0000 7fa2e77fe700 1 -- 172.21.15.77:0/2335353825 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d4004230 con 0x7fa2e80d2fc0 2023-07-24T05:45:56.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.587+0000 7fa2e77fe700 1 -- 172.21.15.77:0/2335353825 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d4004390 con 0x7fa2e80d2fc0 2023-07-24T05:45:56.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.587+0000 7fa2e77fe700 1 -- 172.21.15.77:0/2335353825 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d40036c0 con 0x7fa2e80d2fc0 2023-07-24T05:45:56.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.587+0000 7fa2ef093700 1 -- 172.21.15.77:0/2335353825 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa2e80d2fc0 msgr2=0x7fa2e80b1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:56.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.587+0000 7fa2ef093700 1 --2- 172.21.15.77:0/2335353825 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa2e80d2fc0 0x7fa2e80b1a20 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4009880 tx=0x7fa2d4009b90 comp rx=0 tx=0).stop 2023-07-24T05:45:56.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.587+0000 7fa2ef093700 1 -- 172.21.15.77:0/2335353825 shutdown_connections 2023-07-24T05:45:56.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.587+0000 7fa2ef093700 1 --2- 172.21.15.77:0/2335353825 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa2e80d2fc0 0x7fa2e80b1a20 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:56.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.587+0000 7fa2ef093700 1 -- 172.21.15.77:0/2335353825 >> 172.21.15.77:0/2335353825 conn(0x7fa2e809bc20 msgr2=0x7fa2e80b7920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:56.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.587+0000 7fa2ef093700 1 -- 172.21.15.77:0/2335353825 shutdown_connections 2023-07-24T05:45:56.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.587+0000 7fa2ef093700 1 -- 172.21.15.77:0/2335353825 wait complete. 2023-07-24T05:45:56.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.591+0000 7fa2ef093700 1 Processor -- start 2023-07-24T05:45:56.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.591+0000 7fa2ef093700 1 -- start start 2023-07-24T05:45:56.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.591+0000 7fa2ef093700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa2e806afc0 0x7fa2e81501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:56.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.591+0000 7fa2ef093700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2e80d2fc0 0x7fa2e80ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:56.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.591+0000 7fa2ef093700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2e815db20 0x7fa2e80b4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:56.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.591+0000 7fa2ef093700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e81f68c0 con 0x7fa2e80d2fc0 2023-07-24T05:45:56.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.591+0000 7fa2ef093700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e80b2e70 con 0x7fa2e815db20 2023-07-24T05:45:56.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.591+0000 7fa2ef093700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e80b2540 con 0x7fa2e806afc0 2023-07-24T05:45:56.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.591+0000 7fa2e7fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2e80d2fc0 0x7fa2e80ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:56.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.591+0000 7fa2e7fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2e80d2fc0 0x7fa2e80ca3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47054/0 (socket says 172.21.15.77:47054) 2023-07-24T05:45:56.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.591+0000 7fa2e7fff700 1 -- 172.21.15.77:0/95452236 learned_addr learned my addr 172.21.15.77:0/95452236 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:45:56.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.591+0000 7fa2ed630700 1 --2- 172.21.15.77:0/95452236 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2e815db20 0x7fa2e80b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:56.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.591+0000 7fa2ece2f700 1 --2- 172.21.15.77:0/95452236 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa2e806afc0 0x7fa2e81501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:56.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.591+0000 7fa2e7fff700 1 -- 172.21.15.77:0/95452236 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa2e806afc0 msgr2=0x7fa2e81501d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:56.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.591+0000 7fa2e7fff700 1 --2- 172.21.15.77:0/95452236 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa2e806afc0 0x7fa2e81501d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:56.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.591+0000 7fa2e7fff700 1 -- 172.21.15.77:0/95452236 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2e815db20 msgr2=0x7fa2e80b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:56.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.591+0000 7fa2e7fff700 1 --2- 172.21.15.77:0/95452236 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2e815db20 0x7fa2e80b4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:56.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.591+0000 7fa2e7fff700 1 -- 172.21.15.77:0/95452236 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d40094b0 con 0x7fa2e80d2fc0 2023-07-24T05:45:56.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.591+0000 7fa2ece2f700 1 --2- 172.21.15.77:0/95452236 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa2e806afc0 0x7fa2e81501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:45:56.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.595+0000 7fa2e7fff700 1 --2- 172.21.15.77:0/95452236 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2e80d2fc0 0x7fa2e80ca3f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4014040 tx=0x7fa2d4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:56.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.595+0000 7fa2e57fa700 1 -- 172.21.15.77:0/95452236 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d4006e80 con 0x7fa2e80d2fc0 2023-07-24T05:45:56.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.595+0000 7fa2e57fa700 1 -- 172.21.15.77:0/95452236 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d4011850 con 0x7fa2e80d2fc0 2023-07-24T05:45:56.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.595+0000 7fa2ef093700 1 -- 172.21.15.77:0/95452236 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2e80b2820 con 0x7fa2e80d2fc0 2023-07-24T05:45:56.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.595+0000 7fa2e57fa700 1 -- 172.21.15.77:0/95452236 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d4011c00 con 0x7fa2e80d2fc0 2023-07-24T05:45:56.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.595+0000 7fa2ef093700 1 -- 172.21.15.77:0/95452236 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2e8150710 con 0x7fa2e80d2fc0 2023-07-24T05:45:56.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.595+0000 7fa2ef093700 1 -- 172.21.15.77:0/95452236 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2e80b22f0 con 0x7fa2e80d2fc0 2023-07-24T05:45:56.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.595+0000 7fa2e57fa700 1 -- 172.21.15.77:0/95452236 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa2d4018050 con 0x7fa2e80d2fc0 2023-07-24T05:45:56.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.599+0000 7fa2e57fa700 1 --2- 172.21.15.77:0/95452236 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa2cc0662f0 0x7fa2cc0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:56.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.599+0000 7fa2e57fa700 1 -- 172.21.15.77:0/95452236 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa2d40844b0 con 0x7fa2e80d2fc0 2023-07-24T05:45:56.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.599+0000 7fa2ece2f700 1 --2- 172.21.15.77:0/95452236 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa2cc0662f0 0x7fa2cc0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:56.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.599+0000 7fa2ece2f700 1 --2- 172.21.15.77:0/95452236 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa2cc0662f0 0x7fa2cc0687b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc0011e0 tx=0x7fa2dc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:56.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.603+0000 7fa2e57fa700 1 -- 172.21.15.77:0/95452236 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa2d4051d90 con 0x7fa2e80d2fc0 2023-07-24T05:45:56.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.783+0000 7fa2ef093700 1 -- 172.21.15.77:0/95452236 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa2e80b3000 con 0x7fa2e80d2fc0 2023-07-24T05:45:56.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.847+0000 7fa2e57fa700 1 -- 172.21.15.77:0/95452236 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa2d40553b0 con 0x7fa2e80d2fc0 2023-07-24T05:45:56.851 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-07-24T05:45:56.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.851+0000 7fa2ef093700 1 -- 172.21.15.77:0/95452236 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa2cc0662f0 msgr2=0x7fa2cc0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:56.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.851+0000 7fa2ef093700 1 --2- 172.21.15.77:0/95452236 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa2cc0662f0 0x7fa2cc0687b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc0011e0 tx=0x7fa2dc009040 comp rx=0 tx=0).stop 2023-07-24T05:45:56.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.851+0000 7fa2ef093700 1 -- 172.21.15.77:0/95452236 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2e80d2fc0 msgr2=0x7fa2e80ca3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:56.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.851+0000 7fa2ef093700 1 --2- 172.21.15.77:0/95452236 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2e80d2fc0 0x7fa2e80ca3f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4014040 tx=0x7fa2d4004770 comp rx=0 tx=0).stop 2023-07-24T05:45:56.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.851+0000 7fa2ef093700 1 -- 172.21.15.77:0/95452236 shutdown_connections 2023-07-24T05:45:56.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.851+0000 7fa2ef093700 1 --2- 172.21.15.77:0/95452236 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2e815db20 0x7fa2e80b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:56.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.851+0000 7fa2ef093700 1 --2- 172.21.15.77:0/95452236 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa2e80d2fc0 0x7fa2e80ca3f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:56.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.851+0000 7fa2ef093700 1 --2- 172.21.15.77:0/95452236 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa2cc0662f0 0x7fa2cc0687b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:56.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.851+0000 7fa2ef093700 1 --2- 172.21.15.77:0/95452236 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa2e806afc0 0x7fa2e81501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:56.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.851+0000 7fa2ef093700 1 -- 172.21.15.77:0/95452236 >> 172.21.15.77:0/95452236 conn(0x7fa2e809bc20 msgr2=0x7fa2e80b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:56.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.851+0000 7fa2ef093700 1 -- 172.21.15.77:0/95452236 shutdown_connections 2023-07-24T05:45:56.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:56.851+0000 7fa2ef093700 1 -- 172.21.15.77:0/95452236 wait complete. 2023-07-24T05:45:56.876 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-24T05:45:57.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.063+0000 7f14f2fef700 1 Processor -- start 2023-07-24T05:45:57.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.063+0000 7f14f2fef700 1 -- start start 2023-07-24T05:45:57.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.063+0000 7f14f2fef700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f14ec0b2230 0x7f14ec1675f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:57.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.063+0000 7f14f2fef700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14ec06aaa0 con 0x7f14ec15cc50 2023-07-24T05:45:57.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.063+0000 7f14f2fef700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14ec06ad80 con 0x7f14ec15c870 2023-07-24T05:45:57.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.063+0000 7f14f2fef700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14ec06b060 con 0x7f14ec0b2230 2023-07-24T05:45:57.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.067+0000 7f14f17ec700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f14ec15cc50 0x7f14ec0b1b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:50902/0 (socket says 172.21.15.77:50902) 2023-07-24T05:45:57.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.067+0000 7f14f17ec700 1 -- 172.21.15.77:0/1324798446 learned_addr learned my addr 172.21.15.77:0/1324798446 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:45:57.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.067+0000 7f14f27ee700 1 --2- 172.21.15.77:0/1324798446 >> v2:172.21.15.103:3300/0 conn(0x7f14ec0b2230 0x7f14ec1675f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:57.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.067+0000 7f14f0feb700 1 -- 172.21.15.77:0/1324798446 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1046553820 0 0) 0x7f14ec06aaa0 con 0x7f14ec15cc50 2023-07-24T05:45:57.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.067+0000 7f14f0feb700 1 -- 172.21.15.77:0/1324798446 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14d80035d0 con 0x7f14ec15cc50 2023-07-24T05:45:57.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.067+0000 7f14f0feb700 1 -- 172.21.15.77:0/1324798446 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3874232074 0 0) 0x7f14d80035d0 con 0x7f14ec15cc50 2023-07-24T05:45:57.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.067+0000 7f14f0feb700 1 -- 172.21.15.77:0/1324798446 >> v2:172.21.15.103:3300/0 conn(0x7f14ec0b2230 msgr2=0x7f14ec1675f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:45:57.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.067+0000 7f14f0feb700 1 --2- 172.21.15.77:0/1324798446 >> v2:172.21.15.103:3300/0 conn(0x7f14ec0b2230 0x7f14ec1675f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:57.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.067+0000 7f14f0feb700 1 -- 172.21.15.77:0/1324798446 >> v1:172.21.15.103:6789/0 conn(0x7f14ec15c870 legacy=0x7f14ec0cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:57.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.067+0000 7f14f0feb700 1 -- 172.21.15.77:0/1324798446 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ec06b340 con 0x7f14ec15cc50 2023-07-24T05:45:57.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.067+0000 7f14f0feb700 1 -- 172.21.15.77:0/1324798446 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4109865209 0 0) 0x7f14dc001670 con 0x7f14ec15cc50 2023-07-24T05:45:57.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.067+0000 7f14f0feb700 1 -- 172.21.15.77:0/1324798446 >> v1:172.21.15.77:6789/0 conn(0x7f14ec15cc50 legacy=0x7f14ec0b1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:57.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.067+0000 7f14f0feb700 1 --2- 172.21.15.77:0/1324798446 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f14d8003a20 0x7f14d8003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:57.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.067+0000 7f14f0feb700 1 --2- 172.21.15.77:0/1324798446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14d8004870 0x7f14d8004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:57.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.067+0000 7f14f0feb700 1 --2- 172.21.15.77:0/1324798446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14d8005230 0x7f14d800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:57.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.067+0000 7f14f0feb700 1 -- 172.21.15.77:0/1324798446 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec06b060 con 0x7f14d8004870 2023-07-24T05:45:57.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.067+0000 7f14f0feb700 1 -- 172.21.15.77:0/1324798446 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d800c1d0 con 0x7f14d8005230 2023-07-24T05:45:57.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.067+0000 7f14f0feb700 1 -- 172.21.15.77:0/1324798446 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d800c390 con 0x7f14d8003a20 2023-07-24T05:45:57.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.067+0000 7f14f17ec700 1 --2- 172.21.15.77:0/1324798446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14d8004870 0x7f14d8004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:57.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.067+0000 7f14f27ee700 1 --2- 172.21.15.77:0/1324798446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14d8005230 0x7f14d800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:57.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.067+0000 7f14f17ec700 1 -- 172.21.15.77:0/1324798446 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f14d8003a20 msgr2=0x7f14d8003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:45:57.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.067+0000 7f14f17ec700 1 --2- 172.21.15.77:0/1324798446 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f14d8003a20 0x7f14d8003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:57.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.067+0000 7f14f17ec700 1 -- 172.21.15.77:0/1324798446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14d8005230 msgr2=0x7f14d800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:45:57.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.067+0000 7f14f17ec700 1 --2- 172.21.15.77:0/1324798446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14d8005230 0x7f14d800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:57.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.067+0000 7f14f17ec700 1 -- 172.21.15.77:0/1324798446 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d80035d0 con 0x7f14d8004870 2023-07-24T05:45:57.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.067+0000 7f14f27ee700 1 -- 172.21.15.77:0/1324798446 reap_dead start 2023-07-24T05:45:57.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.067+0000 7f14f17ec700 1 --2- 172.21.15.77:0/1324798446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14d8004870 0x7f14d8004cf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f14dc00c320 tx=0x7f14d80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=796a6acc8d6b4966 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:57.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.067+0000 7f14f0feb700 1 -- 172.21.15.77:0/1324798446 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14dc007c30 con 0x7f14d8004870 2023-07-24T05:45:57.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.067+0000 7f14f0feb700 1 -- 172.21.15.77:0/1324798446 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14dc00ce00 con 0x7f14d8004870 2023-07-24T05:45:57.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.067+0000 7f14f0feb700 1 -- 172.21.15.77:0/1324798446 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14dc005bc0 con 0x7f14d8004870 2023-07-24T05:45:57.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.071+0000 7f14f2fef700 1 -- 172.21.15.77:0/1324798446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14d8004870 msgr2=0x7f14d8004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:57.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.071+0000 7f14f2fef700 1 --2- 172.21.15.77:0/1324798446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14d8004870 0x7f14d8004cf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f14dc00c320 tx=0x7f14d80058a0 comp rx=0 tx=0).stop 2023-07-24T05:45:57.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.071+0000 7f14f2fef700 1 -- 172.21.15.77:0/1324798446 shutdown_connections 2023-07-24T05:45:57.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.071+0000 7f14f2fef700 1 --2- 172.21.15.77:0/1324798446 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14d8004870 0x7f14d8004cf0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:57.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.071+0000 7f14f2fef700 1 -- 172.21.15.77:0/1324798446 >> 172.21.15.77:0/1324798446 conn(0x7f14ec089f80 msgr2=0x7f14ec09b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:57.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.071+0000 7f14f2fef700 1 -- 172.21.15.77:0/1324798446 shutdown_connections 2023-07-24T05:45:57.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.071+0000 7f14f2fef700 1 -- 172.21.15.77:0/1324798446 wait complete. 2023-07-24T05:45:57.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.075+0000 7f14f2fef700 1 Processor -- start 2023-07-24T05:45:57.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.075+0000 7f14f2fef700 1 -- start start 2023-07-24T05:45:57.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.075+0000 7f14f2fef700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14d8004870 0x7f14ec06bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:57.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.075+0000 7f14f2fef700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f14ec15d030 0x7f14ec15d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:57.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.075+0000 7f14f2fef700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14ec1f1540 0x7f14ec1f19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:57.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.075+0000 7f14f2fef700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec15a540 con 0x7f14d8004870 2023-07-24T05:45:57.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.075+0000 7f14f2fef700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec1582c0 con 0x7f14ec1f1540 2023-07-24T05:45:57.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.075+0000 7f14f2fef700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14ec15d9d0 con 0x7f14ec15d030 2023-07-24T05:45:57.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.075+0000 7f14f1fed700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14d8004870 0x7f14ec06bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:57.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.075+0000 7f14f1fed700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14d8004870 0x7f14ec06bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47072/0 (socket says 172.21.15.77:47072) 2023-07-24T05:45:57.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.075+0000 7f14f1fed700 1 -- 172.21.15.77:0/2616482364 learned_addr learned my addr 172.21.15.77:0/2616482364 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:45:57.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.075+0000 7f14f27ee700 1 --2- 172.21.15.77:0/2616482364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14ec1f1540 0x7f14ec1f19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:57.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.075+0000 7f14f17ec700 1 --2- 172.21.15.77:0/2616482364 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f14ec15d030 0x7f14ec15d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:57.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.075+0000 7f14f1fed700 1 -- 172.21.15.77:0/2616482364 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f14ec15d030 msgr2=0x7f14ec15d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:57.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.075+0000 7f14f1fed700 1 --2- 172.21.15.77:0/2616482364 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f14ec15d030 0x7f14ec15d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:57.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.075+0000 7f14f1fed700 1 -- 172.21.15.77:0/2616482364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14ec1f1540 msgr2=0x7f14ec1f19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:57.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.075+0000 7f14f1fed700 1 --2- 172.21.15.77:0/2616482364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14ec1f1540 0x7f14ec1f19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:57.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.075+0000 7f14f1fed700 1 -- 172.21.15.77:0/2616482364 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ec1f1f00 con 0x7f14d8004870 2023-07-24T05:45:57.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.075+0000 7f14f1fed700 1 --2- 172.21.15.77:0/2616482364 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14d8004870 0x7f14ec06bdd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f14e800c460 tx=0x7f14e800c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:57.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.079+0000 7f14e27fc700 1 -- 172.21.15.77:0/2616482364 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e80052d0 con 0x7f14d8004870 2023-07-24T05:45:57.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.079+0000 7f14e27fc700 1 -- 172.21.15.77:0/2616482364 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14e8005470 con 0x7f14d8004870 2023-07-24T05:45:57.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.079+0000 7f14f2fef700 1 -- 172.21.15.77:0/2616482364 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14ec15dc20 con 0x7f14d8004870 2023-07-24T05:45:57.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.079+0000 7f14e27fc700 1 -- 172.21.15.77:0/2616482364 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e8006b10 con 0x7f14d8004870 2023-07-24T05:45:57.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.079+0000 7f14f2fef700 1 -- 172.21.15.77:0/2616482364 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14ec157f50 con 0x7f14d8004870 2023-07-24T05:45:57.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.079+0000 7f14f2fef700 1 -- 172.21.15.77:0/2616482364 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14ec072490 con 0x7f14d8004870 2023-07-24T05:45:57.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.083+0000 7f14e27fc700 1 -- 172.21.15.77:0/2616482364 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f14e8006c70 con 0x7f14d8004870 2023-07-24T05:45:57.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.087+0000 7f14e27fc700 1 --2- 172.21.15.77:0/2616482364 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f14d00662f0 0x7f14d00687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:57.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.087+0000 7f14e27fc700 1 -- 172.21.15.77:0/2616482364 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f14e80830b0 con 0x7f14d8004870 2023-07-24T05:45:57.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.087+0000 7f14f17ec700 1 --2- 172.21.15.77:0/2616482364 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f14d00662f0 0x7f14d00687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:57.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.087+0000 7f14f17ec700 1 --2- 172.21.15.77:0/2616482364 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f14d00662f0 0x7f14d00687b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f14ec06c800 tx=0x7f14dc007000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:57.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.087+0000 7f14e27fc700 1 -- 172.21.15.77:0/2616482364 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f14e8050860 con 0x7f14d8004870 2023-07-24T05:45:57.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.259+0000 7f14f2fef700 1 -- 172.21.15.77:0/2616482364 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f14ec0cf3f0 con 0x7f14d8004870 2023-07-24T05:45:57.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.259+0000 7f14e27fc700 1 -- 172.21.15.77:0/2616482364 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f14e8053e80 con 0x7f14d8004870 2023-07-24T05:45:57.264 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 8 2023-07-24T05:45:57.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.263+0000 7f14f2fef700 1 -- 172.21.15.77:0/2616482364 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f14d00662f0 msgr2=0x7f14d00687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:57.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.263+0000 7f14f2fef700 1 --2- 172.21.15.77:0/2616482364 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f14d00662f0 0x7f14d00687b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f14ec06c800 tx=0x7f14dc007000 comp rx=0 tx=0).stop 2023-07-24T05:45:57.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.263+0000 7f14f2fef700 1 -- 172.21.15.77:0/2616482364 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14d8004870 msgr2=0x7f14ec06bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:57.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.263+0000 7f14f2fef700 1 --2- 172.21.15.77:0/2616482364 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14d8004870 0x7f14ec06bdd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f14e800c460 tx=0x7f14e800c770 comp rx=0 tx=0).stop 2023-07-24T05:45:57.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.263+0000 7f14f2fef700 1 -- 172.21.15.77:0/2616482364 shutdown_connections 2023-07-24T05:45:57.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.263+0000 7f14f2fef700 1 --2- 172.21.15.77:0/2616482364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14ec1f1540 0x7f14ec1f19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:57.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.263+0000 7f14f2fef700 1 --2- 172.21.15.77:0/2616482364 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f14d00662f0 0x7f14d00687b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:57.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.263+0000 7f14f2fef700 1 --2- 172.21.15.77:0/2616482364 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f14ec15d030 0x7f14ec15d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:57.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.263+0000 7f14f2fef700 1 --2- 172.21.15.77:0/2616482364 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f14d8004870 0x7f14ec06bdd0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:57.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.263+0000 7f14f2fef700 1 -- 172.21.15.77:0/2616482364 >> 172.21.15.77:0/2616482364 conn(0x7f14ec089f80 msgr2=0x7f14ec0cf910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:57.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.263+0000 7f14f2fef700 1 -- 172.21.15.77:0/2616482364 shutdown_connections 2023-07-24T05:45:57.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.263+0000 7f14f2fef700 1 -- 172.21.15.77:0/2616482364 wait complete. 2023-07-24T05:45:57.287 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-24T05:45:57.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.455+0000 7fc2ae79e700 1 Processor -- start 2023-07-24T05:45:57.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.455+0000 7fc2ae79e700 1 -- start start 2023-07-24T05:45:57.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.459+0000 7fc2ae79e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc2a8161100 0x7fc2a80b1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:57.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.459+0000 7fc2ae79e700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc2a80b15d0 0x7fc2a80af700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:57.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.459+0000 7fc2ae79e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2a80af170 con 0x7fc2a8160d20 2023-07-24T05:45:57.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.459+0000 7fc2ae79e700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a80b19d0 con 0x7fc2a80b15d0 2023-07-24T05:45:57.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.459+0000 7fc2ae79e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a80ae5f0 con 0x7fc2a8161100 2023-07-24T05:45:57.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.459+0000 7fc2adf9d700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc2a80b15d0 0x7fc2a80af700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:57.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.459+0000 7fc2adf9d700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc2a80b15d0 0x7fc2a80af700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47076/0 (socket says 172.21.15.77:47076) 2023-07-24T05:45:57.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.459+0000 7fc2adf9d700 1 -- 172.21.15.77:0/673418849 learned_addr learned my addr 172.21.15.77:0/673418849 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:45:57.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.459+0000 7fc2acf9b700 1 --2- 172.21.15.77:0/673418849 >> v2:172.21.15.103:3300/0 conn(0x7fc2a8161100 0x7fc2a80b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:57.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.459+0000 7fc2adf9d700 1 -- 172.21.15.77:0/673418849 >> v2:172.21.15.103:3300/0 conn(0x7fc2a8161100 msgr2=0x7fc2a80b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:45:57.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.459+0000 7fc2adf9d700 1 --2- 172.21.15.77:0/673418849 >> v2:172.21.15.103:3300/0 conn(0x7fc2a8161100 0x7fc2a80b1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:57.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.459+0000 7fc2adf9d700 1 -- 172.21.15.77:0/673418849 >> v1:172.21.15.103:6789/0 conn(0x7fc2a8160d20 legacy=0x7fc2a80adba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:45:57.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.459+0000 7fc2adf9d700 1 -- 172.21.15.77:0/673418849 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a80ae8d0 con 0x7fc2a80b15d0 2023-07-24T05:45:57.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.459+0000 7fc2adf9d700 1 --2- 172.21.15.77:0/673418849 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2a80b15d0 0x7fc2a80af700 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc2a806f9a0 tx=0x7fc2a000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=820aeba92dc1eac9 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:57.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.459+0000 7fc29ffff700 1 -- 172.21.15.77:0/673418849 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a000e070 con 0x7fc2a80b15d0 2023-07-24T05:45:57.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.459+0000 7fc29ffff700 1 -- 172.21.15.77:0/673418849 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a000b9c0 con 0x7fc2a80b15d0 2023-07-24T05:45:57.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.459+0000 7fc29ffff700 1 -- 172.21.15.77:0/673418849 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a000bd70 con 0x7fc2a80b15d0 2023-07-24T05:45:57.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.459+0000 7fc2ae79e700 1 -- 172.21.15.77:0/673418849 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2a80b15d0 msgr2=0x7fc2a80af700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:57.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.459+0000 7fc2ae79e700 1 --2- 172.21.15.77:0/673418849 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2a80b15d0 0x7fc2a80af700 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc2a806f9a0 tx=0x7fc2a000b330 comp rx=0 tx=0).stop 2023-07-24T05:45:57.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.459+0000 7fc2ae79e700 1 -- 172.21.15.77:0/673418849 shutdown_connections 2023-07-24T05:45:57.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.459+0000 7fc2ae79e700 1 --2- 172.21.15.77:0/673418849 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2a80b15d0 0x7fc2a80af700 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:57.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.459+0000 7fc2ae79e700 1 --2- 172.21.15.77:0/673418849 >> v2:172.21.15.103:3300/0 conn(0x7fc2a8161100 0x7fc2a80b1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:57.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.459+0000 7fc2ae79e700 1 -- 172.21.15.77:0/673418849 >> 172.21.15.77:0/673418849 conn(0x7fc2a80cacc0 msgr2=0x7fc2a80cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:57.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.459+0000 7fc2ae79e700 1 -- 172.21.15.77:0/673418849 shutdown_connections 2023-07-24T05:45:57.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.459+0000 7fc2ae79e700 1 -- 172.21.15.77:0/673418849 wait complete. 2023-07-24T05:45:57.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.463+0000 7fc2ae79e700 1 Processor -- start 2023-07-24T05:45:57.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.463+0000 7fc2ae79e700 1 -- start start 2023-07-24T05:45:57.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.467+0000 7fc2ae79e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2a80b15d0 0x7fc2a8158050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:57.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.467+0000 7fc2ae79e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2a8160d20 0x7fc2a80cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:57.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.467+0000 7fc2ae79e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc2a8161100 0x7fc2a815d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:57.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.467+0000 7fc2ae79e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a8158590 con 0x7fc2a80b15d0 2023-07-24T05:45:57.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.467+0000 7fc2ae79e700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a80cb9d0 con 0x7fc2a8160d20 2023-07-24T05:45:57.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.467+0000 7fc2ae79e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a80cbcb0 con 0x7fc2a8161100 2023-07-24T05:45:57.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.467+0000 7fc2ad79c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2a80b15d0 0x7fc2a8158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:57.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.467+0000 7fc2ad79c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2a80b15d0 0x7fc2a8158050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47082/0 (socket says 172.21.15.77:47082) 2023-07-24T05:45:57.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.467+0000 7fc2ad79c700 1 -- 172.21.15.77:0/3849104424 learned_addr learned my addr 172.21.15.77:0/3849104424 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:45:57.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.467+0000 7fc2acf9b700 1 --2- 172.21.15.77:0/3849104424 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2a8160d20 0x7fc2a80cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:57.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.467+0000 7fc2adf9d700 1 --2- 172.21.15.77:0/3849104424 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc2a8161100 0x7fc2a815d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:57.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.467+0000 7fc2ad79c700 1 -- 172.21.15.77:0/3849104424 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc2a8161100 msgr2=0x7fc2a815d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:57.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.467+0000 7fc2ad79c700 1 --2- 172.21.15.77:0/3849104424 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc2a8161100 0x7fc2a815d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:57.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.467+0000 7fc2ad79c700 1 -- 172.21.15.77:0/3849104424 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2a8160d20 msgr2=0x7fc2a80cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:57.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.467+0000 7fc2ad79c700 1 --2- 172.21.15.77:0/3849104424 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2a8160d20 0x7fc2a80cd9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:57.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.467+0000 7fc2ad79c700 1 -- 172.21.15.77:0/3849104424 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a0009b30 con 0x7fc2a80b15d0 2023-07-24T05:45:57.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.467+0000 7fc2acf9b700 1 --2- 172.21.15.77:0/3849104424 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2a8160d20 0x7fc2a80cd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:45:57.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.467+0000 7fc2ad79c700 1 --2- 172.21.15.77:0/3849104424 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2a80b15d0 0x7fc2a8158050 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc2a400c500 tx=0x7fc2a400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:57.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.467+0000 7fc29dffb700 1 -- 172.21.15.77:0/3849104424 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a40052d0 con 0x7fc2a80b15d0 2023-07-24T05:45:57.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.467+0000 7fc29dffb700 1 -- 172.21.15.77:0/3849104424 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a4005430 con 0x7fc2a80b15d0 2023-07-24T05:45:57.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.467+0000 7fc2ae79e700 1 -- 172.21.15.77:0/3849104424 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2a80cbf90 con 0x7fc2a80b15d0 2023-07-24T05:45:57.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.467+0000 7fc29dffb700 1 -- 172.21.15.77:0/3849104424 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a40055a0 con 0x7fc2a80b15d0 2023-07-24T05:45:57.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.467+0000 7fc2ae79e700 1 -- 172.21.15.77:0/3849104424 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a80cc550 con 0x7fc2a80b15d0 2023-07-24T05:45:57.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.471+0000 7fc2ae79e700 1 -- 172.21.15.77:0/3849104424 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2a80cc770 con 0x7fc2a80b15d0 2023-07-24T05:45:57.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.471+0000 7fc29dffb700 1 -- 172.21.15.77:0/3849104424 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc2a40038e0 con 0x7fc2a80b15d0 2023-07-24T05:45:57.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.471+0000 7fc29dffb700 1 --2- 172.21.15.77:0/3849104424 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc28c0662f0 0x7fc28c0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:57.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.471+0000 7fc29dffb700 1 -- 172.21.15.77:0/3849104424 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc2a4082ec0 con 0x7fc2a80b15d0 2023-07-24T05:45:57.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.475+0000 7fc2acf9b700 1 --2- 172.21.15.77:0/3849104424 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc28c0662f0 0x7fc28c0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:57.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.475+0000 7fc2acf9b700 1 --2- 172.21.15.77:0/3849104424 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc28c0662f0 0x7fc28c0687b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc2a809bc40 tx=0x7fc298008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:57.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.479+0000 7fc29dffb700 1 -- 172.21.15.77:0/3849104424 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc2a4050680 con 0x7fc2a80b15d0 2023-07-24T05:45:57.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.651+0000 7fc2ae79e700 1 -- 172.21.15.77:0/3849104424 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc2a8072490 con 0x7fc2a80b15d0 2023-07-24T05:45:57.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.651+0000 7fc29dffb700 1 -- 172.21.15.77:0/3849104424 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+126 (secure 0 0 0) 0x7fc2a4053ca0 con 0x7fc2a80b15d0 2023-07-24T05:45:57.657 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:45:57.657 INFO:teuthology.orchestra.run.smithi077.stdout:[ 2023-07-24T05:45:57.657 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-07-24T05:45:57.657 INFO:teuthology.orchestra.run.smithi077.stdout: "poolnum": 1, 2023-07-24T05:45:57.657 INFO:teuthology.orchestra.run.smithi077.stdout: "poolname": ".mgr" 2023-07-24T05:45:57.658 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-07-24T05:45:57.658 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-07-24T05:45:57.658 INFO:teuthology.orchestra.run.smithi077.stdout: "poolnum": 2, 2023-07-24T05:45:57.658 INFO:teuthology.orchestra.run.smithi077.stdout: "poolname": "rbd" 2023-07-24T05:45:57.658 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-07-24T05:45:57.658 INFO:teuthology.orchestra.run.smithi077.stdout:] 2023-07-24T05:45:57.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.659+0000 7fc2ae79e700 1 -- 172.21.15.77:0/3849104424 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc28c0662f0 msgr2=0x7fc28c0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:57.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.659+0000 7fc2ae79e700 1 --2- 172.21.15.77:0/3849104424 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc28c0662f0 0x7fc28c0687b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc2a809bc40 tx=0x7fc298008040 comp rx=0 tx=0).stop 2023-07-24T05:45:57.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.659+0000 7fc2ae79e700 1 -- 172.21.15.77:0/3849104424 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2a80b15d0 msgr2=0x7fc2a8158050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:57.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.659+0000 7fc2ae79e700 1 --2- 172.21.15.77:0/3849104424 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2a80b15d0 0x7fc2a8158050 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc2a400c500 tx=0x7fc2a400c8c0 comp rx=0 tx=0).stop 2023-07-24T05:45:57.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.659+0000 7fc2ae79e700 1 -- 172.21.15.77:0/3849104424 shutdown_connections 2023-07-24T05:45:57.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.659+0000 7fc2ae79e700 1 --2- 172.21.15.77:0/3849104424 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc28c0662f0 0x7fc28c0687b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:57.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.659+0000 7fc2ae79e700 1 --2- 172.21.15.77:0/3849104424 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc2a8161100 0x7fc2a815d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:57.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.659+0000 7fc2ae79e700 1 --2- 172.21.15.77:0/3849104424 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2a8160d20 0x7fc2a80cd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:57.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.659+0000 7fc2ae79e700 1 --2- 172.21.15.77:0/3849104424 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2a80b15d0 0x7fc2a8158050 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:57.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.659+0000 7fc2ae79e700 1 -- 172.21.15.77:0/3849104424 >> 172.21.15.77:0/3849104424 conn(0x7fc2a80cacc0 msgr2=0x7fc2a8164870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:57.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.659+0000 7fc2ae79e700 1 -- 172.21.15.77:0/3849104424 shutdown_connections 2023-07-24T05:45:57.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.659+0000 7fc2ae79e700 1 -- 172.21.15.77:0/3849104424 wait complete. 2023-07-24T05:45:57.682 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-24T05:45:57.682 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-24T05:45:57.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.855+0000 7fc85311a700 1 Processor -- start 2023-07-24T05:45:57.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.855+0000 7fc85311a700 1 -- start start 2023-07-24T05:45:57.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.859+0000 7fc85311a700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc84c0ca6f0 0x7fc84c0cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:57.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.859+0000 7fc85311a700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc84c0c8b60 0x7fc84c06c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:57.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.859+0000 7fc85311a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc84c06cdd0 0x7fc84c0caf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:57.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.859+0000 7fc85311a700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc84c15aed0 con 0x7fc84c0c8b60 2023-07-24T05:45:57.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.859+0000 7fc85311a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc84c15e5a0 con 0x7fc84c06cdd0 2023-07-24T05:45:57.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.859+0000 7fc85311a700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc84c0c8ff0 con 0x7fc84c0ca6f0 2023-07-24T05:45:57.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.859+0000 7fc84bfff700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc84c0c8b60 0x7fc84c06c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:57.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.859+0000 7fc84bfff700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc84c0c8b60 0x7fc84c06c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47084/0 (socket says 172.21.15.77:47084) 2023-07-24T05:45:57.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.859+0000 7fc84bfff700 1 -- 172.21.15.77:0/3703935044 learned_addr learned my addr 172.21.15.77:0/3703935044 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:45:57.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.859+0000 7fc850eb6700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc84c0ca6f0 0x7fc84c0cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:57.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.859+0000 7fc8516b7700 1 --2- 172.21.15.77:0/3703935044 >> v2:172.21.15.103:3300/0 conn(0x7fc84c06cdd0 0x7fc84c0caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:57.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.859+0000 7fc84bfff700 1 -- 172.21.15.77:0/3703935044 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc84c0ca6f0 msgr2=0x7fc84c0cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:45:57.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.859+0000 7fc84bfff700 1 --2- 172.21.15.77:0/3703935044 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc84c0ca6f0 0x7fc84c0cf000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:57.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.859+0000 7fc84bfff700 1 -- 172.21.15.77:0/3703935044 >> v2:172.21.15.103:3300/0 conn(0x7fc84c06cdd0 msgr2=0x7fc84c0caf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:45:57.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.859+0000 7fc84bfff700 1 --2- 172.21.15.77:0/3703935044 >> v2:172.21.15.103:3300/0 conn(0x7fc84c06cdd0 0x7fc84c0caf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:57.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.859+0000 7fc84bfff700 1 -- 172.21.15.77:0/3703935044 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc84c0c92d0 con 0x7fc84c0c8b60 2023-07-24T05:45:57.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.859+0000 7fc84bfff700 1 --2- 172.21.15.77:0/3703935044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc84c0c8b60 0x7fc84c06c890 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc84c0ad640 tx=0x7fc838009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c62b8b2310cc7ce1 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:57.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.859+0000 7fc84b7fe700 1 -- 172.21.15.77:0/3703935044 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc838011830 con 0x7fc84c0c8b60 2023-07-24T05:45:57.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.859+0000 7fc84b7fe700 1 -- 172.21.15.77:0/3703935044 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc838011990 con 0x7fc84c0c8b60 2023-07-24T05:45:57.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.859+0000 7fc84b7fe700 1 -- 172.21.15.77:0/3703935044 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc838011d20 con 0x7fc84c0c8b60 2023-07-24T05:45:57.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.863+0000 7fc85311a700 1 -- 172.21.15.77:0/3703935044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc84c0c8b60 msgr2=0x7fc84c06c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:57.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.863+0000 7fc85311a700 1 --2- 172.21.15.77:0/3703935044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc84c0c8b60 0x7fc84c06c890 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc84c0ad640 tx=0x7fc838009bf0 comp rx=0 tx=0).stop 2023-07-24T05:45:57.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.863+0000 7fc85311a700 1 -- 172.21.15.77:0/3703935044 shutdown_connections 2023-07-24T05:45:57.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.863+0000 7fc85311a700 1 --2- 172.21.15.77:0/3703935044 >> v2:172.21.15.103:3300/0 conn(0x7fc84c06cdd0 0x7fc84c0caf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:57.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.863+0000 7fc85311a700 1 --2- 172.21.15.77:0/3703935044 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc84c0c8b60 0x7fc84c06c890 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:57.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.863+0000 7fc85311a700 1 --2- 172.21.15.77:0/3703935044 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc84c0ca6f0 0x7fc84c0cf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:57.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.863+0000 7fc85311a700 1 -- 172.21.15.77:0/3703935044 >> 172.21.15.77:0/3703935044 conn(0x7fc84c0ce510 msgr2=0x7fc84c0ce8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:57.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.863+0000 7fc85311a700 1 -- 172.21.15.77:0/3703935044 shutdown_connections 2023-07-24T05:45:57.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.863+0000 7fc85311a700 1 -- 172.21.15.77:0/3703935044 wait complete. 2023-07-24T05:45:57.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.863+0000 7fc85311a700 1 Processor -- start 2023-07-24T05:45:57.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.863+0000 7fc85311a700 1 -- start start 2023-07-24T05:45:57.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.867+0000 7fc85311a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc84c06cdd0 0x7fc84c0adf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:57.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.867+0000 7fc85311a700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc84c0ca6f0 0x7fc84c0c57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:57.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.867+0000 7fc85311a700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc84c0acd10 0x7fc84c156340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:57.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.867+0000 7fc85311a700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84c0ae460 con 0x7fc84c06cdd0 2023-07-24T05:45:57.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.867+0000 7fc85311a700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84c159bd0 con 0x7fc84c0ca6f0 2023-07-24T05:45:57.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.867+0000 7fc85311a700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc84c0ab2e0 con 0x7fc84c0acd10 2023-07-24T05:45:57.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.867+0000 7fc850eb6700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc84c06cdd0 0x7fc84c0adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:57.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.867+0000 7fc850eb6700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc84c06cdd0 0x7fc84c0adf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47086/0 (socket says 172.21.15.77:47086) 2023-07-24T05:45:57.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.867+0000 7fc850eb6700 1 -- 172.21.15.77:0/2146272539 learned_addr learned my addr 172.21.15.77:0/2146272539 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:45:57.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.867+0000 7fc8516b7700 1 --2- 172.21.15.77:0/2146272539 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc84c0acd10 0x7fc84c156340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:57.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.867+0000 7fc84bfff700 1 --2- 172.21.15.77:0/2146272539 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc84c0ca6f0 0x7fc84c0c57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:57.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.867+0000 7fc8516b7700 1 -- 172.21.15.77:0/2146272539 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc84c0ca6f0 msgr2=0x7fc84c0c57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:57.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.867+0000 7fc8516b7700 1 --2- 172.21.15.77:0/2146272539 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc84c0ca6f0 0x7fc84c0c57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:57.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.867+0000 7fc8516b7700 1 -- 172.21.15.77:0/2146272539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc84c06cdd0 msgr2=0x7fc84c0adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:57.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.867+0000 7fc8516b7700 1 --2- 172.21.15.77:0/2146272539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc84c06cdd0 0x7fc84c0adf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:57.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.867+0000 7fc8516b7700 1 -- 172.21.15.77:0/2146272539 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc838009570 con 0x7fc84c0acd10 2023-07-24T05:45:57.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.867+0000 7fc850eb6700 1 --2- 172.21.15.77:0/2146272539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc84c06cdd0 0x7fc84c0adf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:45:57.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.867+0000 7fc8516b7700 1 --2- 172.21.15.77:0/2146272539 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc84c0acd10 0x7fc84c156340 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc844007d40 tx=0x7fc84400e3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:57.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.867+0000 7fc8497fa700 1 -- 172.21.15.77:0/2146272539 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc844018070 con 0x7fc84c0acd10 2023-07-24T05:45:57.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.867+0000 7fc8497fa700 1 -- 172.21.15.77:0/2146272539 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc844007e30 con 0x7fc84c0acd10 2023-07-24T05:45:57.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.867+0000 7fc8497fa700 1 -- 172.21.15.77:0/2146272539 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84400ed50 con 0x7fc84c0acd10 2023-07-24T05:45:57.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.867+0000 7fc85311a700 1 -- 172.21.15.77:0/2146272539 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc84c071020 con 0x7fc84c0acd10 2023-07-24T05:45:57.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.867+0000 7fc85311a700 1 -- 172.21.15.77:0/2146272539 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc84c0c4900 con 0x7fc84c0acd10 2023-07-24T05:45:57.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.867+0000 7fc85311a700 1 -- 172.21.15.77:0/2146272539 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc84c0ab500 con 0x7fc84c0acd10 2023-07-24T05:45:57.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.871+0000 7fc8497fa700 1 -- 172.21.15.77:0/2146272539 <== mon.2 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc844014420 con 0x7fc84c0acd10 2023-07-24T05:45:57.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.871+0000 7fc8497fa700 1 --2- 172.21.15.77:0/2146272539 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc8300662f0 0x7fc8300687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:57.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.871+0000 7fc8497fa700 1 -- 172.21.15.77:0/2146272539 <== mon.2 v2:172.21.15.103:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc844083680 con 0x7fc84c0acd10 2023-07-24T05:45:57.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.871+0000 7fc850eb6700 1 --2- 172.21.15.77:0/2146272539 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc8300662f0 0x7fc8300687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:57.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.871+0000 7fc850eb6700 1 --2- 172.21.15.77:0/2146272539 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc8300662f0 0x7fc8300687b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc8400113d0 tx=0x7fc8400091c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:57.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:57.879+0000 7fc8497fa700 1 -- 172.21.15.77:0/2146272539 <== mon.2 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc844050db0 con 0x7fc84c0acd10 2023-07-24T05:45:58.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:58.055+0000 7fc85311a700 1 -- 172.21.15.77:0/2146272539 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc84c04df80 con 0x7fc84c0acd10 2023-07-24T05:45:58.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:58.879+0000 7fc8497fa700 1 -- 172.21.15.77:0/2146272539 <== mon.2 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc8440543d0 con 0x7fc84c0acd10 2023-07-24T05:45:58.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:58.883+0000 7fc85311a700 1 -- 172.21.15.77:0/2146272539 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc8300662f0 msgr2=0x7fc8300687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:58.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:58.883+0000 7fc85311a700 1 --2- 172.21.15.77:0/2146272539 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc8300662f0 0x7fc8300687b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc8400113d0 tx=0x7fc8400091c0 comp rx=0 tx=0).stop 2023-07-24T05:45:58.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:58.883+0000 7fc85311a700 1 -- 172.21.15.77:0/2146272539 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc84c0acd10 msgr2=0x7fc84c156340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:58.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:58.883+0000 7fc85311a700 1 --2- 172.21.15.77:0/2146272539 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc84c0acd10 0x7fc84c156340 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc844007d40 tx=0x7fc84400e3c0 comp rx=0 tx=0).stop 2023-07-24T05:45:58.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:58.883+0000 7fc85311a700 1 -- 172.21.15.77:0/2146272539 shutdown_connections 2023-07-24T05:45:58.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:58.883+0000 7fc85311a700 1 --2- 172.21.15.77:0/2146272539 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc8300662f0 0x7fc8300687b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:58.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:58.883+0000 7fc85311a700 1 --2- 172.21.15.77:0/2146272539 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc84c0acd10 0x7fc84c156340 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:58.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:58.883+0000 7fc85311a700 1 --2- 172.21.15.77:0/2146272539 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc84c0ca6f0 0x7fc84c0c57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:58.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:58.883+0000 7fc85311a700 1 --2- 172.21.15.77:0/2146272539 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc84c06cdd0 0x7fc84c0adf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:58.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:58.883+0000 7fc85311a700 1 -- 172.21.15.77:0/2146272539 >> 172.21.15.77:0/2146272539 conn(0x7fc84c0ce510 msgr2=0x7fc84c0ac0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:58.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:58.883+0000 7fc85311a700 1 -- 172.21.15.77:0/2146272539 shutdown_connections 2023-07-24T05:45:58.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:58.883+0000 7fc85311a700 1 -- 172.21.15.77:0/2146272539 wait complete. 2023-07-24T05:45:58.890 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_metadata' created 2023-07-24T05:45:58.906 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-07-24T05:45:59.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.095+0000 7f0525501700 1 Processor -- start 2023-07-24T05:45:59.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.095+0000 7f0525501700 1 -- start start 2023-07-24T05:45:59.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.099+0000 7f0525501700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f052015c750 0x7f052006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:59.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.099+0000 7f0525501700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05201604f0 con 0x7f052015cb30 2023-07-24T05:45:59.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.099+0000 7f0525501700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0520160740 con 0x7f05200cf610 2023-07-24T05:45:59.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.099+0000 7f0525501700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0520160a20 con 0x7f052015c750 2023-07-24T05:45:59.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.099+0000 7f051e7fc700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f052015cb30 0x7f05200cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:50908/0 (socket says 172.21.15.77:50908) 2023-07-24T05:45:59.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.099+0000 7f051e7fc700 1 -- 172.21.15.77:0/1803155857 learned_addr learned my addr 172.21.15.77:0/1803155857 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:45:59.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.099+0000 7f051effd700 1 --2- 172.21.15.77:0/1803155857 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f052015c750 0x7f052006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:59.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.099+0000 7f051dffb700 1 -- 172.21.15.77:0/1803155857 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2780648361 0 0) 0x7f05201604f0 con 0x7f052015cb30 2023-07-24T05:45:59.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.099+0000 7f051dffb700 1 -- 172.21.15.77:0/1803155857 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05080035d0 con 0x7f052015cb30 2023-07-24T05:45:59.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.103+0000 7f051dffb700 1 -- 172.21.15.77:0/1803155857 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2050076394 0 0) 0x7f05080035d0 con 0x7f052015cb30 2023-07-24T05:45:59.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.103+0000 7f051dffb700 1 -- 172.21.15.77:0/1803155857 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f052015c750 msgr2=0x7f052006d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:45:59.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.103+0000 7f051dffb700 1 --2- 172.21.15.77:0/1803155857 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f052015c750 0x7f052006d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:59.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.103+0000 7f051dffb700 1 -- 172.21.15.77:0/1803155857 >> v1:172.21.15.103:6789/0 conn(0x7f05200cf610 legacy=0x7f05200b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:59.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.103+0000 7f051dffb700 1 -- 172.21.15.77:0/1803155857 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0520160d00 con 0x7f052015cb30 2023-07-24T05:45:59.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.103+0000 7f051dffb700 1 -- 172.21.15.77:0/1803155857 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4109865209 0 0) 0x7f0514001670 con 0x7f052015cb30 2023-07-24T05:45:59.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.103+0000 7f051dffb700 1 -- 172.21.15.77:0/1803155857 >> v1:172.21.15.77:6789/0 conn(0x7f052015cb30 legacy=0x7f05200cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:59.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.103+0000 7f051dffb700 1 --2- 172.21.15.77:0/1803155857 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f052015c750 0x7f0508003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:59.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.103+0000 7f051dffb700 1 --2- 172.21.15.77:0/1803155857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0508003f90 0x7f0508004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:59.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.103+0000 7f051dffb700 1 --2- 172.21.15.77:0/1803155857 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0508004db0 0x7f0508005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:59.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.103+0000 7f051dffb700 1 -- 172.21.15.77:0/1803155857 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0520160a20 con 0x7f0508004db0 2023-07-24T05:45:59.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.103+0000 7f051dffb700 1 -- 172.21.15.77:0/1803155857 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050800bae0 con 0x7f0508003f90 2023-07-24T05:45:59.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.103+0000 7f051dffb700 1 -- 172.21.15.77:0/1803155857 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f050800bca0 con 0x7f052015c750 2023-07-24T05:45:59.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.103+0000 7f051f7fe700 1 --2- 172.21.15.77:0/1803155857 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0508004db0 0x7f0508005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:59.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.103+0000 7f051e7fc700 1 --2- 172.21.15.77:0/1803155857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0508003f90 0x7f0508004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:59.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.103+0000 7f051effd700 1 --2- 172.21.15.77:0/1803155857 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f052015c750 0x7f0508003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:59.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.103+0000 7f051f7fe700 1 -- 172.21.15.77:0/1803155857 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f052015c750 msgr2=0x7f0508003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:45:59.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.103+0000 7f051f7fe700 1 --2- 172.21.15.77:0/1803155857 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f052015c750 0x7f0508003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:59.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.103+0000 7f051f7fe700 1 -- 172.21.15.77:0/1803155857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0508003f90 msgr2=0x7f0508004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:45:59.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.103+0000 7f051f7fe700 1 --2- 172.21.15.77:0/1803155857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0508003f90 0x7f0508004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:59.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.103+0000 7f051f7fe700 1 -- 172.21.15.77:0/1803155857 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05080035d0 con 0x7f0508004db0 2023-07-24T05:45:59.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.103+0000 7f051f7fe700 1 --2- 172.21.15.77:0/1803155857 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0508004db0 0x7f0508005230 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f051800c260 tx=0x7f05080058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1433e09e6327408 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:59.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.103+0000 7f051dffb700 1 -- 172.21.15.77:0/1803155857 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0518001e70 con 0x7f0508004db0 2023-07-24T05:45:59.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.103+0000 7f051dffb700 1 -- 172.21.15.77:0/1803155857 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f051800ce20 con 0x7f0508004db0 2023-07-24T05:45:59.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.103+0000 7f051dffb700 1 -- 172.21.15.77:0/1803155857 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0518012660 con 0x7f0508004db0 2023-07-24T05:45:59.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.103+0000 7f0525501700 1 -- 172.21.15.77:0/1803155857 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0508004db0 msgr2=0x7f0508005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:59.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.103+0000 7f0525501700 1 --2- 172.21.15.77:0/1803155857 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0508004db0 0x7f0508005230 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f051800c260 tx=0x7f05080058a0 comp rx=0 tx=0).stop 2023-07-24T05:45:59.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.103+0000 7f051f7fe700 1 -- 172.21.15.77:0/1803155857 reap_dead start 2023-07-24T05:45:59.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.103+0000 7f0525501700 1 -- 172.21.15.77:0/1803155857 shutdown_connections 2023-07-24T05:45:59.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.103+0000 7f0525501700 1 -- 172.21.15.77:0/1803155857 >> 172.21.15.77:0/1803155857 conn(0x7f05200b7620 msgr2=0x7f05200b7a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:59.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.103+0000 7f0525501700 1 -- 172.21.15.77:0/1803155857 shutdown_connections 2023-07-24T05:45:59.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.103+0000 7f0525501700 1 -- 172.21.15.77:0/1803155857 wait complete. 2023-07-24T05:45:59.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.107+0000 7f0525501700 1 Processor -- start 2023-07-24T05:45:59.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.107+0000 7f0525501700 1 -- start start 2023-07-24T05:45:59.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.111+0000 7f0525501700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0508004db0 0x7f052009d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:59.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.111+0000 7f0525501700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f05200c8be0 0x7f0520158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:59.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.111+0000 7f0525501700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f052015d050 0x7f052015d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:59.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.111+0000 7f0525501700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05200a0160 con 0x7f0508004db0 2023-07-24T05:45:59.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.111+0000 7f0525501700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052009d760 con 0x7f052015d050 2023-07-24T05:45:59.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.111+0000 7f0525501700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f052015da10 con 0x7f05200c8be0 2023-07-24T05:45:59.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.111+0000 7f051effd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0508004db0 0x7f052009d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:59.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.111+0000 7f051effd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0508004db0 0x7f052009d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47114/0 (socket says 172.21.15.77:47114) 2023-07-24T05:45:59.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.111+0000 7f051effd700 1 -- 172.21.15.77:0/2114600773 learned_addr learned my addr 172.21.15.77:0/2114600773 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:45:59.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.111+0000 7f051f7fe700 1 --2- 172.21.15.77:0/2114600773 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f052015d050 0x7f052015d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:59.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.111+0000 7f051effd700 1 -- 172.21.15.77:0/2114600773 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f05200c8be0 msgr2=0x7f0520158c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:59.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.111+0000 7f051effd700 1 --2- 172.21.15.77:0/2114600773 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f05200c8be0 0x7f0520158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:59.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.111+0000 7f051effd700 1 -- 172.21.15.77:0/2114600773 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f052015d050 msgr2=0x7f052015d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:59.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.111+0000 7f051effd700 1 --2- 172.21.15.77:0/2114600773 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f052015d050 0x7f052015d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:59.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.111+0000 7f051effd700 1 -- 172.21.15.77:0/2114600773 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f052009ec70 con 0x7f0508004db0 2023-07-24T05:45:59.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.111+0000 7f051f7fe700 1 --2- 172.21.15.77:0/2114600773 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f052015d050 0x7f052015d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:45:59.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.111+0000 7f051effd700 1 --2- 172.21.15.77:0/2114600773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0508004db0 0x7f052009d220 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f05100116d0 tx=0x7f0510011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:59.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.111+0000 7f05077fe700 1 -- 172.21.15.77:0/2114600773 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0510015870 con 0x7f0508004db0 2023-07-24T05:45:59.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.111+0000 7f05077fe700 1 -- 172.21.15.77:0/2114600773 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05100159d0 con 0x7f0508004db0 2023-07-24T05:45:59.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.111+0000 7f0525501700 1 -- 172.21.15.77:0/2114600773 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f052009e060 con 0x7f0508004db0 2023-07-24T05:45:59.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.111+0000 7f05077fe700 1 -- 172.21.15.77:0/2114600773 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0510015d40 con 0x7f0508004db0 2023-07-24T05:45:59.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.111+0000 7f0525501700 1 -- 172.21.15.77:0/2114600773 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f052009e620 con 0x7f0508004db0 2023-07-24T05:45:59.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.115+0000 7f0525501700 1 -- 172.21.15.77:0/2114600773 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0520072490 con 0x7f0508004db0 2023-07-24T05:45:59.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.115+0000 7f05077fe700 1 -- 172.21.15.77:0/2114600773 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0510013400 con 0x7f0508004db0 2023-07-24T05:45:59.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.115+0000 7f05077fe700 1 --2- 172.21.15.77:0/2114600773 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f050c066320 0x7f050c0687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:45:59.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.115+0000 7f05077fe700 1 -- 172.21.15.77:0/2114600773 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f05100843b0 con 0x7f0508004db0 2023-07-24T05:45:59.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.115+0000 7f051e7fc700 1 --2- 172.21.15.77:0/2114600773 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f050c066320 0x7f050c0687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:45:59.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.119+0000 7f051e7fc700 1 --2- 172.21.15.77:0/2114600773 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f050c066320 0x7f050c0687e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0514001050 tx=0x7f0514000f40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:45:59.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.123+0000 7f05077fe700 1 -- 172.21.15.77:0/2114600773 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0510055370 con 0x7f0508004db0 2023-07-24T05:45:59.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.299+0000 7f0525501700 1 -- 172.21.15.77:0/2114600773 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f05200d32f0 con 0x7f0508004db0 2023-07-24T05:45:59.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.875+0000 7f05077fe700 1 -- 172.21.15.77:0/2114600773 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) v1 ==== 171+0+0 (secure 0 0 0) 0x7f0510054f00 con 0x7f0508004db0 2023-07-24T05:45:59.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.887+0000 7f0525501700 1 -- 172.21.15.77:0/2114600773 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f050c066320 msgr2=0x7f050c0687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:59.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.887+0000 7f0525501700 1 --2- 172.21.15.77:0/2114600773 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f050c066320 0x7f050c0687e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0514001050 tx=0x7f0514000f40 comp rx=0 tx=0).stop 2023-07-24T05:45:59.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.887+0000 7f0525501700 1 -- 172.21.15.77:0/2114600773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0508004db0 msgr2=0x7f052009d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:45:59.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.887+0000 7f0525501700 1 --2- 172.21.15.77:0/2114600773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0508004db0 0x7f052009d220 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f05100116d0 tx=0x7f0510011a90 comp rx=0 tx=0).stop 2023-07-24T05:45:59.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.895+0000 7f0525501700 1 -- 172.21.15.77:0/2114600773 shutdown_connections 2023-07-24T05:45:59.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.895+0000 7f0525501700 1 --2- 172.21.15.77:0/2114600773 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f052015d050 0x7f052015d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:59.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.895+0000 7f0525501700 1 --2- 172.21.15.77:0/2114600773 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f050c066320 0x7f050c0687e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:59.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.895+0000 7f0525501700 1 --2- 172.21.15.77:0/2114600773 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f05200c8be0 0x7f0520158c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:59.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.895+0000 7f0525501700 1 --2- 172.21.15.77:0/2114600773 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0508004db0 0x7f052009d220 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:45:59.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.895+0000 7f0525501700 1 -- 172.21.15.77:0/2114600773 >> 172.21.15.77:0/2114600773 conn(0x7f05200b7620 msgr2=0x7f05200d16e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:45:59.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.895+0000 7f0525501700 1 -- 172.21.15.77:0/2114600773 shutdown_connections 2023-07-24T05:45:59.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:45:59.895+0000 7f0525501700 1 -- 172.21.15.77:0/2114600773 wait complete. 2023-07-24T05:45:59.903 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_data' created 2023-07-24T05:45:59.927 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-24T05:46:00.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.099+0000 7fc83df88700 1 Processor -- start 2023-07-24T05:46:00.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.099+0000 7fc83df88700 1 -- start start 2023-07-24T05:46:00.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.099+0000 7fc83df88700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc83815cc50 0x7fc8380b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:00.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.099+0000 7fc83df88700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc83806a520 0x7fc8380b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:00.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.099+0000 7fc83df88700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc83806aaa0 con 0x7fc83815c870 2023-07-24T05:46:00.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.099+0000 7fc83df88700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc83806ad80 con 0x7fc83815cc50 2023-07-24T05:46:00.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.099+0000 7fc83df88700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc83806b060 con 0x7fc83806a520 2023-07-24T05:46:00.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.103+0000 7fc837fff700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc83815cc50 0x7fc8380b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:00.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.103+0000 7fc837fff700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc83815cc50 0x7fc8380b1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47124/0 (socket says 172.21.15.77:47124) 2023-07-24T05:46:00.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.103+0000 7fc837fff700 1 -- 172.21.15.77:0/4081209301 learned_addr learned my addr 172.21.15.77:0/4081209301 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:00.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.103+0000 7fc83d787700 1 --2- 172.21.15.77:0/4081209301 >> v2:172.21.15.103:3300/0 conn(0x7fc83806a520 0x7fc8380b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:00.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.103+0000 7fc837fff700 1 -- 172.21.15.77:0/4081209301 >> v2:172.21.15.103:3300/0 conn(0x7fc83806a520 msgr2=0x7fc8380b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:00.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.103+0000 7fc837fff700 1 --2- 172.21.15.77:0/4081209301 >> v2:172.21.15.103:3300/0 conn(0x7fc83806a520 0x7fc8380b2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:00.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.103+0000 7fc837fff700 1 -- 172.21.15.77:0/4081209301 >> v1:172.21.15.77:6789/0 conn(0x7fc83815c870 legacy=0x7fc8380cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:00.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.103+0000 7fc837fff700 1 -- 172.21.15.77:0/4081209301 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83806b340 con 0x7fc83815cc50 2023-07-24T05:46:00.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.103+0000 7fc837fff700 1 --2- 172.21.15.77:0/4081209301 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc83815cc50 0x7fc8380b1b20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc8380b4010 tx=0x7fc824009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90958988509cfacf server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:00.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.103+0000 7fc8377fe700 1 -- 172.21.15.77:0/4081209301 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc824011830 con 0x7fc83815cc50 2023-07-24T05:46:00.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.103+0000 7fc8377fe700 1 -- 172.21.15.77:0/4081209301 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc824011990 con 0x7fc83815cc50 2023-07-24T05:46:00.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.103+0000 7fc8377fe700 1 -- 172.21.15.77:0/4081209301 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc824011d20 con 0x7fc83815cc50 2023-07-24T05:46:00.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.103+0000 7fc83df88700 1 -- 172.21.15.77:0/4081209301 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc83815cc50 msgr2=0x7fc8380b1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:00.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.103+0000 7fc83df88700 1 --2- 172.21.15.77:0/4081209301 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc83815cc50 0x7fc8380b1b20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc8380b4010 tx=0x7fc824009bf0 comp rx=0 tx=0).stop 2023-07-24T05:46:00.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.103+0000 7fc83df88700 1 -- 172.21.15.77:0/4081209301 shutdown_connections 2023-07-24T05:46:00.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.103+0000 7fc83df88700 1 --2- 172.21.15.77:0/4081209301 >> v2:172.21.15.103:3300/0 conn(0x7fc83806a520 0x7fc8380b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:00.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.103+0000 7fc83df88700 1 --2- 172.21.15.77:0/4081209301 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc83815cc50 0x7fc8380b1b20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:00.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.103+0000 7fc83df88700 1 -- 172.21.15.77:0/4081209301 >> 172.21.15.77:0/4081209301 conn(0x7fc838089f80 msgr2=0x7fc83809b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:00.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.103+0000 7fc83df88700 1 -- 172.21.15.77:0/4081209301 shutdown_connections 2023-07-24T05:46:00.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.103+0000 7fc83df88700 1 -- 172.21.15.77:0/4081209301 wait complete. 2023-07-24T05:46:00.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.107+0000 7fc83df88700 1 Processor -- start 2023-07-24T05:46:00.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.107+0000 7fc83df88700 1 -- start start 2023-07-24T05:46:00.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.111+0000 7fc83df88700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc83806a520 0x7fc838158a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:00.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.111+0000 7fc83df88700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc83815c870 0x7fc8380d2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:00.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.111+0000 7fc83df88700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc83815cc50 0x7fc8380b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:00.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.111+0000 7fc83df88700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc838158f80 con 0x7fc83806a520 2023-07-24T05:46:00.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.111+0000 7fc83df88700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8380af370 con 0x7fc83815cc50 2023-07-24T05:46:00.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.111+0000 7fc83df88700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8380af650 con 0x7fc83815c870 2023-07-24T05:46:00.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.111+0000 7fc83cf86700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc83806a520 0x7fc838158a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:00.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.111+0000 7fc83cf86700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc83806a520 0x7fc838158a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47130/0 (socket says 172.21.15.77:47130) 2023-07-24T05:46:00.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.111+0000 7fc83cf86700 1 -- 172.21.15.77:0/1107699551 learned_addr learned my addr 172.21.15.77:0/1107699551 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:00.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.111+0000 7fc83d787700 1 --2- 172.21.15.77:0/1107699551 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc83815cc50 0x7fc8380b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:00.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.111+0000 7fc837fff700 1 --2- 172.21.15.77:0/1107699551 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc83815c870 0x7fc8380d2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:00.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.111+0000 7fc83cf86700 1 -- 172.21.15.77:0/1107699551 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc83815c870 msgr2=0x7fc8380d2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:00.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.111+0000 7fc83cf86700 1 --2- 172.21.15.77:0/1107699551 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc83815c870 0x7fc8380d2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:00.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.111+0000 7fc83cf86700 1 -- 172.21.15.77:0/1107699551 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc83815cc50 msgr2=0x7fc8380b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:00.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.111+0000 7fc83cf86700 1 --2- 172.21.15.77:0/1107699551 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc83815cc50 0x7fc8380b0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:00.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.111+0000 7fc83cf86700 1 -- 172.21.15.77:0/1107699551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc824009570 con 0x7fc83806a520 2023-07-24T05:46:00.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.111+0000 7fc837fff700 1 --2- 172.21.15.77:0/1107699551 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc83815c870 0x7fc8380d2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:46:00.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.111+0000 7fc83cf86700 1 --2- 172.21.15.77:0/1107699551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc83806a520 0x7fc838158a40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00c500 tx=0x7fc82c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:00.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.111+0000 7fc8357fa700 1 -- 172.21.15.77:0/1107699551 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c0054e0 con 0x7fc83806a520 2023-07-24T05:46:00.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.111+0000 7fc8357fa700 1 -- 172.21.15.77:0/1107699551 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82c0036a0 con 0x7fc83806a520 2023-07-24T05:46:00.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.111+0000 7fc83df88700 1 -- 172.21.15.77:0/1107699551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8380af930 con 0x7fc83806a520 2023-07-24T05:46:00.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.111+0000 7fc8357fa700 1 -- 172.21.15.77:0/1107699551 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c003a50 con 0x7fc83806a520 2023-07-24T05:46:00.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.111+0000 7fc83df88700 1 -- 172.21.15.77:0/1107699551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8380afef0 con 0x7fc83806a520 2023-07-24T05:46:00.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.111+0000 7fc83df88700 1 -- 172.21.15.77:0/1107699551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc838072490 con 0x7fc83806a520 2023-07-24T05:46:00.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.115+0000 7fc8357fa700 1 -- 172.21.15.77:0/1107699551 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc82c003bb0 con 0x7fc83806a520 2023-07-24T05:46:00.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.115+0000 7fc8357fa700 1 --2- 172.21.15.77:0/1107699551 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc81c0662f0 0x7fc81c0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:00.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.115+0000 7fc8357fa700 1 -- 172.21.15.77:0/1107699551 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fc82c083240 con 0x7fc83806a520 2023-07-24T05:46:00.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.115+0000 7fc837fff700 1 --2- 172.21.15.77:0/1107699551 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc81c0662f0 0x7fc81c0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:00.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.119+0000 7fc837fff700 1 --2- 172.21.15.77:0/1107699551 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc81c0662f0 0x7fc81c0687b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc8380b1550 tx=0x7fc824008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:00.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.123+0000 7fc8357fa700 1 -- 172.21.15.77:0/1107699551 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc82c050720 con 0x7fc83806a520 2023-07-24T05:46:00.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.391+0000 7fc83df88700 1 -- 172.21.15.77:0/1107699551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc83815be50 con 0x7fc83806a520 2023-07-24T05:46:00.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.951+0000 7fc8357fa700 1 -- 172.21.15.77:0/1107699551 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fc82c003e60 con 0x7fc83806a520 2023-07-24T05:46:00.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.955+0000 7fc83df88700 1 -- 172.21.15.77:0/1107699551 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc81c0662f0 msgr2=0x7fc81c0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:00.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.955+0000 7fc83df88700 1 --2- 172.21.15.77:0/1107699551 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc81c0662f0 0x7fc81c0687b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc8380b1550 tx=0x7fc824008030 comp rx=0 tx=0).stop 2023-07-24T05:46:00.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.955+0000 7fc83df88700 1 -- 172.21.15.77:0/1107699551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc83806a520 msgr2=0x7fc838158a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:00.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.955+0000 7fc83df88700 1 --2- 172.21.15.77:0/1107699551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc83806a520 0x7fc838158a40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00c500 tx=0x7fc82c00c8c0 comp rx=0 tx=0).stop 2023-07-24T05:46:00.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.955+0000 7fc83df88700 1 -- 172.21.15.77:0/1107699551 shutdown_connections 2023-07-24T05:46:00.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.955+0000 7fc83df88700 1 --2- 172.21.15.77:0/1107699551 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc83815cc50 0x7fc8380b0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:00.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.955+0000 7fc83df88700 1 --2- 172.21.15.77:0/1107699551 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc81c0662f0 0x7fc81c0687b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:00.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.955+0000 7fc83df88700 1 --2- 172.21.15.77:0/1107699551 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc83815c870 0x7fc8380d2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:00.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.955+0000 7fc83df88700 1 --2- 172.21.15.77:0/1107699551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc83806a520 0x7fc838158a40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:00.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.955+0000 7fc83df88700 1 -- 172.21.15.77:0/1107699551 >> 172.21.15.77:0/1107699551 conn(0x7fc838089f80 msgr2=0x7fc83815aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:00.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.955+0000 7fc83df88700 1 -- 172.21.15.77:0/1107699551 shutdown_connections 2023-07-24T05:46:00.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:00.955+0000 7fc83df88700 1 -- 172.21.15.77:0/1107699551 wait complete. 2023-07-24T05:46:00.962 INFO:teuthology.orchestra.run.smithi077.stderr:new fs with metadata pool 3 and data pool 4 2023-07-24T05:46:00.980 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-07-24T05:46:00.981 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-07-24T05:46:01.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.155+0000 7f7dfc2b5700 1 Processor -- start 2023-07-24T05:46:01.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.155+0000 7f7dfc2b5700 1 -- start start 2023-07-24T05:46:01.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.159+0000 7f7dfc2b5700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7df415c9c0 0x7f7df406d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:01.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.159+0000 7f7dfc2b5700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7df40d2eb0 0x7f7df40b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:01.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.159+0000 7f7dfc2b5700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7df40d0240 con 0x7f7df415cda0 2023-07-24T05:46:01.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.159+0000 7f7dfc2b5700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7df40cfa70 con 0x7f7df415c9c0 2023-07-24T05:46:01.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.159+0000 7f7dfc2b5700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df406aef0 con 0x7f7df40d2eb0 2023-07-24T05:46:01.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.159+0000 7f7dfa051700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7df415c9c0 0x7f7df406d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:01.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.159+0000 7f7dfa051700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7df415c9c0 0x7f7df406d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47134/0 (socket says 172.21.15.77:47134) 2023-07-24T05:46:01.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.159+0000 7f7dfa051700 1 -- 172.21.15.77:0/2583897931 learned_addr learned my addr 172.21.15.77:0/2583897931 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:01.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.159+0000 7f7dfa852700 1 --2- 172.21.15.77:0/2583897931 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7df40d2eb0 0x7f7df40b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:01.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.159+0000 7f7dfa051700 1 -- 172.21.15.77:0/2583897931 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7df40d2eb0 msgr2=0x7f7df40b4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:01.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.159+0000 7f7dfa051700 1 --2- 172.21.15.77:0/2583897931 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7df40d2eb0 0x7f7df40b4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:01.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.159+0000 7f7dfa051700 1 -- 172.21.15.77:0/2583897931 >> v1:172.21.15.103:6789/0 conn(0x7f7df415cda0 legacy=0x7f7df40d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:01.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.159+0000 7f7dfa051700 1 -- 172.21.15.77:0/2583897931 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df40d1420 con 0x7f7df415c9c0 2023-07-24T05:46:01.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.159+0000 7f7dfa051700 1 --2- 172.21.15.77:0/2583897931 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7df415c9c0 0x7f7df406d480 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7df0009910 tx=0x7f7df0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c652a1e39cd9029 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:01.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.163+0000 7f7df904f700 1 -- 172.21.15.77:0/2583897931 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df0011830 con 0x7f7df415c9c0 2023-07-24T05:46:01.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.163+0000 7f7df904f700 1 -- 172.21.15.77:0/2583897931 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df0011990 con 0x7f7df415c9c0 2023-07-24T05:46:01.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.163+0000 7f7df904f700 1 -- 172.21.15.77:0/2583897931 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df0011d40 con 0x7f7df415c9c0 2023-07-24T05:46:01.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.163+0000 7f7dfc2b5700 1 -- 172.21.15.77:0/2583897931 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7df415c9c0 msgr2=0x7f7df406d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:01.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.163+0000 7f7dfc2b5700 1 --2- 172.21.15.77:0/2583897931 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7df415c9c0 0x7f7df406d480 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7df0009910 tx=0x7f7df0009c20 comp rx=0 tx=0).stop 2023-07-24T05:46:01.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.163+0000 7f7dfc2b5700 1 -- 172.21.15.77:0/2583897931 shutdown_connections 2023-07-24T05:46:01.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.163+0000 7f7dfc2b5700 1 --2- 172.21.15.77:0/2583897931 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7df40d2eb0 0x7f7df40b4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:01.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.163+0000 7f7dfc2b5700 1 --2- 172.21.15.77:0/2583897931 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7df415c9c0 0x7f7df406d480 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:01.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.163+0000 7f7dfc2b5700 1 -- 172.21.15.77:0/2583897931 >> 172.21.15.77:0/2583897931 conn(0x7f7df40b8120 msgr2=0x7f7df409bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:01.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.163+0000 7f7dfc2b5700 1 -- 172.21.15.77:0/2583897931 shutdown_connections 2023-07-24T05:46:01.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.163+0000 7f7dfc2b5700 1 -- 172.21.15.77:0/2583897931 wait complete. 2023-07-24T05:46:01.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.163+0000 7f7dfc2b5700 1 Processor -- start 2023-07-24T05:46:01.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.163+0000 7f7dfc2b5700 1 -- start start 2023-07-24T05:46:01.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.167+0000 7f7dfc2b5700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7df40d2eb0 0x7f7df40b5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:01.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.167+0000 7f7dfc2b5700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7df415c9c0 0x7f7df41f1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:01.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.167+0000 7f7dfc2b5700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7df415cda0 0x7f7df41f18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:01.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.167+0000 7f7dfc2b5700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df41f5520 con 0x7f7df415c9c0 2023-07-24T05:46:01.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.167+0000 7f7dfc2b5700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df41f5790 con 0x7f7df40d2eb0 2023-07-24T05:46:01.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.167+0000 7f7dfc2b5700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df41f5a70 con 0x7f7df415cda0 2023-07-24T05:46:01.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.167+0000 7f7df9850700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7df415c9c0 0x7f7df41f1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:01.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.167+0000 7f7df9850700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7df415c9c0 0x7f7df41f1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47142/0 (socket says 172.21.15.77:47142) 2023-07-24T05:46:01.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.167+0000 7f7df9850700 1 -- 172.21.15.77:0/201563298 learned_addr learned my addr 172.21.15.77:0/201563298 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:01.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.167+0000 7f7dfa852700 1 --2- 172.21.15.77:0/201563298 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7df415cda0 0x7f7df41f18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:01.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.167+0000 7f7dfa051700 1 --2- 172.21.15.77:0/201563298 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7df40d2eb0 0x7f7df40b5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:01.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.167+0000 7f7df9850700 1 -- 172.21.15.77:0/201563298 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7df415cda0 msgr2=0x7f7df41f18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:01.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.167+0000 7f7df9850700 1 --2- 172.21.15.77:0/201563298 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7df415cda0 0x7f7df41f18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:01.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.167+0000 7f7df9850700 1 -- 172.21.15.77:0/201563298 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7df40d2eb0 msgr2=0x7f7df40b5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:01.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.167+0000 7f7df9850700 1 --2- 172.21.15.77:0/201563298 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7df40d2eb0 0x7f7df40b5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:01.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.167+0000 7f7df9850700 1 -- 172.21.15.77:0/201563298 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df0009570 con 0x7f7df415c9c0 2023-07-24T05:46:01.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.167+0000 7f7dfa051700 1 --2- 172.21.15.77:0/201563298 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7df40d2eb0 0x7f7df40b5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:46:01.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.167+0000 7f7df9850700 1 --2- 172.21.15.77:0/201563298 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7df415c9c0 0x7f7df41f1370 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7de400c500 tx=0x7f7de400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:01.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.167+0000 7f7deaffd700 1 -- 172.21.15.77:0/201563298 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de40052d0 con 0x7f7df415c9c0 2023-07-24T05:46:01.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.167+0000 7f7dfc2b5700 1 -- 172.21.15.77:0/201563298 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7df41f5d50 con 0x7f7df415c9c0 2023-07-24T05:46:01.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.167+0000 7f7deaffd700 1 -- 172.21.15.77:0/201563298 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de4005430 con 0x7f7df415c9c0 2023-07-24T05:46:01.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.167+0000 7f7deaffd700 1 -- 172.21.15.77:0/201563298 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de40055a0 con 0x7f7df415c9c0 2023-07-24T05:46:01.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.167+0000 7f7dfc2b5700 1 -- 172.21.15.77:0/201563298 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7df40b6060 con 0x7f7df415c9c0 2023-07-24T05:46:01.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.167+0000 7f7dfc2b5700 1 -- 172.21.15.77:0/201563298 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7df406b360 con 0x7f7df415c9c0 2023-07-24T05:46:01.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.171+0000 7f7deaffd700 1 -- 172.21.15.77:0/201563298 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7de40038e0 con 0x7f7df415c9c0 2023-07-24T05:46:01.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.171+0000 7f7deaffd700 1 --2- 172.21.15.77:0/201563298 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f7dd80662f0 0x7f7dd80687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:01.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.171+0000 7f7deaffd700 1 -- 172.21.15.77:0/201563298 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7de4083060 con 0x7f7df415c9c0 2023-07-24T05:46:01.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.171+0000 7f7dfa051700 1 --2- 172.21.15.77:0/201563298 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f7dd80662f0 0x7f7dd80687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:01.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.171+0000 7f7dfa051700 1 --2- 172.21.15.77:0/201563298 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f7dd80662f0 0x7f7dd80687b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7df0000c00 tx=0x7f7df0008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:01.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.179+0000 7f7deaffd700 1 -- 172.21.15.77:0/201563298 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7de40b3700 con 0x7f7df415c9c0 2023-07-24T05:46:01.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.363+0000 7f7dfc2b5700 1 -- 172.21.15.77:0/201563298 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f7df40b6060 con 0x7f7df415c9c0 2023-07-24T05:46:01.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.915+0000 7f7deaffd700 1 -- 172.21.15.77:0/201563298 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) v1 ==== 157+0+0 (secure 0 0 0) 0x7f7df40b6060 con 0x7f7df415c9c0 2023-07-24T05:46:01.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.919+0000 7f7dfc2b5700 1 -- 172.21.15.77:0/201563298 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f7dd80662f0 msgr2=0x7f7dd80687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:01.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.919+0000 7f7dfc2b5700 1 --2- 172.21.15.77:0/201563298 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f7dd80662f0 0x7f7dd80687b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7df0000c00 tx=0x7f7df0008030 comp rx=0 tx=0).stop 2023-07-24T05:46:01.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.919+0000 7f7dfc2b5700 1 -- 172.21.15.77:0/201563298 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7df415c9c0 msgr2=0x7f7df41f1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:01.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.919+0000 7f7dfc2b5700 1 --2- 172.21.15.77:0/201563298 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7df415c9c0 0x7f7df41f1370 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7de400c500 tx=0x7f7de400c8c0 comp rx=0 tx=0).stop 2023-07-24T05:46:01.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.919+0000 7f7dfc2b5700 1 -- 172.21.15.77:0/201563298 shutdown_connections 2023-07-24T05:46:01.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.919+0000 7f7dfc2b5700 1 --2- 172.21.15.77:0/201563298 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f7dd80662f0 0x7f7dd80687b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:01.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.919+0000 7f7dfc2b5700 1 --2- 172.21.15.77:0/201563298 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7df415cda0 0x7f7df41f18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:01.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.919+0000 7f7dfc2b5700 1 --2- 172.21.15.77:0/201563298 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7df415c9c0 0x7f7df41f1370 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:01.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.919+0000 7f7dfc2b5700 1 --2- 172.21.15.77:0/201563298 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7df40d2eb0 0x7f7df40b5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:01.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.919+0000 7f7dfc2b5700 1 -- 172.21.15.77:0/201563298 >> 172.21.15.77:0/201563298 conn(0x7f7df40b8120 msgr2=0x7f7df40b2920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:01.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.919+0000 7f7dfc2b5700 1 -- 172.21.15.77:0/201563298 shutdown_connections 2023-07-24T05:46:01.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:01.919+0000 7f7dfc2b5700 1 -- 172.21.15.77:0/201563298 wait complete. 2023-07-24T05:46:01.948 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-07-24T05:46:02.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.127+0000 7f7b4e27d700 1 Processor -- start 2023-07-24T05:46:02.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.127+0000 7f7b4e27d700 1 -- start start 2023-07-24T05:46:02.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.131+0000 7f7b4e27d700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7b4815c9a0 0x7f7b4806d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:02.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.131+0000 7f7b4e27d700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7b4806bb60 0x7f7b480d0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:02.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.131+0000 7f7b4e27d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f7b480d07d0 0x7f7b480cf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:02.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.131+0000 7f7b4e27d700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b480cf170 con 0x7f7b4815c9a0 2023-07-24T05:46:02.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.131+0000 7f7b4e27d700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b4806b4d0 con 0x7f7b480d07d0 2023-07-24T05:46:02.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.131+0000 7f7b4e27d700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4806ac30 con 0x7f7b4806bb60 2023-07-24T05:46:02.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.131+0000 7f7b4d27b700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7b4815c9a0 0x7f7b4806d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:02.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.131+0000 7f7b4d27b700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f7b4815c9a0 0x7f7b4806d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47144/0 (socket says 172.21.15.77:47144) 2023-07-24T05:46:02.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.131+0000 7f7b4d27b700 1 -- 172.21.15.77:0/1354317588 learned_addr learned my addr 172.21.15.77:0/1354317588 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:02.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.135+0000 7f7b4ca7a700 1 --2- 172.21.15.77:0/1354317588 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7b4806bb60 0x7f7b480d0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:02.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.135+0000 7f7b4da7c700 1 --2- 172.21.15.77:0/1354317588 >> v2:172.21.15.103:3300/0 conn(0x7f7b480d07d0 0x7f7b480cf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:02.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.135+0000 7f7b4d27b700 1 -- 172.21.15.77:0/1354317588 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7b4806bb60 msgr2=0x7f7b480d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:02.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.135+0000 7f7b4d27b700 1 --2- 172.21.15.77:0/1354317588 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7b4806bb60 0x7f7b480d0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:02.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.135+0000 7f7b4d27b700 1 -- 172.21.15.77:0/1354317588 >> v2:172.21.15.103:3300/0 conn(0x7f7b480d07d0 msgr2=0x7f7b480cf5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:02.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.135+0000 7f7b4d27b700 1 --2- 172.21.15.77:0/1354317588 >> v2:172.21.15.103:3300/0 conn(0x7f7b480d07d0 0x7f7b480cf5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:02.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.135+0000 7f7b4d27b700 1 -- 172.21.15.77:0/1354317588 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b4806af10 con 0x7f7b4815c9a0 2023-07-24T05:46:02.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.135+0000 7f7b4da7c700 1 --2- 172.21.15.77:0/1354317588 >> v2:172.21.15.103:3300/0 conn(0x7f7b480d07d0 0x7f7b480cf5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:46:02.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.135+0000 7f7b4d27b700 1 --2- 172.21.15.77:0/1354317588 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b4815c9a0 0x7f7b4806d2d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7b480b4140 tx=0x7f7b44009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b2ff84347e96016 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:02.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.135+0000 7f7b3ffff700 1 -- 172.21.15.77:0/1354317588 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b44011830 con 0x7f7b4815c9a0 2023-07-24T05:46:02.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.135+0000 7f7b3ffff700 1 -- 172.21.15.77:0/1354317588 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b44011990 con 0x7f7b4815c9a0 2023-07-24T05:46:02.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.135+0000 7f7b3ffff700 1 -- 172.21.15.77:0/1354317588 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b44011d20 con 0x7f7b4815c9a0 2023-07-24T05:46:02.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.135+0000 7f7b4e27d700 1 -- 172.21.15.77:0/1354317588 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b4815c9a0 msgr2=0x7f7b4806d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:02.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.135+0000 7f7b4e27d700 1 --2- 172.21.15.77:0/1354317588 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b4815c9a0 0x7f7b4806d2d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7b480b4140 tx=0x7f7b44009bf0 comp rx=0 tx=0).stop 2023-07-24T05:46:02.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.135+0000 7f7b4e27d700 1 -- 172.21.15.77:0/1354317588 shutdown_connections 2023-07-24T05:46:02.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.135+0000 7f7b4e27d700 1 --2- 172.21.15.77:0/1354317588 >> v2:172.21.15.103:3300/0 conn(0x7f7b480d07d0 0x7f7b480cf5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:02.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.135+0000 7f7b4e27d700 1 --2- 172.21.15.77:0/1354317588 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7b4806bb60 0x7f7b480d0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:02.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.135+0000 7f7b4e27d700 1 --2- 172.21.15.77:0/1354317588 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b4815c9a0 0x7f7b4806d2d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:02.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.135+0000 7f7b4e27d700 1 -- 172.21.15.77:0/1354317588 >> 172.21.15.77:0/1354317588 conn(0x7f7b480b5610 msgr2=0x7f7b480b5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:02.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.135+0000 7f7b4e27d700 1 -- 172.21.15.77:0/1354317588 shutdown_connections 2023-07-24T05:46:02.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.135+0000 7f7b4e27d700 1 -- 172.21.15.77:0/1354317588 wait complete. 2023-07-24T05:46:02.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.139+0000 7f7b4e27d700 1 Processor -- start 2023-07-24T05:46:02.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.139+0000 7f7b4e27d700 1 -- start start 2023-07-24T05:46:02.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.139+0000 7f7b4e27d700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7b4806bb60 0x7f7b480c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:02.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.139+0000 7f7b4e27d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b480d07d0 0x7f7b48158810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:02.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.139+0000 7f7b4e27d700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b4815c9a0 0x7f7b48156860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:02.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.139+0000 7f7b4e27d700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4815fca0 con 0x7f7b480d07d0 2023-07-24T05:46:02.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.139+0000 7f7b4e27d700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b480c92d0 con 0x7f7b4815c9a0 2023-07-24T05:46:02.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.139+0000 7f7b4e27d700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4815ec00 con 0x7f7b4806bb60 2023-07-24T05:46:02.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.139+0000 7f7b4ca7a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b480d07d0 0x7f7b48158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:02.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.139+0000 7f7b4ca7a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b480d07d0 0x7f7b48158810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47158/0 (socket says 172.21.15.77:47158) 2023-07-24T05:46:02.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.139+0000 7f7b4ca7a700 1 -- 172.21.15.77:0/1887825062 learned_addr learned my addr 172.21.15.77:0/1887825062 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:02.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.139+0000 7f7b4da7c700 1 --2- 172.21.15.77:0/1887825062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b4815c9a0 0x7f7b48156860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:02.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.139+0000 7f7b4d27b700 1 --2- 172.21.15.77:0/1887825062 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7b4806bb60 0x7f7b480c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:02.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.139+0000 7f7b4ca7a700 1 -- 172.21.15.77:0/1887825062 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7b4806bb60 msgr2=0x7f7b480c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:02.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.139+0000 7f7b4ca7a700 1 --2- 172.21.15.77:0/1887825062 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7b4806bb60 0x7f7b480c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:02.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.139+0000 7f7b4ca7a700 1 -- 172.21.15.77:0/1887825062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b4815c9a0 msgr2=0x7f7b48156860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:02.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.139+0000 7f7b4ca7a700 1 --2- 172.21.15.77:0/1887825062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b4815c9a0 0x7f7b48156860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:02.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.139+0000 7f7b4ca7a700 1 -- 172.21.15.77:0/1887825062 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b44009570 con 0x7f7b480d07d0 2023-07-24T05:46:02.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.139+0000 7f7b4ca7a700 1 --2- 172.21.15.77:0/1887825062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b480d07d0 0x7f7b48158810 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7b3800e970 tx=0x7f7b3800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:02.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.139+0000 7f7b3dffb700 1 -- 172.21.15.77:0/1887825062 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3800eec0 con 0x7f7b480d07d0 2023-07-24T05:46:02.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.139+0000 7f7b3dffb700 1 -- 172.21.15.77:0/1887825062 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3800c850 con 0x7f7b480d07d0 2023-07-24T05:46:02.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.139+0000 7f7b4e27d700 1 -- 172.21.15.77:0/1887825062 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b4815eee0 con 0x7f7b480d07d0 2023-07-24T05:46:02.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.139+0000 7f7b3dffb700 1 -- 172.21.15.77:0/1887825062 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3800cbc0 con 0x7f7b480d07d0 2023-07-24T05:46:02.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.143+0000 7f7b4e27d700 1 -- 172.21.15.77:0/1887825062 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b4815f4a0 con 0x7f7b480d07d0 2023-07-24T05:46:02.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.143+0000 7f7b4e27d700 1 -- 172.21.15.77:0/1887825062 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b48072490 con 0x7f7b480d07d0 2023-07-24T05:46:02.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.143+0000 7f7b3dffb700 1 -- 172.21.15.77:0/1887825062 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7b3800cd20 con 0x7f7b480d07d0 2023-07-24T05:46:02.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.147+0000 7f7b3dffb700 1 --2- 172.21.15.77:0/1887825062 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f7b2c0662f0 0x7f7b2c0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:02.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.147+0000 7f7b3dffb700 1 -- 172.21.15.77:0/1887825062 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6288+0+0 (secure 0 0 0) 0x7f7b38083e30 con 0x7f7b480d07d0 2023-07-24T05:46:02.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.147+0000 7f7b4d27b700 1 --2- 172.21.15.77:0/1887825062 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f7b2c0662f0 0x7f7b2c0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:02.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.147+0000 7f7b4d27b700 1 --2- 172.21.15.77:0/1887825062 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f7b2c0662f0 0x7f7b2c0687b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7b44000c00 tx=0x7f7b44008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:02.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.151+0000 7f7b3dffb700 1 -- 172.21.15.77:0/1887825062 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7b38054c70 con 0x7f7b480d07d0 2023-07-24T05:46:02.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:02.331+0000 7f7b4e27d700 1 -- 172.21.15.77:0/1887825062 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7b480b3720 con 0x7f7b480d07d0 2023-07-24T05:46:03.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:03.979+0000 7f7b3dffb700 1 -- 172.21.15.77:0/1887825062 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) v1 ==== 228+0+0 (secure 0 0 0) 0x7f7b38017100 con 0x7f7b480d07d0 2023-07-24T05:46:03.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:03.987+0000 7f7b4e27d700 1 -- 172.21.15.77:0/1887825062 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f7b2c0662f0 msgr2=0x7f7b2c0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:03.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:03.987+0000 7f7b4e27d700 1 --2- 172.21.15.77:0/1887825062 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f7b2c0662f0 0x7f7b2c0687b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7b44000c00 tx=0x7f7b44008030 comp rx=0 tx=0).stop 2023-07-24T05:46:03.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:03.987+0000 7f7b4e27d700 1 -- 172.21.15.77:0/1887825062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b480d07d0 msgr2=0x7f7b48158810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:03.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:03.987+0000 7f7b4e27d700 1 --2- 172.21.15.77:0/1887825062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b480d07d0 0x7f7b48158810 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7b3800e970 tx=0x7f7b3800ec80 comp rx=0 tx=0).stop 2023-07-24T05:46:03.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:03.987+0000 7f7b4e27d700 1 -- 172.21.15.77:0/1887825062 shutdown_connections 2023-07-24T05:46:03.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:03.987+0000 7f7b4e27d700 1 --2- 172.21.15.77:0/1887825062 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b4815c9a0 0x7f7b48156860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:03.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:03.987+0000 7f7b4e27d700 1 --2- 172.21.15.77:0/1887825062 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7b480d07d0 0x7f7b48158810 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:03.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:03.987+0000 7f7b4e27d700 1 --2- 172.21.15.77:0/1887825062 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f7b2c0662f0 0x7f7b2c0687b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:03.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:03.987+0000 7f7b4e27d700 1 --2- 172.21.15.77:0/1887825062 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f7b4806bb60 0x7f7b480c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:03.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:03.987+0000 7f7b4e27d700 1 -- 172.21.15.77:0/1887825062 >> 172.21.15.77:0/1887825062 conn(0x7f7b480b5610 msgr2=0x7f7b480b7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:03.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:03.987+0000 7f7b4e27d700 1 -- 172.21.15.77:0/1887825062 shutdown_connections 2023-07-24T05:46:03.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:03.987+0000 7f7b4e27d700 1 -- 172.21.15.77:0/1887825062 wait complete. 2023-07-24T05:46:03.996 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_data_ec' created 2023-07-24T05:46:04.013 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-07-24T05:46:04.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.191+0000 7f78660b5700 1 Processor -- start 2023-07-24T05:46:04.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.191+0000 7f78660b5700 1 -- start start 2023-07-24T05:46:04.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.195+0000 7f78660b5700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f78600c8b60 0x7f78600cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:04.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.195+0000 7f78660b5700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f786015e5a0 con 0x7f78600ca6f0 2023-07-24T05:46:04.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.195+0000 7f78660b5700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78600c8ff0 con 0x7f78600caf20 2023-07-24T05:46:04.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.195+0000 7f78660b5700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f786015aed0 con 0x7f78600c8b60 2023-07-24T05:46:04.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.195+0000 7f785effd700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f78600c8b60 0x7f78600cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:04.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.195+0000 7f785effd700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f78600c8b60 0x7f78600cf000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:32950/0 (socket says 172.21.15.77:32950) 2023-07-24T05:46:04.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.195+0000 7f785f7fe700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f78600ca6f0 0x7f786006c890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:34362/0 (socket says 172.21.15.77:34362) 2023-07-24T05:46:04.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.195+0000 7f785effd700 1 -- 172.21.15.77:0/3758279939 learned_addr learned my addr 172.21.15.77:0/3758279939 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:04.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.195+0000 7f785effd700 1 -- 172.21.15.77:0/3758279939 >> v1:172.21.15.103:6789/0 conn(0x7f78600caf20 legacy=0x7f78600cb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:04.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.195+0000 7f785effd700 1 -- 172.21.15.77:0/3758279939 >> v1:172.21.15.77:6789/0 conn(0x7f78600ca6f0 legacy=0x7f786006c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:04.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.195+0000 7f785effd700 1 -- 172.21.15.77:0/3758279939 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78600c92d0 con 0x7f78600c8b60 2023-07-24T05:46:04.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.195+0000 7f785effd700 1 --2- 172.21.15.77:0/3758279939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78600c8b60 0x7f78600cf000 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7854009910 tx=0x7f7854009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3852d494aaf1d34 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:04.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.195+0000 7f785e7fc700 1 -- 172.21.15.77:0/3758279939 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785400ba60 con 0x7f78600c8b60 2023-07-24T05:46:04.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.195+0000 7f785e7fc700 1 -- 172.21.15.77:0/3758279939 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f785400bbc0 con 0x7f78600c8b60 2023-07-24T05:46:04.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.195+0000 7f785e7fc700 1 -- 172.21.15.77:0/3758279939 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7854009e60 con 0x7f78600c8b60 2023-07-24T05:46:04.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.199+0000 7f78660b5700 1 -- 172.21.15.77:0/3758279939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78600c8b60 msgr2=0x7f78600cf000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:04.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.199+0000 7f78660b5700 1 --2- 172.21.15.77:0/3758279939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78600c8b60 0x7f78600cf000 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7854009910 tx=0x7f7854009c20 comp rx=0 tx=0).stop 2023-07-24T05:46:04.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.199+0000 7f78660b5700 1 -- 172.21.15.77:0/3758279939 shutdown_connections 2023-07-24T05:46:04.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.199+0000 7f78660b5700 1 --2- 172.21.15.77:0/3758279939 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f78600c8b60 0x7f78600cf000 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:04.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.199+0000 7f78660b5700 1 -- 172.21.15.77:0/3758279939 >> 172.21.15.77:0/3758279939 conn(0x7f78600ce510 msgr2=0x7f78600ce8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:04.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.199+0000 7f78660b5700 1 -- 172.21.15.77:0/3758279939 shutdown_connections 2023-07-24T05:46:04.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.199+0000 7f78660b5700 1 -- 172.21.15.77:0/3758279939 wait complete. 2023-07-24T05:46:04.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.203+0000 7f78660b5700 1 Processor -- start 2023-07-24T05:46:04.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.203+0000 7f78660b5700 1 -- start start 2023-07-24T05:46:04.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.203+0000 7f78660b5700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78600ca6f0 0x7f78600cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:04.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.203+0000 7f78660b5700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f78600caf20 0x7f78600b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:04.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.203+0000 7f78660b5700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f786015d600 0x7f786015dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:04.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.203+0000 7f78660b5700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78600b0930 con 0x7f786015d600 2023-07-24T05:46:04.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.203+0000 7f78660b5700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7860155c50 con 0x7f78600ca6f0 2023-07-24T05:46:04.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.203+0000 7f78660b5700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f786015b740 con 0x7f78600caf20 2023-07-24T05:46:04.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.203+0000 7f785ffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f786015d600 0x7f786015dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:04.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.203+0000 7f785ffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f786015d600 0x7f786015dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:32952/0 (socket says 172.21.15.77:32952) 2023-07-24T05:46:04.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.203+0000 7f785ffff700 1 -- 172.21.15.77:0/348713219 learned_addr learned my addr 172.21.15.77:0/348713219 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:04.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.203+0000 7f785effd700 1 --2- 172.21.15.77:0/348713219 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f78600caf20 0x7f78600b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:04.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.203+0000 7f785f7fe700 1 --2- 172.21.15.77:0/348713219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78600ca6f0 0x7f78600cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:04.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.203+0000 7f785ffff700 1 -- 172.21.15.77:0/348713219 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f78600caf20 msgr2=0x7f78600b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:04.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.203+0000 7f785ffff700 1 --2- 172.21.15.77:0/348713219 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f78600caf20 0x7f78600b0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:04.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.203+0000 7f785ffff700 1 -- 172.21.15.77:0/348713219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78600ca6f0 msgr2=0x7f78600cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:04.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.203+0000 7f785ffff700 1 --2- 172.21.15.77:0/348713219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78600ca6f0 0x7f78600cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:04.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.203+0000 7f785ffff700 1 -- 172.21.15.77:0/348713219 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7854009570 con 0x7f786015d600 2023-07-24T05:46:04.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.207+0000 7f785ffff700 1 --2- 172.21.15.77:0/348713219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f786015d600 0x7f786015dab0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f785800cc50 tx=0x7f785800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:04.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.207+0000 7f7847fff700 1 -- 172.21.15.77:0/348713219 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7858003c20 con 0x7f786015d600 2023-07-24T05:46:04.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.207+0000 7f78660b5700 1 -- 172.21.15.77:0/348713219 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f786015cb80 con 0x7f786015d600 2023-07-24T05:46:04.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.207+0000 7f7847fff700 1 -- 172.21.15.77:0/348713219 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7858003d80 con 0x7f786015d600 2023-07-24T05:46:04.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.207+0000 7f7847fff700 1 -- 172.21.15.77:0/348713219 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785800aab0 con 0x7f786015d600 2023-07-24T05:46:04.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.207+0000 7f78660b5700 1 -- 172.21.15.77:0/348713219 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f786015b460 con 0x7f786015d600 2023-07-24T05:46:04.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.207+0000 7f78660b5700 1 -- 172.21.15.77:0/348713219 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78600ad900 con 0x7f786015d600 2023-07-24T05:46:04.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.211+0000 7f7847fff700 1 -- 172.21.15.77:0/348713219 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f785800ac10 con 0x7f786015d600 2023-07-24T05:46:04.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.211+0000 7f7847fff700 1 --2- 172.21.15.77:0/348713219 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f784c066320 0x7f784c0687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:04.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.211+0000 7f7847fff700 1 -- 172.21.15.77:0/348713219 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f7858083f80 con 0x7f786015d600 2023-07-24T05:46:04.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.211+0000 7f785f7fe700 1 --2- 172.21.15.77:0/348713219 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f784c066320 0x7f784c0687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:04.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.211+0000 7f785f7fe700 1 --2- 172.21.15.77:0/348713219 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f784c066320 0x7f784c0687e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7850001020 tx=0x7f7850009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:04.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.219+0000 7f7847fff700 1 -- 172.21.15.77:0/348713219 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7858051150 con 0x7f786015d600 2023-07-24T05:46:04.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.395+0000 7f78660b5700 1 -- 172.21.15.77:0/348713219 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f786006d140 con 0x7f786015d600 2023-07-24T05:46:04.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:04.987+0000 7f7847fff700 1 -- 172.21.15.77:0/348713219 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7858054770 con 0x7f786015d600 2023-07-24T05:46:05.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.011+0000 7f78660b5700 1 -- 172.21.15.77:0/348713219 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f784c066320 msgr2=0x7f784c0687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:05.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.015+0000 7f78660b5700 1 --2- 172.21.15.77:0/348713219 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f784c066320 0x7f784c0687e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7850001020 tx=0x7f7850009040 comp rx=0 tx=0).stop 2023-07-24T05:46:05.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.015+0000 7f78660b5700 1 -- 172.21.15.77:0/348713219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f786015d600 msgr2=0x7f786015dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:05.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.015+0000 7f78660b5700 1 --2- 172.21.15.77:0/348713219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f786015d600 0x7f786015dab0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f785800cc50 tx=0x7f785800cf60 comp rx=0 tx=0).stop 2023-07-24T05:46:05.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.015+0000 7f78660b5700 1 -- 172.21.15.77:0/348713219 shutdown_connections 2023-07-24T05:46:05.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.019+0000 7f78660b5700 1 --2- 172.21.15.77:0/348713219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f786015d600 0x7f786015dab0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:05.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.019+0000 7f78660b5700 1 --2- 172.21.15.77:0/348713219 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f784c066320 0x7f784c0687e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:05.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.019+0000 7f78660b5700 1 --2- 172.21.15.77:0/348713219 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f78600caf20 0x7f78600b0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:05.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.019+0000 7f78660b5700 1 --2- 172.21.15.77:0/348713219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f78600ca6f0 0x7f78600cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:05.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.019+0000 7f78660b5700 1 -- 172.21.15.77:0/348713219 >> 172.21.15.77:0/348713219 conn(0x7f78600ce510 msgr2=0x7f78600ab160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:05.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.023+0000 7f78660b5700 1 -- 172.21.15.77:0/348713219 shutdown_connections 2023-07-24T05:46:05.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.023+0000 7f78660b5700 1 -- 172.21.15.77:0/348713219 wait complete. 2023-07-24T05:46:05.031 INFO:teuthology.orchestra.run.smithi077.stderr:set pool 5 allow_ec_overwrites to true 2023-07-24T05:46:05.048 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-07-24T05:46:05.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.215+0000 7fc279d70700 1 Processor -- start 2023-07-24T05:46:05.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.215+0000 7fc279d70700 1 -- start start 2023-07-24T05:46:05.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.215+0000 7fc279d70700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc2740aaf50 0x7fc2740abb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:05.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.215+0000 7fc279d70700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc27406d400 0x7fc2740b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:05.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.215+0000 7fc279d70700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc27406cf70 con 0x7fc27406a520 2023-07-24T05:46:05.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.215+0000 7fc279d70700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2740ac400 con 0x7fc2740aaf50 2023-07-24T05:46:05.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.215+0000 7fc279d70700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc27406ac90 con 0x7fc27406d400 2023-07-24T05:46:05.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.215+0000 7fc278d6e700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc2740aaf50 0x7fc2740abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:05.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.215+0000 7fc278d6e700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc2740aaf50 0x7fc2740abb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:32958/0 (socket says 172.21.15.77:32958) 2023-07-24T05:46:05.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.215+0000 7fc278d6e700 1 -- 172.21.15.77:0/4283783595 learned_addr learned my addr 172.21.15.77:0/4283783595 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:05.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.215+0000 7fc273fff700 1 --1- 172.21.15.77:0/4283783595 >> v1:172.21.15.77:6789/0 conn(0x7fc27406a520 0x7fc2740ab330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:34374/0 (socket says 172.21.15.77:34374) 2023-07-24T05:46:05.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.215+0000 7fc27956f700 1 --2- 172.21.15.77:0/4283783595 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc27406d400 0x7fc2740b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:05.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.219+0000 7fc278d6e700 1 -- 172.21.15.77:0/4283783595 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc27406d400 msgr2=0x7fc2740b10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:05.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.219+0000 7fc278d6e700 1 --2- 172.21.15.77:0/4283783595 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc27406d400 0x7fc2740b10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:05.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.219+0000 7fc278d6e700 1 -- 172.21.15.77:0/4283783595 >> v1:172.21.15.77:6789/0 conn(0x7fc27406a520 legacy=0x7fc2740ab330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:05.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.219+0000 7fc278d6e700 1 -- 172.21.15.77:0/4283783595 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc27406c920 con 0x7fc2740aaf50 2023-07-24T05:46:05.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.219+0000 7fc278d6e700 1 --2- 172.21.15.77:0/4283783595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2740aaf50 0x7fc2740abb10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc268009e50 tx=0x7fc26800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2e257d8c864d888 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:05.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.219+0000 7fc2737fe700 1 -- 172.21.15.77:0/4283783595 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26800e070 con 0x7fc2740aaf50 2023-07-24T05:46:05.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.219+0000 7fc2737fe700 1 -- 172.21.15.77:0/4283783595 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26800b910 con 0x7fc2740aaf50 2023-07-24T05:46:05.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.219+0000 7fc2737fe700 1 -- 172.21.15.77:0/4283783595 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26800bcc0 con 0x7fc2740aaf50 2023-07-24T05:46:05.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.219+0000 7fc279d70700 1 -- 172.21.15.77:0/4283783595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2740aaf50 msgr2=0x7fc2740abb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:05.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.219+0000 7fc279d70700 1 --2- 172.21.15.77:0/4283783595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2740aaf50 0x7fc2740abb10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc268009e50 tx=0x7fc26800b330 comp rx=0 tx=0).stop 2023-07-24T05:46:05.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.219+0000 7fc279d70700 1 -- 172.21.15.77:0/4283783595 shutdown_connections 2023-07-24T05:46:05.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.219+0000 7fc279d70700 1 --2- 172.21.15.77:0/4283783595 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc27406d400 0x7fc2740b10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:05.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.219+0000 7fc279d70700 1 --2- 172.21.15.77:0/4283783595 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2740aaf50 0x7fc2740abb10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:05.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.219+0000 7fc279d70700 1 -- 172.21.15.77:0/4283783595 >> 172.21.15.77:0/4283783595 conn(0x7fc2740ce260 msgr2=0x7fc2740ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:05.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.219+0000 7fc279d70700 1 -- 172.21.15.77:0/4283783595 shutdown_connections 2023-07-24T05:46:05.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.219+0000 7fc279d70700 1 -- 172.21.15.77:0/4283783595 wait complete. 2023-07-24T05:46:05.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.223+0000 7fc279d70700 1 Processor -- start 2023-07-24T05:46:05.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.223+0000 7fc279d70700 1 -- start start 2023-07-24T05:46:05.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.223+0000 7fc279d70700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc27406a520 0x7fc27415fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:05.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.223+0000 7fc279d70700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc27406d400 0x7fc2740c7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:05.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.223+0000 7fc279d70700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc2740aaf50 0x7fc2740c3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:05.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.223+0000 7fc279d70700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2740c2940 con 0x7fc27406d400 2023-07-24T05:46:05.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.223+0000 7fc279d70700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2740c2c20 con 0x7fc27406a520 2023-07-24T05:46:05.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.223+0000 7fc279d70700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2740c2f00 con 0x7fc2740aaf50 2023-07-24T05:46:05.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.223+0000 7fc273fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc27406d400 0x7fc2740c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:05.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.223+0000 7fc273fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc27406d400 0x7fc2740c7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:32970/0 (socket says 172.21.15.77:32970) 2023-07-24T05:46:05.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.223+0000 7fc273fff700 1 -- 172.21.15.77:0/3106354139 learned_addr learned my addr 172.21.15.77:0/3106354139 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:05.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.223+0000 7fc278d6e700 1 --2- 172.21.15.77:0/3106354139 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc27406a520 0x7fc27415fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:05.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.223+0000 7fc27956f700 1 --2- 172.21.15.77:0/3106354139 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc2740aaf50 0x7fc2740c3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:05.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.223+0000 7fc273fff700 1 -- 172.21.15.77:0/3106354139 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc2740aaf50 msgr2=0x7fc2740c3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:05.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.223+0000 7fc273fff700 1 --2- 172.21.15.77:0/3106354139 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc2740aaf50 0x7fc2740c3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:05.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.227+0000 7fc273fff700 1 -- 172.21.15.77:0/3106354139 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc27406a520 msgr2=0x7fc27415fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:05.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.227+0000 7fc273fff700 1 --2- 172.21.15.77:0/3106354139 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc27406a520 0x7fc27415fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:05.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.227+0000 7fc273fff700 1 -- 172.21.15.77:0/3106354139 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc268009b30 con 0x7fc27406d400 2023-07-24T05:46:05.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.227+0000 7fc278d6e700 1 --2- 172.21.15.77:0/3106354139 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc27406a520 0x7fc27415fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:46:05.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.227+0000 7fc273fff700 1 --2- 172.21.15.77:0/3106354139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc27406d400 0x7fc2740c7460 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc26000c6b0 tx=0x7fc26000ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:05.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.227+0000 7fc2717fa700 1 -- 172.21.15.77:0/3106354139 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc260005cd0 con 0x7fc27406d400 2023-07-24T05:46:05.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.227+0000 7fc2717fa700 1 -- 172.21.15.77:0/3106354139 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc260005e30 con 0x7fc27406d400 2023-07-24T05:46:05.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.227+0000 7fc279d70700 1 -- 172.21.15.77:0/3106354139 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2740c31e0 con 0x7fc27406d400 2023-07-24T05:46:05.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.227+0000 7fc2717fa700 1 -- 172.21.15.77:0/3106354139 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2600072d0 con 0x7fc27406d400 2023-07-24T05:46:05.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.227+0000 7fc279d70700 1 -- 172.21.15.77:0/3106354139 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2741600e0 con 0x7fc27406d400 2023-07-24T05:46:05.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.227+0000 7fc279d70700 1 -- 172.21.15.77:0/3106354139 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2740ac760 con 0x7fc27406d400 2023-07-24T05:46:05.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.231+0000 7fc2717fa700 1 -- 172.21.15.77:0/3106354139 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc260007430 con 0x7fc27406d400 2023-07-24T05:46:05.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.231+0000 7fc2717fa700 1 --2- 172.21.15.77:0/3106354139 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc258066320 0x7fc2580687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:05.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.231+0000 7fc2717fa700 1 -- 172.21.15.77:0/3106354139 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6781+0+0 (secure 0 0 0) 0x7fc2600833b0 con 0x7fc27406d400 2023-07-24T05:46:05.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.231+0000 7fc278d6e700 1 --2- 172.21.15.77:0/3106354139 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc258066320 0x7fc2580687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:05.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.231+0000 7fc278d6e700 1 --2- 172.21.15.77:0/3106354139 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc258066320 0x7fc2580687e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc26800b370 tx=0x7fc268009000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:05.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.235+0000 7fc2717fa700 1 -- 172.21.15.77:0/3106354139 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc260050600 con 0x7fc27406d400 2023-07-24T05:46:05.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:05.443+0000 7fc279d70700 1 -- 172.21.15.77:0/3106354139 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fc2740c5610 con 0x7fc27406d400 2023-07-24T05:46:05.545 INFO:tasks.ceph.mds.c.smithi077.stderr:2023-07-24T05:46:05.543+0000 7f4eca77b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-24T05:46:06.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.415+0000 7fc2717fa700 1 -- 172.21.15.77:0/3106354139 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7fc2740c5610 con 0x7fc27406d400 2023-07-24T05:46:06.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.419+0000 7fc279d70700 1 -- 172.21.15.77:0/3106354139 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc258066320 msgr2=0x7fc2580687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:06.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.419+0000 7fc279d70700 1 --2- 172.21.15.77:0/3106354139 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc258066320 0x7fc2580687e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc26800b370 tx=0x7fc268009000 comp rx=0 tx=0).stop 2023-07-24T05:46:06.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.419+0000 7fc279d70700 1 -- 172.21.15.77:0/3106354139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc27406d400 msgr2=0x7fc2740c7460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:06.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.419+0000 7fc279d70700 1 --2- 172.21.15.77:0/3106354139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc27406d400 0x7fc2740c7460 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc26000c6b0 tx=0x7fc26000ca70 comp rx=0 tx=0).stop 2023-07-24T05:46:06.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.419+0000 7fc279d70700 1 -- 172.21.15.77:0/3106354139 shutdown_connections 2023-07-24T05:46:06.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.419+0000 7fc279d70700 1 --2- 172.21.15.77:0/3106354139 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc258066320 0x7fc2580687e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:06.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.419+0000 7fc279d70700 1 --2- 172.21.15.77:0/3106354139 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc2740aaf50 0x7fc2740c3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:06.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.419+0000 7fc279d70700 1 --2- 172.21.15.77:0/3106354139 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc27406d400 0x7fc2740c7460 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:06.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.419+0000 7fc279d70700 1 --2- 172.21.15.77:0/3106354139 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc27406a520 0x7fc27415fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:06.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.419+0000 7fc279d70700 1 -- 172.21.15.77:0/3106354139 >> 172.21.15.77:0/3106354139 conn(0x7fc2740ce260 msgr2=0x7fc2740c9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:06.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.419+0000 7fc279d70700 1 -- 172.21.15.77:0/3106354139 shutdown_connections 2023-07-24T05:46:06.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.419+0000 7fc279d70700 1 -- 172.21.15.77:0/3106354139 wait complete. 2023-07-24T05:46:06.425 INFO:teuthology.orchestra.run.smithi077.stderr:added data pool 5 to fsmap 2023-07-24T05:46:06.446 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-24T05:46:06.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.619+0000 7f00ca8a6700 1 Processor -- start 2023-07-24T05:46:06.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.619+0000 7f00ca8a6700 1 -- start start 2023-07-24T05:46:06.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.619+0000 7f00ca8a6700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f00c40b13c0 0x7f00c406adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:06.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.619+0000 7f00ca8a6700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00c40a4580 0x7f00c406fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:06.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.619+0000 7f00ca8a6700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00c40adc40 con 0x7f00c4069b10 2023-07-24T05:46:06.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.619+0000 7f00ca8a6700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00c406b330 con 0x7f00c40b13c0 2023-07-24T05:46:06.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.619+0000 7f00ca8a6700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c40adee0 con 0x7f00c40a4580 2023-07-24T05:46:06.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.623+0000 7f00ca0a5700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f00c4069b10 0x7f00c40ae9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:34386/0 (socket says 172.21.15.77:34386) 2023-07-24T05:46:06.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.623+0000 7f00ca0a5700 1 -- 172.21.15.77:0/1991604160 learned_addr learned my addr 172.21.15.77:0/1991604160 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:06.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.623+0000 7f00c98a4700 1 --2- 172.21.15.77:0/1991604160 >> v2:172.21.15.103:3300/0 conn(0x7f00c40b13c0 0x7f00c406adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:06.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.623+0000 7f00c90a3700 1 --2- 172.21.15.77:0/1991604160 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00c40a4580 0x7f00c406fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:06.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.623+0000 7f00c88a2700 1 -- 172.21.15.77:0/1991604160 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3757089635 0 0) 0x7f00c40adc40 con 0x7f00c4069b10 2023-07-24T05:46:06.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.623+0000 7f00c88a2700 1 -- 172.21.15.77:0/1991604160 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00b00035d0 con 0x7f00c4069b10 2023-07-24T05:46:06.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.623+0000 7f00c98a4700 1 -- 172.21.15.77:0/1991604160 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00c40a4580 msgr2=0x7f00c406fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:06.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.623+0000 7f00c98a4700 1 --2- 172.21.15.77:0/1991604160 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00c40a4580 0x7f00c406fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:06.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.623+0000 7f00c98a4700 1 -- 172.21.15.77:0/1991604160 >> v1:172.21.15.77:6789/0 conn(0x7f00c4069b10 legacy=0x7f00c40ae9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:06.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.623+0000 7f00c98a4700 1 -- 172.21.15.77:0/1991604160 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c40ae1c0 con 0x7f00c40b13c0 2023-07-24T05:46:06.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.623+0000 7f00c90a3700 1 --2- 172.21.15.77:0/1991604160 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00c40a4580 0x7f00c406fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:46:06.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.623+0000 7f00c98a4700 1 --2- 172.21.15.77:0/1991604160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00c40b13c0 0x7f00c406adf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f00c0009850 tx=0x7f00c0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=607b95bc215a278e server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:06.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.623+0000 7f00c88a2700 1 -- 172.21.15.77:0/1991604160 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c0011830 con 0x7f00c40b13c0 2023-07-24T05:46:06.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.623+0000 7f00c88a2700 1 -- 172.21.15.77:0/1991604160 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c0011990 con 0x7f00c40b13c0 2023-07-24T05:46:06.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.623+0000 7f00c88a2700 1 -- 172.21.15.77:0/1991604160 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c0011d00 con 0x7f00c40b13c0 2023-07-24T05:46:06.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.623+0000 7f00ca8a6700 1 -- 172.21.15.77:0/1991604160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00c40b13c0 msgr2=0x7f00c406adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:06.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.623+0000 7f00ca8a6700 1 --2- 172.21.15.77:0/1991604160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00c40b13c0 0x7f00c406adf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f00c0009850 tx=0x7f00c0009b60 comp rx=0 tx=0).stop 2023-07-24T05:46:06.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.623+0000 7f00ca8a6700 1 -- 172.21.15.77:0/1991604160 shutdown_connections 2023-07-24T05:46:06.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.623+0000 7f00ca8a6700 1 --2- 172.21.15.77:0/1991604160 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00c40a4580 0x7f00c406fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:06.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.623+0000 7f00ca8a6700 1 --2- 172.21.15.77:0/1991604160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00c40b13c0 0x7f00c406adf0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:06.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.623+0000 7f00ca8a6700 1 -- 172.21.15.77:0/1991604160 >> 172.21.15.77:0/1991604160 conn(0x7f00c40cacc0 msgr2=0x7f00c40cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:06.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.627+0000 7f00ca8a6700 1 -- 172.21.15.77:0/1991604160 shutdown_connections 2023-07-24T05:46:06.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.627+0000 7f00ca8a6700 1 -- 172.21.15.77:0/1991604160 wait complete. 2023-07-24T05:46:06.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.627+0000 7f00ca8a6700 1 Processor -- start 2023-07-24T05:46:06.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.631+0000 7f00ca8a6700 1 -- start start 2023-07-24T05:46:06.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.631+0000 7f00ca8a6700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00c4069b10 0x7f00c40cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:06.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.631+0000 7f00ca8a6700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00c40a4580 0x7f00c415d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:06.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.631+0000 7f00ca8a6700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00c40b13c0 0x7f00c41569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:06.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.631+0000 7f00ca8a6700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c415dd00 con 0x7f00c40b13c0 2023-07-24T05:46:06.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.631+0000 7f00ca8a6700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c40cc550 con 0x7f00c4069b10 2023-07-24T05:46:06.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.631+0000 7f00ca8a6700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c40cc830 con 0x7f00c40a4580 2023-07-24T05:46:06.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.631+0000 7f00ca0a5700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00c40b13c0 0x7f00c41569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:06.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.631+0000 7f00ca0a5700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00c40b13c0 0x7f00c41569c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:32972/0 (socket says 172.21.15.77:32972) 2023-07-24T05:46:06.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.631+0000 7f00ca0a5700 1 -- 172.21.15.77:0/3677632872 learned_addr learned my addr 172.21.15.77:0/3677632872 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:06.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.631+0000 7f00c90a3700 1 --2- 172.21.15.77:0/3677632872 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00c40a4580 0x7f00c415d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:06.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.631+0000 7f00c98a4700 1 --2- 172.21.15.77:0/3677632872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00c4069b10 0x7f00c40cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:06.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.631+0000 7f00ca0a5700 1 -- 172.21.15.77:0/3677632872 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00c40a4580 msgr2=0x7f00c415d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:06.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.631+0000 7f00ca0a5700 1 --2- 172.21.15.77:0/3677632872 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00c40a4580 0x7f00c415d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:06.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.631+0000 7f00ca0a5700 1 -- 172.21.15.77:0/3677632872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00c4069b10 msgr2=0x7f00c40cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:06.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.631+0000 7f00ca0a5700 1 --2- 172.21.15.77:0/3677632872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00c4069b10 0x7f00c40cbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:06.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.631+0000 7f00ca0a5700 1 -- 172.21.15.77:0/3677632872 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b40094b0 con 0x7f00c40b13c0 2023-07-24T05:46:06.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.631+0000 7f00c90a3700 1 --2- 172.21.15.77:0/3677632872 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00c40a4580 0x7f00c415d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:46:06.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.631+0000 7f00c98a4700 1 --2- 172.21.15.77:0/3677632872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00c4069b10 0x7f00c40cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:46:06.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.631+0000 7f00ca0a5700 1 --2- 172.21.15.77:0/3677632872 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00c40b13c0 0x7f00c41569c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f00bc00ca20 tx=0x7f00bc00cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:06.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.631+0000 7f00ba7fc700 1 -- 172.21.15.77:0/3677632872 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00bc00a770 con 0x7f00c40b13c0 2023-07-24T05:46:06.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.631+0000 7f00ba7fc700 1 -- 172.21.15.77:0/3677632872 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00bc00a8d0 con 0x7f00c40b13c0 2023-07-24T05:46:06.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.631+0000 7f00ca8a6700 1 -- 172.21.15.77:0/3677632872 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00c00094b0 con 0x7f00c40b13c0 2023-07-24T05:46:06.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.631+0000 7f00ba7fc700 1 -- 172.21.15.77:0/3677632872 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00bc00ac60 con 0x7f00c40b13c0 2023-07-24T05:46:06.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.631+0000 7f00ca8a6700 1 -- 172.21.15.77:0/3677632872 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00c40ccdf0 con 0x7f00c40b13c0 2023-07-24T05:46:06.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.635+0000 7f00ca8a6700 1 -- 172.21.15.77:0/3677632872 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00c4072490 con 0x7f00c40b13c0 2023-07-24T05:46:06.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.635+0000 7f00ba7fc700 1 -- 172.21.15.77:0/3677632872 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f00bc01b3b0 con 0x7f00c40b13c0 2023-07-24T05:46:06.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.639+0000 7f00ba7fc700 1 --2- 172.21.15.77:0/3677632872 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f00a80662f0 0x7f00a80687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:06.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.639+0000 7f00ba7fc700 1 -- 172.21.15.77:0/3677632872 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f00bc083ac0 con 0x7f00c40b13c0 2023-07-24T05:46:06.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.639+0000 7f00c98a4700 1 --2- 172.21.15.77:0/3677632872 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f00a80662f0 0x7f00a80687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:06.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.639+0000 7f00c98a4700 1 --2- 172.21.15.77:0/3677632872 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f00a80662f0 0x7f00a80687b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f00c00090b0 tx=0x7f00c0008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:06.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.643+0000 7f00ba7fc700 1 -- 172.21.15.77:0/3677632872 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f00bc050bb0 con 0x7f00c40b13c0 2023-07-24T05:46:06.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.859+0000 7f00ca8a6700 1 -- 172.21.15.77:0/3677632872 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f00c40b0590 con 0x7f00c40b13c0 2023-07-24T05:46:06.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.859+0000 7f00ba7fc700 1 -- 172.21.15.77:0/3677632872 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f00bc001ae0 con 0x7f00c40b13c0 2023-07-24T05:46:06.862 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:46:06.863 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/4201639271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4201639271},{"type":"v1","addr":"172.21.15.77:6834","nonce":4201639271}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/993116623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":993116623},{"type":"v1","addr":"172.21.15.103:6835","nonce":993116623}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/1196529067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":1196529067},{"type":"v1","addr":"172.21.15.103:6837","nonce":1196529067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-24T05:46:00.395327+0000","modified":"2023-07-24T05:46:06.407831+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6835/2428690206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2428690206},{"type":"v1","addr":"172.21.15.77:6835","nonce":2428690206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-07-24T05:46:06.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.863+0000 7f00ca8a6700 1 -- 172.21.15.77:0/3677632872 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f00a80662f0 msgr2=0x7f00a80687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:06.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.863+0000 7f00ca8a6700 1 --2- 172.21.15.77:0/3677632872 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f00a80662f0 0x7f00a80687b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f00c00090b0 tx=0x7f00c0008030 comp rx=0 tx=0).stop 2023-07-24T05:46:06.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.863+0000 7f00ca8a6700 1 -- 172.21.15.77:0/3677632872 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00c40b13c0 msgr2=0x7f00c41569c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:06.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.863+0000 7f00ca8a6700 1 --2- 172.21.15.77:0/3677632872 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00c40b13c0 0x7f00c41569c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f00bc00ca20 tx=0x7f00bc00cb00 comp rx=0 tx=0).stop 2023-07-24T05:46:06.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.863+0000 7f00ca8a6700 1 -- 172.21.15.77:0/3677632872 shutdown_connections 2023-07-24T05:46:06.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.863+0000 7f00ca8a6700 1 --2- 172.21.15.77:0/3677632872 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00c40b13c0 0x7f00c41569c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:06.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.863+0000 7f00ca8a6700 1 --2- 172.21.15.77:0/3677632872 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f00a80662f0 0x7f00a80687b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:06.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.863+0000 7f00ca8a6700 1 --2- 172.21.15.77:0/3677632872 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00c40a4580 0x7f00c415d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:06.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.863+0000 7f00ca8a6700 1 --2- 172.21.15.77:0/3677632872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00c4069b10 0x7f00c40cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:06.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.863+0000 7f00ca8a6700 1 -- 172.21.15.77:0/3677632872 >> 172.21.15.77:0/3677632872 conn(0x7f00c40cacc0 msgr2=0x7f00c40aec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:06.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.863+0000 7f00ca8a6700 1 -- 172.21.15.77:0/3677632872 shutdown_connections 2023-07-24T05:46:06.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:06.863+0000 7f00ca8a6700 1 -- 172.21.15.77:0/3677632872 wait complete. 2023-07-24T05:46:06.869 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 7 2023-07-24T05:46:06.887 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-24T05:46:07.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.047+0000 7f023885b700 1 Processor -- start 2023-07-24T05:46:07.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.047+0000 7f023885b700 1 -- start start 2023-07-24T05:46:07.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.051+0000 7f023885b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f023415ca90 0x7f02340b8280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:07.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.051+0000 7f023885b700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f02340d1f00 0x7f02340b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:07.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.051+0000 7f023885b700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02340b5a00 con 0x7f02340b4420 2023-07-24T05:46:07.055 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.051+0000 7f023885b700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02340b4df0 con 0x7f02340d1f00 2023-07-24T05:46:07.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.051+0000 7f023885b700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f023406a8a0 con 0x7f023415ca90 2023-07-24T05:46:07.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.051+0000 7f0232d9d700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f02340d1f00 0x7f02340b48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:07.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.051+0000 7f0232d9d700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f02340d1f00 0x7f02340b48b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:32978/0 (socket says 172.21.15.77:32978) 2023-07-24T05:46:07.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.051+0000 7f0232d9d700 1 -- 172.21.15.77:0/1407375281 learned_addr learned my addr 172.21.15.77:0/1407375281 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:07.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.051+0000 7f023259c700 1 --2- 172.21.15.77:0/1407375281 >> v2:172.21.15.103:3300/0 conn(0x7f023415ca90 0x7f02340b8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:07.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.051+0000 7f0232d9d700 1 -- 172.21.15.77:0/1407375281 >> v2:172.21.15.103:3300/0 conn(0x7f023415ca90 msgr2=0x7f02340b8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:07.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.051+0000 7f0232d9d700 1 --2- 172.21.15.77:0/1407375281 >> v2:172.21.15.103:3300/0 conn(0x7f023415ca90 0x7f02340b8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:07.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.051+0000 7f0232d9d700 1 -- 172.21.15.77:0/1407375281 >> v1:172.21.15.103:6789/0 conn(0x7f02340b4420 legacy=0x7f0234160770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:07.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.051+0000 7f0232d9d700 1 -- 172.21.15.77:0/1407375281 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0234069c90 con 0x7f02340d1f00 2023-07-24T05:46:07.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.051+0000 7f0232d9d700 1 --2- 172.21.15.77:0/1407375281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02340d1f00 0x7f02340b48b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f02340b5340 tx=0x7f022c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=791541cde0d333fe server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:07.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.051+0000 7f023159a700 1 -- 172.21.15.77:0/1407375281 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022c00e070 con 0x7f02340d1f00 2023-07-24T05:46:07.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.051+0000 7f023159a700 1 -- 172.21.15.77:0/1407375281 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022c003a40 con 0x7f02340d1f00 2023-07-24T05:46:07.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.051+0000 7f023159a700 1 -- 172.21.15.77:0/1407375281 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022c003df0 con 0x7f02340d1f00 2023-07-24T05:46:07.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.055+0000 7f023885b700 1 -- 172.21.15.77:0/1407375281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02340d1f00 msgr2=0x7f02340b48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:07.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.055+0000 7f023885b700 1 --2- 172.21.15.77:0/1407375281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02340d1f00 0x7f02340b48b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f02340b5340 tx=0x7f022c00b330 comp rx=0 tx=0).stop 2023-07-24T05:46:07.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.055+0000 7f023885b700 1 -- 172.21.15.77:0/1407375281 shutdown_connections 2023-07-24T05:46:07.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.055+0000 7f023885b700 1 --2- 172.21.15.77:0/1407375281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02340d1f00 0x7f02340b48b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:07.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.055+0000 7f023885b700 1 --2- 172.21.15.77:0/1407375281 >> v2:172.21.15.103:3300/0 conn(0x7f023415ca90 0x7f02340b8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:07.059 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.055+0000 7f023885b700 1 -- 172.21.15.77:0/1407375281 >> 172.21.15.77:0/1407375281 conn(0x7f02340cf420 msgr2=0x7f02340cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:07.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.055+0000 7f023885b700 1 -- 172.21.15.77:0/1407375281 shutdown_connections 2023-07-24T05:46:07.060 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.055+0000 7f023885b700 1 -- 172.21.15.77:0/1407375281 wait complete. 2023-07-24T05:46:07.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.059+0000 7f023885b700 1 Processor -- start 2023-07-24T05:46:07.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.059+0000 7f023885b700 1 -- start start 2023-07-24T05:46:07.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.059+0000 7f023885b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02340b4420 0x7f023415a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:07.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.059+0000 7f023885b700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02340d1f00 0x7f023415ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:07.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.059+0000 7f023885b700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f023415ca90 0x7f023415d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:07.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.059+0000 7f023885b700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02340c8bf0 con 0x7f02340b4420 2023-07-24T05:46:07.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.059+0000 7f023885b700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023415da30 con 0x7f02340d1f00 2023-07-24T05:46:07.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.059+0000 7f023885b700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f023415dd10 con 0x7f023415ca90 2023-07-24T05:46:07.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.059+0000 7f023259c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02340b4420 0x7f023415a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:07.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.059+0000 7f023259c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02340b4420 0x7f023415a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:32990/0 (socket says 172.21.15.77:32990) 2023-07-24T05:46:07.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.059+0000 7f023259c700 1 -- 172.21.15.77:0/821443545 learned_addr learned my addr 172.21.15.77:0/821443545 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:07.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.059+0000 7f0231d9b700 1 --2- 172.21.15.77:0/821443545 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02340d1f00 0x7f023415ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:07.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.059+0000 7f0232d9d700 1 --2- 172.21.15.77:0/821443545 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f023415ca90 0x7f023415d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:07.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.059+0000 7f023259c700 1 -- 172.21.15.77:0/821443545 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f023415ca90 msgr2=0x7f023415d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:07.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.059+0000 7f023259c700 1 --2- 172.21.15.77:0/821443545 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f023415ca90 0x7f023415d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:07.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.059+0000 7f023259c700 1 -- 172.21.15.77:0/821443545 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02340d1f00 msgr2=0x7f023415ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:07.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.059+0000 7f023259c700 1 --2- 172.21.15.77:0/821443545 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02340d1f00 0x7f023415ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:07.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.059+0000 7f023259c700 1 -- 172.21.15.77:0/821443545 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f022c009b30 con 0x7f02340b4420 2023-07-24T05:46:07.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.059+0000 7f0232d9d700 1 --2- 172.21.15.77:0/821443545 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f023415ca90 0x7f023415d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:46:07.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.059+0000 7f023259c700 1 --2- 172.21.15.77:0/821443545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02340b4420 0x7f023415a160 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f022400d800 tx=0x7f022400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:07.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.059+0000 7f0222ffd700 1 -- 172.21.15.77:0/821443545 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02240125f0 con 0x7f02340b4420 2023-07-24T05:46:07.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.059+0000 7f0222ffd700 1 -- 172.21.15.77:0/821443545 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0224012750 con 0x7f02340b4420 2023-07-24T05:46:07.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.059+0000 7f023885b700 1 -- 172.21.15.77:0/821443545 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f023415dff0 con 0x7f02340b4420 2023-07-24T05:46:07.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.059+0000 7f0222ffd700 1 -- 172.21.15.77:0/821443545 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0224012ac0 con 0x7f02340b4420 2023-07-24T05:46:07.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.063+0000 7f023885b700 1 -- 172.21.15.77:0/821443545 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f023415e5b0 con 0x7f02340b4420 2023-07-24T05:46:07.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.063+0000 7f023885b700 1 -- 172.21.15.77:0/821443545 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f023404df10 con 0x7f02340b4420 2023-07-24T05:46:07.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.063+0000 7f0222ffd700 1 -- 172.21.15.77:0/821443545 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0224012c20 con 0x7f02340b4420 2023-07-24T05:46:07.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.067+0000 7f0222ffd700 1 --2- 172.21.15.77:0/821443545 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f02140662f0 0x7f02140687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:07.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.067+0000 7f0222ffd700 1 -- 172.21.15.77:0/821443545 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f02240843f0 con 0x7f02340b4420 2023-07-24T05:46:07.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.067+0000 7f0231d9b700 1 --2- 172.21.15.77:0/821443545 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f02140662f0 0x7f02140687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:07.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.067+0000 7f0231d9b700 1 --2- 172.21.15.77:0/821443545 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f02140662f0 0x7f02140687b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f023406b1c0 tx=0x7f0228009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:07.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.071+0000 7f0222ffd700 1 -- 172.21.15.77:0/821443545 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0224054f70 con 0x7f02340b4420 2023-07-24T05:46:07.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.243+0000 7f023885b700 1 -- 172.21.15.77:0/821443545 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02340b2e80 con 0x7f02340b4420 2023-07-24T05:46:07.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.247+0000 7f0222ffd700 1 -- 172.21.15.77:0/821443545 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20108 (secure 0 0 0) 0x7f0224012ed0 con 0x7f02340b4420 2023-07-24T05:46:07.250 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:46:07.250 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":25,"fsid":"5aed5f7b-fb55-4d95-9c02-c6adbb1677b4","created":"2023-07-24T05:45:39.639731+0000","modified":"2023-07-24T05:46:05.445306+0000","last_up_change":"2023-07-24T05:45:52.319670+0000","last_in_change":"2023-07-24T05:45:43.643277+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-24T05:45:52.610430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-24T05:45:52.773787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-24T05:45:58.121732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-24T05:45:59.368726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-24T05:46:03.032057+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ffa0d496-461a-4053-b764-0627d969521b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6812","nonce":825987196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6817","nonce":825987196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6831","nonce":825987196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6824","nonce":825987196}]},"public_addr":"172.21.15.77:6812/825987196","cluster_addr":"172.21.15.77:6817/825987196","heartbeat_back_addr":"172.21.15.77:6831/825987196","heartbeat_front_addr":"172.21.15.77:6824/825987196","state":["exists","up"]},{"osd":1,"uuid":"9f595e5e-5c43-49bc-8ce4-ee70575c90da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6801","nonce":4133026815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6803","nonce":4133026815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6807","nonce":4133026815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6805","nonce":4133026815}]},"public_addr":"172.21.15.77:6801/4133026815","cluster_addr":"172.21.15.77:6803/4133026815","heartbeat_back_addr":"172.21.15.77:6807/4133026815","heartbeat_front_addr":"172.21.15.77:6805/4133026815","state":["exists","up"]},{"osd":2,"uuid":"2ac177aa-4d7d-4262-bd54-d2b9f29f4c3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6811","nonce":2394142159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6819","nonce":2394142159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6830","nonce":2394142159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6825","nonce":2394142159}]},"public_addr":"172.21.15.77:6811/2394142159","cluster_addr":"172.21.15.77:6819/2394142159","heartbeat_back_addr":"172.21.15.77:6830/2394142159","heartbeat_front_addr":"172.21.15.77:6825/2394142159","state":["exists","up"]},{"osd":3,"uuid":"17d7a251-19e8-484c-8172-a578ab3da153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6813","nonce":1492113982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6818","nonce":1492113982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6829","nonce":1492113982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6823","nonce":1492113982}]},"public_addr":"172.21.15.77:6813/1492113982","cluster_addr":"172.21.15.77:6818/1492113982","heartbeat_back_addr":"172.21.15.77:6829/1492113982","heartbeat_front_addr":"172.21.15.77:6823/1492113982","state":["exists","up"]},{"osd":4,"uuid":"bf63ca05-f06d-4e0f-ac44-2a416c70b919","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6825","nonce":1080481057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6827","nonce":1080481057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6831","nonce":1080481057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6829","nonce":1080481057}]},"public_addr":"172.21.15.103:6825/1080481057","cluster_addr":"172.21.15.103:6827/1080481057","heartbeat_back_addr":"172.21.15.103:6831/1080481057","heartbeat_front_addr":"172.21.15.103:6829/1080481057","state":["exists","up"]},{"osd":5,"uuid":"65a11a35-9e9f-4b3c-9fe3-b658d62b9318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6811","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6813","nonce":2756677504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6818","nonce":2756677504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6823","nonce":2756677504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6821","nonce":2756677504}]},"public_addr":"172.21.15.103:6813/2756677504","cluster_addr":"172.21.15.103:6818/2756677504","heartbeat_back_addr":"172.21.15.103:6823/2756677504","heartbeat_front_addr":"172.21.15.103:6821/2756677504","state":["exists","up"]},{"osd":6,"uuid":"750c1f87-686c-40b4-94a1-1a299dc78f3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6809","nonce":568977764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6812","nonce":568977764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6819","nonce":568977764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6815","nonce":568977764}]},"public_addr":"172.21.15.103:6809/568977764","cluster_addr":"172.21.15.103:6812/568977764","heartbeat_back_addr":"172.21.15.103:6819/568977764","heartbeat_front_addr":"172.21.15.103:6815/568977764","state":["exists","up"]},{"osd":7,"uuid":"d5fe4fb6-2e09-4158-885b-403803c85822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6801","nonce":1074557176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6803","nonce":1074557176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6807","nonce":1074557176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6805","nonce":1074557176}]},"public_addr":"172.21.15.103:6801/1074557176","cluster_addr":"172.21.15.103:6803/1074557176","heartbeat_back_addr":"172.21.15.103:6807/1074557176","heartbeat_front_addr":"172.21.15.103:6805/1074557176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.631032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.154109+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.398587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.679089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.311218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.353726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.314372+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.126212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-24T05:46:07.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.247+0000 7f023885b700 1 -- 172.21.15.77:0/821443545 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f02140662f0 msgr2=0x7f02140687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:07.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.247+0000 7f023885b700 1 --2- 172.21.15.77:0/821443545 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f02140662f0 0x7f02140687b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f023406b1c0 tx=0x7f0228009040 comp rx=0 tx=0).stop 2023-07-24T05:46:07.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.247+0000 7f023885b700 1 -- 172.21.15.77:0/821443545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02340b4420 msgr2=0x7f023415a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:07.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.247+0000 7f023885b700 1 --2- 172.21.15.77:0/821443545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02340b4420 0x7f023415a160 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f022400d800 tx=0x7f022400dbc0 comp rx=0 tx=0).stop 2023-07-24T05:46:07.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.247+0000 7f023885b700 1 -- 172.21.15.77:0/821443545 shutdown_connections 2023-07-24T05:46:07.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.247+0000 7f023885b700 1 --2- 172.21.15.77:0/821443545 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f02140662f0 0x7f02140687b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:07.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.247+0000 7f023885b700 1 --2- 172.21.15.77:0/821443545 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f023415ca90 0x7f023415d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:07.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.247+0000 7f023885b700 1 --2- 172.21.15.77:0/821443545 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02340d1f00 0x7f023415ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:07.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.247+0000 7f023885b700 1 --2- 172.21.15.77:0/821443545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02340b4420 0x7f023415a160 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:07.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.247+0000 7f023885b700 1 -- 172.21.15.77:0/821443545 >> 172.21.15.77:0/821443545 conn(0x7f02340cf420 msgr2=0x7f02340b7830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:07.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.247+0000 7f023885b700 1 -- 172.21.15.77:0/821443545 shutdown_connections 2023-07-24T05:46:07.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.247+0000 7f023885b700 1 -- 172.21.15.77:0/821443545 wait complete. 2023-07-24T05:46:07.274 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-24T05:46:07.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.443+0000 7fd6689b0700 1 Processor -- start 2023-07-24T05:46:07.446 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.443+0000 7fd6689b0700 1 -- start start 2023-07-24T05:46:07.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.443+0000 7fd6689b0700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd6640af980 0x7fd66406e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:07.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.447+0000 7fd6689b0700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd66415ea40 0x7fd6640cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:07.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.447+0000 7fd6689b0700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6640cf210 con 0x7fd66406edc0 2023-07-24T05:46:07.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.447+0000 7fd6689b0700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6640cf4f0 con 0x7fd6640af980 2023-07-24T05:46:07.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.447+0000 7fd6689b0700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6640cf7d0 con 0x7fd66415ea40 2023-07-24T05:46:07.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.447+0000 7fd662d9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd6640af980 0x7fd66406e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:07.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.447+0000 7fd662d9d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd6640af980 0x7fd66406e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:48960/0 (socket says 172.21.15.77:48960) 2023-07-24T05:46:07.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.447+0000 7fd662d9d700 1 -- 172.21.15.77:0/3137438305 learned_addr learned my addr 172.21.15.77:0/3137438305 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:07.450 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.447+0000 7fd66259c700 1 --1- 172.21.15.77:0/3137438305 >> v1:172.21.15.103:6789/0 conn(0x7fd66406edc0 0x7fd66415e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.77:37196/0 (socket says 172.21.15.77:37196) 2023-07-24T05:46:07.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.447+0000 7fd66359e700 1 --2- 172.21.15.77:0/3137438305 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd66415ea40 0x7fd6640cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:07.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.447+0000 7fd661d9b700 1 -- 172.21.15.77:0/3137438305 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 764126892 0 0) 0x7fd6640cf210 con 0x7fd66406edc0 2023-07-24T05:46:07.451 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.447+0000 7fd661d9b700 1 -- 172.21.15.77:0/3137438305 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd64c0035d0 con 0x7fd66406edc0 2023-07-24T05:46:07.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.447+0000 7fd662d9d700 1 -- 172.21.15.77:0/3137438305 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd66415ea40 msgr2=0x7fd6640cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:07.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.447+0000 7fd662d9d700 1 --2- 172.21.15.77:0/3137438305 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd66415ea40 0x7fd6640cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:07.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.447+0000 7fd662d9d700 1 -- 172.21.15.77:0/3137438305 >> v1:172.21.15.103:6789/0 conn(0x7fd66406edc0 legacy=0x7fd66415e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:07.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.447+0000 7fd662d9d700 1 -- 172.21.15.77:0/3137438305 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6640cfab0 con 0x7fd6640af980 2023-07-24T05:46:07.452 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.447+0000 7fd662d9d700 1 --2- 172.21.15.77:0/3137438305 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6640af980 0x7fd66406e880 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd654009910 tx=0x7fd654009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=755145ef80498650 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:07.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.447+0000 7fd661d9b700 1 -- 172.21.15.77:0/3137438305 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd654005e50 con 0x7fd6640af980 2023-07-24T05:46:07.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.447+0000 7fd661d9b700 1 -- 172.21.15.77:0/3137438305 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd654006030 con 0x7fd6640af980 2023-07-24T05:46:07.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.447+0000 7fd661d9b700 1 -- 172.21.15.77:0/3137438305 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6540063a0 con 0x7fd6640af980 2023-07-24T05:46:07.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.451+0000 7fd6689b0700 1 -- 172.21.15.77:0/3137438305 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6640af980 msgr2=0x7fd66406e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:07.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.451+0000 7fd6689b0700 1 --2- 172.21.15.77:0/3137438305 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6640af980 0x7fd66406e880 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd654009910 tx=0x7fd654009c20 comp rx=0 tx=0).stop 2023-07-24T05:46:07.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.451+0000 7fd6689b0700 1 -- 172.21.15.77:0/3137438305 shutdown_connections 2023-07-24T05:46:07.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.451+0000 7fd6689b0700 1 --2- 172.21.15.77:0/3137438305 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd66415ea40 0x7fd6640cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:07.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.451+0000 7fd6689b0700 1 --2- 172.21.15.77:0/3137438305 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6640af980 0x7fd66406e880 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:07.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.451+0000 7fd6689b0700 1 -- 172.21.15.77:0/3137438305 >> 172.21.15.77:0/3137438305 conn(0x7fd6640d09d0 msgr2=0x7fd6640d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:07.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.451+0000 7fd6689b0700 1 -- 172.21.15.77:0/3137438305 shutdown_connections 2023-07-24T05:46:07.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.451+0000 7fd6689b0700 1 -- 172.21.15.77:0/3137438305 wait complete. 2023-07-24T05:46:07.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.451+0000 7fd6689b0700 1 Processor -- start 2023-07-24T05:46:07.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.455+0000 7fd6689b0700 1 -- start start 2023-07-24T05:46:07.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.455+0000 7fd6689b0700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd66406edc0 0x7fd664158310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:07.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.455+0000 7fd6689b0700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6640af980 0x7fd66415d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:07.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.455+0000 7fd6689b0700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd66415ea40 0x7fd664153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:07.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.455+0000 7fd6689b0700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd664156eb0 con 0x7fd6640af980 2023-07-24T05:46:07.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.455+0000 7fd6689b0700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd664158850 con 0x7fd66406edc0 2023-07-24T05:46:07.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.455+0000 7fd6689b0700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd664156bd0 con 0x7fd66415ea40 2023-07-24T05:46:07.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.455+0000 7fd66259c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6640af980 0x7fd66415d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:07.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.455+0000 7fd66259c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6640af980 0x7fd66415d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33006/0 (socket says 172.21.15.77:33006) 2023-07-24T05:46:07.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.455+0000 7fd66259c700 1 -- 172.21.15.77:0/2158017884 learned_addr learned my addr 172.21.15.77:0/2158017884 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:07.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.455+0000 7fd662d9d700 1 --2- 172.21.15.77:0/2158017884 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd66406edc0 0x7fd664158310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:07.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.455+0000 7fd66359e700 1 --2- 172.21.15.77:0/2158017884 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd66415ea40 0x7fd664153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:07.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.455+0000 7fd66259c700 1 -- 172.21.15.77:0/2158017884 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd66415ea40 msgr2=0x7fd664153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:07.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.455+0000 7fd66259c700 1 --2- 172.21.15.77:0/2158017884 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd66415ea40 0x7fd664153970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:07.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.455+0000 7fd66259c700 1 -- 172.21.15.77:0/2158017884 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd66406edc0 msgr2=0x7fd664158310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:07.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.455+0000 7fd66259c700 1 --2- 172.21.15.77:0/2158017884 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd66406edc0 0x7fd664158310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:07.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.455+0000 7fd66259c700 1 -- 172.21.15.77:0/2158017884 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd654009520 con 0x7fd6640af980 2023-07-24T05:46:07.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.455+0000 7fd66359e700 1 --2- 172.21.15.77:0/2158017884 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd66415ea40 0x7fd664153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:46:07.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.455+0000 7fd662d9d700 1 --2- 172.21.15.77:0/2158017884 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd66406edc0 0x7fd664158310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:46:07.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.455+0000 7fd66259c700 1 --2- 172.21.15.77:0/2158017884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6640af980 0x7fd66415d080 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd65800c730 tx=0x7fd65800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:07.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.455+0000 7fd64b7fe700 1 -- 172.21.15.77:0/2158017884 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd658005cd0 con 0x7fd6640af980 2023-07-24T05:46:07.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.455+0000 7fd64b7fe700 1 -- 172.21.15.77:0/2158017884 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd658005e30 con 0x7fd6640af980 2023-07-24T05:46:07.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.455+0000 7fd64b7fe700 1 -- 172.21.15.77:0/2158017884 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd658007310 con 0x7fd6640af980 2023-07-24T05:46:07.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.455+0000 7fd6689b0700 1 -- 172.21.15.77:0/2158017884 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6640b4cc0 con 0x7fd6640af980 2023-07-24T05:46:07.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.455+0000 7fd6689b0700 1 -- 172.21.15.77:0/2158017884 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6640b5280 con 0x7fd6640af980 2023-07-24T05:46:07.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.459+0000 7fd6689b0700 1 -- 172.21.15.77:0/2158017884 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6640b5470 con 0x7fd6640af980 2023-07-24T05:46:07.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.459+0000 7fd64b7fe700 1 -- 172.21.15.77:0/2158017884 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd658007470 con 0x7fd6640af980 2023-07-24T05:46:07.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.463+0000 7fd64b7fe700 1 --2- 172.21.15.77:0/2158017884 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd6500662f0 0x7fd6500687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:07.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.463+0000 7fd64b7fe700 1 -- 172.21.15.77:0/2158017884 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd6580835b0 con 0x7fd6640af980 2023-07-24T05:46:07.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.463+0000 7fd662d9d700 1 --2- 172.21.15.77:0/2158017884 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd6500662f0 0x7fd6500687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:07.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.463+0000 7fd662d9d700 1 --2- 172.21.15.77:0/2158017884 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd6500662f0 0x7fd6500687b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd654006000 tx=0x7fd654008070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:07.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.467+0000 7fd64b7fe700 1 -- 172.21.15.77:0/2158017884 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd6580506b0 con 0x7fd6640af980 2023-07-24T05:46:07.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.647+0000 7fd6689b0700 1 -- 172.21.15.77:0/2158017884 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6640ced80 con 0x7fd6640af980 2023-07-24T05:46:07.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.651+0000 7fd64b7fe700 1 -- 172.21.15.77:0/2158017884 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20108 (secure 0 0 0) 0x7fd6640ced80 con 0x7fd6640af980 2023-07-24T05:46:07.654 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:46:07.655 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":25,"fsid":"5aed5f7b-fb55-4d95-9c02-c6adbb1677b4","created":"2023-07-24T05:45:39.639731+0000","modified":"2023-07-24T05:46:05.445306+0000","last_up_change":"2023-07-24T05:45:52.319670+0000","last_in_change":"2023-07-24T05:45:43.643277+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-24T05:45:52.610430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-24T05:45:52.773787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-24T05:45:58.121732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-24T05:45:59.368726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-24T05:46:03.032057+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ffa0d496-461a-4053-b764-0627d969521b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6812","nonce":825987196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6817","nonce":825987196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6831","nonce":825987196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6824","nonce":825987196}]},"public_addr":"172.21.15.77:6812/825987196","cluster_addr":"172.21.15.77:6817/825987196","heartbeat_back_addr":"172.21.15.77:6831/825987196","heartbeat_front_addr":"172.21.15.77:6824/825987196","state":["exists","up"]},{"osd":1,"uuid":"9f595e5e-5c43-49bc-8ce4-ee70575c90da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6801","nonce":4133026815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6803","nonce":4133026815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6807","nonce":4133026815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6805","nonce":4133026815}]},"public_addr":"172.21.15.77:6801/4133026815","cluster_addr":"172.21.15.77:6803/4133026815","heartbeat_back_addr":"172.21.15.77:6807/4133026815","heartbeat_front_addr":"172.21.15.77:6805/4133026815","state":["exists","up"]},{"osd":2,"uuid":"2ac177aa-4d7d-4262-bd54-d2b9f29f4c3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6811","nonce":2394142159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6819","nonce":2394142159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6830","nonce":2394142159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6825","nonce":2394142159}]},"public_addr":"172.21.15.77:6811/2394142159","cluster_addr":"172.21.15.77:6819/2394142159","heartbeat_back_addr":"172.21.15.77:6830/2394142159","heartbeat_front_addr":"172.21.15.77:6825/2394142159","state":["exists","up"]},{"osd":3,"uuid":"17d7a251-19e8-484c-8172-a578ab3da153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6813","nonce":1492113982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6818","nonce":1492113982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6829","nonce":1492113982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6823","nonce":1492113982}]},"public_addr":"172.21.15.77:6813/1492113982","cluster_addr":"172.21.15.77:6818/1492113982","heartbeat_back_addr":"172.21.15.77:6829/1492113982","heartbeat_front_addr":"172.21.15.77:6823/1492113982","state":["exists","up"]},{"osd":4,"uuid":"bf63ca05-f06d-4e0f-ac44-2a416c70b919","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6825","nonce":1080481057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6827","nonce":1080481057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6831","nonce":1080481057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6829","nonce":1080481057}]},"public_addr":"172.21.15.103:6825/1080481057","cluster_addr":"172.21.15.103:6827/1080481057","heartbeat_back_addr":"172.21.15.103:6831/1080481057","heartbeat_front_addr":"172.21.15.103:6829/1080481057","state":["exists","up"]},{"osd":5,"uuid":"65a11a35-9e9f-4b3c-9fe3-b658d62b9318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6811","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6813","nonce":2756677504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6818","nonce":2756677504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6823","nonce":2756677504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6821","nonce":2756677504}]},"public_addr":"172.21.15.103:6813/2756677504","cluster_addr":"172.21.15.103:6818/2756677504","heartbeat_back_addr":"172.21.15.103:6823/2756677504","heartbeat_front_addr":"172.21.15.103:6821/2756677504","state":["exists","up"]},{"osd":6,"uuid":"750c1f87-686c-40b4-94a1-1a299dc78f3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6809","nonce":568977764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6812","nonce":568977764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6819","nonce":568977764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6815","nonce":568977764}]},"public_addr":"172.21.15.103:6809/568977764","cluster_addr":"172.21.15.103:6812/568977764","heartbeat_back_addr":"172.21.15.103:6819/568977764","heartbeat_front_addr":"172.21.15.103:6815/568977764","state":["exists","up"]},{"osd":7,"uuid":"d5fe4fb6-2e09-4158-885b-403803c85822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6801","nonce":1074557176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6803","nonce":1074557176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6807","nonce":1074557176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6805","nonce":1074557176}]},"public_addr":"172.21.15.103:6801/1074557176","cluster_addr":"172.21.15.103:6803/1074557176","heartbeat_back_addr":"172.21.15.103:6807/1074557176","heartbeat_front_addr":"172.21.15.103:6805/1074557176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.631032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.154109+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.398587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.679089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.311218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.353726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.314372+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.126212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-24T05:46:07.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.651+0000 7fd6689b0700 1 -- 172.21.15.77:0/2158017884 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd6500662f0 msgr2=0x7fd6500687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:07.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.651+0000 7fd6689b0700 1 --2- 172.21.15.77:0/2158017884 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd6500662f0 0x7fd6500687b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd654006000 tx=0x7fd654008070 comp rx=0 tx=0).stop 2023-07-24T05:46:07.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.651+0000 7fd6689b0700 1 -- 172.21.15.77:0/2158017884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6640af980 msgr2=0x7fd66415d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:07.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.651+0000 7fd6689b0700 1 --2- 172.21.15.77:0/2158017884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6640af980 0x7fd66415d080 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd65800c730 tx=0x7fd65800ca40 comp rx=0 tx=0).stop 2023-07-24T05:46:07.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.655+0000 7fd6689b0700 1 -- 172.21.15.77:0/2158017884 shutdown_connections 2023-07-24T05:46:07.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.655+0000 7fd6689b0700 1 --2- 172.21.15.77:0/2158017884 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd6500662f0 0x7fd6500687b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:07.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.655+0000 7fd6689b0700 1 --2- 172.21.15.77:0/2158017884 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd66415ea40 0x7fd664153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:07.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.655+0000 7fd6689b0700 1 --2- 172.21.15.77:0/2158017884 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd6640af980 0x7fd66415d080 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:07.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.655+0000 7fd6689b0700 1 --2- 172.21.15.77:0/2158017884 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd66406edc0 0x7fd664158310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:07.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.655+0000 7fd6689b0700 1 -- 172.21.15.77:0/2158017884 >> 172.21.15.77:0/2158017884 conn(0x7fd6640d09d0 msgr2=0x7fd6640afee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:07.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.655+0000 7fd6689b0700 1 -- 172.21.15.77:0/2158017884 shutdown_connections 2023-07-24T05:46:07.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.655+0000 7fd6689b0700 1 -- 172.21.15.77:0/2158017884 wait complete. 2023-07-24T05:46:07.694 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-24T05:46:07.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.871+0000 7fd5f6647700 1 Processor -- start 2023-07-24T05:46:07.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.871+0000 7fd5f6647700 1 -- start start 2023-07-24T05:46:07.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.871+0000 7fd5f6647700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd5f015fdd0 0x7fd5f0069b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:07.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.871+0000 7fd5f6647700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd5f0160370 0x7fd5f00ce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:07.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.871+0000 7fd5f6647700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5f0160800 con 0x7fd5f00ce5c0 2023-07-24T05:46:07.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.871+0000 7fd5f6647700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5f0161380 con 0x7fd5f015fdd0 2023-07-24T05:46:07.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.871+0000 7fd5f6647700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f01601b0 con 0x7fd5f0160370 2023-07-24T05:46:07.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.875+0000 7fd5f5645700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd5f015fdd0 0x7fd5f0069b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:07.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.875+0000 7fd5f5645700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd5f015fdd0 0x7fd5f0069b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33018/0 (socket says 172.21.15.77:33018) 2023-07-24T05:46:07.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.875+0000 7fd5f5645700 1 -- 172.21.15.77:0/4032886666 learned_addr learned my addr 172.21.15.77:0/4032886666 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:07.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.875+0000 7fd5f4e44700 1 --2- 172.21.15.77:0/4032886666 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd5f0160370 0x7fd5f00ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:07.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.875+0000 7fd5f5645700 1 -- 172.21.15.77:0/4032886666 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd5f0160370 msgr2=0x7fd5f00ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:07.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.875+0000 7fd5f5645700 1 --2- 172.21.15.77:0/4032886666 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd5f0160370 0x7fd5f00ce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:07.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.875+0000 7fd5f5645700 1 -- 172.21.15.77:0/4032886666 >> v1:172.21.15.103:6789/0 conn(0x7fd5f00ce5c0 legacy=0x7fd5f006c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:07.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.875+0000 7fd5f5645700 1 -- 172.21.15.77:0/4032886666 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f0160ae0 con 0x7fd5f015fdd0 2023-07-24T05:46:07.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.875+0000 7fd5f5645700 1 --2- 172.21.15.77:0/4032886666 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5f015fdd0 0x7fd5f0069b10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec009910 tx=0x7fd5ec009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76839a3e19fa11bb server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:07.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.875+0000 7fd5e7fff700 1 -- 172.21.15.77:0/4032886666 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec00ba60 con 0x7fd5f015fdd0 2023-07-24T05:46:07.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.875+0000 7fd5e7fff700 1 -- 172.21.15.77:0/4032886666 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5ec00bbc0 con 0x7fd5f015fdd0 2023-07-24T05:46:07.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.875+0000 7fd5e7fff700 1 -- 172.21.15.77:0/4032886666 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec009e60 con 0x7fd5f015fdd0 2023-07-24T05:46:07.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.879+0000 7fd5f6647700 1 -- 172.21.15.77:0/4032886666 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5f015fdd0 msgr2=0x7fd5f0069b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:07.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.879+0000 7fd5f6647700 1 --2- 172.21.15.77:0/4032886666 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5f015fdd0 0x7fd5f0069b10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec009910 tx=0x7fd5ec009c20 comp rx=0 tx=0).stop 2023-07-24T05:46:07.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.879+0000 7fd5f6647700 1 -- 172.21.15.77:0/4032886666 shutdown_connections 2023-07-24T05:46:07.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.879+0000 7fd5f6647700 1 --2- 172.21.15.77:0/4032886666 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd5f0160370 0x7fd5f00ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:07.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.879+0000 7fd5f6647700 1 --2- 172.21.15.77:0/4032886666 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5f015fdd0 0x7fd5f0069b10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:07.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.879+0000 7fd5f6647700 1 -- 172.21.15.77:0/4032886666 >> 172.21.15.77:0/4032886666 conn(0x7fd5f00ceeb0 msgr2=0x7fd5f00cf2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:07.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.879+0000 7fd5f6647700 1 -- 172.21.15.77:0/4032886666 shutdown_connections 2023-07-24T05:46:07.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.879+0000 7fd5f6647700 1 -- 172.21.15.77:0/4032886666 wait complete. 2023-07-24T05:46:07.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.883+0000 7fd5f6647700 1 Processor -- start 2023-07-24T05:46:07.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.883+0000 7fd5f6647700 1 -- start start 2023-07-24T05:46:07.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.883+0000 7fd5f6647700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5f00ce5c0 0x7fd5f01f5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:07.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.883+0000 7fd5f6647700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5f015fdd0 0x7fd5f00abe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:07.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.883+0000 7fd5f6647700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd5f01f61b0 0x7fd5f00ac390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:07.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.883+0000 7fd5f6647700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f01f5500 con 0x7fd5f00ce5c0 2023-07-24T05:46:07.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.883+0000 7fd5f6647700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f01f26f0 con 0x7fd5f015fdd0 2023-07-24T05:46:07.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.883+0000 7fd5f6647700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f01f29d0 con 0x7fd5f01f61b0 2023-07-24T05:46:07.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.883+0000 7fd5f5645700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5f00ce5c0 0x7fd5f01f5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:07.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.883+0000 7fd5f5645700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5f00ce5c0 0x7fd5f01f5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33024/0 (socket says 172.21.15.77:33024) 2023-07-24T05:46:07.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.883+0000 7fd5f5645700 1 -- 172.21.15.77:0/1324056958 learned_addr learned my addr 172.21.15.77:0/1324056958 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:07.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.883+0000 7fd5f4e44700 1 --2- 172.21.15.77:0/1324056958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5f015fdd0 0x7fd5f00abe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:07.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.883+0000 7fd5f5e46700 1 --2- 172.21.15.77:0/1324056958 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd5f01f61b0 0x7fd5f00ac390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:07.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.883+0000 7fd5f5645700 1 -- 172.21.15.77:0/1324056958 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd5f01f61b0 msgr2=0x7fd5f00ac390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:07.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.883+0000 7fd5f5645700 1 --2- 172.21.15.77:0/1324056958 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd5f01f61b0 0x7fd5f00ac390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:07.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.883+0000 7fd5f5645700 1 -- 172.21.15.77:0/1324056958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5f015fdd0 msgr2=0x7fd5f00abe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:07.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.883+0000 7fd5f5645700 1 --2- 172.21.15.77:0/1324056958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5f015fdd0 0x7fd5f00abe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:07.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.883+0000 7fd5f5645700 1 -- 172.21.15.77:0/1324056958 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5ec009570 con 0x7fd5f00ce5c0 2023-07-24T05:46:07.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.887+0000 7fd5f5645700 1 --2- 172.21.15.77:0/1324056958 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5f00ce5c0 0x7fd5f01f5c70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec000c00 tx=0x7fd5ec004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:07.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.887+0000 7fd5e5ffb700 1 -- 172.21.15.77:0/1324056958 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec004550 con 0x7fd5f00ce5c0 2023-07-24T05:46:07.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.887+0000 7fd5e5ffb700 1 -- 172.21.15.77:0/1324056958 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5ec01f070 con 0x7fd5f00ce5c0 2023-07-24T05:46:07.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.887+0000 7fd5e5ffb700 1 -- 172.21.15.77:0/1324056958 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec003900 con 0x7fd5f00ce5c0 2023-07-24T05:46:07.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.887+0000 7fd5f6647700 1 -- 172.21.15.77:0/1324056958 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5f01f2cb0 con 0x7fd5f00ce5c0 2023-07-24T05:46:07.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.887+0000 7fd5f6647700 1 -- 172.21.15.77:0/1324056958 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5f00c6060 con 0x7fd5f00ce5c0 2023-07-24T05:46:07.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.887+0000 7fd5f6647700 1 -- 172.21.15.77:0/1324056958 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5f0072bd0 con 0x7fd5f00ce5c0 2023-07-24T05:46:07.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.891+0000 7fd5e5ffb700 1 -- 172.21.15.77:0/1324056958 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd5ec003a60 con 0x7fd5f00ce5c0 2023-07-24T05:46:07.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.891+0000 7fd5e5ffb700 1 --2- 172.21.15.77:0/1324056958 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd5d40662f0 0x7fd5d40687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:07.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.891+0000 7fd5e5ffb700 1 -- 172.21.15.77:0/1324056958 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd5ec021070 con 0x7fd5f00ce5c0 2023-07-24T05:46:07.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.891+0000 7fd5f4e44700 1 --2- 172.21.15.77:0/1324056958 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd5d40662f0 0x7fd5d40687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:07.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.895+0000 7fd5f4e44700 1 --2- 172.21.15.77:0/1324056958 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd5d40662f0 0x7fd5d40687b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd5f006bc00 tx=0x7fd5e0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:07.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:07.899+0000 7fd5e5ffb700 1 -- 172.21.15.77:0/1324056958 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd5ec052810 con 0x7fd5f00ce5c0 2023-07-24T05:46:08.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.107+0000 7fd5f6647700 1 -- 172.21.15.77:0/1324056958 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd5f0072490 con 0x7fd5f00ce5c0 2023-07-24T05:46:08.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.107+0000 7fd5e5ffb700 1 -- 172.21.15.77:0/1324056958 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4670 (secure 0 0 0) 0x7fd5ec055e30 con 0x7fd5f00ce5c0 2023-07-24T05:46:08.111 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:46:08.111 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/4201639271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4201639271},{"type":"v1","addr":"172.21.15.77:6834","nonce":4201639271}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/993116623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":993116623},{"type":"v1","addr":"172.21.15.103:6835","nonce":993116623}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/1196529067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":1196529067},{"type":"v1","addr":"172.21.15.103:6837","nonce":1196529067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-24T05:46:00.395327+0000","modified":"2023-07-24T05:46:06.407831+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6835/2428690206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2428690206},{"type":"v1","addr":"172.21.15.77:6835","nonce":2428690206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-07-24T05:46:08.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.111+0000 7fd5f6647700 1 -- 172.21.15.77:0/1324056958 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd5d40662f0 msgr2=0x7fd5d40687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:08.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.111+0000 7fd5f6647700 1 --2- 172.21.15.77:0/1324056958 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd5d40662f0 0x7fd5d40687b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd5f006bc00 tx=0x7fd5e0008040 comp rx=0 tx=0).stop 2023-07-24T05:46:08.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.111+0000 7fd5f6647700 1 -- 172.21.15.77:0/1324056958 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5f00ce5c0 msgr2=0x7fd5f01f5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:08.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.111+0000 7fd5f6647700 1 --2- 172.21.15.77:0/1324056958 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5f00ce5c0 0x7fd5f01f5c70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec000c00 tx=0x7fd5ec004770 comp rx=0 tx=0).stop 2023-07-24T05:46:08.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.111+0000 7fd5f6647700 1 -- 172.21.15.77:0/1324056958 shutdown_connections 2023-07-24T05:46:08.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.111+0000 7fd5f6647700 1 --2- 172.21.15.77:0/1324056958 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd5d40662f0 0x7fd5d40687b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:08.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.111+0000 7fd5f6647700 1 --2- 172.21.15.77:0/1324056958 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd5f01f61b0 0x7fd5f00ac390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:08.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.111+0000 7fd5f6647700 1 --2- 172.21.15.77:0/1324056958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd5f015fdd0 0x7fd5f00abe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:08.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.111+0000 7fd5f6647700 1 --2- 172.21.15.77:0/1324056958 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5f00ce5c0 0x7fd5f01f5c70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:08.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.111+0000 7fd5f6647700 1 -- 172.21.15.77:0/1324056958 >> 172.21.15.77:0/1324056958 conn(0x7fd5f00ceeb0 msgr2=0x7fd5f015efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:08.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.115+0000 7fd5f6647700 1 -- 172.21.15.77:0/1324056958 shutdown_connections 2023-07-24T05:46:08.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.115+0000 7fd5f6647700 1 -- 172.21.15.77:0/1324056958 wait complete. 2023-07-24T05:46:08.119 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 7 2023-07-24T05:46:08.135 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-24T05:46:08.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.299+0000 7fdce0f1c700 1 Processor -- start 2023-07-24T05:46:08.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.299+0000 7fdce0f1c700 1 -- start start 2023-07-24T05:46:08.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.303+0000 7fdce0f1c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdcdc160d20 0x7fdcdc0adba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:08.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.303+0000 7fdce0f1c700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdcdc0ae0e0 0x7fdcdc0b1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:08.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.303+0000 7fdce0f1c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcdc0af170 con 0x7fdcdc161100 2023-07-24T05:46:08.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.303+0000 7fdce0f1c700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcdc0ae5f0 con 0x7fdcdc0ae0e0 2023-07-24T05:46:08.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.303+0000 7fdce0f1c700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcdc0ae8d0 con 0x7fdcdc160d20 2023-07-24T05:46:08.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.303+0000 7fdcd2ffd700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdcdc0ae0e0 0x7fdcdc0b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:08.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.303+0000 7fdcd2ffd700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdcdc0ae0e0 0x7fdcdc0b1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33040/0 (socket says 172.21.15.77:33040) 2023-07-24T05:46:08.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.303+0000 7fdcd2ffd700 1 -- 172.21.15.77:0/2350638306 learned_addr learned my addr 172.21.15.77:0/2350638306 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:08.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.303+0000 7fdcdb7fe700 1 --2- 172.21.15.77:0/2350638306 >> v2:172.21.15.103:3300/0 conn(0x7fdcdc160d20 0x7fdcdc0adba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:08.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.303+0000 7fdcd2ffd700 1 -- 172.21.15.77:0/2350638306 >> v2:172.21.15.103:3300/0 conn(0x7fdcdc160d20 msgr2=0x7fdcdc0adba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:08.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.303+0000 7fdcd2ffd700 1 --2- 172.21.15.77:0/2350638306 >> v2:172.21.15.103:3300/0 conn(0x7fdcdc160d20 0x7fdcdc0adba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:08.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.303+0000 7fdcd2ffd700 1 -- 172.21.15.77:0/2350638306 >> v1:172.21.15.103:6789/0 conn(0x7fdcdc161100 legacy=0x7fdcdc164b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:08.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.303+0000 7fdcd2ffd700 1 -- 172.21.15.77:0/2350638306 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcdc0aebb0 con 0x7fdcdc0ae0e0 2023-07-24T05:46:08.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.303+0000 7fdcd2ffd700 1 --2- 172.21.15.77:0/2350638306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcdc0ae0e0 0x7fdcdc0b1090 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc0a4c10 tx=0x7fdcc4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75a1b0963e1bcfe9 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:08.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.303+0000 7fdcdaffd700 1 -- 172.21.15.77:0/2350638306 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc400b8a0 con 0x7fdcdc0ae0e0 2023-07-24T05:46:08.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.303+0000 7fdcdaffd700 1 -- 172.21.15.77:0/2350638306 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc400ba00 con 0x7fdcdc0ae0e0 2023-07-24T05:46:08.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.303+0000 7fdcdaffd700 1 -- 172.21.15.77:0/2350638306 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc400bd90 con 0x7fdcdc0ae0e0 2023-07-24T05:46:08.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.307+0000 7fdce0f1c700 1 -- 172.21.15.77:0/2350638306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcdc0ae0e0 msgr2=0x7fdcdc0b1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:08.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.307+0000 7fdce0f1c700 1 --2- 172.21.15.77:0/2350638306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcdc0ae0e0 0x7fdcdc0b1090 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc0a4c10 tx=0x7fdcc4009bf0 comp rx=0 tx=0).stop 2023-07-24T05:46:08.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.307+0000 7fdce0f1c700 1 -- 172.21.15.77:0/2350638306 shutdown_connections 2023-07-24T05:46:08.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.307+0000 7fdce0f1c700 1 --2- 172.21.15.77:0/2350638306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcdc0ae0e0 0x7fdcdc0b1090 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:08.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.307+0000 7fdce0f1c700 1 --2- 172.21.15.77:0/2350638306 >> v2:172.21.15.103:3300/0 conn(0x7fdcdc160d20 0x7fdcdc0adba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:08.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.307+0000 7fdce0f1c700 1 -- 172.21.15.77:0/2350638306 >> 172.21.15.77:0/2350638306 conn(0x7fdcdc0cacc0 msgr2=0x7fdcdc0cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:08.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.307+0000 7fdce0f1c700 1 -- 172.21.15.77:0/2350638306 shutdown_connections 2023-07-24T05:46:08.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.307+0000 7fdce0f1c700 1 -- 172.21.15.77:0/2350638306 wait complete. 2023-07-24T05:46:08.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.311+0000 7fdce0f1c700 1 Processor -- start 2023-07-24T05:46:08.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.311+0000 7fdce0f1c700 1 -- start start 2023-07-24T05:46:08.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.311+0000 7fdce0f1c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdcdc0ae0e0 0x7fdcdc0c0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:08.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.311+0000 7fdce0f1c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcdc160d20 0x7fdcdc15c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:08.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.311+0000 7fdce0f1c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdcdc161100 0x7fdcdc15c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:08.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.311+0000 7fdce0f1c700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc0c4130 con 0x7fdcdc160d20 2023-07-24T05:46:08.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.311+0000 7fdce0f1c700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc0c4410 con 0x7fdcdc0ae0e0 2023-07-24T05:46:08.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.311+0000 7fdce0f1c700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc0c46f0 con 0x7fdcdc161100 2023-07-24T05:46:08.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.311+0000 7fdcd2ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcdc160d20 0x7fdcdc15c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:08.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.311+0000 7fdcd2ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcdc160d20 0x7fdcdc15c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33046/0 (socket says 172.21.15.77:33046) 2023-07-24T05:46:08.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.311+0000 7fdcd2ffd700 1 -- 172.21.15.77:0/552888054 learned_addr learned my addr 172.21.15.77:0/552888054 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:08.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.311+0000 7fdcdb7fe700 1 --2- 172.21.15.77:0/552888054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdcdc0ae0e0 0x7fdcdc0c0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:08.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.311+0000 7fdcdbfff700 1 --2- 172.21.15.77:0/552888054 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdcdc161100 0x7fdcdc15c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:08.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.311+0000 7fdcd2ffd700 1 -- 172.21.15.77:0/552888054 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdcdc161100 msgr2=0x7fdcdc15c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:08.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.311+0000 7fdcd2ffd700 1 --2- 172.21.15.77:0/552888054 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdcdc161100 0x7fdcdc15c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:08.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.311+0000 7fdcd2ffd700 1 -- 172.21.15.77:0/552888054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdcdc0ae0e0 msgr2=0x7fdcdc0c0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:08.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.311+0000 7fdcd2ffd700 1 --2- 172.21.15.77:0/552888054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdcdc0ae0e0 0x7fdcdc0c0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:08.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.311+0000 7fdcd2ffd700 1 -- 172.21.15.77:0/552888054 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc4009570 con 0x7fdcdc160d20 2023-07-24T05:46:08.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.311+0000 7fdcdbfff700 1 --2- 172.21.15.77:0/552888054 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdcdc161100 0x7fdcdc15c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:46:08.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.315+0000 7fdcd2ffd700 1 --2- 172.21.15.77:0/552888054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcdc160d20 0x7fdcdc15c110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc06e160 tx=0x7fdcc4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:08.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.315+0000 7fdcd8ff9700 1 -- 172.21.15.77:0/552888054 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc40036c0 con 0x7fdcdc160d20 2023-07-24T05:46:08.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.315+0000 7fdcd8ff9700 1 -- 172.21.15.77:0/552888054 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc401f070 con 0x7fdcdc160d20 2023-07-24T05:46:08.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.315+0000 7fdcd8ff9700 1 -- 172.21.15.77:0/552888054 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4003a80 con 0x7fdcdc160d20 2023-07-24T05:46:08.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.315+0000 7fdce0f1c700 1 -- 172.21.15.77:0/552888054 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcdc0c49d0 con 0x7fdcdc160d20 2023-07-24T05:46:08.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.315+0000 7fdce0f1c700 1 -- 172.21.15.77:0/552888054 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcdc0c12d0 con 0x7fdcdc160d20 2023-07-24T05:46:08.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.315+0000 7fdce0f1c700 1 -- 172.21.15.77:0/552888054 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcdc0c4ef0 con 0x7fdcdc160d20 2023-07-24T05:46:08.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.319+0000 7fdcd8ff9700 1 -- 172.21.15.77:0/552888054 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdcc4021030 con 0x7fdcdc160d20 2023-07-24T05:46:08.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.319+0000 7fdcd8ff9700 1 --2- 172.21.15.77:0/552888054 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fdcbc0662f0 0x7fdcbc0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:08.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.319+0000 7fdcd8ff9700 1 -- 172.21.15.77:0/552888054 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdcc4085750 con 0x7fdcdc160d20 2023-07-24T05:46:08.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.319+0000 7fdcdb7fe700 1 --2- 172.21.15.77:0/552888054 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fdcbc0662f0 0x7fdcbc0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:08.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.323+0000 7fdcdb7fe700 1 --2- 172.21.15.77:0/552888054 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fdcbc0662f0 0x7fdcbc0687b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdccc006b40 tx=0x7fdccc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:08.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.327+0000 7fdcd8ff9700 1 -- 172.21.15.77:0/552888054 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdcc40529f0 con 0x7fdcdc160d20 2023-07-24T05:46:08.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.495+0000 7fdce0f1c700 1 -- 172.21.15.77:0/552888054 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdcdc072490 con 0x7fdcdc160d20 2023-07-24T05:46:08.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.499+0000 7fdcd8ff9700 1 -- 172.21.15.77:0/552888054 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20108 (secure 0 0 0) 0x7fdcc4056010 con 0x7fdcdc160d20 2023-07-24T05:46:08.504 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:46:08.504 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":25,"fsid":"5aed5f7b-fb55-4d95-9c02-c6adbb1677b4","created":"2023-07-24T05:45:39.639731+0000","modified":"2023-07-24T05:46:05.445306+0000","last_up_change":"2023-07-24T05:45:52.319670+0000","last_in_change":"2023-07-24T05:45:43.643277+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-24T05:45:52.610430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-24T05:45:52.773787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-24T05:45:58.121732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-24T05:45:59.368726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-24T05:46:03.032057+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ffa0d496-461a-4053-b764-0627d969521b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6812","nonce":825987196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6817","nonce":825987196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6831","nonce":825987196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6824","nonce":825987196}]},"public_addr":"172.21.15.77:6812/825987196","cluster_addr":"172.21.15.77:6817/825987196","heartbeat_back_addr":"172.21.15.77:6831/825987196","heartbeat_front_addr":"172.21.15.77:6824/825987196","state":["exists","up"]},{"osd":1,"uuid":"9f595e5e-5c43-49bc-8ce4-ee70575c90da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6801","nonce":4133026815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6803","nonce":4133026815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6807","nonce":4133026815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6805","nonce":4133026815}]},"public_addr":"172.21.15.77:6801/4133026815","cluster_addr":"172.21.15.77:6803/4133026815","heartbeat_back_addr":"172.21.15.77:6807/4133026815","heartbeat_front_addr":"172.21.15.77:6805/4133026815","state":["exists","up"]},{"osd":2,"uuid":"2ac177aa-4d7d-4262-bd54-d2b9f29f4c3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6811","nonce":2394142159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6819","nonce":2394142159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6830","nonce":2394142159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6825","nonce":2394142159}]},"public_addr":"172.21.15.77:6811/2394142159","cluster_addr":"172.21.15.77:6819/2394142159","heartbeat_back_addr":"172.21.15.77:6830/2394142159","heartbeat_front_addr":"172.21.15.77:6825/2394142159","state":["exists","up"]},{"osd":3,"uuid":"17d7a251-19e8-484c-8172-a578ab3da153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6813","nonce":1492113982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6818","nonce":1492113982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6829","nonce":1492113982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6823","nonce":1492113982}]},"public_addr":"172.21.15.77:6813/1492113982","cluster_addr":"172.21.15.77:6818/1492113982","heartbeat_back_addr":"172.21.15.77:6829/1492113982","heartbeat_front_addr":"172.21.15.77:6823/1492113982","state":["exists","up"]},{"osd":4,"uuid":"bf63ca05-f06d-4e0f-ac44-2a416c70b919","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6825","nonce":1080481057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6827","nonce":1080481057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6831","nonce":1080481057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6829","nonce":1080481057}]},"public_addr":"172.21.15.103:6825/1080481057","cluster_addr":"172.21.15.103:6827/1080481057","heartbeat_back_addr":"172.21.15.103:6831/1080481057","heartbeat_front_addr":"172.21.15.103:6829/1080481057","state":["exists","up"]},{"osd":5,"uuid":"65a11a35-9e9f-4b3c-9fe3-b658d62b9318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6811","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6813","nonce":2756677504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6818","nonce":2756677504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6823","nonce":2756677504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6821","nonce":2756677504}]},"public_addr":"172.21.15.103:6813/2756677504","cluster_addr":"172.21.15.103:6818/2756677504","heartbeat_back_addr":"172.21.15.103:6823/2756677504","heartbeat_front_addr":"172.21.15.103:6821/2756677504","state":["exists","up"]},{"osd":6,"uuid":"750c1f87-686c-40b4-94a1-1a299dc78f3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6809","nonce":568977764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6812","nonce":568977764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6819","nonce":568977764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6815","nonce":568977764}]},"public_addr":"172.21.15.103:6809/568977764","cluster_addr":"172.21.15.103:6812/568977764","heartbeat_back_addr":"172.21.15.103:6819/568977764","heartbeat_front_addr":"172.21.15.103:6815/568977764","state":["exists","up"]},{"osd":7,"uuid":"d5fe4fb6-2e09-4158-885b-403803c85822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6801","nonce":1074557176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6803","nonce":1074557176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6807","nonce":1074557176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6805","nonce":1074557176}]},"public_addr":"172.21.15.103:6801/1074557176","cluster_addr":"172.21.15.103:6803/1074557176","heartbeat_back_addr":"172.21.15.103:6807/1074557176","heartbeat_front_addr":"172.21.15.103:6805/1074557176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.631032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.154109+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.398587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.679089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.311218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.353726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.314372+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.126212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-24T05:46:08.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.503+0000 7fdce0f1c700 1 -- 172.21.15.77:0/552888054 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fdcbc0662f0 msgr2=0x7fdcbc0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:08.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.503+0000 7fdce0f1c700 1 --2- 172.21.15.77:0/552888054 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fdcbc0662f0 0x7fdcbc0687b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdccc006b40 tx=0x7fdccc008040 comp rx=0 tx=0).stop 2023-07-24T05:46:08.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.503+0000 7fdce0f1c700 1 -- 172.21.15.77:0/552888054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcdc160d20 msgr2=0x7fdcdc15c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:08.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.503+0000 7fdce0f1c700 1 --2- 172.21.15.77:0/552888054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcdc160d20 0x7fdcdc15c110 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc06e160 tx=0x7fdcc4004770 comp rx=0 tx=0).stop 2023-07-24T05:46:08.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.503+0000 7fdce0f1c700 1 -- 172.21.15.77:0/552888054 shutdown_connections 2023-07-24T05:46:08.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.503+0000 7fdce0f1c700 1 --2- 172.21.15.77:0/552888054 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fdcbc0662f0 0x7fdcbc0687b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:08.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.503+0000 7fdce0f1c700 1 --2- 172.21.15.77:0/552888054 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdcdc161100 0x7fdcdc15c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:08.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.503+0000 7fdce0f1c700 1 --2- 172.21.15.77:0/552888054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcdc160d20 0x7fdcdc15c110 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:08.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.503+0000 7fdce0f1c700 1 --2- 172.21.15.77:0/552888054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdcdc0ae0e0 0x7fdcdc0c0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:08.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.503+0000 7fdce0f1c700 1 -- 172.21.15.77:0/552888054 >> 172.21.15.77:0/552888054 conn(0x7fdcdc0cacc0 msgr2=0x7fdcdc0cbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:08.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.503+0000 7fdce0f1c700 1 -- 172.21.15.77:0/552888054 shutdown_connections 2023-07-24T05:46:08.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:08.503+0000 7fdce0f1c700 1 -- 172.21.15.77:0/552888054 wait complete. 2023-07-24T05:46:08.932 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-24T05:46:00.395327+0000', 'modified': '2023-07-24T05:46:06.407831+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4284}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4284': {'gid': 4284, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.77:6835/2428690206', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6833', 'nonce': 2428690206}, {'type': 'v1', 'addr': '172.21.15.77:6835', 'nonce': 2428690206}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-07-24T05:46:08.932 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-24T05:46:08.933 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-24T05:46:09.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.111+0000 7f50ad8e2700 1 Processor -- start 2023-07-24T05:46:09.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.111+0000 7f50ad8e2700 1 -- start start 2023-07-24T05:46:09.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.111+0000 7f50ad8e2700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f50a815ca00 0x7f50a80d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:09.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.111+0000 7f50ad8e2700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f50a806d450 0x7f50a80b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:09.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.111+0000 7f50ad8e2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f50a80b4630 0x7f50a80b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:09.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.111+0000 7f50ad8e2700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50a80b4ac0 con 0x7f50a806d450 2023-07-24T05:46:09.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.111+0000 7f50ad8e2700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50a80d0300 con 0x7f50a80b4630 2023-07-24T05:46:09.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.111+0000 7f50ad8e2700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a815cde0 con 0x7f50a815ca00 2023-07-24T05:46:09.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.111+0000 7f50a7fff700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f50a806d450 0x7f50a80b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:09.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.111+0000 7f50a7fff700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f50a806d450 0x7f50a80b40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33054/0 (socket says 172.21.15.77:33054) 2023-07-24T05:46:09.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.111+0000 7f50a7fff700 1 -- 172.21.15.77:0/3526694051 learned_addr learned my addr 172.21.15.77:0/3526694051 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:09.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.111+0000 7f50a7fff700 1 -- 172.21.15.77:0/3526694051 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f50a815ca00 msgr2=0x7f50a80d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:09.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.111+0000 7f50a7fff700 1 --2- 172.21.15.77:0/3526694051 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f50a815ca00 0x7f50a80d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:09.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.111+0000 7f50a7fff700 1 -- 172.21.15.77:0/3526694051 >> v2:172.21.15.103:3300/0 conn(0x7f50a80b4630 msgr2=0x7f50a80b11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:09.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.111+0000 7f50a7fff700 1 --2- 172.21.15.77:0/3526694051 >> v2:172.21.15.103:3300/0 conn(0x7f50a80b4630 0x7f50a80b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:09.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.111+0000 7f50a7fff700 1 -- 172.21.15.77:0/3526694051 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a80d2870 con 0x7f50a806d450 2023-07-24T05:46:09.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.115+0000 7f50a7fff700 1 --2- 172.21.15.77:0/3526694051 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50a806d450 0x7f50a80b40f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f50a808c2e0 tx=0x7f5094009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aaf04b5c601e23a server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:09.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.115+0000 7f50a77fe700 1 -- 172.21.15.77:0/3526694051 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509400b8a0 con 0x7f50a806d450 2023-07-24T05:46:09.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.115+0000 7f50a77fe700 1 -- 172.21.15.77:0/3526694051 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f509400ba00 con 0x7f50a806d450 2023-07-24T05:46:09.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.115+0000 7f50a77fe700 1 -- 172.21.15.77:0/3526694051 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509400bd90 con 0x7f50a806d450 2023-07-24T05:46:09.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.115+0000 7f50ad8e2700 1 -- 172.21.15.77:0/3526694051 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50a806d450 msgr2=0x7f50a80b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:09.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.115+0000 7f50ad8e2700 1 --2- 172.21.15.77:0/3526694051 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50a806d450 0x7f50a80b40f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f50a808c2e0 tx=0x7f5094009bf0 comp rx=0 tx=0).stop 2023-07-24T05:46:09.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.115+0000 7f50ad8e2700 1 -- 172.21.15.77:0/3526694051 shutdown_connections 2023-07-24T05:46:09.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.115+0000 7f50ad8e2700 1 --2- 172.21.15.77:0/3526694051 >> v2:172.21.15.103:3300/0 conn(0x7f50a80b4630 0x7f50a80b11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:09.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.115+0000 7f50ad8e2700 1 --2- 172.21.15.77:0/3526694051 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50a806d450 0x7f50a80b40f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:09.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.115+0000 7f50ad8e2700 1 --2- 172.21.15.77:0/3526694051 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f50a815ca00 0x7f50a80d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:09.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.115+0000 7f50ad8e2700 1 -- 172.21.15.77:0/3526694051 >> 172.21.15.77:0/3526694051 conn(0x7f50a80b7610 msgr2=0x7f50a80b7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:09.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.115+0000 7f50ad8e2700 1 -- 172.21.15.77:0/3526694051 shutdown_connections 2023-07-24T05:46:09.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.115+0000 7f50ad8e2700 1 -- 172.21.15.77:0/3526694051 wait complete. 2023-07-24T05:46:09.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.119+0000 7f50ad8e2700 1 Processor -- start 2023-07-24T05:46:09.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.119+0000 7f50ad8e2700 1 -- start start 2023-07-24T05:46:09.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.123+0000 7f50ad8e2700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50a806d450 0x7f50a81f2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:09.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.123+0000 7f50ad8e2700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f50a80b4630 0x7f50a81f4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:09.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.123+0000 7f50ad8e2700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50a815ca00 0x7f50a80d15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:09.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.123+0000 7f50ad8e2700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a81f3260 con 0x7f50a806d450 2023-07-24T05:46:09.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.123+0000 7f50ad8e2700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a81563a0 con 0x7f50a815ca00 2023-07-24T05:46:09.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.123+0000 7f50ad8e2700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a8156680 con 0x7f50a80b4630 2023-07-24T05:46:09.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.123+0000 7f50ac8e0700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50a806d450 0x7f50a81f2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:09.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.123+0000 7f50ac8e0700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50a806d450 0x7f50a81f2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33066/0 (socket says 172.21.15.77:33066) 2023-07-24T05:46:09.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.123+0000 7f50ac8e0700 1 -- 172.21.15.77:0/810682388 learned_addr learned my addr 172.21.15.77:0/810682388 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:09.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.123+0000 7f50a7fff700 1 --2- 172.21.15.77:0/810682388 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f50a80b4630 0x7f50a81f4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:09.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.123+0000 7f50ad0e1700 1 --2- 172.21.15.77:0/810682388 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50a815ca00 0x7f50a80d15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:09.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.123+0000 7f50ac8e0700 1 -- 172.21.15.77:0/810682388 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f50a80b4630 msgr2=0x7f50a81f4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:09.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.123+0000 7f50ac8e0700 1 --2- 172.21.15.77:0/810682388 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f50a80b4630 0x7f50a81f4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:09.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.123+0000 7f50ac8e0700 1 -- 172.21.15.77:0/810682388 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50a815ca00 msgr2=0x7f50a80d15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:09.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.123+0000 7f50ac8e0700 1 --2- 172.21.15.77:0/810682388 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50a815ca00 0x7f50a80d15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:09.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.123+0000 7f50ac8e0700 1 -- 172.21.15.77:0/810682388 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5094009570 con 0x7f50a806d450 2023-07-24T05:46:09.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.123+0000 7f50ac8e0700 1 --2- 172.21.15.77:0/810682388 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50a806d450 0x7f50a81f2d20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f509c00b540 tx=0x7f509c00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:09.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.123+0000 7f50a57fa700 1 -- 172.21.15.77:0/810682388 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509c015070 con 0x7f50a806d450 2023-07-24T05:46:09.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.123+0000 7f50a57fa700 1 -- 172.21.15.77:0/810682388 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f509c005ac0 con 0x7f50a806d450 2023-07-24T05:46:09.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.123+0000 7f50a57fa700 1 -- 172.21.15.77:0/810682388 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509c005e70 con 0x7f50a806d450 2023-07-24T05:46:09.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.123+0000 7f50ad8e2700 1 -- 172.21.15.77:0/810682388 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50a8156960 con 0x7f50a806d450 2023-07-24T05:46:09.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.123+0000 7f50ad8e2700 1 -- 172.21.15.77:0/810682388 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50a8156f20 con 0x7f50a806d450 2023-07-24T05:46:09.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.127+0000 7f50a57fa700 1 -- 172.21.15.77:0/810682388 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f509c011630 con 0x7f50a806d450 2023-07-24T05:46:09.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.131+0000 7f50a57fa700 1 --2- 172.21.15.77:0/810682388 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f508c0662f0 0x7f508c0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:09.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.131+0000 7f50a57fa700 1 -- 172.21.15.77:0/810682388 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f509c0837e0 con 0x7f50a806d450 2023-07-24T05:46:09.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.131+0000 7f50a7fff700 1 --2- 172.21.15.77:0/810682388 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f508c0662f0 0x7f508c0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:09.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.131+0000 7f50b1dd2740 1 Processor -- start 2023-07-24T05:46:09.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.131+0000 7f50a7fff700 1 --2- 172.21.15.77:0/810682388 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f508c0662f0 0x7f508c0687b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5094014040 tx=0x7f5094008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:09.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.131+0000 7f50b1dd2740 1 -- start start 2023-07-24T05:46:09.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.131+0000 7f50b1dd2740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2b3db80 0x2b3df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:09.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.131+0000 7f50b1dd2740 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x2b3e4a0 0x2af2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:09.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.131+0000 7f50b1dd2740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2af3310 0x2af36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:09.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.131+0000 7f50b1dd2740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a64ef0 con 0x2af3310 2023-07-24T05:46:09.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.131+0000 7f50b1dd2740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a625e0 con 0x2b3db80 2023-07-24T05:46:09.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.131+0000 7f50b1dd2740 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x2a5ded0 con 0x2b3e4a0 2023-07-24T05:46:09.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.135+0000 7f50ad0e1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2af3310 0x2af36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:09.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.135+0000 7f50ac8e0700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2b3db80 0x2b3df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:09.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.135+0000 7f50ad0e1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2af3310 0x2af36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33078/0 (socket says 172.21.15.77:33078) 2023-07-24T05:46:09.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.135+0000 7f50ad0e1700 1 -- 172.21.15.77:0/2948758303 learned_addr learned my addr 172.21.15.77:0/2948758303 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:09.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.135+0000 7f50a7fff700 1 --2- 172.21.15.77:0/2948758303 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x2b3e4a0 0x2af2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:09.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.135+0000 7f50ad0e1700 1 -- 172.21.15.77:0/2948758303 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x2b3e4a0 msgr2=0x2af2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:09.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.135+0000 7f50ad0e1700 1 --2- 172.21.15.77:0/2948758303 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x2b3e4a0 0x2af2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:09.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.135+0000 7f50ad0e1700 1 -- 172.21.15.77:0/2948758303 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2b3db80 msgr2=0x2b3df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:09.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.135+0000 7f50ad0e1700 1 --2- 172.21.15.77:0/2948758303 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2b3db80 0x2b3df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:09.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.135+0000 7f50ad0e1700 1 -- 172.21.15.77:0/2948758303 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2a0f580 con 0x2af3310 2023-07-24T05:46:09.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.135+0000 7f50ad0e1700 1 --2- 172.21.15.77:0/2948758303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2af3310 0x2af36f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f50a0009ef0 tx=0x7f50a0009f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d2acf6cd6851c14 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:09.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.135+0000 7f50927fc700 1 -- 172.21.15.77:0/2948758303 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a0011070 con 0x2af3310 2023-07-24T05:46:09.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.135+0000 7f50927fc700 1 -- 172.21.15.77:0/2948758303 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a000c910 con 0x2af3310 2023-07-24T05:46:09.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.135+0000 7f50927fc700 1 -- 172.21.15.77:0/2948758303 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a000ccc0 con 0x2af3310 2023-07-24T05:46:09.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.135+0000 7f50b1dd2740 1 -- 172.21.15.77:0/2948758303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2af3310 msgr2=0x2af36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:09.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.135+0000 7f50b1dd2740 1 --2- 172.21.15.77:0/2948758303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2af3310 0x2af36f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f50a0009ef0 tx=0x7f50a0009f20 comp rx=0 tx=0).stop 2023-07-24T05:46:09.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.135+0000 7f50b1dd2740 1 -- 172.21.15.77:0/2948758303 shutdown_connections 2023-07-24T05:46:09.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.135+0000 7f50b1dd2740 1 --2- 172.21.15.77:0/2948758303 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2af3310 0x2af36f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:09.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.135+0000 7f50b1dd2740 1 --2- 172.21.15.77:0/2948758303 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x2b3e4a0 0x2af2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:09.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.135+0000 7f50b1dd2740 1 --2- 172.21.15.77:0/2948758303 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2b3db80 0x2b3df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:09.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.135+0000 7f50b1dd2740 1 -- 172.21.15.77:0/2948758303 >> 172.21.15.77:0/2948758303 conn(0x2885550 msgr2=0x2af9210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:09.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.135+0000 7f50b1dd2740 1 -- 172.21.15.77:0/2948758303 shutdown_connections 2023-07-24T05:46:09.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.135+0000 7f50b1dd2740 1 -- 172.21.15.77:0/2948758303 wait complete. 2023-07-24T05:46:09.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.135+0000 7f50b1dd2740 1 -- start start 2023-07-24T05:46:09.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.135+0000 7f50b1dd2740 1 Processor -- start 2023-07-24T05:46:09.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.139+0000 7f50b1dd2740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2af3310 0x2b23e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:09.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.139+0000 7f50b1dd2740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2b3db80 0x2b1d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:09.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.139+0000 7f50b1dd2740 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x2b3e4a0 0x2b44070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:09.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.139+0000 7f50b1dd2740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a1fb00 con 0x2b3db80 2023-07-24T05:46:09.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.139+0000 7f50b1dd2740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a1e470 con 0x2af3310 2023-07-24T05:46:09.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.139+0000 7f50b1dd2740 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x2909b20 con 0x2b3e4a0 2023-07-24T05:46:09.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.139+0000 7f50b1dd2740 10 client.0 _ll_register_callbacks cb 0x2ab0bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-24T05:46:09.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.139+0000 7f50a7fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2b3db80 0x2b1d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:09.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.139+0000 7f50a7fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2b3db80 0x2b1d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33084/0 (socket says 172.21.15.77:33084) 2023-07-24T05:46:09.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.139+0000 7f50a7fff700 1 -- 172.21.15.77:0/2367351121 learned_addr learned my addr 172.21.15.77:0/2367351121 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:09.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.139+0000 7f50ad0e1700 1 --2- 172.21.15.77:0/2367351121 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x2b3e4a0 0x2b44070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:09.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.139+0000 7f50ac8e0700 1 --2- 172.21.15.77:0/2367351121 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2af3310 0x2b23e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:09.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.139+0000 7f50a7fff700 1 -- 172.21.15.77:0/2367351121 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x2b3e4a0 msgr2=0x2b44070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:09.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.139+0000 7f50a7fff700 1 --2- 172.21.15.77:0/2367351121 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x2b3e4a0 0x2b44070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:09.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.139+0000 7f50a7fff700 1 -- 172.21.15.77:0/2367351121 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2af3310 msgr2=0x2b23e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:09.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.139+0000 7f50a7fff700 1 --2- 172.21.15.77:0/2367351121 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2af3310 0x2b23e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:09.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.139+0000 7f50a7fff700 1 -- 172.21.15.77:0/2367351121 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50a0009ba0 con 0x2b3db80 2023-07-24T05:46:09.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.139+0000 7f50a7fff700 1 --2- 172.21.15.77:0/2367351121 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2b3db80 0x2b1d140 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f50940045c0 tx=0x7f50940047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5ede50bb2fcd5cf server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:09.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.139+0000 7f50877fe700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-07-24T05:46:09.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.139+0000 7f50877fe700 1 -- 172.21.15.77:0/2367351121 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5094003ee0 con 0x2b3db80 2023-07-24T05:46:09.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.139+0000 7f50b1dd2740 1 -- 172.21.15.77:0/2367351121 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2a55be0 con 0x2b3db80 2023-07-24T05:46:09.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.139+0000 7f50877fe700 1 -- 172.21.15.77:0/2367351121 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f509401b840 con 0x2b3db80 2023-07-24T05:46:09.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.139+0000 7f50877fe700 1 -- 172.21.15.77:0/2367351121 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50940045f0 con 0x2b3db80 2023-07-24T05:46:09.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.139+0000 7f50b1dd2740 10 client.4434 fetch_fsmap learned FSMap version 7 2023-07-24T05:46:09.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.139+0000 7f50b1dd2740 1 -- 172.21.15.77:0/2367351121 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x28d09e0 con 0x2b3db80 2023-07-24T05:46:09.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.143+0000 7f50877fe700 1 -- 172.21.15.77:0/2367351121 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2a55be0 con 0x2b3db80 2023-07-24T05:46:09.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.143+0000 7f50877fe700 1 -- 172.21.15.77:0/2367351121 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f509401ba00 con 0x2b3db80 2023-07-24T05:46:09.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.143+0000 7f50b1dd2740 10 client.4434 fetch_fsmap finished waiting for FSMap version 7 2023-07-24T05:46:09.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.143+0000 7f50b1dd2740 10 client.4434 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-24T05:46:09.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.143+0000 7f50b1dd2740 20 client.4434 populate_metadata read hostname 'smithi077' 2023-07-24T05:46:09.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.143+0000 7f50b1dd2740 1 --2- 172.21.15.77:0/2367351121 >> [v2:172.21.15.77:6833/2428690206,v1:172.21.15.77:6835/2428690206] conn(0x2b44ed0 0x2af9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:09.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.143+0000 7f50b1dd2740 4 client.4434 mds_command: new command op to 4284 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-24T05:46:09.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.143+0000 7f50b1dd2740 1 -- 172.21.15.77:0/2367351121 --> [v2:172.21.15.77:6833/2428690206,v1:172.21.15.77:6835/2428690206] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2a56eb0 con 0x2b44ed0 2023-07-24T05:46:09.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.143+0000 7f50ac8e0700 1 --2- 172.21.15.77:0/2367351121 >> [v2:172.21.15.77:6833/2428690206,v1:172.21.15.77:6835/2428690206] conn(0x2b44ed0 0x2af9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:09.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.143+0000 7f50877fe700 10 client.4434 ms_handle_connect on v2:172.21.15.77:6833/2428690206 2023-07-24T05:46:09.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.143+0000 7f50ac8e0700 1 --2- 172.21.15.77:0/2367351121 >> [v2:172.21.15.77:6833/2428690206,v1:172.21.15.77:6835/2428690206] conn(0x2b44ed0 0x2af9040 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b1ac3ee280122e7 server_cookie=30edeb7c64477cfa in_seq=0 out_seq=0 2023-07-24T05:46:09.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.143+0000 7f50877fe700 1 -- 172.21.15.77:0/2367351121 <== mds.0 v2:172.21.15.77:6833/2428690206 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x2a56eb0 con 0x2b44ed0 2023-07-24T05:46:09.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.143+0000 7f50877fe700 10 client.4434 handle_command_reply: tid=0 2023-07-24T05:46:09.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.143+0000 7f50b1dd2740 1 client.4434 shutdown 2023-07-24T05:46:09.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.143+0000 7f50b1dd2740 1 -- 172.21.15.77:0/2367351121 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2b3db80 msgr2=0x2b1d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:09.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.143+0000 7f50b1dd2740 1 --2- 172.21.15.77:0/2367351121 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2b3db80 0x2b1d140 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f50940045c0 tx=0x7f50940047e0 comp rx=0 tx=0).stop 2023-07-24T05:46:09.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.143+0000 7f50b1dd2740 1 -- 172.21.15.77:0/2367351121 shutdown_connections 2023-07-24T05:46:09.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.143+0000 7f50b1dd2740 1 --2- 172.21.15.77:0/2367351121 >> [v2:172.21.15.77:6833/2428690206,v1:172.21.15.77:6835/2428690206] conn(0x2b44ed0 0x2af9040 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:09.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.143+0000 7f50b1dd2740 1 --2- 172.21.15.77:0/2367351121 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x2b3e4a0 0x2b44070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:09.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.143+0000 7f50b1dd2740 1 --2- 172.21.15.77:0/2367351121 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2b3db80 0x2b1d140 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:09.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.143+0000 7f50b1dd2740 1 --2- 172.21.15.77:0/2367351121 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2af3310 0x2b23e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:09.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.143+0000 7f50877fe700 0 client.4434 ms_handle_reset on v2:172.21.15.77:6833/2428690206 2023-07-24T05:46:09.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.143+0000 7f50b1dd2740 1 -- 172.21.15.77:0/2367351121 >> 172.21.15.77:0/2367351121 conn(0x2885550 msgr2=0x2af3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:09.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.143+0000 7f50b1dd2740 1 -- 172.21.15.77:0/2367351121 shutdown_connections 2023-07-24T05:46:09.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.143+0000 7f50b1dd2740 1 -- 172.21.15.77:0/2367351121 wait complete. 2023-07-24T05:46:09.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.147+0000 7f50b1dd2740 20 client.4434 trim_cache size 0 max 16384 2023-07-24T05:46:09.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.167+0000 7f50b1dd2740 1 Processor -- start 2023-07-24T05:46:09.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.167+0000 7f50b1dd2740 1 -- start start 2023-07-24T05:46:09.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.167+0000 7f50b1dd2740 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x2af3310 0x2b1bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:09.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.167+0000 7f50b1dd2740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2b3db80 0x2b1c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:09.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.167+0000 7f50b1dd2740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2b3e4a0 0x2b20230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:09.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.167+0000 7f50b1dd2740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a60a30 con 0x2b3e4a0 2023-07-24T05:46:09.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.167+0000 7f50b1dd2740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a56440 con 0x2b3db80 2023-07-24T05:46:09.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.167+0000 7f50b1dd2740 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x2b1cbe0 con 0x2af3310 2023-07-24T05:46:09.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.167+0000 7f50ad0e1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2b3e4a0 0x2b20230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:09.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.167+0000 7f50ad0e1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2b3e4a0 0x2b20230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33092/0 (socket says 172.21.15.77:33092) 2023-07-24T05:46:09.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.167+0000 7f50ad0e1700 1 -- 172.21.15.77:0/2408338997 learned_addr learned my addr 172.21.15.77:0/2408338997 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:09.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.167+0000 7f50a7fff700 1 --2- 172.21.15.77:0/2408338997 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2b3db80 0x2b1c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:09.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.167+0000 7f50ac8e0700 1 --2- 172.21.15.77:0/2408338997 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x2af3310 0x2b1bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:09.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.167+0000 7f50ad0e1700 1 -- 172.21.15.77:0/2408338997 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x2af3310 msgr2=0x2b1bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:09.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.167+0000 7f50ad0e1700 1 --2- 172.21.15.77:0/2408338997 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x2af3310 0x2b1bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:09.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.167+0000 7f50ad0e1700 1 -- 172.21.15.77:0/2408338997 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2b3db80 msgr2=0x2b1c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:09.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.167+0000 7f50ad0e1700 1 --2- 172.21.15.77:0/2408338997 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2b3db80 0x2b1c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:09.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.167+0000 7f50ad0e1700 1 -- 172.21.15.77:0/2408338997 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a80d1e70 con 0x2b3e4a0 2023-07-24T05:46:09.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.167+0000 7f50a7fff700 1 --2- 172.21.15.77:0/2408338997 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2b3db80 0x2b1c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:46:09.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.167+0000 7f50ad0e1700 1 --2- 172.21.15.77:0/2408338997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2b3e4a0 0x2b20230 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f50a0009e90 tx=0x7f50a000e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=800a118ca9e646fe server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:09.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.167+0000 7f5092ffd700 1 -- 172.21.15.77:0/2408338997 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a000ca80 con 0x2b3e4a0 2023-07-24T05:46:09.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.167+0000 7f5092ffd700 1 -- 172.21.15.77:0/2408338997 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a000cc00 con 0x2b3e4a0 2023-07-24T05:46:09.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.167+0000 7f5092ffd700 1 -- 172.21.15.77:0/2408338997 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a001f470 con 0x2b3e4a0 2023-07-24T05:46:09.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.171+0000 7f50b1dd2740 1 -- 172.21.15.77:0/2408338997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2b3e4a0 msgr2=0x2b20230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:09.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.171+0000 7f50b1dd2740 1 --2- 172.21.15.77:0/2408338997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2b3e4a0 0x2b20230 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f50a0009e90 tx=0x7f50a000e050 comp rx=0 tx=0).stop 2023-07-24T05:46:09.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.171+0000 7f50b1dd2740 1 -- 172.21.15.77:0/2408338997 shutdown_connections 2023-07-24T05:46:09.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.171+0000 7f50b1dd2740 1 --2- 172.21.15.77:0/2408338997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2b3e4a0 0x2b20230 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:09.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.171+0000 7f50b1dd2740 1 --2- 172.21.15.77:0/2408338997 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2b3db80 0x2b1c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:09.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.171+0000 7f50b1dd2740 1 --2- 172.21.15.77:0/2408338997 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x2af3310 0x2b1bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:09.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.171+0000 7f50b1dd2740 1 -- 172.21.15.77:0/2408338997 >> 172.21.15.77:0/2408338997 conn(0x2885550 msgr2=0x2b3ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:09.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.171+0000 7f50b1dd2740 1 -- 172.21.15.77:0/2408338997 shutdown_connections 2023-07-24T05:46:09.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.171+0000 7f50b1dd2740 1 -- 172.21.15.77:0/2408338997 wait complete. 2023-07-24T05:46:09.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.171+0000 7f50b1dd2740 1 -- start start 2023-07-24T05:46:09.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.171+0000 7f50b1dd2740 1 Processor -- start 2023-07-24T05:46:09.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.175+0000 7f50b1dd2740 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x2af3310 0x2b42670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:09.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.175+0000 7f50b1dd2740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2b3db80 0x2b9d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:09.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.175+0000 7f50b1dd2740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2b3e4a0 0x2b43120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:09.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.175+0000 7f50b1dd2740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b42bb0 con 0x2b3e4a0 2023-07-24T05:46:09.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.175+0000 7f50b1dd2740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b1dce0 con 0x2b3db80 2023-07-24T05:46:09.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.175+0000 7f50b1dd2740 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x2b44c10 con 0x2af3310 2023-07-24T05:46:09.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.175+0000 7f50b1dd2740 10 client.0 _ll_register_callbacks cb 0x2a15800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-24T05:46:09.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.175+0000 7f50a7fff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2b3db80 0x2b9d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:09.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.175+0000 7f50ad0e1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2b3e4a0 0x2b43120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:09.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.175+0000 7f50a7fff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2b3db80 0x2b9d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:49032/0 (socket says 172.21.15.77:49032) 2023-07-24T05:46:09.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.175+0000 7f50a7fff700 1 -- 172.21.15.77:0/964152143 learned_addr learned my addr 172.21.15.77:0/964152143 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:09.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.175+0000 7f50ac8e0700 1 --2- 172.21.15.77:0/964152143 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x2af3310 0x2b42670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:09.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.175+0000 7f50ad0e1700 1 -- 172.21.15.77:0/964152143 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x2af3310 msgr2=0x2b42670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:09.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.175+0000 7f50ad0e1700 1 --2- 172.21.15.77:0/964152143 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x2af3310 0x2b42670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:09.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.175+0000 7f50ad0e1700 1 -- 172.21.15.77:0/964152143 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2b3db80 msgr2=0x2b9d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:09.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.175+0000 7f50ad0e1700 1 --2- 172.21.15.77:0/964152143 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2b3db80 0x2b9d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:09.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.175+0000 7f50ad0e1700 1 -- 172.21.15.77:0/964152143 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f509401be70 con 0x2b3e4a0 2023-07-24T05:46:09.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.175+0000 7f50a7fff700 1 --2- 172.21.15.77:0/964152143 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2b3db80 0x2b9d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:46:09.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.179+0000 7f50ad0e1700 1 --2- 172.21.15.77:0/964152143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2b3e4a0 0x2b43120 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x2a03d50 tx=0x7f50a0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=603b67a6b737d495 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:09.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.179+0000 7f50877fe700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-07-24T05:46:09.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.179+0000 7f50877fe700 1 -- 172.21.15.77:0/964152143 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a001fba0 con 0x2b3e4a0 2023-07-24T05:46:09.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.179+0000 7f50b1dd2740 1 -- 172.21.15.77:0/964152143 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2af2ad0 con 0x2b3e4a0 2023-07-24T05:46:09.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.179+0000 7f50877fe700 1 -- 172.21.15.77:0/964152143 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f50a001fd00 con 0x2b3e4a0 2023-07-24T05:46:09.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.179+0000 7f50877fe700 1 -- 172.21.15.77:0/964152143 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50a0009970 con 0x2b3e4a0 2023-07-24T05:46:09.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.179+0000 7f50b1dd2740 10 client.4440 fetch_fsmap learned FSMap version 7 2023-07-24T05:46:09.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.179+0000 7f50b1dd2740 1 -- 172.21.15.77:0/964152143 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x2a0f580 con 0x2b3e4a0 2023-07-24T05:46:09.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.179+0000 7f50877fe700 1 -- 172.21.15.77:0/964152143 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2af2ad0 con 0x2b3e4a0 2023-07-24T05:46:09.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.179+0000 7f50877fe700 1 -- 172.21.15.77:0/964152143 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f50a0029070 con 0x2b3e4a0 2023-07-24T05:46:09.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.179+0000 7f50b1dd2740 10 client.4440 fetch_fsmap finished waiting for FSMap version 7 2023-07-24T05:46:09.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.179+0000 7f50b1dd2740 10 client.4440 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-24T05:46:09.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.179+0000 7f50b1dd2740 20 client.4440 populate_metadata read hostname 'smithi077' 2023-07-24T05:46:09.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.179+0000 7f50b1dd2740 1 --2- 172.21.15.77:0/964152143 >> [v2:172.21.15.77:6833/2428690206,v1:172.21.15.77:6835/2428690206] conn(0x2b9bfc0 0x2b40890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:09.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.179+0000 7f50b1dd2740 4 client.4440 mds_command: new command op to 4284 tid=0[{"prefix": "status"}] 2023-07-24T05:46:09.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.179+0000 7f50b1dd2740 1 -- 172.21.15.77:0/964152143 --> [v2:172.21.15.77:6833/2428690206,v1:172.21.15.77:6835/2428690206] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f50a000c910 con 0x2b9bfc0 2023-07-24T05:46:09.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.179+0000 7f50ac8e0700 1 --2- 172.21.15.77:0/964152143 >> [v2:172.21.15.77:6833/2428690206,v1:172.21.15.77:6835/2428690206] conn(0x2b9bfc0 0x2b40890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:09.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.179+0000 7f50877fe700 10 client.4440 ms_handle_connect on v2:172.21.15.77:6833/2428690206 2023-07-24T05:46:09.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.179+0000 7f50ac8e0700 1 --2- 172.21.15.77:0/964152143 >> [v2:172.21.15.77:6833/2428690206,v1:172.21.15.77:6835/2428690206] conn(0x2b9bfc0 0x2b40890 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4305677123800502 server_cookie=df941632682db7ec in_seq=0 out_seq=0 2023-07-24T05:46:09.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.179+0000 7f50877fe700 1 -- 172.21.15.77:0/964152143 <== mds.0 v2:172.21.15.77:6833/2428690206 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x7f50a000c910 con 0x2b9bfc0 2023-07-24T05:46:09.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.179+0000 7f50877fe700 10 client.4440 handle_command_reply: tid=0 2023-07-24T05:46:09.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.179+0000 7f50b1dd2740 1 client.4440 shutdown 2023-07-24T05:46:09.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.179+0000 7f50b1dd2740 1 -- 172.21.15.77:0/964152143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2b3e4a0 msgr2=0x2b43120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:09.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.179+0000 7f50b1dd2740 1 --2- 172.21.15.77:0/964152143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2b3e4a0 0x2b43120 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x2a03d50 tx=0x7f50a0012000 comp rx=0 tx=0).stop 2023-07-24T05:46:09.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.179+0000 7f50b1dd2740 1 -- 172.21.15.77:0/964152143 shutdown_connections 2023-07-24T05:46:09.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.179+0000 7f50b1dd2740 1 --2- 172.21.15.77:0/964152143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2b3e4a0 0x2b43120 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:09.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.183+0000 7f50b1dd2740 1 --2- 172.21.15.77:0/964152143 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2b3db80 0x2b9d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:09.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.183+0000 7f50b1dd2740 1 --2- 172.21.15.77:0/964152143 >> [v2:172.21.15.77:6833/2428690206,v1:172.21.15.77:6835/2428690206] conn(0x2b9bfc0 0x2b40890 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:09.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.183+0000 7f50b1dd2740 1 --2- 172.21.15.77:0/964152143 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x2af3310 0x2b42670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:09.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.183+0000 7f50877fe700 0 client.4440 ms_handle_reset on v2:172.21.15.77:6833/2428690206 2023-07-24T05:46:09.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.183+0000 7f50b1dd2740 1 -- 172.21.15.77:0/964152143 >> 172.21.15.77:0/964152143 conn(0x2885550 msgr2=0x2b218d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:09.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.183+0000 7f50b1dd2740 1 -- 172.21.15.77:0/964152143 shutdown_connections 2023-07-24T05:46:09.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.183+0000 7f50b1dd2740 1 -- 172.21.15.77:0/964152143 wait complete. 2023-07-24T05:46:09.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.183+0000 7f50b1dd2740 20 client.4440 trim_cache size 0 max 16384 2023-07-24T05:46:09.189 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-07-24T05:46:09.189 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "5aed5f7b-fb55-4d95-9c02-c6adbb1677b4", 2023-07-24T05:46:09.189 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 0, 2023-07-24T05:46:09.189 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 4284, 2023-07-24T05:46:09.189 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2023-07-24T05:46:09.190 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2023-07-24T05:46:09.190 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs", 2023-07-24T05:46:09.190 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 8.2464039650000007, 2023-07-24T05:46:09.190 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 7, 2023-07-24T05:46:09.190 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 25, 2023-07-24T05:46:09.190 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 25, 2023-07-24T05:46:09.190 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 14.683045843 2023-07-24T05:46:09.190 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-07-24T05:46:09.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.183+0000 7f50ad8e2700 1 -- 172.21.15.77:0/810682388 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f508c0662f0 msgr2=0x7f508c0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:09.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.183+0000 7f50ad8e2700 1 --2- 172.21.15.77:0/810682388 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f508c0662f0 0x7f508c0687b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5094014040 tx=0x7f5094008030 comp rx=0 tx=0).stop 2023-07-24T05:46:09.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.183+0000 7f50ad8e2700 1 -- 172.21.15.77:0/810682388 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50a806d450 msgr2=0x7f50a81f2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:09.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.183+0000 7f50ad8e2700 1 --2- 172.21.15.77:0/810682388 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50a806d450 0x7f50a81f2d20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f509c00b540 tx=0x7f509c00b900 comp rx=0 tx=0).stop 2023-07-24T05:46:09.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.183+0000 7f50ad8e2700 1 -- 172.21.15.77:0/810682388 shutdown_connections 2023-07-24T05:46:09.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.183+0000 7f50ad8e2700 1 --2- 172.21.15.77:0/810682388 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50a815ca00 0x7f50a80d15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:09.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.183+0000 7f50ad8e2700 1 --2- 172.21.15.77:0/810682388 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f508c0662f0 0x7f508c0687b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:09.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.183+0000 7f50ad8e2700 1 --2- 172.21.15.77:0/810682388 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f50a80b4630 0x7f50a81f4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:09.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.183+0000 7f50ad8e2700 1 --2- 172.21.15.77:0/810682388 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50a806d450 0x7f50a81f2d20 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:09.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.183+0000 7f50ad8e2700 1 -- 172.21.15.77:0/810682388 >> 172.21.15.77:0/810682388 conn(0x7f50a80b7610 msgr2=0x7f50a80cf5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:09.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.183+0000 7f50ad8e2700 1 -- 172.21.15.77:0/810682388 shutdown_connections 2023-07-24T05:46:09.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.183+0000 7f50ad8e2700 1 -- 172.21.15.77:0/810682388 wait complete. 2023-07-24T05:46:09.208 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-24T05:46:09.209 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-07-24T05:46:09.209 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-24T05:46:09.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.375+0000 7f3744d51700 1 Processor -- start 2023-07-24T05:46:09.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.375+0000 7f3744d51700 1 -- start start 2023-07-24T05:46:09.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.379+0000 7f3744d51700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f37400b17a0 0x7f374016be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:09.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.379+0000 7f3744d51700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37400af170 con 0x7f3740161100 2023-07-24T05:46:09.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.379+0000 7f3744d51700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37400ae5f0 con 0x7f3740160d20 2023-07-24T05:46:09.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.379+0000 7f3744d51700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37400ae8d0 con 0x7f37400b17a0 2023-07-24T05:46:09.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.379+0000 7f3736ffd700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f3740161100 0x7f37400b1090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:34388/0 (socket says 172.21.15.77:34388) 2023-07-24T05:46:09.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.379+0000 7f3736ffd700 1 -- 172.21.15.77:0/2289147255 learned_addr learned my addr 172.21.15.77:0/2289147255 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:09.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.379+0000 7f373ffff700 1 --2- 172.21.15.77:0/2289147255 >> v2:172.21.15.103:3300/0 conn(0x7f37400b17a0 0x7f374016be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:09.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.379+0000 7f373effd700 1 -- 172.21.15.77:0/2289147255 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3720561019 0 0) 0x7f37400ae5f0 con 0x7f3740160d20 2023-07-24T05:46:09.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.379+0000 7f373effd700 1 -- 172.21.15.77:0/2289147255 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f372c0035d0 con 0x7f3740160d20 2023-07-24T05:46:09.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.379+0000 7f373effd700 1 -- 172.21.15.77:0/2289147255 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 355193365 0 0) 0x7f37400af170 con 0x7f3740161100 2023-07-24T05:46:09.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.379+0000 7f373effd700 1 -- 172.21.15.77:0/2289147255 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37400ae5f0 con 0x7f3740161100 2023-07-24T05:46:09.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.379+0000 7f373ffff700 1 -- 172.21.15.77:0/2289147255 >> v1:172.21.15.103:6789/0 conn(0x7f3740160d20 legacy=0x7f37400adba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:09.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.379+0000 7f373ffff700 1 -- 172.21.15.77:0/2289147255 >> v1:172.21.15.77:6789/0 conn(0x7f3740161100 legacy=0x7f37400b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:09.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.379+0000 7f373ffff700 1 -- 172.21.15.77:0/2289147255 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37400aebb0 con 0x7f37400b17a0 2023-07-24T05:46:09.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.379+0000 7f373ffff700 1 --2- 172.21.15.77:0/2289147255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37400b17a0 0x7f374016be60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3738009d90 tx=0x7f373800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=485bf66ff9b1dd32 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:09.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.379+0000 7f373effd700 1 -- 172.21.15.77:0/2289147255 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373800e070 con 0x7f37400b17a0 2023-07-24T05:46:09.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.379+0000 7f373effd700 1 -- 172.21.15.77:0/2289147255 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373800bb20 con 0x7f37400b17a0 2023-07-24T05:46:09.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.379+0000 7f373effd700 1 -- 172.21.15.77:0/2289147255 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3738012430 con 0x7f37400b17a0 2023-07-24T05:46:09.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.383+0000 7f3744d51700 1 -- 172.21.15.77:0/2289147255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37400b17a0 msgr2=0x7f374016be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:09.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.383+0000 7f3744d51700 1 --2- 172.21.15.77:0/2289147255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37400b17a0 0x7f374016be60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3738009d90 tx=0x7f373800b330 comp rx=0 tx=0).stop 2023-07-24T05:46:09.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.383+0000 7f3744d51700 1 -- 172.21.15.77:0/2289147255 shutdown_connections 2023-07-24T05:46:09.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.383+0000 7f3744d51700 1 --2- 172.21.15.77:0/2289147255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37400b17a0 0x7f374016be60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:09.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.383+0000 7f3744d51700 1 -- 172.21.15.77:0/2289147255 >> 172.21.15.77:0/2289147255 conn(0x7f37400cacc0 msgr2=0x7f37400cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:09.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.383+0000 7f3744d51700 1 -- 172.21.15.77:0/2289147255 shutdown_connections 2023-07-24T05:46:09.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.383+0000 7f3744d51700 1 -- 172.21.15.77:0/2289147255 wait complete. 2023-07-24T05:46:09.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.383+0000 7f3744d51700 1 Processor -- start 2023-07-24T05:46:09.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.383+0000 7f3744d51700 1 -- start start 2023-07-24T05:46:09.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.387+0000 7f3744d51700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37400b17a0 0x7f3740161590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:09.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.387+0000 7f3744d51700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3740160d20 0x7f37400c2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:09.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.387+0000 7f3744d51700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3740161100 0x7f3740156050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:09.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.387+0000 7f3744d51700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3740162c10 con 0x7f3740160d20 2023-07-24T05:46:09.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.387+0000 7f3744d51700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3740161b70 con 0x7f37400b17a0 2023-07-24T05:46:09.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.387+0000 7f3744d51700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3740161e50 con 0x7f3740161100 2023-07-24T05:46:09.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.387+0000 7f3736ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3740160d20 0x7f37400c2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:09.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.387+0000 7f3736ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3740160d20 0x7f37400c2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33110/0 (socket says 172.21.15.77:33110) 2023-07-24T05:46:09.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.387+0000 7f3736ffd700 1 -- 172.21.15.77:0/3409509066 learned_addr learned my addr 172.21.15.77:0/3409509066 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:09.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.387+0000 7f373f7fe700 1 --2- 172.21.15.77:0/3409509066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37400b17a0 0x7f3740161590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:09.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.387+0000 7f373ffff700 1 --2- 172.21.15.77:0/3409509066 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3740161100 0x7f3740156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:09.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.387+0000 7f3736ffd700 1 -- 172.21.15.77:0/3409509066 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3740161100 msgr2=0x7f3740156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:09.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.387+0000 7f3736ffd700 1 --2- 172.21.15.77:0/3409509066 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3740161100 0x7f3740156050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:09.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.387+0000 7f3736ffd700 1 -- 172.21.15.77:0/3409509066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37400b17a0 msgr2=0x7f3740161590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:09.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.387+0000 7f3736ffd700 1 --2- 172.21.15.77:0/3409509066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37400b17a0 0x7f3740161590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:09.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.387+0000 7f3736ffd700 1 -- 172.21.15.77:0/3409509066 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3738009a70 con 0x7f3740160d20 2023-07-24T05:46:09.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.387+0000 7f3736ffd700 1 --2- 172.21.15.77:0/3409509066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3740160d20 0x7f37400c2440 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f372800c700 tx=0x7f372800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:09.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.387+0000 7f373cff9700 1 -- 172.21.15.77:0/3409509066 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3728005d90 con 0x7f3740160d20 2023-07-24T05:46:09.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.387+0000 7f373cff9700 1 -- 172.21.15.77:0/3409509066 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37280070d0 con 0x7f3740160d20 2023-07-24T05:46:09.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.387+0000 7f3744d51700 1 -- 172.21.15.77:0/3409509066 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3740162130 con 0x7f3740160d20 2023-07-24T05:46:09.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.387+0000 7f373cff9700 1 -- 172.21.15.77:0/3409509066 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3728007480 con 0x7f3740160d20 2023-07-24T05:46:09.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.387+0000 7f3744d51700 1 -- 172.21.15.77:0/3409509066 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3740156590 con 0x7f3740160d20 2023-07-24T05:46:09.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.391+0000 7f3744d51700 1 -- 172.21.15.77:0/3409509066 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3740156750 con 0x7f3740160d20 2023-07-24T05:46:09.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.391+0000 7f373cff9700 1 -- 172.21.15.77:0/3409509066 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f37280075e0 con 0x7f3740160d20 2023-07-24T05:46:09.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.395+0000 7f373cff9700 1 --2- 172.21.15.77:0/3409509066 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3720066320 0x7f37200687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:09.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.395+0000 7f373cff9700 1 -- 172.21.15.77:0/3409509066 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3728083550 con 0x7f3740160d20 2023-07-24T05:46:09.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.395+0000 7f373f7fe700 1 --2- 172.21.15.77:0/3409509066 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3720066320 0x7f37200687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:09.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.395+0000 7f373f7fe700 1 --2- 172.21.15.77:0/3409509066 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3720066320 0x7f37200687e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f37300011e0 tx=0x7f3730009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:09.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.399+0000 7f373cff9700 1 -- 172.21.15.77:0/3409509066 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3728050640 con 0x7f3740160d20 2023-07-24T05:46:09.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.607+0000 7f3744d51700 1 -- 172.21.15.77:0/3409509066 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3740162650 con 0x7f3740160d20 2023-07-24T05:46:09.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.607+0000 7f373cff9700 1 -- 172.21.15.77:0/3409509066 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f3728053c60 con 0x7f3740160d20 2023-07-24T05:46:09.611 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-24T05:46:09.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.611+0000 7f3744d51700 1 -- 172.21.15.77:0/3409509066 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3720066320 msgr2=0x7f37200687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:09.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.611+0000 7f3744d51700 1 --2- 172.21.15.77:0/3409509066 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3720066320 0x7f37200687e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f37300011e0 tx=0x7f3730009040 comp rx=0 tx=0).stop 2023-07-24T05:46:09.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.611+0000 7f3744d51700 1 -- 172.21.15.77:0/3409509066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3740160d20 msgr2=0x7f37400c2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:09.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.611+0000 7f3744d51700 1 --2- 172.21.15.77:0/3409509066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3740160d20 0x7f37400c2440 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f372800c700 tx=0x7f372800ca10 comp rx=0 tx=0).stop 2023-07-24T05:46:09.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.611+0000 7f3744d51700 1 -- 172.21.15.77:0/3409509066 shutdown_connections 2023-07-24T05:46:09.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.611+0000 7f3744d51700 1 --2- 172.21.15.77:0/3409509066 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3720066320 0x7f37200687e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:09.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.611+0000 7f3744d51700 1 --2- 172.21.15.77:0/3409509066 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3740161100 0x7f3740156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:09.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.611+0000 7f3744d51700 1 --2- 172.21.15.77:0/3409509066 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3740160d20 0x7f37400c2440 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:09.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.611+0000 7f3744d51700 1 --2- 172.21.15.77:0/3409509066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f37400b17a0 0x7f3740161590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:09.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.611+0000 7f3744d51700 1 -- 172.21.15.77:0/3409509066 >> 172.21.15.77:0/3409509066 conn(0x7f37400cacc0 msgr2=0x7f37400af600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:09.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.611+0000 7f3744d51700 1 -- 172.21.15.77:0/3409509066 shutdown_connections 2023-07-24T05:46:09.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:09.611+0000 7f3744d51700 1 -- 172.21.15.77:0/3409509066 wait complete. 2023-07-24T05:46:09.637 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-07-24T05:46:09.637 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-24T05:46:09.638 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi077.front.sepia.ceph.com 2023-07-24T05:46:09.638 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-07-24T05:46:09.638 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-07-24T05:46:09.638 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-07-24T05:46:09.639 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-24T05:46:09.639 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-24T05:46:09.639 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-07-24T05:46:09.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:09.640 DEBUG:teuthology.orchestra.run.smithi077:> ip addr 2023-07-24T05:46:09.654 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-24T05:46:09.654 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-24T05:46:09.655 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2023-07-24T05:46:09.655 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:46:09.655 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2023-07-24T05:46:09.655 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:46:09.655 INFO:teuthology.orchestra.run.smithi077.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-24T05:46:09.655 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d8 brd ff:ff:ff:ff:ff:ff 2023-07-24T05:46:09.655 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f0 2023-07-24T05:46:09.655 INFO:teuthology.orchestra.run.smithi077.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-24T05:46:09.656 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d9 brd ff:ff:ff:ff:ff:ff 2023-07-24T05:46:09.656 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f1 2023-07-24T05:46:09.656 INFO:teuthology.orchestra.run.smithi077.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-24T05:46:09.656 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d2 brd ff:ff:ff:ff:ff:ff 2023-07-24T05:46:09.656 INFO:teuthology.orchestra.run.smithi077.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-24T05:46:09.656 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d3 brd ff:ff:ff:ff:ff:ff 2023-07-24T05:46:09.656 INFO:teuthology.orchestra.run.smithi077.stdout: inet 172.21.15.77/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-24T05:46:09.657 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft 42400sec preferred_lft 42400sec 2023-07-24T05:46:09.657 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::ec4:7aff:fe8f:d3d3/64 scope link 2023-07-24T05:46:09.657 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:46:09.657 INFO:teuthology.orchestra.run.smithi077.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-24T05:46:09.657 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 02:42:ca:23:89:0f brd ff:ff:ff:ff:ff:ff 2023-07-24T05:46:09.657 INFO:teuthology.orchestra.run.smithi077.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-24T05:46:09.657 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:46:09.658 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-24T05:46:09.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:09.659 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-07-24T05:46:09.659 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-07-24T05:46:09.660 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link add name ceph-brx type bridge 2023-07-24T05:46:09.660 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip addr flush dev ceph-brx 2023-07-24T05:46:09.660 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set ceph-brx up 2023-07-24T05:46:09.660 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-24T05:46:09.661 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-07-24T05:46:09.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:09.808 DEBUG:teuthology.orchestra.run.smithi077:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-24T05:46:09.843 INFO:teuthology.orchestra.run.smithi077.stdout:1 2023-07-24T05:46:09.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:09.847 DEBUG:teuthology.orchestra.run.smithi077:> route 2023-07-24T05:46:09.933 INFO:teuthology.orchestra.run.smithi077.stdout:Kernel IP routing table 2023-07-24T05:46:09.933 INFO:teuthology.orchestra.run.smithi077.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-24T05:46:09.933 INFO:teuthology.orchestra.run.smithi077.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-24T05:46:09.934 INFO:teuthology.orchestra.run.smithi077.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-24T05:46:09.934 INFO:teuthology.orchestra.run.smithi077.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-24T05:46:09.934 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-07-24T05:46:09.934 INFO:teuthology.orchestra.run.smithi077.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-24T05:46:09.934 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-24T05:46:09.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:09.935 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-07-24T05:46:09.936 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-07-24T05:46:09.936 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-24T05:46:09.936 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-24T05:46:09.936 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-24T05:46:09.937 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-07-24T05:46:10.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:10.074 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2023-07-24T05:46:10.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:10.090 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list-id 2023-07-24T05:46:10.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:10.150 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-07-24T05:46:10.151 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-07-24T05:46:10.151 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-07-24T05:46:10.151 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-07-24T05:46:10.151 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-07-24T05:46:10.269 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-07-24T05:46:10.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:10.270 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-07-24T05:46:10.270 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-07-24T05:46:10.271 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-07-24T05:46:10.271 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-24T05:46:10.271 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-07-24T05:46:10.271 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-07-24T05:46:10.272 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-07-24T05:46:10.272 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-07-24T05:46:10.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:10.442 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-07-24T05:46:10.442 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-07-24T05:46:10.443 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set brx.0 up 2023-07-24T05:46:10.443 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set dev brx.0 master ceph-brx 2023-07-24T05:46:10.443 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-07-24T05:46:10.514 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-07-24T05:46:10.515 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-24T05:46:10.515 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-07-24T05:46:10.528 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-07-24T05:46:10.528 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-24T05:46:10.529 DEBUG:teuthology.orchestra.run.smithi077:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-07-24T05:46:10.590 DEBUG:teuthology.orchestra.run.smithi077:> sudo modprobe fuse 2023-07-24T05:46:10.678 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-24T05:46:10.679 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-24T05:46:10.754 INFO:teuthology.orchestra.run.smithi077.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-24T05:46:10.756 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-24T05:46:10.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:10.757 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-07-24T05:46:10.819 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-24T05:46:10.819 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-07-24T05:46:10.871 DEBUG:teuthology.orchestra.run.smithi077:> sudo modprobe fuse 2023-07-24T05:46:10.905 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-24T05:46:10.906 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-24T05:46:10.982 INFO:teuthology.orchestra.run.smithi077.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-24T05:46:10.986 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-24T05:46:10.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:10.987 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-07-24T05:46:11.009 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi077.stderr:2023-07-24T05:46:11.007+0000 7f9c51771640 -1 init, newargv = 0x55ca74dae8f0 newargc=15 2023-07-24T05:46:11.009 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi077.stderr:ceph-fuse[39892]: starting ceph client 2023-07-24T05:46:11.024 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi077.stderr:ceph-fuse[39892]: starting fuse 2023-07-24T05:46:12.123 DEBUG:teuthology.orchestra.run.smithi077:> sudo modprobe fuse 2023-07-24T05:46:12.151 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-24T05:46:12.151 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-24T05:46:12.218 INFO:teuthology.orchestra.run.smithi077.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-24T05:46:12.220 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-24T05:46:12.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:12.221 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-07-24T05:46:12.279 INFO:teuthology.orchestra.run.smithi077.stdout:49 2023-07-24T05:46:12.280 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-07-24T05:46:12.280 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-24T05:46:12.280 DEBUG:teuthology.orchestra.run.smithi077:> import glob 2023-07-24T05:46:12.281 DEBUG:teuthology.orchestra.run.smithi077:> import re 2023-07-24T05:46:12.281 DEBUG:teuthology.orchestra.run.smithi077:> import os 2023-07-24T05:46:12.281 DEBUG:teuthology.orchestra.run.smithi077:> import subprocess 2023-07-24T05:46:12.281 DEBUG:teuthology.orchestra.run.smithi077:> 2023-07-24T05:46:12.282 DEBUG:teuthology.orchestra.run.smithi077:> def _find_admin_socket(client_name): 2023-07-24T05:46:12.282 DEBUG:teuthology.orchestra.run.smithi077:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-07-24T05:46:12.282 DEBUG:teuthology.orchestra.run.smithi077:> files = glob.glob(asok_path) 2023-07-24T05:46:12.282 DEBUG:teuthology.orchestra.run.smithi077:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-07-24T05:46:12.283 DEBUG:teuthology.orchestra.run.smithi077:> 2023-07-24T05:46:12.283 DEBUG:teuthology.orchestra.run.smithi077:> # Given a non-glob path, it better be there 2023-07-24T05:46:12.283 DEBUG:teuthology.orchestra.run.smithi077:> if "*" not in asok_path: 2023-07-24T05:46:12.284 DEBUG:teuthology.orchestra.run.smithi077:> assert(len(files) == 1) 2023-07-24T05:46:12.284 DEBUG:teuthology.orchestra.run.smithi077:> return files[0] 2023-07-24T05:46:12.284 DEBUG:teuthology.orchestra.run.smithi077:> 2023-07-24T05:46:12.284 DEBUG:teuthology.orchestra.run.smithi077:> for f in files: 2023-07-24T05:46:12.285 DEBUG:teuthology.orchestra.run.smithi077:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-24T05:46:12.285 DEBUG:teuthology.orchestra.run.smithi077:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-24T05:46:12.285 DEBUG:teuthology.orchestra.run.smithi077:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-24T05:46:12.286 DEBUG:teuthology.orchestra.run.smithi077:> contents = proc_f.read() 2023-07-24T05:46:12.286 DEBUG:teuthology.orchestra.run.smithi077:> if mountpoint in contents: 2023-07-24T05:46:12.286 DEBUG:teuthology.orchestra.run.smithi077:> return f 2023-07-24T05:46:12.286 DEBUG:teuthology.orchestra.run.smithi077:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-24T05:46:12.287 DEBUG:teuthology.orchestra.run.smithi077:> 2023-07-24T05:46:12.287 DEBUG:teuthology.orchestra.run.smithi077:> print(_find_admin_socket("client.admin")) 2023-07-24T05:46:12.287 DEBUG:teuthology.orchestra.run.smithi077:> ' 2023-07-24T05:46:12.438 INFO:teuthology.orchestra.run.smithi077.stdout:/var/run/ceph/ceph-client.admin.39892.asok 2023-07-24T05:46:12.619 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.39892.asok 2023-07-24T05:46:12.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:12.620 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.39892.asok status 2023-07-24T05:46:12.814 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-07-24T05:46:12.814 INFO:teuthology.orchestra.run.smithi077.stdout: "metadata": { 2023-07-24T05:46:12.814 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_sha1": "e2c50893bf78471cc8ee960317cc10390300dfd5", 2023-07-24T05:46:12.814 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_version": "ceph version 18.0.0-5042-ge2c50893 (e2c50893bf78471cc8ee960317cc10390300dfd5) reef (dev)", 2023-07-24T05:46:12.814 INFO:teuthology.orchestra.run.smithi077.stdout: "entity_id": "admin", 2023-07-24T05:46:12.814 INFO:teuthology.orchestra.run.smithi077.stdout: "hostname": "smithi077", 2023-07-24T05:46:12.815 INFO:teuthology.orchestra.run.smithi077.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-07-24T05:46:12.815 INFO:teuthology.orchestra.run.smithi077.stdout: "pid": "39892", 2023-07-24T05:46:12.815 INFO:teuthology.orchestra.run.smithi077.stdout: "root": "/" 2023-07-24T05:46:12.815 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-07-24T05:46:12.815 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_count": 0, 2023-07-24T05:46:12.815 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_pinned_count": 0, 2023-07-24T05:46:12.815 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 4452, 2023-07-24T05:46:12.816 INFO:teuthology.orchestra.run.smithi077.stdout: "inst": { 2023-07-24T05:46:12.816 INFO:teuthology.orchestra.run.smithi077.stdout: "name": { 2023-07-24T05:46:12.816 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "client", 2023-07-24T05:46:12.816 INFO:teuthology.orchestra.run.smithi077.stdout: "num": 4452 2023-07-24T05:46:12.816 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-07-24T05:46:12.816 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2023-07-24T05:46:12.816 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2023-07-24T05:46:12.816 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.1:0", 2023-07-24T05:46:12.817 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1461758334 2023-07-24T05:46:12.817 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-07-24T05:46:12.817 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-07-24T05:46:12.817 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2023-07-24T05:46:12.817 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2023-07-24T05:46:12.817 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.1:0", 2023-07-24T05:46:12.817 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1461758334 2023-07-24T05:46:12.817 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-07-24T05:46:12.818 INFO:teuthology.orchestra.run.smithi077.stdout: "inst_str": "client.4452 192.168.0.1:0/1461758334", 2023-07-24T05:46:12.818 INFO:teuthology.orchestra.run.smithi077.stdout: "addr_str": "192.168.0.1:0/1461758334", 2023-07-24T05:46:12.818 INFO:teuthology.orchestra.run.smithi077.stdout: "inode_count": 1, 2023-07-24T05:46:12.818 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_epoch": 7, 2023-07-24T05:46:12.818 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch": 25, 2023-07-24T05:46:12.818 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch_barrier": 0, 2023-07-24T05:46:12.818 INFO:teuthology.orchestra.run.smithi077.stdout: "blocklisted": false, 2023-07-24T05:46:12.818 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs" 2023-07-24T05:46:12.819 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-07-24T05:46:12.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:12.829 DEBUG:teuthology.orchestra.run.smithi077:> stat --file-system '--printf=%T 2023-07-24T05:46:12.829 DEBUG:teuthology.orchestra.run.smithi077:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-07-24T05:46:12.843 INFO:teuthology.orchestra.run.smithi077.stdout:fuseblk 2023-07-24T05:46:12.844 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-07-24T05:46:12.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:12.844 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-07-24T05:46:12.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:12.928 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-07-24T05:46:13.042 INFO:teuthology.orchestra.run.smithi077.stdout:# file: . 2023-07-24T05:46:13.042 INFO:teuthology.orchestra.run.smithi077.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-07-24T05:46:13.042 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:46:13.043 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-07-24T05:46:13.044 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-24T05:46:13.060 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-24T05:46:13.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.271+0000 7fc775065700 1 Processor -- start 2023-07-24T05:46:13.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.271+0000 7fc775065700 1 -- start start 2023-07-24T05:46:13.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.275+0000 7fc775065700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc77006cac0 0x7fc77006cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:13.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.275+0000 7fc775065700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc77015e950 0x7fc77006a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:13.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.275+0000 7fc775065700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc77006bb60 con 0x7fc77015e4c0 2023-07-24T05:46:13.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.275+0000 7fc775065700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc77015f380 con 0x7fc77006cac0 2023-07-24T05:46:13.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.275+0000 7fc775065700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7700cb950 con 0x7fc77015e950 2023-07-24T05:46:13.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.275+0000 7fc76e59c700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fc77015e4c0 0x7fc770069b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:51956/0 (socket says 172.21.15.77:51956) 2023-07-24T05:46:13.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.275+0000 7fc76e59c700 1 -- 172.21.15.77:0/1926986747 learned_addr learned my addr 172.21.15.77:0/1926986747 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:13.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.275+0000 7fc76ed9d700 1 --2- 172.21.15.77:0/1926986747 >> v2:172.21.15.103:3300/0 conn(0x7fc77006cac0 0x7fc77006cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:13.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.275+0000 7fc76f59e700 1 --2- 172.21.15.77:0/1926986747 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc77015e950 0x7fc77006a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:13.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.275+0000 7fc76dd9b700 1 -- 172.21.15.77:0/1926986747 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 666242382 0 0) 0x7fc77006bb60 con 0x7fc77015e4c0 2023-07-24T05:46:13.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.275+0000 7fc76dd9b700 1 -- 172.21.15.77:0/1926986747 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7580035d0 con 0x7fc77015e4c0 2023-07-24T05:46:13.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.275+0000 7fc76dd9b700 1 -- 172.21.15.77:0/1926986747 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2166351327 0 0) 0x7fc7580035d0 con 0x7fc77015e4c0 2023-07-24T05:46:13.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.275+0000 7fc76dd9b700 1 -- 172.21.15.77:0/1926986747 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc77015e950 msgr2=0x7fc77006a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:13.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.275+0000 7fc76dd9b700 1 --2- 172.21.15.77:0/1926986747 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc77015e950 0x7fc77006a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:13.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.275+0000 7fc76dd9b700 1 -- 172.21.15.77:0/1926986747 >> v2:172.21.15.103:3300/0 conn(0x7fc77006cac0 msgr2=0x7fc77006cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:13.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.275+0000 7fc76dd9b700 1 --2- 172.21.15.77:0/1926986747 >> v2:172.21.15.103:3300/0 conn(0x7fc77006cac0 0x7fc77006cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:13.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.275+0000 7fc76dd9b700 1 -- 172.21.15.77:0/1926986747 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc77006d3e0 con 0x7fc77015e4c0 2023-07-24T05:46:13.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.275+0000 7fc76dd9b700 1 -- 172.21.15.77:0/1926986747 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4109865209 0 0) 0x7fc764001670 con 0x7fc77015e4c0 2023-07-24T05:46:13.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.275+0000 7fc76dd9b700 1 -- 172.21.15.77:0/1926986747 >> v1:172.21.15.77:6789/0 conn(0x7fc77015e4c0 legacy=0x7fc770069b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:13.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.275+0000 7fc76dd9b700 1 --2- 172.21.15.77:0/1926986747 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc77015e950 0x7fc758003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:13.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.275+0000 7fc76dd9b700 1 --2- 172.21.15.77:0/1926986747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc758003ff0 0x7fc758004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:13.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.275+0000 7fc76dd9b700 1 --2- 172.21.15.77:0/1926986747 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc758004db0 0x7fc758005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:13.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.275+0000 7fc76dd9b700 1 -- 172.21.15.77:0/1926986747 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77015f380 con 0x7fc758003ff0 2023-07-24T05:46:13.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.275+0000 7fc76dd9b700 1 -- 172.21.15.77:0/1926986747 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7700cb950 con 0x7fc758004db0 2023-07-24T05:46:13.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.275+0000 7fc76dd9b700 1 -- 172.21.15.77:0/1926986747 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc75800ba30 con 0x7fc77015e950 2023-07-24T05:46:13.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.275+0000 7fc76e59c700 1 --2- 172.21.15.77:0/1926986747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc758003ff0 0x7fc758004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:13.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.279+0000 7fc76ed9d700 1 --2- 172.21.15.77:0/1926986747 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc77015e950 0x7fc758003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:13.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.279+0000 7fc76f59e700 1 --2- 172.21.15.77:0/1926986747 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc758004db0 0x7fc758005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:13.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.279+0000 7fc76e59c700 1 -- 172.21.15.77:0/1926986747 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc77015e950 msgr2=0x7fc758003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:13.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.279+0000 7fc76e59c700 1 --2- 172.21.15.77:0/1926986747 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc77015e950 0x7fc758003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:13.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.279+0000 7fc76e59c700 1 -- 172.21.15.77:0/1926986747 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc758004db0 msgr2=0x7fc758005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:13.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.279+0000 7fc76e59c700 1 --2- 172.21.15.77:0/1926986747 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc758004db0 0x7fc758005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:13.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.279+0000 7fc76e59c700 1 -- 172.21.15.77:0/1926986747 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7580035d0 con 0x7fc758003ff0 2023-07-24T05:46:13.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.279+0000 7fc76ed9d700 1 --2- 172.21.15.77:0/1926986747 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc77015e950 0x7fc758003a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:46:13.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.279+0000 7fc76e59c700 1 --2- 172.21.15.77:0/1926986747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc758003ff0 0x7fc758004870 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc764007cd0 tx=0x7fc7580058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebd85a01e29ccea2 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:13.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.279+0000 7fc76dd9b700 1 -- 172.21.15.77:0/1926986747 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76400cd10 con 0x7fc758003ff0 2023-07-24T05:46:13.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.279+0000 7fc76dd9b700 1 -- 172.21.15.77:0/1926986747 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc76400ce70 con 0x7fc758003ff0 2023-07-24T05:46:13.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.279+0000 7fc76dd9b700 1 -- 172.21.15.77:0/1926986747 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc764005ba0 con 0x7fc758003ff0 2023-07-24T05:46:13.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.279+0000 7fc775065700 1 -- 172.21.15.77:0/1926986747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc758003ff0 msgr2=0x7fc758004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:13.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.279+0000 7fc775065700 1 --2- 172.21.15.77:0/1926986747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc758003ff0 0x7fc758004870 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc764007cd0 tx=0x7fc7580058a0 comp rx=0 tx=0).stop 2023-07-24T05:46:13.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.279+0000 7fc76f59e700 1 -- 172.21.15.77:0/1926986747 reap_dead start 2023-07-24T05:46:13.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.279+0000 7fc775065700 1 -- 172.21.15.77:0/1926986747 shutdown_connections 2023-07-24T05:46:13.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.279+0000 7fc775065700 1 -- 172.21.15.77:0/1926986747 >> 172.21.15.77:0/1926986747 conn(0x7fc7700ce410 msgr2=0x7fc7700ce7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:13.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.279+0000 7fc775065700 1 -- 172.21.15.77:0/1926986747 shutdown_connections 2023-07-24T05:46:13.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.279+0000 7fc775065700 1 -- 172.21.15.77:0/1926986747 wait complete. 2023-07-24T05:46:13.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.283+0000 7fc775065700 1 Processor -- start 2023-07-24T05:46:13.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.283+0000 7fc775065700 1 -- start start 2023-07-24T05:46:13.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.283+0000 7fc775065700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc758003ff0 0x7fc770155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:13.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.283+0000 7fc775065700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7700cdac0 0x7fc7700ae150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:13.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.283+0000 7fc775065700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7700cdf40 0x7fc7700ae690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:13.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.283+0000 7fc775065700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc770156a70 con 0x7fc7700cdf40 2023-07-24T05:46:13.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.283+0000 7fc775065700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc770155df0 con 0x7fc7700cdac0 2023-07-24T05:46:13.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.283+0000 7fc775065700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7701560d0 con 0x7fc758003ff0 2023-07-24T05:46:13.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.283+0000 7fc76f59e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7700cdf40 0x7fc7700ae690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:13.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.283+0000 7fc76f59e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7700cdf40 0x7fc7700ae690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53210/0 (socket says 172.21.15.77:53210) 2023-07-24T05:46:13.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.283+0000 7fc76f59e700 1 -- 172.21.15.77:0/3362267934 learned_addr learned my addr 172.21.15.77:0/3362267934 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:13.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.283+0000 7fc76e59c700 1 --2- 172.21.15.77:0/3362267934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7700cdac0 0x7fc7700ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:13.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.283+0000 7fc76f59e700 1 -- 172.21.15.77:0/3362267934 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc758003ff0 msgr2=0x7fc770155610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:13.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.283+0000 7fc76ed9d700 1 --2- 172.21.15.77:0/3362267934 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc758003ff0 0x7fc770155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:13.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.283+0000 7fc76f59e700 1 --2- 172.21.15.77:0/3362267934 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc758003ff0 0x7fc770155610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:13.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.283+0000 7fc76f59e700 1 -- 172.21.15.77:0/3362267934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7700cdac0 msgr2=0x7fc7700ae150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:13.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.283+0000 7fc76f59e700 1 --2- 172.21.15.77:0/3362267934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7700cdac0 0x7fc7700ae150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:13.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.283+0000 7fc76f59e700 1 -- 172.21.15.77:0/3362267934 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7701563b0 con 0x7fc7700cdf40 2023-07-24T05:46:13.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.283+0000 7fc76e59c700 1 --2- 172.21.15.77:0/3362267934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7700cdac0 0x7fc7700ae150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:46:13.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.283+0000 7fc76ed9d700 1 --2- 172.21.15.77:0/3362267934 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc758003ff0 0x7fc770155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:46:13.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.287+0000 7fc76f59e700 1 --2- 172.21.15.77:0/3362267934 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7700cdf40 0x7fc7700ae690 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc7700cba90 tx=0x7fc7680114b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:13.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.287+0000 7fc7577fe700 1 -- 172.21.15.77:0/3362267934 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76800e070 con 0x7fc7700cdf40 2023-07-24T05:46:13.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.287+0000 7fc7577fe700 1 -- 172.21.15.77:0/3362267934 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc768003c50 con 0x7fc7700cdf40 2023-07-24T05:46:13.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.287+0000 7fc775065700 1 -- 172.21.15.77:0/3362267934 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc770156690 con 0x7fc7700cdf40 2023-07-24T05:46:13.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.287+0000 7fc7577fe700 1 -- 172.21.15.77:0/3362267934 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc768003e00 con 0x7fc7700cdf40 2023-07-24T05:46:13.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.287+0000 7fc775065700 1 -- 172.21.15.77:0/3362267934 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7700cbfc0 con 0x7fc7700cdf40 2023-07-24T05:46:13.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.287+0000 7fc775065700 1 -- 172.21.15.77:0/3362267934 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc770156bb0 con 0x7fc7700cdf40 2023-07-24T05:46:13.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.291+0000 7fc7577fe700 1 -- 172.21.15.77:0/3362267934 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc768011a10 con 0x7fc7700cdf40 2023-07-24T05:46:13.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.291+0000 7fc7577fe700 1 --2- 172.21.15.77:0/3362267934 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc75c066340 0x7fc75c068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:13.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.291+0000 7fc7577fe700 1 -- 172.21.15.77:0/3362267934 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc768084360 con 0x7fc7700cdf40 2023-07-24T05:46:13.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.291+0000 7fc76ed9d700 1 --2- 172.21.15.77:0/3362267934 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc75c066340 0x7fc75c068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:13.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.291+0000 7fc76ed9d700 1 --2- 172.21.15.77:0/3362267934 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc75c066340 0x7fc75c068800 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc7700ceeb0 tx=0x7fc760008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:13.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.299+0000 7fc7577fe700 1 -- 172.21.15.77:0/3362267934 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc7680514d0 con 0x7fc7700cdf40 2023-07-24T05:46:13.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.471+0000 7fc775065700 1 -- 172.21.15.77:0/3362267934 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc77004df10 con 0x7fc7700cdf40 2023-07-24T05:46:13.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.475+0000 7fc7577fe700 1 -- 172.21.15.77:0/3362267934 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20108 (secure 0 0 0) 0x7fc768054af0 con 0x7fc7700cdf40 2023-07-24T05:46:13.478 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:46:13.479 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":25,"fsid":"5aed5f7b-fb55-4d95-9c02-c6adbb1677b4","created":"2023-07-24T05:45:39.639731+0000","modified":"2023-07-24T05:46:05.445306+0000","last_up_change":"2023-07-24T05:45:52.319670+0000","last_in_change":"2023-07-24T05:45:43.643277+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-24T05:45:52.610430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-24T05:45:52.773787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-24T05:45:58.121732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-24T05:45:59.368726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-24T05:46:03.032057+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ffa0d496-461a-4053-b764-0627d969521b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6812","nonce":825987196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6817","nonce":825987196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6831","nonce":825987196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6824","nonce":825987196}]},"public_addr":"172.21.15.77:6812/825987196","cluster_addr":"172.21.15.77:6817/825987196","heartbeat_back_addr":"172.21.15.77:6831/825987196","heartbeat_front_addr":"172.21.15.77:6824/825987196","state":["exists","up"]},{"osd":1,"uuid":"9f595e5e-5c43-49bc-8ce4-ee70575c90da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6801","nonce":4133026815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6803","nonce":4133026815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6807","nonce":4133026815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6805","nonce":4133026815}]},"public_addr":"172.21.15.77:6801/4133026815","cluster_addr":"172.21.15.77:6803/4133026815","heartbeat_back_addr":"172.21.15.77:6807/4133026815","heartbeat_front_addr":"172.21.15.77:6805/4133026815","state":["exists","up"]},{"osd":2,"uuid":"2ac177aa-4d7d-4262-bd54-d2b9f29f4c3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6811","nonce":2394142159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6819","nonce":2394142159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6830","nonce":2394142159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6825","nonce":2394142159}]},"public_addr":"172.21.15.77:6811/2394142159","cluster_addr":"172.21.15.77:6819/2394142159","heartbeat_back_addr":"172.21.15.77:6830/2394142159","heartbeat_front_addr":"172.21.15.77:6825/2394142159","state":["exists","up"]},{"osd":3,"uuid":"17d7a251-19e8-484c-8172-a578ab3da153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6813","nonce":1492113982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6818","nonce":1492113982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6829","nonce":1492113982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6823","nonce":1492113982}]},"public_addr":"172.21.15.77:6813/1492113982","cluster_addr":"172.21.15.77:6818/1492113982","heartbeat_back_addr":"172.21.15.77:6829/1492113982","heartbeat_front_addr":"172.21.15.77:6823/1492113982","state":["exists","up"]},{"osd":4,"uuid":"bf63ca05-f06d-4e0f-ac44-2a416c70b919","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6825","nonce":1080481057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6827","nonce":1080481057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6831","nonce":1080481057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6829","nonce":1080481057}]},"public_addr":"172.21.15.103:6825/1080481057","cluster_addr":"172.21.15.103:6827/1080481057","heartbeat_back_addr":"172.21.15.103:6831/1080481057","heartbeat_front_addr":"172.21.15.103:6829/1080481057","state":["exists","up"]},{"osd":5,"uuid":"65a11a35-9e9f-4b3c-9fe3-b658d62b9318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6811","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6813","nonce":2756677504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6818","nonce":2756677504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6823","nonce":2756677504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6821","nonce":2756677504}]},"public_addr":"172.21.15.103:6813/2756677504","cluster_addr":"172.21.15.103:6818/2756677504","heartbeat_back_addr":"172.21.15.103:6823/2756677504","heartbeat_front_addr":"172.21.15.103:6821/2756677504","state":["exists","up"]},{"osd":6,"uuid":"750c1f87-686c-40b4-94a1-1a299dc78f3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6809","nonce":568977764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6812","nonce":568977764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6819","nonce":568977764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6815","nonce":568977764}]},"public_addr":"172.21.15.103:6809/568977764","cluster_addr":"172.21.15.103:6812/568977764","heartbeat_back_addr":"172.21.15.103:6819/568977764","heartbeat_front_addr":"172.21.15.103:6815/568977764","state":["exists","up"]},{"osd":7,"uuid":"d5fe4fb6-2e09-4158-885b-403803c85822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6801","nonce":1074557176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6803","nonce":1074557176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6807","nonce":1074557176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6805","nonce":1074557176}]},"public_addr":"172.21.15.103:6801/1074557176","cluster_addr":"172.21.15.103:6803/1074557176","heartbeat_back_addr":"172.21.15.103:6807/1074557176","heartbeat_front_addr":"172.21.15.103:6805/1074557176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.631032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.154109+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.398587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.679089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.311218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.353726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.314372+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.126212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-24T05:46:13.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.475+0000 7fc775065700 1 -- 172.21.15.77:0/3362267934 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc75c066340 msgr2=0x7fc75c068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:13.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.475+0000 7fc775065700 1 --2- 172.21.15.77:0/3362267934 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc75c066340 0x7fc75c068800 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc7700ceeb0 tx=0x7fc760008040 comp rx=0 tx=0).stop 2023-07-24T05:46:13.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.475+0000 7fc775065700 1 -- 172.21.15.77:0/3362267934 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7700cdf40 msgr2=0x7fc7700ae690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:13.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.475+0000 7fc775065700 1 --2- 172.21.15.77:0/3362267934 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7700cdf40 0x7fc7700ae690 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc7700cba90 tx=0x7fc7680114b0 comp rx=0 tx=0).stop 2023-07-24T05:46:13.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.475+0000 7fc775065700 1 -- 172.21.15.77:0/3362267934 shutdown_connections 2023-07-24T05:46:13.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.475+0000 7fc775065700 1 --2- 172.21.15.77:0/3362267934 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc7700cdf40 0x7fc7700ae690 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:13.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.475+0000 7fc775065700 1 --2- 172.21.15.77:0/3362267934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc7700cdac0 0x7fc7700ae150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:13.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.475+0000 7fc775065700 1 --2- 172.21.15.77:0/3362267934 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc75c066340 0x7fc75c068800 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:13.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.475+0000 7fc775065700 1 --2- 172.21.15.77:0/3362267934 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc758003ff0 0x7fc770155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:13.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.475+0000 7fc775065700 1 -- 172.21.15.77:0/3362267934 >> 172.21.15.77:0/3362267934 conn(0x7fc7700ce410 msgr2=0x7fc7700713a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:13.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.479+0000 7fc775065700 1 -- 172.21.15.77:0/3362267934 shutdown_connections 2023-07-24T05:46:13.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.479+0000 7fc775065700 1 -- 172.21.15.77:0/3362267934 wait complete. 2023-07-24T05:46:13.503 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-24T05:45:52.610430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-24T05:45:52.773787+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-24T05:45:58.121732+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-24T05:45:59.368726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-24T05:46:03.032057+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-24T05:46:13.504 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-24T05:46:13.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.682+0000 7f5f0d4e2700 1 Processor -- start 2023-07-24T05:46:13.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.682+0000 7f5f0d4e2700 1 -- start start 2023-07-24T05:46:13.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.682+0000 7f5f0d4e2700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5f0815c9a0 0x7f5f0806d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:13.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.682+0000 7f5f0d4e2700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f0806ac30 con 0x7f5f080cf5c0 2023-07-24T05:46:13.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.682+0000 7f5f0d4e2700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f0806af10 con 0x7f5f0806bb60 2023-07-24T05:46:13.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.682+0000 7f5f0d4e2700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f080cf170 con 0x7f5f0815c9a0 2023-07-24T05:46:13.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.682+0000 7f5f07fff700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5f0815c9a0 0x7f5f0806d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:13.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.686+0000 7f5f0cce1700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f5f080cf5c0 0x7f5f080cf9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:51962/0 (socket says 172.21.15.77:51962) 2023-07-24T05:46:13.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.686+0000 7f5f0cce1700 1 -- 172.21.15.77:0/882042728 learned_addr learned my addr 172.21.15.77:0/882042728 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:13.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.686+0000 7f5f07fff700 1 -- 172.21.15.77:0/882042728 >> v1:172.21.15.103:6789/0 conn(0x7f5f0806bb60 legacy=0x7f5f080d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:13.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.686+0000 7f5f07fff700 1 -- 172.21.15.77:0/882042728 >> v1:172.21.15.77:6789/0 conn(0x7f5f080cf5c0 legacy=0x7f5f080cf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:13.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.686+0000 7f5f07fff700 1 -- 172.21.15.77:0/882042728 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0806b1f0 con 0x7f5f0815c9a0 2023-07-24T05:46:13.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.686+0000 7f5f07fff700 1 --2- 172.21.15.77:0/882042728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f0815c9a0 0x7f5f0806d2d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8009850 tx=0x7f5ef8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c24662682f793e server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:13.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.686+0000 7f5f06ffd700 1 -- 172.21.15.77:0/882042728 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef8011830 con 0x7f5f0815c9a0 2023-07-24T05:46:13.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.686+0000 7f5f06ffd700 1 -- 172.21.15.77:0/882042728 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef8011990 con 0x7f5f0815c9a0 2023-07-24T05:46:13.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.686+0000 7f5f06ffd700 1 -- 172.21.15.77:0/882042728 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef8011d20 con 0x7f5f0815c9a0 2023-07-24T05:46:13.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.686+0000 7f5f0d4e2700 1 -- 172.21.15.77:0/882042728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f0815c9a0 msgr2=0x7f5f0806d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:13.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.686+0000 7f5f0d4e2700 1 --2- 172.21.15.77:0/882042728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f0815c9a0 0x7f5f0806d2d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8009850 tx=0x7f5ef8009b60 comp rx=0 tx=0).stop 2023-07-24T05:46:13.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.686+0000 7f5f0d4e2700 1 -- 172.21.15.77:0/882042728 shutdown_connections 2023-07-24T05:46:13.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.686+0000 7f5f0d4e2700 1 --2- 172.21.15.77:0/882042728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f0815c9a0 0x7f5f0806d2d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:13.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.686+0000 7f5f0d4e2700 1 -- 172.21.15.77:0/882042728 >> 172.21.15.77:0/882042728 conn(0x7f5f080b5610 msgr2=0x7f5f080b5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:13.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.686+0000 7f5f0d4e2700 1 -- 172.21.15.77:0/882042728 shutdown_connections 2023-07-24T05:46:13.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.686+0000 7f5f0d4e2700 1 -- 172.21.15.77:0/882042728 wait complete. 2023-07-24T05:46:13.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.690+0000 7f5f0d4e2700 1 Processor -- start 2023-07-24T05:46:13.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.690+0000 7f5f0d4e2700 1 -- start start 2023-07-24T05:46:13.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.690+0000 7f5f0d4e2700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5f0806bb60 0x7f5f08155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:13.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.690+0000 7f5f0d4e2700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f080cf5c0 0x7f5f081fa520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:13.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.690+0000 7f5f0d4e2700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f0815c9a0 0x7f5f080c7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:13.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.690+0000 7f5f0d4e2700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f080d24d0 con 0x7f5f0815c9a0 2023-07-24T05:46:13.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.690+0000 7f5f0d4e2700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f08155c60 con 0x7f5f080cf5c0 2023-07-24T05:46:13.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.690+0000 7f5f0d4e2700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f081faa60 con 0x7f5f0806bb60 2023-07-24T05:46:13.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.690+0000 7f5f0cce1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f0815c9a0 0x7f5f080c7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:13.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.690+0000 7f5f0cce1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f0815c9a0 0x7f5f080c7510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53234/0 (socket says 172.21.15.77:53234) 2023-07-24T05:46:13.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.690+0000 7f5f0cce1700 1 -- 172.21.15.77:0/2880356855 learned_addr learned my addr 172.21.15.77:0/2880356855 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:13.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.690+0000 7f5f07fff700 1 --2- 172.21.15.77:0/2880356855 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5f0806bb60 0x7f5f08155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:13.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.690+0000 7f5f077fe700 1 --2- 172.21.15.77:0/2880356855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f080cf5c0 0x7f5f081fa520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:13.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.690+0000 7f5f0cce1700 1 -- 172.21.15.77:0/2880356855 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5f0806bb60 msgr2=0x7f5f08155720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:13.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.690+0000 7f5f0cce1700 1 --2- 172.21.15.77:0/2880356855 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5f0806bb60 0x7f5f08155720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:13.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.690+0000 7f5f0cce1700 1 -- 172.21.15.77:0/2880356855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f080cf5c0 msgr2=0x7f5f081fa520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:13.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.690+0000 7f5f0cce1700 1 --2- 172.21.15.77:0/2880356855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f080cf5c0 0x7f5f081fa520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:13.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.690+0000 7f5f0cce1700 1 -- 172.21.15.77:0/2880356855 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef80094b0 con 0x7f5f0815c9a0 2023-07-24T05:46:13.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.694+0000 7f5f0cce1700 1 --2- 172.21.15.77:0/2880356855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f0815c9a0 0x7f5f080c7510 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5f0000cbc0 tx=0x7f5f0000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:13.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.694+0000 7f5f04ff9700 1 -- 172.21.15.77:0/2880356855 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f00007480 con 0x7f5f0815c9a0 2023-07-24T05:46:13.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.694+0000 7f5f04ff9700 1 -- 172.21.15.77:0/2880356855 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f000075e0 con 0x7f5f0815c9a0 2023-07-24T05:46:13.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.694+0000 7f5f0d4e2700 1 -- 172.21.15.77:0/2880356855 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f080c6700 con 0x7f5f0815c9a0 2023-07-24T05:46:13.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.694+0000 7f5f04ff9700 1 -- 172.21.15.77:0/2880356855 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f00007950 con 0x7f5f0815c9a0 2023-07-24T05:46:13.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.694+0000 7f5f0d4e2700 1 -- 172.21.15.77:0/2880356855 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f080c6cc0 con 0x7f5f0815c9a0 2023-07-24T05:46:13.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.694+0000 7f5f0d4e2700 1 -- 172.21.15.77:0/2880356855 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f08072490 con 0x7f5f0815c9a0 2023-07-24T05:46:13.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.698+0000 7f5f04ff9700 1 -- 172.21.15.77:0/2880356855 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5f00012400 con 0x7f5f0815c9a0 2023-07-24T05:46:13.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.698+0000 7f5f04ff9700 1 --2- 172.21.15.77:0/2880356855 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f5ef40662f0 0x7f5ef40687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:13.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.698+0000 7f5f04ff9700 1 -- 172.21.15.77:0/2880356855 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5f00083840 con 0x7f5f0815c9a0 2023-07-24T05:46:13.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.698+0000 7f5f07fff700 1 --2- 172.21.15.77:0/2880356855 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f5ef40662f0 0x7f5ef40687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:13.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.702+0000 7f5f07fff700 1 --2- 172.21.15.77:0/2880356855 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f5ef40662f0 0x7f5ef40687b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8009fd0 tx=0x7f5ef8008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:13.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.706+0000 7f5f04ff9700 1 -- 172.21.15.77:0/2880356855 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5f00050a70 con 0x7f5f0815c9a0 2023-07-24T05:46:13.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.870+0000 7f5f0d4e2700 1 -- 172.21.15.77:0/2880356855 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5f0806b4a0 con 0x7f5f0815c9a0 2023-07-24T05:46:13.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.870+0000 7f5f04ff9700 1 -- 172.21.15.77:0/2880356855 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5f00054090 con 0x7f5f0815c9a0 2023-07-24T05:46:13.876 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-07-24T05:46:13.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.874+0000 7f5f0d4e2700 1 -- 172.21.15.77:0/2880356855 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f5ef40662f0 msgr2=0x7f5ef40687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:13.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.874+0000 7f5f0d4e2700 1 --2- 172.21.15.77:0/2880356855 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f5ef40662f0 0x7f5ef40687b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8009fd0 tx=0x7f5ef8008030 comp rx=0 tx=0).stop 2023-07-24T05:46:13.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.874+0000 7f5f0d4e2700 1 -- 172.21.15.77:0/2880356855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f0815c9a0 msgr2=0x7f5f080c7510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:13.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.874+0000 7f5f0d4e2700 1 --2- 172.21.15.77:0/2880356855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f0815c9a0 0x7f5f080c7510 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5f0000cbc0 tx=0x7f5f0000cbf0 comp rx=0 tx=0).stop 2023-07-24T05:46:13.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.874+0000 7f5f0d4e2700 1 -- 172.21.15.77:0/2880356855 shutdown_connections 2023-07-24T05:46:13.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.874+0000 7f5f0d4e2700 1 --2- 172.21.15.77:0/2880356855 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f0815c9a0 0x7f5f080c7510 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:13.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.874+0000 7f5f0d4e2700 1 --2- 172.21.15.77:0/2880356855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f080cf5c0 0x7f5f081fa520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:13.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.874+0000 7f5f0d4e2700 1 --2- 172.21.15.77:0/2880356855 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f5ef40662f0 0x7f5ef40687b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:13.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.874+0000 7f5f0d4e2700 1 --2- 172.21.15.77:0/2880356855 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5f0806bb60 0x7f5f08155720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:13.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.874+0000 7f5f0d4e2700 1 -- 172.21.15.77:0/2880356855 >> 172.21.15.77:0/2880356855 conn(0x7f5f080b5610 msgr2=0x7f5f080d3020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:13.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.874+0000 7f5f0d4e2700 1 -- 172.21.15.77:0/2880356855 shutdown_connections 2023-07-24T05:46:13.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:13.874+0000 7f5f0d4e2700 1 -- 172.21.15.77:0/2880356855 wait complete. 2023-07-24T05:46:13.901 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-24T05:46:14.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.078+0000 7f5e7a101700 1 Processor -- start 2023-07-24T05:46:14.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.078+0000 7f5e7a101700 1 -- start start 2023-07-24T05:46:14.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.078+0000 7f5e7a101700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5e7406afc0 0x7f5e740b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:14.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.082+0000 7f5e7a101700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5e740d2fc0 0x7f5e740d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:14.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.082+0000 7f5e7a101700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e74160fa0 con 0x7f5e7415db20 2023-07-24T05:46:14.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.082+0000 7f5e7a101700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e740d0360 con 0x7f5e740d2fc0 2023-07-24T05:46:14.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.082+0000 7f5e7a101700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e740b20b0 con 0x7f5e7406afc0 2023-07-24T05:46:14.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.082+0000 7f5e73fff700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5e740d2fc0 0x7f5e740d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:14.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.082+0000 7f5e72ffd700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f5e7415db20 0x7f5e740d28b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:51968/0 (socket says 172.21.15.77:51968) 2023-07-24T05:46:14.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.082+0000 7f5e72ffd700 1 -- 172.21.15.77:0/168525689 learned_addr learned my addr 172.21.15.77:0/168525689 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:14.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.082+0000 7f5e737fe700 1 --2- 172.21.15.77:0/168525689 >> v2:172.21.15.103:3300/0 conn(0x7f5e7406afc0 0x7f5e740b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:14.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.082+0000 7f5e727fc700 1 -- 172.21.15.77:0/168525689 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3775323599 0 0) 0x7f5e74160fa0 con 0x7f5e7415db20 2023-07-24T05:46:14.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.082+0000 7f5e727fc700 1 -- 172.21.15.77:0/168525689 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e5c0035d0 con 0x7f5e7415db20 2023-07-24T05:46:14.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.082+0000 7f5e73fff700 1 -- 172.21.15.77:0/168525689 >> v2:172.21.15.103:3300/0 conn(0x7f5e7406afc0 msgr2=0x7f5e740b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:14.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.082+0000 7f5e73fff700 1 --2- 172.21.15.77:0/168525689 >> v2:172.21.15.103:3300/0 conn(0x7f5e7406afc0 0x7f5e740b1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:14.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.082+0000 7f5e73fff700 1 -- 172.21.15.77:0/168525689 >> v1:172.21.15.77:6789/0 conn(0x7f5e7415db20 legacy=0x7f5e740d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:14.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.082+0000 7f5e73fff700 1 -- 172.21.15.77:0/168525689 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e74160670 con 0x7f5e740d2fc0 2023-07-24T05:46:14.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.082+0000 7f5e73fff700 1 --2- 172.21.15.77:0/168525689 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e740d2fc0 0x7f5e740d1520 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5e7406dc40 tx=0x7f5e6c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdf2742d798cb446 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:14.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.082+0000 7f5e727fc700 1 -- 172.21.15.77:0/168525689 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c00e070 con 0x7f5e740d2fc0 2023-07-24T05:46:14.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.082+0000 7f5e727fc700 1 -- 172.21.15.77:0/168525689 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6c00bb20 con 0x7f5e740d2fc0 2023-07-24T05:46:14.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.082+0000 7f5e727fc700 1 -- 172.21.15.77:0/168525689 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c012430 con 0x7f5e740d2fc0 2023-07-24T05:46:14.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.082+0000 7f5e7a101700 1 -- 172.21.15.77:0/168525689 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e740d2fc0 msgr2=0x7f5e740d1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:14.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.082+0000 7f5e7a101700 1 --2- 172.21.15.77:0/168525689 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e740d2fc0 0x7f5e740d1520 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5e7406dc40 tx=0x7f5e6c00b330 comp rx=0 tx=0).stop 2023-07-24T05:46:14.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.086+0000 7f5e7a101700 1 -- 172.21.15.77:0/168525689 shutdown_connections 2023-07-24T05:46:14.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.086+0000 7f5e7a101700 1 --2- 172.21.15.77:0/168525689 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e740d2fc0 0x7f5e740d1520 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:14.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.086+0000 7f5e7a101700 1 --2- 172.21.15.77:0/168525689 >> v2:172.21.15.103:3300/0 conn(0x7f5e7406afc0 0x7f5e740b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:14.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.086+0000 7f5e7a101700 1 -- 172.21.15.77:0/168525689 >> 172.21.15.77:0/168525689 conn(0x7f5e7409bc20 msgr2=0x7f5e740b7920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:14.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.086+0000 7f5e7a101700 1 -- 172.21.15.77:0/168525689 shutdown_connections 2023-07-24T05:46:14.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.086+0000 7f5e7a101700 1 -- 172.21.15.77:0/168525689 wait complete. 2023-07-24T05:46:14.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.086+0000 7f5e7a101700 1 Processor -- start 2023-07-24T05:46:14.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.086+0000 7f5e7a101700 1 -- start start 2023-07-24T05:46:14.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.090+0000 7f5e7a101700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5e7406afc0 0x7f5e740c8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:14.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.090+0000 7f5e7a101700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e740d2fc0 0x7f5e740d1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:14.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.090+0000 7f5e7a101700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e7415db20 0x7f5e740d1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:14.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.090+0000 7f5e7a101700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e740c9f70 con 0x7f5e740d2fc0 2023-07-24T05:46:14.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.090+0000 7f5e7a101700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e74149820 con 0x7f5e7415db20 2023-07-24T05:46:14.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.090+0000 7f5e7a101700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e740c8b70 con 0x7f5e7406afc0 2023-07-24T05:46:14.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.090+0000 7f5e72ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e740d2fc0 0x7f5e740d1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:14.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.090+0000 7f5e72ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e740d2fc0 0x7f5e740d1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53248/0 (socket says 172.21.15.77:53248) 2023-07-24T05:46:14.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.090+0000 7f5e72ffd700 1 -- 172.21.15.77:0/1577406350 learned_addr learned my addr 172.21.15.77:0/1577406350 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:14.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.090+0000 7f5e737fe700 1 --2- 172.21.15.77:0/1577406350 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5e7406afc0 0x7f5e740c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:14.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.090+0000 7f5e73fff700 1 --2- 172.21.15.77:0/1577406350 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e7415db20 0x7f5e740d1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:14.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.090+0000 7f5e72ffd700 1 -- 172.21.15.77:0/1577406350 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5e7406afc0 msgr2=0x7f5e740c8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:14.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.090+0000 7f5e72ffd700 1 --2- 172.21.15.77:0/1577406350 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5e7406afc0 0x7f5e740c8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:14.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.090+0000 7f5e72ffd700 1 -- 172.21.15.77:0/1577406350 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e7415db20 msgr2=0x7f5e740d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:14.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.090+0000 7f5e72ffd700 1 --2- 172.21.15.77:0/1577406350 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e7415db20 0x7f5e740d1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:14.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.090+0000 7f5e72ffd700 1 -- 172.21.15.77:0/1577406350 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6c009a70 con 0x7f5e740d2fc0 2023-07-24T05:46:14.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.090+0000 7f5e73fff700 1 --2- 172.21.15.77:0/1577406350 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e7415db20 0x7f5e740d1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:46:14.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.090+0000 7f5e72ffd700 1 --2- 172.21.15.77:0/1577406350 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e740d2fc0 0x7f5e740d1790 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5e6800c500 tx=0x7f5e6800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:14.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.090+0000 7f5e5bfff700 1 -- 172.21.15.77:0/1577406350 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e68005d90 con 0x7f5e740d2fc0 2023-07-24T05:46:14.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.090+0000 7f5e5bfff700 1 -- 172.21.15.77:0/1577406350 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e680070d0 con 0x7f5e740d2fc0 2023-07-24T05:46:14.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.090+0000 7f5e5bfff700 1 -- 172.21.15.77:0/1577406350 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e68007480 con 0x7f5e740d2fc0 2023-07-24T05:46:14.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.090+0000 7f5e7a101700 1 -- 172.21.15.77:0/1577406350 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e740b4b20 con 0x7f5e740d2fc0 2023-07-24T05:46:14.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.090+0000 7f5e7a101700 1 -- 172.21.15.77:0/1577406350 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e740c9b90 con 0x7f5e740d2fc0 2023-07-24T05:46:14.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.094+0000 7f5e7a101700 1 -- 172.21.15.77:0/1577406350 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e740ca0b0 con 0x7f5e740d2fc0 2023-07-24T05:46:14.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.094+0000 7f5e5bfff700 1 -- 172.21.15.77:0/1577406350 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5e680075e0 con 0x7f5e740d2fc0 2023-07-24T05:46:14.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.098+0000 7f5e5bfff700 1 --2- 172.21.15.77:0/1577406350 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f5e600662f0 0x7f5e600687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:14.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.098+0000 7f5e5bfff700 1 -- 172.21.15.77:0/1577406350 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5e68083530 con 0x7f5e740d2fc0 2023-07-24T05:46:14.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.098+0000 7f5e737fe700 1 --2- 172.21.15.77:0/1577406350 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f5e600662f0 0x7f5e600687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:14.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.098+0000 7f5e737fe700 1 --2- 172.21.15.77:0/1577406350 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f5e600662f0 0x7f5e600687b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5e64009b80 tx=0x7f5e64008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:14.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.102+0000 7f5e5bfff700 1 -- 172.21.15.77:0/1577406350 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5e740ca0b0 con 0x7f5e740d2fc0 2023-07-24T05:46:14.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.274+0000 7f5e7a101700 1 -- 172.21.15.77:0/1577406350 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5e740ca0b0 con 0x7f5e740d2fc0 2023-07-24T05:46:14.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.274+0000 7f5e5bfff700 1 -- 172.21.15.77:0/1577406350 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5e740ca0b0 con 0x7f5e740d2fc0 2023-07-24T05:46:14.279 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 8 2023-07-24T05:46:14.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.278+0000 7f5e7a101700 1 -- 172.21.15.77:0/1577406350 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f5e600662f0 msgr2=0x7f5e600687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:14.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.278+0000 7f5e7a101700 1 --2- 172.21.15.77:0/1577406350 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f5e600662f0 0x7f5e600687b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5e64009b80 tx=0x7f5e64008040 comp rx=0 tx=0).stop 2023-07-24T05:46:14.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.278+0000 7f5e7a101700 1 -- 172.21.15.77:0/1577406350 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e740d2fc0 msgr2=0x7f5e740d1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:14.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.278+0000 7f5e7a101700 1 --2- 172.21.15.77:0/1577406350 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e740d2fc0 0x7f5e740d1790 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5e6800c500 tx=0x7f5e6800c8c0 comp rx=0 tx=0).stop 2023-07-24T05:46:14.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.278+0000 7f5e7a101700 1 -- 172.21.15.77:0/1577406350 shutdown_connections 2023-07-24T05:46:14.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.278+0000 7f5e7a101700 1 --2- 172.21.15.77:0/1577406350 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e7415db20 0x7f5e740d1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:14.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.278+0000 7f5e7a101700 1 --2- 172.21.15.77:0/1577406350 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e740d2fc0 0x7f5e740d1790 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:14.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.278+0000 7f5e7a101700 1 --2- 172.21.15.77:0/1577406350 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f5e600662f0 0x7f5e600687b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:14.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.278+0000 7f5e7a101700 1 --2- 172.21.15.77:0/1577406350 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5e7406afc0 0x7f5e740c8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:14.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.278+0000 7f5e7a101700 1 -- 172.21.15.77:0/1577406350 >> 172.21.15.77:0/1577406350 conn(0x7f5e7409bc20 msgr2=0x7f5e740af640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:14.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.278+0000 7f5e7a101700 1 -- 172.21.15.77:0/1577406350 shutdown_connections 2023-07-24T05:46:14.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.278+0000 7f5e7a101700 1 -- 172.21.15.77:0/1577406350 wait complete. 2023-07-24T05:46:14.307 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-24T05:46:14.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.474+0000 7fa9715e3700 1 Processor -- start 2023-07-24T05:46:14.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.474+0000 7fa9715e3700 1 -- start start 2023-07-24T05:46:14.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.478+0000 7fa9715e3700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa96c159840 0x7fa96c06bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:14.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.478+0000 7fa9715e3700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa96c0ced80 0x7fa96c070360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:14.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.478+0000 7fa9715e3700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa96c06c1d0 con 0x7fa96c0ca2d0 2023-07-24T05:46:14.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.478+0000 7fa9715e3700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa96c06daa0 con 0x7fa96c159840 2023-07-24T05:46:14.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.478+0000 7fa9715e3700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa96c0cf210 con 0x7fa96c0ced80 2023-07-24T05:46:14.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.478+0000 7fa96bfff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa96c159840 0x7fa96c06bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:14.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.478+0000 7fa96b7fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa96c0ca2d0 0x7fa96c06fc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.77:34248/0 (socket says 172.21.15.77:34248) 2023-07-24T05:46:14.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.478+0000 7fa96b7fe700 1 -- 172.21.15.77:0/3135219821 learned_addr learned my addr 172.21.15.77:0/3135219821 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:14.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.478+0000 7fa970de2700 1 --2- 172.21.15.77:0/3135219821 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa96c0ced80 0x7fa96c070360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:14.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.478+0000 7fa96affd700 1 -- 172.21.15.77:0/3135219821 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 860577907 0 0) 0x7fa96c06c1d0 con 0x7fa96c0ca2d0 2023-07-24T05:46:14.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.478+0000 7fa96affd700 1 -- 172.21.15.77:0/3135219821 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9540035d0 con 0x7fa96c0ca2d0 2023-07-24T05:46:14.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.478+0000 7fa96bfff700 1 -- 172.21.15.77:0/3135219821 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa96c0ced80 msgr2=0x7fa96c070360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:14.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.478+0000 7fa96bfff700 1 --2- 172.21.15.77:0/3135219821 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa96c0ced80 0x7fa96c070360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:14.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.478+0000 7fa96bfff700 1 -- 172.21.15.77:0/3135219821 >> v1:172.21.15.103:6789/0 conn(0x7fa96c0ca2d0 legacy=0x7fa96c06fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:14.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.478+0000 7fa96bfff700 1 -- 172.21.15.77:0/3135219821 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa96c0ca730 con 0x7fa96c159840 2023-07-24T05:46:14.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.478+0000 7fa96bfff700 1 --2- 172.21.15.77:0/3135219821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa96c159840 0x7fa96c06bb60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa95c009880 tx=0x7fa95c009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5db080fde708aa1f server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:14.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.482+0000 7fa96affd700 1 -- 172.21.15.77:0/3135219821 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95c011830 con 0x7fa96c159840 2023-07-24T05:46:14.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.482+0000 7fa96affd700 1 -- 172.21.15.77:0/3135219821 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa95c011990 con 0x7fa96c159840 2023-07-24T05:46:14.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.482+0000 7fa96affd700 1 -- 172.21.15.77:0/3135219821 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95c011d20 con 0x7fa96c159840 2023-07-24T05:46:14.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.482+0000 7fa9715e3700 1 -- 172.21.15.77:0/3135219821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa96c159840 msgr2=0x7fa96c06bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:14.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.482+0000 7fa9715e3700 1 --2- 172.21.15.77:0/3135219821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa96c159840 0x7fa96c06bb60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa95c009880 tx=0x7fa95c009b90 comp rx=0 tx=0).stop 2023-07-24T05:46:14.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.482+0000 7fa9715e3700 1 -- 172.21.15.77:0/3135219821 shutdown_connections 2023-07-24T05:46:14.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.482+0000 7fa9715e3700 1 --2- 172.21.15.77:0/3135219821 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa96c0ced80 0x7fa96c070360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:14.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.482+0000 7fa9715e3700 1 --2- 172.21.15.77:0/3135219821 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa96c159840 0x7fa96c06bb60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:14.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.482+0000 7fa9715e3700 1 -- 172.21.15.77:0/3135219821 >> 172.21.15.77:0/3135219821 conn(0x7fa96c0ce260 msgr2=0x7fa96c0ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:14.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.482+0000 7fa9715e3700 1 -- 172.21.15.77:0/3135219821 shutdown_connections 2023-07-24T05:46:14.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.482+0000 7fa9715e3700 1 -- 172.21.15.77:0/3135219821 wait complete. 2023-07-24T05:46:14.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.486+0000 7fa9715e3700 1 Processor -- start 2023-07-24T05:46:14.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.486+0000 7fa9715e3700 1 -- start start 2023-07-24T05:46:14.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.486+0000 7fa9715e3700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa96c0ca2d0 0x7fa96c1562e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:14.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.486+0000 7fa9715e3700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa96c0ced80 0x7fa96c0adcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:14.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.486+0000 7fa9715e3700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa96c159840 0x7fa96c0989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:14.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.486+0000 7fa9715e3700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96c0ae9a0 con 0x7fa96c0ced80 2023-07-24T05:46:14.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.486+0000 7fa9715e3700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96c0c63e0 con 0x7fa96c159840 2023-07-24T05:46:14.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.486+0000 7fa9715e3700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa96c0c66c0 con 0x7fa96c0ca2d0 2023-07-24T05:46:14.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.486+0000 7fa96b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa96c0ced80 0x7fa96c0adcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:14.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.486+0000 7fa96b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa96c0ced80 0x7fa96c0adcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53264/0 (socket says 172.21.15.77:53264) 2023-07-24T05:46:14.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.486+0000 7fa96b7fe700 1 -- 172.21.15.77:0/1952651578 learned_addr learned my addr 172.21.15.77:0/1952651578 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:14.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.486+0000 7fa96bfff700 1 --2- 172.21.15.77:0/1952651578 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa96c0ca2d0 0x7fa96c1562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:14.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.486+0000 7fa970de2700 1 --2- 172.21.15.77:0/1952651578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa96c159840 0x7fa96c0989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:14.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.486+0000 7fa96b7fe700 1 -- 172.21.15.77:0/1952651578 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa96c0ca2d0 msgr2=0x7fa96c1562e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:14.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.486+0000 7fa96b7fe700 1 --2- 172.21.15.77:0/1952651578 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa96c0ca2d0 0x7fa96c1562e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:14.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.486+0000 7fa96b7fe700 1 -- 172.21.15.77:0/1952651578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa96c159840 msgr2=0x7fa96c0989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:14.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.486+0000 7fa96b7fe700 1 --2- 172.21.15.77:0/1952651578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa96c159840 0x7fa96c0989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:14.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.486+0000 7fa96b7fe700 1 -- 172.21.15.77:0/1952651578 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa95c0094b0 con 0x7fa96c0ced80 2023-07-24T05:46:14.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.486+0000 7fa96b7fe700 1 --2- 172.21.15.77:0/1952651578 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa96c0ced80 0x7fa96c0adcc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa96000c4d0 tx=0x7fa96000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:14.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.490+0000 7fa968ff9700 1 -- 172.21.15.77:0/1952651578 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa960005d90 con 0x7fa96c0ced80 2023-07-24T05:46:14.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.490+0000 7fa968ff9700 1 -- 172.21.15.77:0/1952651578 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa96000ce80 con 0x7fa96c0ced80 2023-07-24T05:46:14.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.490+0000 7fa9715e3700 1 -- 172.21.15.77:0/1952651578 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa96c0c69a0 con 0x7fa96c0ced80 2023-07-24T05:46:14.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.490+0000 7fa968ff9700 1 -- 172.21.15.77:0/1952651578 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9600072d0 con 0x7fa96c0ced80 2023-07-24T05:46:14.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.490+0000 7fa9715e3700 1 -- 172.21.15.77:0/1952651578 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa96c0ae200 con 0x7fa96c0ced80 2023-07-24T05:46:14.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.490+0000 7fa9715e3700 1 -- 172.21.15.77:0/1952651578 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa96c0c6bc0 con 0x7fa96c0ced80 2023-07-24T05:46:14.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.494+0000 7fa968ff9700 1 -- 172.21.15.77:0/1952651578 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa960007430 con 0x7fa96c0ced80 2023-07-24T05:46:14.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.494+0000 7fa968ff9700 1 --2- 172.21.15.77:0/1952651578 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa9580662f0 0x7fa9580687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:14.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.494+0000 7fa968ff9700 1 -- 172.21.15.77:0/1952651578 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa9600832d0 con 0x7fa96c0ced80 2023-07-24T05:46:14.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.494+0000 7fa96bfff700 1 --2- 172.21.15.77:0/1952651578 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa9580662f0 0x7fa9580687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:14.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.498+0000 7fa96bfff700 1 --2- 172.21.15.77:0/1952651578 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa9580662f0 0x7fa9580687b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa95c000c00 tx=0x7fa95c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:14.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.502+0000 7fa968ff9700 1 -- 172.21.15.77:0/1952651578 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa960050470 con 0x7fa96c0ced80 2023-07-24T05:46:14.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.670+0000 7fa9715e3700 1 -- 172.21.15.77:0/1952651578 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa96c072490 con 0x7fa96c0ced80 2023-07-24T05:46:14.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.670+0000 7fa968ff9700 1 -- 172.21.15.77:0/1952651578 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa960053a90 con 0x7fa96c0ced80 2023-07-24T05:46:14.677 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-07-24T05:46:14.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.674+0000 7fa9715e3700 1 -- 172.21.15.77:0/1952651578 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa9580662f0 msgr2=0x7fa9580687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:14.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.674+0000 7fa9715e3700 1 --2- 172.21.15.77:0/1952651578 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa9580662f0 0x7fa9580687b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa95c000c00 tx=0x7fa95c008030 comp rx=0 tx=0).stop 2023-07-24T05:46:14.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.674+0000 7fa9715e3700 1 -- 172.21.15.77:0/1952651578 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa96c0ced80 msgr2=0x7fa96c0adcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:14.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.674+0000 7fa9715e3700 1 --2- 172.21.15.77:0/1952651578 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa96c0ced80 0x7fa96c0adcc0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa96000c4d0 tx=0x7fa96000c7e0 comp rx=0 tx=0).stop 2023-07-24T05:46:14.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.674+0000 7fa9715e3700 1 -- 172.21.15.77:0/1952651578 shutdown_connections 2023-07-24T05:46:14.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.674+0000 7fa9715e3700 1 --2- 172.21.15.77:0/1952651578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa96c159840 0x7fa96c0989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:14.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.674+0000 7fa9715e3700 1 --2- 172.21.15.77:0/1952651578 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa96c0ced80 0x7fa96c0adcc0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:14.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.674+0000 7fa9715e3700 1 --2- 172.21.15.77:0/1952651578 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa9580662f0 0x7fa9580687b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:14.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.674+0000 7fa9715e3700 1 --2- 172.21.15.77:0/1952651578 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa96c0ca2d0 0x7fa96c1562e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:14.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.674+0000 7fa9715e3700 1 -- 172.21.15.77:0/1952651578 >> 172.21.15.77:0/1952651578 conn(0x7fa96c0ce260 msgr2=0x7fa96c06abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:14.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.674+0000 7fa9715e3700 1 -- 172.21.15.77:0/1952651578 shutdown_connections 2023-07-24T05:46:14.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.674+0000 7fa9715e3700 1 -- 172.21.15.77:0/1952651578 wait complete. 2023-07-24T05:46:14.703 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-24T05:46:14.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.878+0000 7fe272def700 1 Processor -- start 2023-07-24T05:46:14.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.878+0000 7fe272def700 1 -- start start 2023-07-24T05:46:14.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.882+0000 7fe272def700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe26c15c870 0x7fe26c0cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:14.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.882+0000 7fe272def700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe26c15cc50 0x7fe26c0b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:14.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.882+0000 7fe272def700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe26c06a520 0x7fe26c0b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:14.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.882+0000 7fe272def700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe26c0cf520 con 0x7fe26c15c870 2023-07-24T05:46:14.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.882+0000 7fe272def700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe26c06aaa0 con 0x7fe26c15cc50 2023-07-24T05:46:14.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.882+0000 7fe272def700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe26c06ad80 con 0x7fe26c06a520 2023-07-24T05:46:14.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.882+0000 7fe271ded700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe26c15c870 0x7fe26c0cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:14.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.882+0000 7fe271ded700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe26c15c870 0x7fe26c0cefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53268/0 (socket says 172.21.15.77:53268) 2023-07-24T05:46:14.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.882+0000 7fe271ded700 1 -- 172.21.15.77:0/3370973888 learned_addr learned my addr 172.21.15.77:0/3370973888 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:14.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.882+0000 7fe2715ec700 1 --2- 172.21.15.77:0/3370973888 >> v2:172.21.15.103:3300/0 conn(0x7fe26c15cc50 0x7fe26c0b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:14.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.882+0000 7fe2725ee700 1 --2- 172.21.15.77:0/3370973888 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe26c06a520 0x7fe26c0b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:14.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.882+0000 7fe271ded700 1 -- 172.21.15.77:0/3370973888 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe26c06a520 msgr2=0x7fe26c0b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:14.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.882+0000 7fe271ded700 1 --2- 172.21.15.77:0/3370973888 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe26c06a520 0x7fe26c0b2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:14.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.882+0000 7fe271ded700 1 -- 172.21.15.77:0/3370973888 >> v2:172.21.15.103:3300/0 conn(0x7fe26c15cc50 msgr2=0x7fe26c0b1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:14.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.882+0000 7fe271ded700 1 --2- 172.21.15.77:0/3370973888 >> v2:172.21.15.103:3300/0 conn(0x7fe26c15cc50 0x7fe26c0b1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:14.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.882+0000 7fe271ded700 1 -- 172.21.15.77:0/3370973888 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe26c06b060 con 0x7fe26c15c870 2023-07-24T05:46:14.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.886+0000 7fe271ded700 1 --2- 172.21.15.77:0/3370973888 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe26c15c870 0x7fe26c0cefe0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe26c0670d0 tx=0x7fe268009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdbd41bb315bc91c server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:14.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.886+0000 7fe270deb700 1 -- 172.21.15.77:0/3370973888 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe268005e50 con 0x7fe26c15c870 2023-07-24T05:46:14.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.886+0000 7fe270deb700 1 -- 172.21.15.77:0/3370973888 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe268006030 con 0x7fe26c15c870 2023-07-24T05:46:14.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.886+0000 7fe270deb700 1 -- 172.21.15.77:0/3370973888 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2680063c0 con 0x7fe26c15c870 2023-07-24T05:46:14.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.886+0000 7fe272def700 1 -- 172.21.15.77:0/3370973888 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe26c15c870 msgr2=0x7fe26c0cefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:14.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.886+0000 7fe272def700 1 --2- 172.21.15.77:0/3370973888 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe26c15c870 0x7fe26c0cefe0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe26c0670d0 tx=0x7fe268009bf0 comp rx=0 tx=0).stop 2023-07-24T05:46:14.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.886+0000 7fe272def700 1 -- 172.21.15.77:0/3370973888 shutdown_connections 2023-07-24T05:46:14.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.886+0000 7fe272def700 1 --2- 172.21.15.77:0/3370973888 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe26c06a520 0x7fe26c0b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:14.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.886+0000 7fe272def700 1 --2- 172.21.15.77:0/3370973888 >> v2:172.21.15.103:3300/0 conn(0x7fe26c15cc50 0x7fe26c0b1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:14.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.886+0000 7fe272def700 1 --2- 172.21.15.77:0/3370973888 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe26c15c870 0x7fe26c0cefe0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:14.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.886+0000 7fe272def700 1 -- 172.21.15.77:0/3370973888 >> 172.21.15.77:0/3370973888 conn(0x7fe26c089f80 msgr2=0x7fe26c09b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:14.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.886+0000 7fe272def700 1 -- 172.21.15.77:0/3370973888 shutdown_connections 2023-07-24T05:46:14.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.886+0000 7fe272def700 1 -- 172.21.15.77:0/3370973888 wait complete. 2023-07-24T05:46:14.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.890+0000 7fe272def700 1 Processor -- start 2023-07-24T05:46:14.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.890+0000 7fe272def700 1 -- start start 2023-07-24T05:46:14.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.890+0000 7fe272def700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe26c06a520 0x7fe26c151d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:14.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.890+0000 7fe272def700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe26c15c870 0x7fe26c0c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:14.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.890+0000 7fe272def700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe26c15cc50 0x7fe26c158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:14.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.890+0000 7fe272def700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26c0c8e40 con 0x7fe26c15cc50 2023-07-24T05:46:14.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.890+0000 7fe272def700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26c159250 con 0x7fe26c15c870 2023-07-24T05:46:14.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.890+0000 7fe272def700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe26c1594d0 con 0x7fe26c06a520 2023-07-24T05:46:14.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.890+0000 7fe2725ee700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe26c15cc50 0x7fe26c158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:14.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.890+0000 7fe2725ee700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe26c15cc50 0x7fe26c158d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53278/0 (socket says 172.21.15.77:53278) 2023-07-24T05:46:14.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.890+0000 7fe2725ee700 1 -- 172.21.15.77:0/3047717431 learned_addr learned my addr 172.21.15.77:0/3047717431 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:14.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.890+0000 7fe2715ec700 1 --2- 172.21.15.77:0/3047717431 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe26c15c870 0x7fe26c0c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:14.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.890+0000 7fe271ded700 1 --2- 172.21.15.77:0/3047717431 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe26c06a520 0x7fe26c151d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:14.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.890+0000 7fe2725ee700 1 -- 172.21.15.77:0/3047717431 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe26c06a520 msgr2=0x7fe26c151d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:14.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.890+0000 7fe2725ee700 1 --2- 172.21.15.77:0/3047717431 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe26c06a520 0x7fe26c151d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:14.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.890+0000 7fe2725ee700 1 -- 172.21.15.77:0/3047717431 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe26c15c870 msgr2=0x7fe26c0c8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:14.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.890+0000 7fe2725ee700 1 --2- 172.21.15.77:0/3047717431 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe26c15c870 0x7fe26c0c8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:14.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.890+0000 7fe2725ee700 1 -- 172.21.15.77:0/3047717431 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe268009520 con 0x7fe26c15cc50 2023-07-24T05:46:14.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.890+0000 7fe271ded700 1 --2- 172.21.15.77:0/3047717431 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe26c06a520 0x7fe26c151d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:46:14.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.890+0000 7fe2725ee700 1 --2- 172.21.15.77:0/3047717431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe26c15cc50 0x7fe26c158d10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe26400eed0 tx=0x7fe26400b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:14.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.890+0000 7fe2627fc700 1 -- 172.21.15.77:0/3047717431 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe264010040 con 0x7fe26c15cc50 2023-07-24T05:46:14.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.890+0000 7fe2627fc700 1 -- 172.21.15.77:0/3047717431 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe26400bd30 con 0x7fe26c15cc50 2023-07-24T05:46:14.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.890+0000 7fe2627fc700 1 -- 172.21.15.77:0/3047717431 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26400bea0 con 0x7fe26c15cc50 2023-07-24T05:46:14.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.890+0000 7fe272def700 1 -- 172.21.15.77:0/3047717431 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe26c1597b0 con 0x7fe26c15cc50 2023-07-24T05:46:14.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.890+0000 7fe272def700 1 -- 172.21.15.77:0/3047717431 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe26c159d70 con 0x7fe26c15cc50 2023-07-24T05:46:14.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.894+0000 7fe272def700 1 -- 172.21.15.77:0/3047717431 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe26c072490 con 0x7fe26c15cc50 2023-07-24T05:46:14.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.894+0000 7fe2627fc700 1 -- 172.21.15.77:0/3047717431 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe264014620 con 0x7fe26c15cc50 2023-07-24T05:46:14.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.898+0000 7fe2627fc700 1 --2- 172.21.15.77:0/3047717431 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe2500662f0 0x7fe2500687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:14.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.898+0000 7fe2627fc700 1 -- 172.21.15.77:0/3047717431 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe264084770 con 0x7fe26c15cc50 2023-07-24T05:46:14.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.898+0000 7fe271ded700 1 --2- 172.21.15.77:0/3047717431 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe2500662f0 0x7fe2500687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:14.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.898+0000 7fe271ded700 1 --2- 172.21.15.77:0/3047717431 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe2500662f0 0x7fe2500687b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe268009c30 tx=0x7fe268008070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:14.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:14.902+0000 7fe2627fc700 1 -- 172.21.15.77:0/3047717431 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe2640553a0 con 0x7fe26c15cc50 2023-07-24T05:46:15.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.074+0000 7fe272def700 1 -- 172.21.15.77:0/3047717431 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe26c1e7260 con 0x7fe26c15cc50 2023-07-24T05:46:15.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.078+0000 7fe2627fc700 1 -- 172.21.15.77:0/3047717431 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe264054f30 con 0x7fe26c15cc50 2023-07-24T05:46:15.081 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-07-24T05:46:15.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.078+0000 7fe272def700 1 -- 172.21.15.77:0/3047717431 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe2500662f0 msgr2=0x7fe2500687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:15.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.078+0000 7fe272def700 1 --2- 172.21.15.77:0/3047717431 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe2500662f0 0x7fe2500687b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe268009c30 tx=0x7fe268008070 comp rx=0 tx=0).stop 2023-07-24T05:46:15.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.078+0000 7fe272def700 1 -- 172.21.15.77:0/3047717431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe26c15cc50 msgr2=0x7fe26c158d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:15.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.078+0000 7fe272def700 1 --2- 172.21.15.77:0/3047717431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe26c15cc50 0x7fe26c158d10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe26400eed0 tx=0x7fe26400b390 comp rx=0 tx=0).stop 2023-07-24T05:46:15.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.078+0000 7fe272def700 1 -- 172.21.15.77:0/3047717431 shutdown_connections 2023-07-24T05:46:15.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.078+0000 7fe272def700 1 --2- 172.21.15.77:0/3047717431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe26c15cc50 0x7fe26c158d10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:15.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.078+0000 7fe272def700 1 --2- 172.21.15.77:0/3047717431 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe26c15c870 0x7fe26c0c8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:15.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.078+0000 7fe272def700 1 --2- 172.21.15.77:0/3047717431 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe2500662f0 0x7fe2500687b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:15.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.078+0000 7fe272def700 1 --2- 172.21.15.77:0/3047717431 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe26c06a520 0x7fe26c151d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:15.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.078+0000 7fe272def700 1 -- 172.21.15.77:0/3047717431 >> 172.21.15.77:0/3047717431 conn(0x7fe26c089f80 msgr2=0x7fe26c15bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:15.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.078+0000 7fe272def700 1 -- 172.21.15.77:0/3047717431 shutdown_connections 2023-07-24T05:46:15.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.078+0000 7fe272def700 1 -- 172.21.15.77:0/3047717431 wait complete. 2023-07-24T05:46:15.104 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-24T05:46:15.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.278+0000 7f3e8a57f700 1 Processor -- start 2023-07-24T05:46:15.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.278+0000 7f3e8a57f700 1 -- start start 2023-07-24T05:46:15.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.278+0000 7f3e8a57f700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3e840ad930 0x7f3e840cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:15.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.278+0000 7f3e8a57f700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3e840cb360 0x7f3e840c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:15.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.278+0000 7f3e8a57f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3e840ca250 0x7f3e84069b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:15.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.278+0000 7f3e8a57f700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e840cf2f0 con 0x7f3e840cb360 2023-07-24T05:46:15.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.278+0000 7f3e8a57f700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e840add10 con 0x7f3e840ca250 2023-07-24T05:46:15.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.278+0000 7f3e8a57f700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e840cb7c0 con 0x7f3e840ad930 2023-07-24T05:46:15.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.278+0000 7f3e837fe700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3e840cb360 0x7f3e840c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:15.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.278+0000 7f3e837fe700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3e840cb360 0x7f3e840c9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53288/0 (socket says 172.21.15.77:53288) 2023-07-24T05:46:15.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.278+0000 7f3e837fe700 1 -- 172.21.15.77:0/3167402438 learned_addr learned my addr 172.21.15.77:0/3167402438 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:15.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.282+0000 7f3e83fff700 1 --2- 172.21.15.77:0/3167402438 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3e840ad930 0x7f3e840cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:15.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.282+0000 7f3e88b1c700 1 --2- 172.21.15.77:0/3167402438 >> v2:172.21.15.103:3300/0 conn(0x7f3e840ca250 0x7f3e84069b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:15.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.282+0000 7f3e837fe700 1 -- 172.21.15.77:0/3167402438 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3e840ad930 msgr2=0x7f3e840cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:15.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.282+0000 7f3e837fe700 1 --2- 172.21.15.77:0/3167402438 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3e840ad930 0x7f3e840cae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:15.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.282+0000 7f3e837fe700 1 -- 172.21.15.77:0/3167402438 >> v2:172.21.15.103:3300/0 conn(0x7f3e840ca250 msgr2=0x7f3e84069b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:15.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.282+0000 7f3e837fe700 1 --2- 172.21.15.77:0/3167402438 >> v2:172.21.15.103:3300/0 conn(0x7f3e840ca250 0x7f3e84069b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:15.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.282+0000 7f3e837fe700 1 -- 172.21.15.77:0/3167402438 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e8415e530 con 0x7f3e840cb360 2023-07-24T05:46:15.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.282+0000 7f3e837fe700 1 --2- 172.21.15.77:0/3167402438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e840cb360 0x7f3e840c9d10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3e840cd270 tx=0x7f3e78009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bda7b3c5a38f9ce server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:15.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.282+0000 7f3e82ffd700 1 -- 172.21.15.77:0/3167402438 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e78011830 con 0x7f3e840cb360 2023-07-24T05:46:15.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.282+0000 7f3e82ffd700 1 -- 172.21.15.77:0/3167402438 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e78011990 con 0x7f3e840cb360 2023-07-24T05:46:15.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.282+0000 7f3e82ffd700 1 -- 172.21.15.77:0/3167402438 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e78011d40 con 0x7f3e840cb360 2023-07-24T05:46:15.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.282+0000 7f3e8a57f700 1 -- 172.21.15.77:0/3167402438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e840cb360 msgr2=0x7f3e840c9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:15.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.282+0000 7f3e8a57f700 1 --2- 172.21.15.77:0/3167402438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e840cb360 0x7f3e840c9d10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3e840cd270 tx=0x7f3e78009c20 comp rx=0 tx=0).stop 2023-07-24T05:46:15.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.282+0000 7f3e8a57f700 1 -- 172.21.15.77:0/3167402438 shutdown_connections 2023-07-24T05:46:15.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.282+0000 7f3e8a57f700 1 --2- 172.21.15.77:0/3167402438 >> v2:172.21.15.103:3300/0 conn(0x7f3e840ca250 0x7f3e84069b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:15.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.282+0000 7f3e8a57f700 1 --2- 172.21.15.77:0/3167402438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e840cb360 0x7f3e840c9d10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:15.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.282+0000 7f3e8a57f700 1 --2- 172.21.15.77:0/3167402438 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3e840ad930 0x7f3e840cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:15.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.282+0000 7f3e8a57f700 1 -- 172.21.15.77:0/3167402438 >> 172.21.15.77:0/3167402438 conn(0x7f3e840ce440 msgr2=0x7f3e840ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:15.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.282+0000 7f3e8a57f700 1 -- 172.21.15.77:0/3167402438 shutdown_connections 2023-07-24T05:46:15.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.282+0000 7f3e8a57f700 1 -- 172.21.15.77:0/3167402438 wait complete. 2023-07-24T05:46:15.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.286+0000 7f3e8a57f700 1 Processor -- start 2023-07-24T05:46:15.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.286+0000 7f3e8a57f700 1 -- start start 2023-07-24T05:46:15.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.290+0000 7f3e8a57f700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e840ad930 0x7f3e84153c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:15.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.290+0000 7f3e8a57f700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3e840ca250 0x7f3e84155f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:15.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.290+0000 7f3e8a57f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e840cb360 0x7f3e84156490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:15.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.290+0000 7f3e8a57f700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e84154180 con 0x7f3e840cb360 2023-07-24T05:46:15.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.290+0000 7f3e8a57f700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e840adef0 con 0x7f3e840ad930 2023-07-24T05:46:15.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.290+0000 7f3e8a57f700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e84155060 con 0x7f3e840ca250 2023-07-24T05:46:15.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.290+0000 7f3e88b1c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e840cb360 0x7f3e84156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:15.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.290+0000 7f3e88b1c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e840cb360 0x7f3e84156490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53292/0 (socket says 172.21.15.77:53292) 2023-07-24T05:46:15.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.290+0000 7f3e88b1c700 1 -- 172.21.15.77:0/327903200 learned_addr learned my addr 172.21.15.77:0/327903200 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:15.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.290+0000 7f3e83fff700 1 --2- 172.21.15.77:0/327903200 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e840ad930 0x7f3e84153c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:15.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.290+0000 7f3e837fe700 1 --2- 172.21.15.77:0/327903200 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3e840ca250 0x7f3e84155f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:15.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.290+0000 7f3e88b1c700 1 -- 172.21.15.77:0/327903200 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3e840ca250 msgr2=0x7f3e84155f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:15.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.290+0000 7f3e88b1c700 1 --2- 172.21.15.77:0/327903200 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3e840ca250 0x7f3e84155f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:15.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.290+0000 7f3e88b1c700 1 -- 172.21.15.77:0/327903200 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e840ad930 msgr2=0x7f3e84153c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:15.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.290+0000 7f3e88b1c700 1 --2- 172.21.15.77:0/327903200 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e840ad930 0x7f3e84153c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:15.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.290+0000 7f3e88b1c700 1 -- 172.21.15.77:0/327903200 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e78009570 con 0x7f3e840cb360 2023-07-24T05:46:15.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.290+0000 7f3e83fff700 1 --2- 172.21.15.77:0/327903200 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e840ad930 0x7f3e84153c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:46:15.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.290+0000 7f3e88b1c700 1 --2- 172.21.15.77:0/327903200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e840cb360 0x7f3e84156490 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c00efc0 tx=0x7f3e7c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:15.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.290+0000 7f3e80ff9700 1 -- 172.21.15.77:0/327903200 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c00cd40 con 0x7f3e840cb360 2023-07-24T05:46:15.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.290+0000 7f3e80ff9700 1 -- 172.21.15.77:0/327903200 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7c00f040 con 0x7f3e840cb360 2023-07-24T05:46:15.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.290+0000 7f3e8a57f700 1 -- 172.21.15.77:0/327903200 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e84155340 con 0x7f3e840cb360 2023-07-24T05:46:15.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.290+0000 7f3e80ff9700 1 -- 172.21.15.77:0/327903200 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c0146c0 con 0x7f3e840cb360 2023-07-24T05:46:15.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.290+0000 7f3e8a57f700 1 -- 172.21.15.77:0/327903200 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e84154d50 con 0x7f3e840cb360 2023-07-24T05:46:15.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.294+0000 7f3e8a57f700 1 -- 172.21.15.77:0/327903200 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e8404df10 con 0x7f3e840cb360 2023-07-24T05:46:15.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.294+0000 7f3e80ff9700 1 -- 172.21.15.77:0/327903200 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3e7c014820 con 0x7f3e840cb360 2023-07-24T05:46:15.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.294+0000 7f3e80ff9700 1 --2- 172.21.15.77:0/327903200 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3e700662f0 0x7f3e700687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:15.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.298+0000 7f3e80ff9700 1 -- 172.21.15.77:0/327903200 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3e7c084830 con 0x7f3e840cb360 2023-07-24T05:46:15.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.298+0000 7f3e83fff700 1 --2- 172.21.15.77:0/327903200 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3e700662f0 0x7f3e700687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:15.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.298+0000 7f3e83fff700 1 --2- 172.21.15.77:0/327903200 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3e700662f0 0x7f3e700687b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3e74009b90 tx=0x7f3e74008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:15.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.302+0000 7f3e80ff9700 1 -- 172.21.15.77:0/327903200 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3e7c0554e0 con 0x7f3e840cb360 2023-07-24T05:46:15.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.470+0000 7f3e8a57f700 1 -- 172.21.15.77:0/327903200 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3e8415add0 con 0x7f3e840cb360 2023-07-24T05:46:15.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.470+0000 7f3e80ff9700 1 -- 172.21.15.77:0/327903200 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3e7c00cea0 con 0x7f3e840cb360 2023-07-24T05:46:15.475 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-07-24T05:46:15.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.474+0000 7f3e8a57f700 1 -- 172.21.15.77:0/327903200 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3e700662f0 msgr2=0x7f3e700687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:15.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.474+0000 7f3e8a57f700 1 --2- 172.21.15.77:0/327903200 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3e700662f0 0x7f3e700687b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3e74009b90 tx=0x7f3e74008040 comp rx=0 tx=0).stop 2023-07-24T05:46:15.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.474+0000 7f3e8a57f700 1 -- 172.21.15.77:0/327903200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e840cb360 msgr2=0x7f3e84156490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:15.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.474+0000 7f3e8a57f700 1 --2- 172.21.15.77:0/327903200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e840cb360 0x7f3e84156490 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c00efc0 tx=0x7f3e7c00c3a0 comp rx=0 tx=0).stop 2023-07-24T05:46:15.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.474+0000 7f3e8a57f700 1 -- 172.21.15.77:0/327903200 shutdown_connections 2023-07-24T05:46:15.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.474+0000 7f3e8a57f700 1 --2- 172.21.15.77:0/327903200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e840cb360 0x7f3e84156490 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:15.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.474+0000 7f3e8a57f700 1 --2- 172.21.15.77:0/327903200 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3e700662f0 0x7f3e700687b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:15.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.474+0000 7f3e8a57f700 1 --2- 172.21.15.77:0/327903200 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3e840ca250 0x7f3e84155f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:15.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.474+0000 7f3e8a57f700 1 --2- 172.21.15.77:0/327903200 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e840ad930 0x7f3e84153c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:15.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.474+0000 7f3e8a57f700 1 -- 172.21.15.77:0/327903200 >> 172.21.15.77:0/327903200 conn(0x7f3e840ce440 msgr2=0x7f3e84065800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:15.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.474+0000 7f3e8a57f700 1 -- 172.21.15.77:0/327903200 shutdown_connections 2023-07-24T05:46:15.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.474+0000 7f3e8a57f700 1 -- 172.21.15.77:0/327903200 wait complete. 2023-07-24T05:46:15.501 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-24T05:46:15.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.674+0000 7f9656d37700 1 Processor -- start 2023-07-24T05:46:15.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.674+0000 7f9656d37700 1 -- start start 2023-07-24T05:46:15.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.674+0000 7f9656d37700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f965015ca00 0x7f96500d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:15.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.674+0000 7f9656d37700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f965006d450 0x7f96500b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:15.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.674+0000 7f9656d37700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96500d0300 con 0x7f96500b4630 2023-07-24T05:46:15.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.674+0000 7f9656d37700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96500b4ac0 con 0x7f965006d450 2023-07-24T05:46:15.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.674+0000 7f9656d37700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f965015cde0 con 0x7f965015ca00 2023-07-24T05:46:15.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.678+0000 7f9656536700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f96500b4630 0x7f96500b11e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:51978/0 (socket says 172.21.15.77:51978) 2023-07-24T05:46:15.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.678+0000 7f9656536700 1 -- 172.21.15.77:0/3645666427 learned_addr learned my addr 172.21.15.77:0/3645666427 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:15.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.678+0000 7f9655d35700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f965015ca00 0x7f96500d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:15.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.678+0000 7f9655534700 1 --2- 172.21.15.77:0/3645666427 >> v2:172.21.15.103:3300/0 conn(0x7f965006d450 0x7f96500b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:15.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.678+0000 7f9654d33700 1 -- 172.21.15.77:0/3645666427 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1842661583 0 0) 0x7f96500d0300 con 0x7f96500b4630 2023-07-24T05:46:15.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.678+0000 7f9654d33700 1 -- 172.21.15.77:0/3645666427 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f963c0035d0 con 0x7f96500b4630 2023-07-24T05:46:15.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.678+0000 7f9655534700 1 -- 172.21.15.77:0/3645666427 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f965015ca00 msgr2=0x7f96500d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:15.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.678+0000 7f9655534700 1 --2- 172.21.15.77:0/3645666427 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f965015ca00 0x7f96500d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:15.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.678+0000 7f9655534700 1 -- 172.21.15.77:0/3645666427 >> v1:172.21.15.77:6789/0 conn(0x7f96500b4630 legacy=0x7f96500b11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:15.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.678+0000 7f9655534700 1 -- 172.21.15.77:0/3645666427 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96500d2870 con 0x7f965006d450 2023-07-24T05:46:15.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.678+0000 7f9655534700 1 --2- 172.21.15.77:0/3645666427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f965006d450 0x7f96500b40f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9640009850 tx=0x7f9640009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ffee64faf89e599 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:15.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.678+0000 7f9654d33700 1 -- 172.21.15.77:0/3645666427 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9640011830 con 0x7f965006d450 2023-07-24T05:46:15.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.678+0000 7f9654d33700 1 -- 172.21.15.77:0/3645666427 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9640011990 con 0x7f965006d450 2023-07-24T05:46:15.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.678+0000 7f9654d33700 1 -- 172.21.15.77:0/3645666427 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9640011d40 con 0x7f965006d450 2023-07-24T05:46:15.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.678+0000 7f9656d37700 1 -- 172.21.15.77:0/3645666427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f965006d450 msgr2=0x7f96500b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:15.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.678+0000 7f9656d37700 1 --2- 172.21.15.77:0/3645666427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f965006d450 0x7f96500b40f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9640009850 tx=0x7f9640009b60 comp rx=0 tx=0).stop 2023-07-24T05:46:15.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.678+0000 7f9656d37700 1 -- 172.21.15.77:0/3645666427 shutdown_connections 2023-07-24T05:46:15.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.678+0000 7f9656d37700 1 --2- 172.21.15.77:0/3645666427 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f965006d450 0x7f96500b40f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:15.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.678+0000 7f9656d37700 1 --2- 172.21.15.77:0/3645666427 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f965015ca00 0x7f96500d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:15.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.678+0000 7f9656d37700 1 -- 172.21.15.77:0/3645666427 >> 172.21.15.77:0/3645666427 conn(0x7f96500b7610 msgr2=0x7f96500b7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:15.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.678+0000 7f9656d37700 1 -- 172.21.15.77:0/3645666427 shutdown_connections 2023-07-24T05:46:15.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.678+0000 7f9656d37700 1 -- 172.21.15.77:0/3645666427 wait complete. 2023-07-24T05:46:15.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.682+0000 7f9656d37700 1 Processor -- start 2023-07-24T05:46:15.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.682+0000 7f9656d37700 1 -- start start 2023-07-24T05:46:15.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.682+0000 7f9656d37700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f965006d450 0x7f96501f2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:15.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.682+0000 7f9656d37700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96500b4630 0x7f9650155170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:15.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.682+0000 7f9656d37700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f965015ca00 0x7f9650157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:15.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.682+0000 7f9656d37700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9650153e10 con 0x7f96500b4630 2023-07-24T05:46:15.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.682+0000 7f9656d37700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96501540d0 con 0x7f965006d450 2023-07-24T05:46:15.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.682+0000 7f9656d37700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96501543b0 con 0x7f965015ca00 2023-07-24T05:46:15.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.682+0000 7f9655534700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96500b4630 0x7f9650155170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:15.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.682+0000 7f9655534700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96500b4630 0x7f9650155170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53298/0 (socket says 172.21.15.77:53298) 2023-07-24T05:46:15.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.682+0000 7f9655534700 1 -- 172.21.15.77:0/3786267186 learned_addr learned my addr 172.21.15.77:0/3786267186 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:15.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.682+0000 7f9656536700 1 --2- 172.21.15.77:0/3786267186 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f965015ca00 0x7f9650157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:15.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.682+0000 7f9655d35700 1 --2- 172.21.15.77:0/3786267186 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f965006d450 0x7f96501f2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:15.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.686+0000 7f9655534700 1 -- 172.21.15.77:0/3786267186 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f965015ca00 msgr2=0x7f9650157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:15.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.686+0000 7f9655534700 1 --2- 172.21.15.77:0/3786267186 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f965015ca00 0x7f9650157d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:15.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.686+0000 7f9655534700 1 -- 172.21.15.77:0/3786267186 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f965006d450 msgr2=0x7f96501f2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:15.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.686+0000 7f9655534700 1 --2- 172.21.15.77:0/3786267186 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f965006d450 0x7f96501f2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:15.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.686+0000 7f9655534700 1 -- 172.21.15.77:0/3786267186 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96400094b0 con 0x7f96500b4630 2023-07-24T05:46:15.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.686+0000 7f9655d35700 1 --2- 172.21.15.77:0/3786267186 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f965006d450 0x7f96501f2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:46:15.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.686+0000 7f9655534700 1 --2- 172.21.15.77:0/3786267186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96500b4630 0x7f9650155170 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f96400090b0 tx=0x7f9640004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:15.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.686+0000 7f96467fc700 1 -- 172.21.15.77:0/3786267186 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9640004510 con 0x7f96500b4630 2023-07-24T05:46:15.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.686+0000 7f96467fc700 1 -- 172.21.15.77:0/3786267186 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964001e070 con 0x7f96500b4630 2023-07-24T05:46:15.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.686+0000 7f9656d37700 1 -- 172.21.15.77:0/3786267186 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9650154690 con 0x7f96500b4630 2023-07-24T05:46:15.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.686+0000 7f96467fc700 1 -- 172.21.15.77:0/3786267186 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96400038e0 con 0x7f96500b4630 2023-07-24T05:46:15.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.686+0000 7f9656d37700 1 -- 172.21.15.77:0/3786267186 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9650154c50 con 0x7f96500b4630 2023-07-24T05:46:15.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.686+0000 7f9656d37700 1 -- 172.21.15.77:0/3786267186 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9650154e40 con 0x7f96500b4630 2023-07-24T05:46:15.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.686+0000 7f96467fc700 1 -- 172.21.15.77:0/3786267186 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9640003a40 con 0x7f96500b4630 2023-07-24T05:46:15.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.690+0000 7f96467fc700 1 --2- 172.21.15.77:0/3786267186 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f96340662f0 0x7f96340687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:15.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.690+0000 7f96467fc700 1 -- 172.21.15.77:0/3786267186 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9640084dd0 con 0x7f96500b4630 2023-07-24T05:46:15.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.690+0000 7f9655d35700 1 --2- 172.21.15.77:0/3786267186 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f96340662f0 0x7f96340687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:15.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.690+0000 7f9655d35700 1 --2- 172.21.15.77:0/3786267186 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f96340662f0 0x7f96340687b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f964c009c30 tx=0x7f964c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:15.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.694+0000 7f96467fc700 1 -- 172.21.15.77:0/3786267186 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9640051f50 con 0x7f96500b4630 2023-07-24T05:46:15.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.874+0000 7f9656d37700 1 -- 172.21.15.77:0/3786267186 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9650072490 con 0x7f96500b4630 2023-07-24T05:46:15.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.874+0000 7f96467fc700 1 -- 172.21.15.77:0/3786267186 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9640020080 con 0x7f96500b4630 2023-07-24T05:46:15.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.878+0000 7f9656d37700 1 -- 172.21.15.77:0/3786267186 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f96340662f0 msgr2=0x7f96340687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:15.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.878+0000 7f9656d37700 1 --2- 172.21.15.77:0/3786267186 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f96340662f0 0x7f96340687b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f964c009c30 tx=0x7f964c008040 comp rx=0 tx=0).stop 2023-07-24T05:46:15.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.878+0000 7f9656d37700 1 -- 172.21.15.77:0/3786267186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96500b4630 msgr2=0x7f9650155170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:15.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.878+0000 7f9656d37700 1 --2- 172.21.15.77:0/3786267186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96500b4630 0x7f9650155170 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f96400090b0 tx=0x7f9640004770 comp rx=0 tx=0).stop 2023-07-24T05:46:15.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.878+0000 7f9656d37700 1 -- 172.21.15.77:0/3786267186 shutdown_connections 2023-07-24T05:46:15.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.878+0000 7f9656d37700 1 --2- 172.21.15.77:0/3786267186 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f96340662f0 0x7f96340687b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:15.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.878+0000 7f9656d37700 1 --2- 172.21.15.77:0/3786267186 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f965015ca00 0x7f9650157d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:15.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.878+0000 7f9656d37700 1 --2- 172.21.15.77:0/3786267186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96500b4630 0x7f9650155170 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:15.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.878+0000 7f9656d37700 1 --2- 172.21.15.77:0/3786267186 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f965006d450 0x7f96501f2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:15.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.878+0000 7f9656d37700 1 -- 172.21.15.77:0/3786267186 >> 172.21.15.77:0/3786267186 conn(0x7f96500b7610 msgr2=0x7f965015d090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:15.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.878+0000 7f9656d37700 1 -- 172.21.15.77:0/3786267186 shutdown_connections 2023-07-24T05:46:15.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:15.878+0000 7f9656d37700 1 -- 172.21.15.77:0/3786267186 wait complete. 2023-07-24T05:46:15.885 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2023-07-24T05:46:15.905 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-07-24T05:46:15.906 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-24T05:46:15.918 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-24T05:46:16.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.126+0000 7fa35e089700 1 Processor -- start 2023-07-24T05:46:16.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.126+0000 7fa35e089700 1 -- start start 2023-07-24T05:46:16.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.126+0000 7fa35e089700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa3580b13c0 0x7fa35806adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:16.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.126+0000 7fa35e089700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa3580a4580 0x7fa35806fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:16.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.126+0000 7fa35e089700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa358069b10 0x7fa358069fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:16.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.126+0000 7fa35e089700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa35806a500 con 0x7fa3580a4580 2023-07-24T05:46:16.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.126+0000 7fa35e089700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3580adc40 con 0x7fa3580b13c0 2023-07-24T05:46:16.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.126+0000 7fa35e089700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa35806b330 con 0x7fa358069b10 2023-07-24T05:46:16.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.126+0000 7fa35c886700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa3580a4580 0x7fa35806fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:16.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.126+0000 7fa35c886700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa3580a4580 0x7fa35806fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53300/0 (socket says 172.21.15.77:53300) 2023-07-24T05:46:16.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.126+0000 7fa35c886700 1 -- 172.21.15.77:0/393002248 learned_addr learned my addr 172.21.15.77:0/393002248 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:16.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.126+0000 7fa35d087700 1 --2- 172.21.15.77:0/393002248 >> v2:172.21.15.103:3300/0 conn(0x7fa3580b13c0 0x7fa35806adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:16.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.126+0000 7fa35d888700 1 --2- 172.21.15.77:0/393002248 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa358069b10 0x7fa358069fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:16.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.130+0000 7fa35c886700 1 -- 172.21.15.77:0/393002248 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa358069b10 msgr2=0x7fa358069fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:16.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.130+0000 7fa35c886700 1 --2- 172.21.15.77:0/393002248 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa358069b10 0x7fa358069fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:16.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.130+0000 7fa35c886700 1 -- 172.21.15.77:0/393002248 >> v2:172.21.15.103:3300/0 conn(0x7fa3580b13c0 msgr2=0x7fa35806adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:16.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.130+0000 7fa35c886700 1 --2- 172.21.15.77:0/393002248 >> v2:172.21.15.103:3300/0 conn(0x7fa3580b13c0 0x7fa35806adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:16.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.130+0000 7fa35c886700 1 -- 172.21.15.77:0/393002248 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3580adee0 con 0x7fa3580a4580 2023-07-24T05:46:16.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.130+0000 7fa35c886700 1 --2- 172.21.15.77:0/393002248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3580a4580 0x7fa35806fbe0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa35806f1a0 tx=0x7fa348009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f1d67040a37765f server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:16.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.130+0000 7fa34ffff700 1 -- 172.21.15.77:0/393002248 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa348011830 con 0x7fa3580a4580 2023-07-24T05:46:16.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.130+0000 7fa34ffff700 1 -- 172.21.15.77:0/393002248 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa348011990 con 0x7fa3580a4580 2023-07-24T05:46:16.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.130+0000 7fa34ffff700 1 -- 172.21.15.77:0/393002248 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa348011d20 con 0x7fa3580a4580 2023-07-24T05:46:16.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.130+0000 7fa35e089700 1 -- 172.21.15.77:0/393002248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3580a4580 msgr2=0x7fa35806fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:16.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.130+0000 7fa35e089700 1 --2- 172.21.15.77:0/393002248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3580a4580 0x7fa35806fbe0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa35806f1a0 tx=0x7fa348009bf0 comp rx=0 tx=0).stop 2023-07-24T05:46:16.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.130+0000 7fa35e089700 1 -- 172.21.15.77:0/393002248 shutdown_connections 2023-07-24T05:46:16.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.130+0000 7fa35e089700 1 --2- 172.21.15.77:0/393002248 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa358069b10 0x7fa358069fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:16.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.130+0000 7fa35e089700 1 --2- 172.21.15.77:0/393002248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3580a4580 0x7fa35806fbe0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:16.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.130+0000 7fa35e089700 1 --2- 172.21.15.77:0/393002248 >> v2:172.21.15.103:3300/0 conn(0x7fa3580b13c0 0x7fa35806adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:16.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.130+0000 7fa35e089700 1 -- 172.21.15.77:0/393002248 >> 172.21.15.77:0/393002248 conn(0x7fa3580cacc0 msgr2=0x7fa3580cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:16.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.130+0000 7fa35e089700 1 -- 172.21.15.77:0/393002248 shutdown_connections 2023-07-24T05:46:16.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.130+0000 7fa35e089700 1 -- 172.21.15.77:0/393002248 wait complete. 2023-07-24T05:46:16.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.134+0000 7fa35e089700 1 Processor -- start 2023-07-24T05:46:16.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.134+0000 7fa35e089700 1 -- start start 2023-07-24T05:46:16.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.134+0000 7fa35e089700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa358069b10 0x7fa3581f1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:16.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.134+0000 7fa35e089700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3580a4580 0x7fa358158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:16.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.134+0000 7fa35e089700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa3580b13c0 0x7fa3581591a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:16.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.134+0000 7fa35e089700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3581537a0 con 0x7fa358069b10 2023-07-24T05:46:16.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.134+0000 7fa35e089700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3580c2b00 con 0x7fa3580a4580 2023-07-24T05:46:16.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.134+0000 7fa35e089700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3580c1ef0 con 0x7fa3580b13c0 2023-07-24T05:46:16.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.134+0000 7fa35d087700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa358069b10 0x7fa3581f1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:16.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.134+0000 7fa35d087700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa358069b10 0x7fa3581f1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53304/0 (socket says 172.21.15.77:53304) 2023-07-24T05:46:16.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.134+0000 7fa35d087700 1 -- 172.21.15.77:0/3532477120 learned_addr learned my addr 172.21.15.77:0/3532477120 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:16.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.134+0000 7fa35d888700 1 --2- 172.21.15.77:0/3532477120 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa3580b13c0 0x7fa3581591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:16.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.134+0000 7fa35c886700 1 --2- 172.21.15.77:0/3532477120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3580a4580 0x7fa358158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:16.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.134+0000 7fa35d087700 1 -- 172.21.15.77:0/3532477120 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa3580b13c0 msgr2=0x7fa3581591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:16.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.134+0000 7fa35d087700 1 --2- 172.21.15.77:0/3532477120 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa3580b13c0 0x7fa3581591a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:16.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.134+0000 7fa35d087700 1 -- 172.21.15.77:0/3532477120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3580a4580 msgr2=0x7fa358158c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:16.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.134+0000 7fa35d087700 1 --2- 172.21.15.77:0/3532477120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3580a4580 0x7fa358158c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:16.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.134+0000 7fa35d087700 1 -- 172.21.15.77:0/3532477120 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa348009570 con 0x7fa358069b10 2023-07-24T05:46:16.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.134+0000 7fa35d087700 1 --2- 172.21.15.77:0/3532477120 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa358069b10 0x7fa3581f1d20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa35400e840 tx=0x7fa35400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:16.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.138+0000 7fa34dffb700 1 -- 172.21.15.77:0/3532477120 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3540095a0 con 0x7fa358069b10 2023-07-24T05:46:16.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.138+0000 7fa34dffb700 1 -- 172.21.15.77:0/3532477120 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa354013680 con 0x7fa358069b10 2023-07-24T05:46:16.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.138+0000 7fa35e089700 1 -- 172.21.15.77:0/3532477120 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3580c21d0 con 0x7fa358069b10 2023-07-24T05:46:16.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.138+0000 7fa34dffb700 1 -- 172.21.15.77:0/3532477120 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3540139f0 con 0x7fa358069b10 2023-07-24T05:46:16.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.138+0000 7fa35e089700 1 -- 172.21.15.77:0/3532477120 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3580c2790 con 0x7fa358069b10 2023-07-24T05:46:16.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.138+0000 7fa35e089700 1 -- 172.21.15.77:0/3532477120 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa358072490 con 0x7fa358069b10 2023-07-24T05:46:16.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.138+0000 7fa34dffb700 1 -- 172.21.15.77:0/3532477120 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa354013b50 con 0x7fa358069b10 2023-07-24T05:46:16.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.142+0000 7fa34dffb700 1 --2- 172.21.15.77:0/3532477120 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa33c0662f0 0x7fa33c0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:16.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.142+0000 7fa34dffb700 1 -- 172.21.15.77:0/3532477120 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa354083e80 con 0x7fa358069b10 2023-07-24T05:46:16.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.142+0000 7fa35c886700 1 --2- 172.21.15.77:0/3532477120 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa33c0662f0 0x7fa33c0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:16.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.146+0000 7fa35c886700 1 --2- 172.21.15.77:0/3532477120 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa33c0662f0 0x7fa33c0687b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa35806f1a0 tx=0x7fa348008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:16.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.150+0000 7fa34dffb700 1 -- 172.21.15.77:0/3532477120 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa354054a90 con 0x7fa358069b10 2023-07-24T05:46:16.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.322+0000 7fa35e089700 1 -- 172.21.15.77:0/3532477120 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3580ac2f0 con 0x7fa358069b10 2023-07-24T05:46:16.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.326+0000 7fa34dffb700 1 -- 172.21.15.77:0/3532477120 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20108 (secure 0 0 0) 0x7fa354054620 con 0x7fa358069b10 2023-07-24T05:46:16.332 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:46:16.332 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":25,"fsid":"5aed5f7b-fb55-4d95-9c02-c6adbb1677b4","created":"2023-07-24T05:45:39.639731+0000","modified":"2023-07-24T05:46:05.445306+0000","last_up_change":"2023-07-24T05:45:52.319670+0000","last_in_change":"2023-07-24T05:45:43.643277+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-24T05:45:52.610430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-24T05:45:52.773787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-24T05:45:58.121732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-24T05:45:59.368726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-24T05:46:03.032057+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ffa0d496-461a-4053-b764-0627d969521b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6812","nonce":825987196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6817","nonce":825987196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6831","nonce":825987196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6824","nonce":825987196}]},"public_addr":"172.21.15.77:6812/825987196","cluster_addr":"172.21.15.77:6817/825987196","heartbeat_back_addr":"172.21.15.77:6831/825987196","heartbeat_front_addr":"172.21.15.77:6824/825987196","state":["exists","up"]},{"osd":1,"uuid":"9f595e5e-5c43-49bc-8ce4-ee70575c90da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6801","nonce":4133026815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6803","nonce":4133026815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6807","nonce":4133026815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6805","nonce":4133026815}]},"public_addr":"172.21.15.77:6801/4133026815","cluster_addr":"172.21.15.77:6803/4133026815","heartbeat_back_addr":"172.21.15.77:6807/4133026815","heartbeat_front_addr":"172.21.15.77:6805/4133026815","state":["exists","up"]},{"osd":2,"uuid":"2ac177aa-4d7d-4262-bd54-d2b9f29f4c3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6811","nonce":2394142159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6819","nonce":2394142159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6830","nonce":2394142159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6825","nonce":2394142159}]},"public_addr":"172.21.15.77:6811/2394142159","cluster_addr":"172.21.15.77:6819/2394142159","heartbeat_back_addr":"172.21.15.77:6830/2394142159","heartbeat_front_addr":"172.21.15.77:6825/2394142159","state":["exists","up"]},{"osd":3,"uuid":"17d7a251-19e8-484c-8172-a578ab3da153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6813","nonce":1492113982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6818","nonce":1492113982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6829","nonce":1492113982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6823","nonce":1492113982}]},"public_addr":"172.21.15.77:6813/1492113982","cluster_addr":"172.21.15.77:6818/1492113982","heartbeat_back_addr":"172.21.15.77:6829/1492113982","heartbeat_front_addr":"172.21.15.77:6823/1492113982","state":["exists","up"]},{"osd":4,"uuid":"bf63ca05-f06d-4e0f-ac44-2a416c70b919","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6825","nonce":1080481057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6827","nonce":1080481057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6831","nonce":1080481057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6829","nonce":1080481057}]},"public_addr":"172.21.15.103:6825/1080481057","cluster_addr":"172.21.15.103:6827/1080481057","heartbeat_back_addr":"172.21.15.103:6831/1080481057","heartbeat_front_addr":"172.21.15.103:6829/1080481057","state":["exists","up"]},{"osd":5,"uuid":"65a11a35-9e9f-4b3c-9fe3-b658d62b9318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6811","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6813","nonce":2756677504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6818","nonce":2756677504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6823","nonce":2756677504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6821","nonce":2756677504}]},"public_addr":"172.21.15.103:6813/2756677504","cluster_addr":"172.21.15.103:6818/2756677504","heartbeat_back_addr":"172.21.15.103:6823/2756677504","heartbeat_front_addr":"172.21.15.103:6821/2756677504","state":["exists","up"]},{"osd":6,"uuid":"750c1f87-686c-40b4-94a1-1a299dc78f3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6809","nonce":568977764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6812","nonce":568977764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6819","nonce":568977764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6815","nonce":568977764}]},"public_addr":"172.21.15.103:6809/568977764","cluster_addr":"172.21.15.103:6812/568977764","heartbeat_back_addr":"172.21.15.103:6819/568977764","heartbeat_front_addr":"172.21.15.103:6815/568977764","state":["exists","up"]},{"osd":7,"uuid":"d5fe4fb6-2e09-4158-885b-403803c85822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6801","nonce":1074557176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6803","nonce":1074557176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6807","nonce":1074557176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6805","nonce":1074557176}]},"public_addr":"172.21.15.103:6801/1074557176","cluster_addr":"172.21.15.103:6803/1074557176","heartbeat_back_addr":"172.21.15.103:6807/1074557176","heartbeat_front_addr":"172.21.15.103:6805/1074557176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.631032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.154109+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.398587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.679089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.311218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.353726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.314372+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.126212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-24T05:46:16.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.334+0000 7fa35e089700 1 -- 172.21.15.77:0/3532477120 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa33c0662f0 msgr2=0x7fa33c0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:16.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.334+0000 7fa35e089700 1 --2- 172.21.15.77:0/3532477120 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa33c0662f0 0x7fa33c0687b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa35806f1a0 tx=0x7fa348008030 comp rx=0 tx=0).stop 2023-07-24T05:46:16.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.334+0000 7fa35e089700 1 -- 172.21.15.77:0/3532477120 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa358069b10 msgr2=0x7fa3581f1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:16.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.334+0000 7fa35e089700 1 --2- 172.21.15.77:0/3532477120 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa358069b10 0x7fa3581f1d20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa35400e840 tx=0x7fa35400eb50 comp rx=0 tx=0).stop 2023-07-24T05:46:16.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.334+0000 7fa35e089700 1 -- 172.21.15.77:0/3532477120 shutdown_connections 2023-07-24T05:46:16.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.334+0000 7fa35e089700 1 --2- 172.21.15.77:0/3532477120 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa33c0662f0 0x7fa33c0687b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:16.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.334+0000 7fa35e089700 1 --2- 172.21.15.77:0/3532477120 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa3580b13c0 0x7fa3581591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:16.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.334+0000 7fa35e089700 1 --2- 172.21.15.77:0/3532477120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3580a4580 0x7fa358158c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:16.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.334+0000 7fa35e089700 1 --2- 172.21.15.77:0/3532477120 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa358069b10 0x7fa3581f1d20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:16.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.334+0000 7fa35e089700 1 -- 172.21.15.77:0/3532477120 >> 172.21.15.77:0/3532477120 conn(0x7fa3580cacc0 msgr2=0x7fa3580c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:16.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.334+0000 7fa35e089700 1 -- 172.21.15.77:0/3532477120 shutdown_connections 2023-07-24T05:46:16.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.334+0000 7fa35e089700 1 -- 172.21.15.77:0/3532477120 wait complete. 2023-07-24T05:46:16.358 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-24T05:45:52.610430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-24T05:45:52.773787+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-24T05:45:58.121732+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-24T05:45:59.368726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-24T05:46:03.032057+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-24T05:46:16.359 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-24T05:46:16.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.530+0000 7f12a59ae700 1 Processor -- start 2023-07-24T05:46:16.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.530+0000 7f12a59ae700 1 -- start start 2023-07-24T05:46:16.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.534+0000 7f12a59ae700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f12a00d2fc0 0x7f12a00b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:16.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.534+0000 7f12a59ae700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f12a015db20 0x7f12a00d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:16.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.534+0000 7f12a59ae700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12a0160fa0 con 0x7f12a006afc0 2023-07-24T05:46:16.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.534+0000 7f12a59ae700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12a00d0360 con 0x7f12a015db20 2023-07-24T05:46:16.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.534+0000 7f12a59ae700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12a00b20b0 con 0x7f12a00d2fc0 2023-07-24T05:46:16.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.534+0000 7f129f7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f12a015db20 0x7f12a00d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:16.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.534+0000 7f1297fff700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f12a00d2fc0 0x7f12a00b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:16.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.534+0000 7f129f7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f12a015db20 0x7f12a00d1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:51900/0 (socket says 172.21.15.77:51900) 2023-07-24T05:46:16.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.534+0000 7f129f7fe700 1 -- 172.21.15.77:0/1608089952 learned_addr learned my addr 172.21.15.77:0/1608089952 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:16.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.534+0000 7f129f7fe700 1 -- 172.21.15.77:0/1608089952 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f12a00d2fc0 msgr2=0x7f12a00b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:16.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.534+0000 7f129f7fe700 1 --2- 172.21.15.77:0/1608089952 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f12a00d2fc0 0x7f12a00b1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:16.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.534+0000 7f129f7fe700 1 -- 172.21.15.77:0/1608089952 >> v1:172.21.15.103:6789/0 conn(0x7f12a006afc0 legacy=0x7f12a00d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:16.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.534+0000 7f129e7fc700 1 -- 172.21.15.77:0/1608089952 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 381571597 0 0) 0x7f12a0160fa0 con 0x7f12a006afc0 2023-07-24T05:46:16.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.534+0000 7f129f7fe700 1 -- 172.21.15.77:0/1608089952 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a0160670 con 0x7f12a015db20 2023-07-24T05:46:16.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.534+0000 7f129f7fe700 1 --2- 172.21.15.77:0/1608089952 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12a015db20 0x7f12a00d1520 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1298009e50 tx=0x7f129800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48257cc909b23db4 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:16.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.538+0000 7f129e7fc700 1 -- 172.21.15.77:0/1608089952 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129800e070 con 0x7f12a015db20 2023-07-24T05:46:16.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.538+0000 7f129e7fc700 1 -- 172.21.15.77:0/1608089952 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f129800b910 con 0x7f12a015db20 2023-07-24T05:46:16.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.538+0000 7f129e7fc700 1 -- 172.21.15.77:0/1608089952 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129800bcc0 con 0x7f12a015db20 2023-07-24T05:46:16.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.538+0000 7f12a59ae700 1 -- 172.21.15.77:0/1608089952 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12a015db20 msgr2=0x7f12a00d1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:16.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.538+0000 7f12a59ae700 1 --2- 172.21.15.77:0/1608089952 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12a015db20 0x7f12a00d1520 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1298009e50 tx=0x7f129800b330 comp rx=0 tx=0).stop 2023-07-24T05:46:16.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.538+0000 7f12a59ae700 1 -- 172.21.15.77:0/1608089952 shutdown_connections 2023-07-24T05:46:16.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.538+0000 7f12a59ae700 1 --2- 172.21.15.77:0/1608089952 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12a015db20 0x7f12a00d1520 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:16.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.538+0000 7f12a59ae700 1 --2- 172.21.15.77:0/1608089952 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f12a00d2fc0 0x7f12a00b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:16.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.538+0000 7f12a59ae700 1 -- 172.21.15.77:0/1608089952 >> 172.21.15.77:0/1608089952 conn(0x7f12a009bc20 msgr2=0x7f12a00b7920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:16.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.538+0000 7f12a59ae700 1 -- 172.21.15.77:0/1608089952 shutdown_connections 2023-07-24T05:46:16.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.538+0000 7f12a59ae700 1 -- 172.21.15.77:0/1608089952 wait complete. 2023-07-24T05:46:16.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.542+0000 7f12a59ae700 1 Processor -- start 2023-07-24T05:46:16.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.542+0000 7f12a59ae700 1 -- start start 2023-07-24T05:46:16.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.542+0000 7f12a59ae700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f12a006afc0 0x7f12a00c9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:16.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.542+0000 7f12a59ae700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12a00d2fc0 0x7f12a00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:16.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.542+0000 7f12a59ae700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12a015db20 0x7f12a014bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:16.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.542+0000 7f12a59ae700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a00b52d0 con 0x7f12a015db20 2023-07-24T05:46:16.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.542+0000 7f12a59ae700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a00ca080 con 0x7f12a00d2fc0 2023-07-24T05:46:16.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.542+0000 7f12a59ae700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12a00ca360 con 0x7f12a006afc0 2023-07-24T05:46:16.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.546+0000 7f129f7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12a015db20 0x7f12a014bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:16.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.546+0000 7f129f7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12a015db20 0x7f12a014bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53312/0 (socket says 172.21.15.77:53312) 2023-07-24T05:46:16.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.546+0000 7f129f7fe700 1 -- 172.21.15.77:0/1596659026 learned_addr learned my addr 172.21.15.77:0/1596659026 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:16.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.546+0000 7f1297fff700 1 --2- 172.21.15.77:0/1596659026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12a00d2fc0 0x7f12a00b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:16.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.546+0000 7f129effd700 1 --2- 172.21.15.77:0/1596659026 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f12a006afc0 0x7f12a00c9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:16.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.546+0000 7f129f7fe700 1 -- 172.21.15.77:0/1596659026 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f12a006afc0 msgr2=0x7f12a00c9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:16.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.546+0000 7f129f7fe700 1 --2- 172.21.15.77:0/1596659026 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f12a006afc0 0x7f12a00c9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:16.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.546+0000 7f129f7fe700 1 -- 172.21.15.77:0/1596659026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12a00d2fc0 msgr2=0x7f12a00b4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:16.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.546+0000 7f129f7fe700 1 --2- 172.21.15.77:0/1596659026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12a00d2fc0 0x7f12a00b4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:16.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.546+0000 7f129f7fe700 1 -- 172.21.15.77:0/1596659026 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1298009b30 con 0x7f12a015db20 2023-07-24T05:46:16.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.546+0000 7f129f7fe700 1 --2- 172.21.15.77:0/1596659026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12a015db20 0x7f12a014bbb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f129800b680 tx=0x7f1298004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:16.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.546+0000 7f129cff9700 1 -- 172.21.15.77:0/1596659026 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1298004960 con 0x7f12a015db20 2023-07-24T05:46:16.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.546+0000 7f129cff9700 1 -- 172.21.15.77:0/1596659026 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12980092e0 con 0x7f12a015db20 2023-07-24T05:46:16.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.546+0000 7f12a59ae700 1 -- 172.21.15.77:0/1596659026 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12a00ca640 con 0x7f12a015db20 2023-07-24T05:46:16.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.546+0000 7f129cff9700 1 -- 172.21.15.77:0/1596659026 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129801c660 con 0x7f12a015db20 2023-07-24T05:46:16.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.546+0000 7f12a59ae700 1 -- 172.21.15.77:0/1596659026 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12a00cac00 con 0x7f12a015db20 2023-07-24T05:46:16.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.546+0000 7f12a59ae700 1 -- 172.21.15.77:0/1596659026 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12a00cae20 con 0x7f12a015db20 2023-07-24T05:46:16.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.550+0000 7f129cff9700 1 -- 172.21.15.77:0/1596659026 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f129801c7c0 con 0x7f12a015db20 2023-07-24T05:46:16.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.550+0000 7f129cff9700 1 --2- 172.21.15.77:0/1596659026 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f12800662f0 0x7f12800687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:16.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.554+0000 7f129cff9700 1 -- 172.21.15.77:0/1596659026 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f12980858c0 con 0x7f12a015db20 2023-07-24T05:46:16.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.554+0000 7f129effd700 1 --2- 172.21.15.77:0/1596659026 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f12800662f0 0x7f12800687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:16.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.554+0000 7f129effd700 1 --2- 172.21.15.77:0/1596659026 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f12800662f0 0x7f12800687b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1290000f60 tx=0x7f1290009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:16.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.558+0000 7f129cff9700 1 -- 172.21.15.77:0/1596659026 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1298052a40 con 0x7f12a015db20 2023-07-24T05:46:16.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.730+0000 7f12a59ae700 1 -- 172.21.15.77:0/1596659026 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f12a004df10 con 0x7f12a015db20 2023-07-24T05:46:16.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.730+0000 7f129cff9700 1 -- 172.21.15.77:0/1596659026 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1298056060 con 0x7f12a015db20 2023-07-24T05:46:16.735 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-07-24T05:46:16.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.734+0000 7f12a59ae700 1 -- 172.21.15.77:0/1596659026 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f12800662f0 msgr2=0x7f12800687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:16.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.734+0000 7f12a59ae700 1 --2- 172.21.15.77:0/1596659026 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f12800662f0 0x7f12800687b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1290000f60 tx=0x7f1290009040 comp rx=0 tx=0).stop 2023-07-24T05:46:16.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.734+0000 7f12a59ae700 1 -- 172.21.15.77:0/1596659026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12a015db20 msgr2=0x7f12a014bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:16.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.734+0000 7f12a59ae700 1 --2- 172.21.15.77:0/1596659026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12a015db20 0x7f12a014bbb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f129800b680 tx=0x7f1298004af0 comp rx=0 tx=0).stop 2023-07-24T05:46:16.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.734+0000 7f12a59ae700 1 -- 172.21.15.77:0/1596659026 shutdown_connections 2023-07-24T05:46:16.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.734+0000 7f12a59ae700 1 --2- 172.21.15.77:0/1596659026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f12a015db20 0x7f12a014bbb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:16.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.734+0000 7f12a59ae700 1 --2- 172.21.15.77:0/1596659026 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12a00d2fc0 0x7f12a00b4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:16.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.734+0000 7f12a59ae700 1 --2- 172.21.15.77:0/1596659026 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f12800662f0 0x7f12800687b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:16.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.734+0000 7f12a59ae700 1 --2- 172.21.15.77:0/1596659026 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f12a006afc0 0x7f12a00c9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:16.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.734+0000 7f12a59ae700 1 -- 172.21.15.77:0/1596659026 >> 172.21.15.77:0/1596659026 conn(0x7f12a009bc20 msgr2=0x7f12a006d220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:16.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.734+0000 7f12a59ae700 1 -- 172.21.15.77:0/1596659026 shutdown_connections 2023-07-24T05:46:16.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.734+0000 7f12a59ae700 1 -- 172.21.15.77:0/1596659026 wait complete. 2023-07-24T05:46:16.761 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-24T05:46:16.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.938+0000 7fe55d54b700 1 Processor -- start 2023-07-24T05:46:16.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.938+0000 7fe55d54b700 1 -- start start 2023-07-24T05:46:16.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.938+0000 7fe55d54b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe55806ce50 0x7fe55806d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:16.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.938+0000 7fe55d54b700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe558071240 con 0x7fe5580cacc0 2023-07-24T05:46:16.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.942+0000 7fe55d54b700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe55806d770 con 0x7fe558071f70 2023-07-24T05:46:16.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.942+0000 7fe55d54b700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe55806b0d0 con 0x7fe55806ce50 2023-07-24T05:46:16.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.942+0000 7fe556ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe55806ce50 0x7fe55806d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:16.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.942+0000 7fe5567fc700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe558071f70 0x7fe55806a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.77:34254/0 (socket says 172.21.15.77:34254) 2023-07-24T05:46:16.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.942+0000 7fe5567fc700 1 -- 172.21.15.77:0/1339680267 learned_addr learned my addr 172.21.15.77:0/1339680267 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:16.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.942+0000 7fe5577fe700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fe5580cacc0 0x7fe5580cb150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:51990/0 (socket says 172.21.15.77:51990) 2023-07-24T05:46:16.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.942+0000 7fe556ffd700 1 --2- 172.21.15.77:0/1339680267 >> v2:172.21.15.103:3300/0 conn(0x7fe55806ce50 0x7fe55806d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:51908/0 (socket says 172.21.15.77:51908) 2023-07-24T05:46:16.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.942+0000 7fe556ffd700 1 -- 172.21.15.77:0/1339680267 >> v1:172.21.15.103:6789/0 conn(0x7fe558071f70 legacy=0x7fe55806a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:16.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.942+0000 7fe556ffd700 1 -- 172.21.15.77:0/1339680267 >> v1:172.21.15.77:6789/0 conn(0x7fe5580cacc0 legacy=0x7fe5580cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:16.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.942+0000 7fe556ffd700 1 -- 172.21.15.77:0/1339680267 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe55806b2f0 con 0x7fe55806ce50 2023-07-24T05:46:16.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.942+0000 7fe556ffd700 1 --2- 172.21.15.77:0/1339680267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe55806ce50 0x7fe55806d230 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe548009840 tx=0x7fe548009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27c1f11fbc737daf server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:16.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.942+0000 7fe555ffb700 1 -- 172.21.15.77:0/1339680267 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe548005e50 con 0x7fe55806ce50 2023-07-24T05:46:16.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.942+0000 7fe555ffb700 1 -- 172.21.15.77:0/1339680267 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe548006030 con 0x7fe55806ce50 2023-07-24T05:46:16.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.942+0000 7fe555ffb700 1 -- 172.21.15.77:0/1339680267 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5480063c0 con 0x7fe55806ce50 2023-07-24T05:46:16.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.942+0000 7fe55d54b700 1 -- 172.21.15.77:0/1339680267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe55806ce50 msgr2=0x7fe55806d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:16.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.942+0000 7fe55d54b700 1 --2- 172.21.15.77:0/1339680267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe55806ce50 0x7fe55806d230 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe548009840 tx=0x7fe548009b50 comp rx=0 tx=0).stop 2023-07-24T05:46:16.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.942+0000 7fe55d54b700 1 -- 172.21.15.77:0/1339680267 shutdown_connections 2023-07-24T05:46:16.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.942+0000 7fe55d54b700 1 --2- 172.21.15.77:0/1339680267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe55806ce50 0x7fe55806d230 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:16.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.942+0000 7fe55d54b700 1 -- 172.21.15.77:0/1339680267 >> 172.21.15.77:0/1339680267 conn(0x7fe5580b1390 msgr2=0x7fe5580b17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:16.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.942+0000 7fe55d54b700 1 -- 172.21.15.77:0/1339680267 shutdown_connections 2023-07-24T05:46:16.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.942+0000 7fe55d54b700 1 -- 172.21.15.77:0/1339680267 wait complete. 2023-07-24T05:46:16.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.946+0000 7fe55d54b700 1 Processor -- start 2023-07-24T05:46:16.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.946+0000 7fe55d54b700 1 -- start start 2023-07-24T05:46:16.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.946+0000 7fe55d54b700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe55806ce50 0x7fe558098e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:16.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.946+0000 7fe55d54b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe558071f70 0x7fe55809b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:16.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.946+0000 7fe55d54b700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5580cacc0 0x7fe5581f2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:16.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.946+0000 7fe55d54b700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55809b8e0 con 0x7fe558071f70 2023-07-24T05:46:16.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.946+0000 7fe55d54b700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5581f2870 con 0x7fe5580cacc0 2023-07-24T05:46:16.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.946+0000 7fe55d54b700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe558099520 con 0x7fe55806ce50 2023-07-24T05:46:16.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.946+0000 7fe5567fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe558071f70 0x7fe55809b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:16.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.946+0000 7fe5567fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe558071f70 0x7fe55809b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53320/0 (socket says 172.21.15.77:53320) 2023-07-24T05:46:16.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.946+0000 7fe5567fc700 1 -- 172.21.15.77:0/1064348484 learned_addr learned my addr 172.21.15.77:0/1064348484 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:16.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.946+0000 7fe556ffd700 1 --2- 172.21.15.77:0/1064348484 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe55806ce50 0x7fe558098e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:16.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.946+0000 7fe5577fe700 1 --2- 172.21.15.77:0/1064348484 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5580cacc0 0x7fe5581f2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:16.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.946+0000 7fe5567fc700 1 -- 172.21.15.77:0/1064348484 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe55806ce50 msgr2=0x7fe558098e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:16.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.946+0000 7fe5567fc700 1 --2- 172.21.15.77:0/1064348484 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe55806ce50 0x7fe558098e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:16.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.946+0000 7fe5567fc700 1 -- 172.21.15.77:0/1064348484 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5580cacc0 msgr2=0x7fe5581f2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:16.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.946+0000 7fe5567fc700 1 --2- 172.21.15.77:0/1064348484 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5580cacc0 0x7fe5581f2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:16.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.946+0000 7fe5567fc700 1 -- 172.21.15.77:0/1064348484 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe548009450 con 0x7fe558071f70 2023-07-24T05:46:16.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.946+0000 7fe5577fe700 1 --2- 172.21.15.77:0/1064348484 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5580cacc0 0x7fe5581f2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:46:16.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.946+0000 7fe5567fc700 1 --2- 172.21.15.77:0/1064348484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe558071f70 0x7fe55809b3a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe54c00b710 tx=0x7fe54c00ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:16.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.950+0000 7fe53f7fe700 1 -- 172.21.15.77:0/1064348484 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54c00f8f0 con 0x7fe558071f70 2023-07-24T05:46:16.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.950+0000 7fe53f7fe700 1 -- 172.21.15.77:0/1064348484 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe54c00fa50 con 0x7fe558071f70 2023-07-24T05:46:16.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.950+0000 7fe55d54b700 1 -- 172.21.15.77:0/1064348484 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe558099800 con 0x7fe558071f70 2023-07-24T05:46:16.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.950+0000 7fe53f7fe700 1 -- 172.21.15.77:0/1064348484 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54c00fdc0 con 0x7fe558071f70 2023-07-24T05:46:16.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.950+0000 7fe55d54b700 1 -- 172.21.15.77:0/1064348484 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe558099dc0 con 0x7fe558071f70 2023-07-24T05:46:16.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.950+0000 7fe55d54b700 1 -- 172.21.15.77:0/1064348484 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5580b0d30 con 0x7fe558071f70 2023-07-24T05:46:16.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.950+0000 7fe53f7fe700 1 -- 172.21.15.77:0/1064348484 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe54c018410 con 0x7fe558071f70 2023-07-24T05:46:16.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.954+0000 7fe53f7fe700 1 --2- 172.21.15.77:0/1064348484 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe5440662f0 0x7fe5440687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:16.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.954+0000 7fe53f7fe700 1 -- 172.21.15.77:0/1064348484 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe54c084a10 con 0x7fe558071f70 2023-07-24T05:46:16.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.954+0000 7fe556ffd700 1 --2- 172.21.15.77:0/1064348484 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe5440662f0 0x7fe5440687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:16.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.954+0000 7fe556ffd700 1 --2- 172.21.15.77:0/1064348484 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe5440662f0 0x7fe5440687b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe548009b90 tx=0x7fe548008070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:16.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:16.958+0000 7fe53f7fe700 1 -- 172.21.15.77:0/1064348484 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe54c051b10 con 0x7fe558071f70 2023-07-24T05:46:17.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.130+0000 7fe55d54b700 1 -- 172.21.15.77:0/1064348484 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe55804df10 con 0x7fe558071f70 2023-07-24T05:46:17.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.130+0000 7fe53f7fe700 1 -- 172.21.15.77:0/1064348484 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe54c055130 con 0x7fe558071f70 2023-07-24T05:46:17.135 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 8 2023-07-24T05:46:17.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.134+0000 7fe55d54b700 1 -- 172.21.15.77:0/1064348484 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe5440662f0 msgr2=0x7fe5440687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:17.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.134+0000 7fe55d54b700 1 --2- 172.21.15.77:0/1064348484 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe5440662f0 0x7fe5440687b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe548009b90 tx=0x7fe548008070 comp rx=0 tx=0).stop 2023-07-24T05:46:17.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.134+0000 7fe55d54b700 1 -- 172.21.15.77:0/1064348484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe558071f70 msgr2=0x7fe55809b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:17.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.134+0000 7fe55d54b700 1 --2- 172.21.15.77:0/1064348484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe558071f70 0x7fe55809b3a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe54c00b710 tx=0x7fe54c00ba20 comp rx=0 tx=0).stop 2023-07-24T05:46:17.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.134+0000 7fe55d54b700 1 -- 172.21.15.77:0/1064348484 shutdown_connections 2023-07-24T05:46:17.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.134+0000 7fe55d54b700 1 --2- 172.21.15.77:0/1064348484 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5580cacc0 0x7fe5581f2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:17.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.134+0000 7fe55d54b700 1 --2- 172.21.15.77:0/1064348484 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe558071f70 0x7fe55809b3a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:17.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.134+0000 7fe55d54b700 1 --2- 172.21.15.77:0/1064348484 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe5440662f0 0x7fe5440687b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:17.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.134+0000 7fe55d54b700 1 --2- 172.21.15.77:0/1064348484 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe55806ce50 0x7fe558098e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:17.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.134+0000 7fe55d54b700 1 -- 172.21.15.77:0/1064348484 >> 172.21.15.77:0/1064348484 conn(0x7fe5580b1390 msgr2=0x7fe5580cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:17.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.134+0000 7fe55d54b700 1 -- 172.21.15.77:0/1064348484 shutdown_connections 2023-07-24T05:46:17.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.134+0000 7fe55d54b700 1 -- 172.21.15.77:0/1064348484 wait complete. 2023-07-24T05:46:17.158 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-24T05:46:17.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.338+0000 7fb85a1e6700 1 Processor -- start 2023-07-24T05:46:17.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.338+0000 7fb85a1e6700 1 -- start start 2023-07-24T05:46:17.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.342+0000 7fb85a1e6700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb85406cb30 0x7fb854069b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:17.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.342+0000 7fb85a1e6700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb8540cdbd0 0x7fb854070130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:17.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.342+0000 7fb85a1e6700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb85406b460 con 0x7fb8541600c0 2023-07-24T05:46:17.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.342+0000 7fb85a1e6700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb85406ae20 con 0x7fb8540cdbd0 2023-07-24T05:46:17.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.342+0000 7fb85a1e6700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85406a210 con 0x7fb85406cb30 2023-07-24T05:46:17.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.342+0000 7fb8537fe700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb8541600c0 0x7fb8540cd4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52000/0 (socket says 172.21.15.77:52000) 2023-07-24T05:46:17.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.342+0000 7fb8537fe700 1 -- 172.21.15.77:0/2610248759 learned_addr learned my addr 172.21.15.77:0/2610248759 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:17.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.342+0000 7fb852ffd700 1 --2- 172.21.15.77:0/2610248759 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb85406cb30 0x7fb854069b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:17.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.342+0000 7fb853fff700 1 --2- 172.21.15.77:0/2610248759 >> v2:172.21.15.77:3300/0 conn(0x7fb8540cdbd0 0x7fb854070130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:17.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.342+0000 7fb8527fc700 1 -- 172.21.15.77:0/2610248759 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3484756226 0 0) 0x7fb85406b460 con 0x7fb8541600c0 2023-07-24T05:46:17.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.342+0000 7fb8527fc700 1 -- 172.21.15.77:0/2610248759 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb83c0035d0 con 0x7fb8541600c0 2023-07-24T05:46:17.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.342+0000 7fb852ffd700 1 -- 172.21.15.77:0/2610248759 >> v2:172.21.15.77:3300/0 conn(0x7fb8540cdbd0 msgr2=0x7fb854070130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:17.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.342+0000 7fb852ffd700 1 --2- 172.21.15.77:0/2610248759 >> v2:172.21.15.77:3300/0 conn(0x7fb8540cdbd0 0x7fb854070130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:17.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.342+0000 7fb852ffd700 1 -- 172.21.15.77:0/2610248759 >> v1:172.21.15.77:6789/0 conn(0x7fb8541600c0 legacy=0x7fb8540cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:17.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.342+0000 7fb852ffd700 1 -- 172.21.15.77:0/2610248759 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85406a4f0 con 0x7fb85406cb30 2023-07-24T05:46:17.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.342+0000 7fb852ffd700 1 --2- 172.21.15.77:0/2610248759 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb85406cb30 0x7fb854069b10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb848009850 tx=0x7fb848009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71a4377561dae547 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:17.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.342+0000 7fb8527fc700 1 -- 172.21.15.77:0/2610248759 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb848011830 con 0x7fb85406cb30 2023-07-24T05:46:17.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.342+0000 7fb8527fc700 1 -- 172.21.15.77:0/2610248759 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb848011990 con 0x7fb85406cb30 2023-07-24T05:46:17.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.342+0000 7fb8527fc700 1 -- 172.21.15.77:0/2610248759 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb848011d40 con 0x7fb85406cb30 2023-07-24T05:46:17.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.346+0000 7fb85a1e6700 1 -- 172.21.15.77:0/2610248759 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb85406cb30 msgr2=0x7fb854069b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:17.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.346+0000 7fb85a1e6700 1 --2- 172.21.15.77:0/2610248759 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb85406cb30 0x7fb854069b10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb848009850 tx=0x7fb848009b60 comp rx=0 tx=0).stop 2023-07-24T05:46:17.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.346+0000 7fb85a1e6700 1 -- 172.21.15.77:0/2610248759 shutdown_connections 2023-07-24T05:46:17.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.346+0000 7fb85a1e6700 1 --2- 172.21.15.77:0/2610248759 >> v2:172.21.15.77:3300/0 conn(0x7fb8540cdbd0 0x7fb854070130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:17.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.346+0000 7fb85a1e6700 1 --2- 172.21.15.77:0/2610248759 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb85406cb30 0x7fb854069b10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:17.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.346+0000 7fb85a1e6700 1 -- 172.21.15.77:0/2610248759 >> 172.21.15.77:0/2610248759 conn(0x7fb8540ce440 msgr2=0x7fb8540ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:17.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.346+0000 7fb85a1e6700 1 -- 172.21.15.77:0/2610248759 shutdown_connections 2023-07-24T05:46:17.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.346+0000 7fb85a1e6700 1 -- 172.21.15.77:0/2610248759 wait complete. 2023-07-24T05:46:17.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.346+0000 7fb85a1e6700 1 Processor -- start 2023-07-24T05:46:17.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.350+0000 7fb85a1e6700 1 -- start start 2023-07-24T05:46:17.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.350+0000 7fb85a1e6700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb85406cb30 0x7fb8540c2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:17.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.350+0000 7fb85a1e6700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8540cdbd0 0x7fb85415ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:17.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.350+0000 7fb85a1e6700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb8541600c0 0x7fb8540c9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:17.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.350+0000 7fb85a1e6700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85415e330 con 0x7fb8540cdbd0 2023-07-24T05:46:17.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.350+0000 7fb85a1e6700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8540c2720 con 0x7fb85406cb30 2023-07-24T05:46:17.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.350+0000 7fb85a1e6700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8540c2a00 con 0x7fb8541600c0 2023-07-24T05:46:17.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.350+0000 7fb852ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8540cdbd0 0x7fb85415ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:17.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.350+0000 7fb852ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8540cdbd0 0x7fb85415ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53336/0 (socket says 172.21.15.77:53336) 2023-07-24T05:46:17.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.350+0000 7fb852ffd700 1 -- 172.21.15.77:0/2189893681 learned_addr learned my addr 172.21.15.77:0/2189893681 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:17.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.350+0000 7fb8537fe700 1 --2- 172.21.15.77:0/2189893681 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb85406cb30 0x7fb8540c2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:17.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.350+0000 7fb853fff700 1 --2- 172.21.15.77:0/2189893681 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb8541600c0 0x7fb8540c9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:17.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.350+0000 7fb852ffd700 1 -- 172.21.15.77:0/2189893681 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb8541600c0 msgr2=0x7fb8540c9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:17.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.350+0000 7fb852ffd700 1 --2- 172.21.15.77:0/2189893681 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb8541600c0 0x7fb8540c9580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:17.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.350+0000 7fb852ffd700 1 -- 172.21.15.77:0/2189893681 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb85406cb30 msgr2=0x7fb8540c2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:17.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.350+0000 7fb852ffd700 1 --2- 172.21.15.77:0/2189893681 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb85406cb30 0x7fb8540c2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:17.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.350+0000 7fb852ffd700 1 -- 172.21.15.77:0/2189893681 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8480094b0 con 0x7fb8540cdbd0 2023-07-24T05:46:17.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.350+0000 7fb8537fe700 1 --2- 172.21.15.77:0/2189893681 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb85406cb30 0x7fb8540c2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:46:17.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.350+0000 7fb852ffd700 1 --2- 172.21.15.77:0/2189893681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8540cdbd0 0x7fb85415ddf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb8480090b0 tx=0x7fb848004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:17.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.350+0000 7fb83bfff700 1 -- 172.21.15.77:0/2189893681 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb848004480 con 0x7fb8540cdbd0 2023-07-24T05:46:17.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.350+0000 7fb85a1e6700 1 -- 172.21.15.77:0/2189893681 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8540c2ce0 con 0x7fb8540cdbd0 2023-07-24T05:46:17.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.350+0000 7fb83bfff700 1 -- 172.21.15.77:0/2189893681 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84801f070 con 0x7fb8540cdbd0 2023-07-24T05:46:17.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.350+0000 7fb83bfff700 1 -- 172.21.15.77:0/2189893681 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb848003900 con 0x7fb8540cdbd0 2023-07-24T05:46:17.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.350+0000 7fb85a1e6700 1 -- 172.21.15.77:0/2189893681 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8540ca100 con 0x7fb8540cdbd0 2023-07-24T05:46:17.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.354+0000 7fb85a1e6700 1 -- 172.21.15.77:0/2189893681 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb85404df10 con 0x7fb8540cdbd0 2023-07-24T05:46:17.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.354+0000 7fb83bfff700 1 -- 172.21.15.77:0/2189893681 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb848021030 con 0x7fb8540cdbd0 2023-07-24T05:46:17.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.354+0000 7fb83bfff700 1 --2- 172.21.15.77:0/2189893681 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb840066320 0x7fb8400687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:17.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.354+0000 7fb83bfff700 1 -- 172.21.15.77:0/2189893681 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb848085650 con 0x7fb8540cdbd0 2023-07-24T05:46:17.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.358+0000 7fb8537fe700 1 --2- 172.21.15.77:0/2189893681 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb840066320 0x7fb8400687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:17.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.358+0000 7fb8537fe700 1 --2- 172.21.15.77:0/2189893681 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb840066320 0x7fb8400687e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb8440010e0 tx=0x7fb844009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:17.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.362+0000 7fb83bfff700 1 -- 172.21.15.77:0/2189893681 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb848052870 con 0x7fb8540cdbd0 2023-07-24T05:46:17.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.538+0000 7fb85a1e6700 1 -- 172.21.15.77:0/2189893681 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb8540c7a80 con 0x7fb8540cdbd0 2023-07-24T05:46:17.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.538+0000 7fb83bfff700 1 -- 172.21.15.77:0/2189893681 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb848006ce0 con 0x7fb8540cdbd0 2023-07-24T05:46:17.543 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-07-24T05:46:17.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.542+0000 7fb85a1e6700 1 -- 172.21.15.77:0/2189893681 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb840066320 msgr2=0x7fb8400687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:17.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.542+0000 7fb85a1e6700 1 --2- 172.21.15.77:0/2189893681 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb840066320 0x7fb8400687e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb8440010e0 tx=0x7fb844009040 comp rx=0 tx=0).stop 2023-07-24T05:46:17.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.542+0000 7fb85a1e6700 1 -- 172.21.15.77:0/2189893681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8540cdbd0 msgr2=0x7fb85415ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:17.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.542+0000 7fb85a1e6700 1 --2- 172.21.15.77:0/2189893681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8540cdbd0 0x7fb85415ddf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb8480090b0 tx=0x7fb848004770 comp rx=0 tx=0).stop 2023-07-24T05:46:17.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.542+0000 7fb85a1e6700 1 -- 172.21.15.77:0/2189893681 shutdown_connections 2023-07-24T05:46:17.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.542+0000 7fb85a1e6700 1 --2- 172.21.15.77:0/2189893681 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb840066320 0x7fb8400687e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:17.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.542+0000 7fb85a1e6700 1 --2- 172.21.15.77:0/2189893681 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb8541600c0 0x7fb8540c9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:17.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.542+0000 7fb85a1e6700 1 --2- 172.21.15.77:0/2189893681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb8540cdbd0 0x7fb85415ddf0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:17.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.542+0000 7fb85a1e6700 1 --2- 172.21.15.77:0/2189893681 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb85406cb30 0x7fb8540c2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:17.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.542+0000 7fb85a1e6700 1 -- 172.21.15.77:0/2189893681 >> 172.21.15.77:0/2189893681 conn(0x7fb8540ce440 msgr2=0x7fb85415f390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:17.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.542+0000 7fb85a1e6700 1 -- 172.21.15.77:0/2189893681 shutdown_connections 2023-07-24T05:46:17.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.542+0000 7fb85a1e6700 1 -- 172.21.15.77:0/2189893681 wait complete. 2023-07-24T05:46:17.569 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-24T05:46:17.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.746+0000 7fcc7cc89700 1 Processor -- start 2023-07-24T05:46:17.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.746+0000 7fcc7cc89700 1 -- start start 2023-07-24T05:46:17.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.750+0000 7fcc7cc89700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fcc7806afc0 0x7fcc780b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:17.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.750+0000 7fcc7cc89700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcc7815db20 0x7fcc780d28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:17.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.750+0000 7fcc7cc89700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcc780d2df0 0x7fcc780d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:17.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.750+0000 7fcc7cc89700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc780d3280 con 0x7fcc7815db20 2023-07-24T05:46:17.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.750+0000 7fcc7cc89700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc78160fa0 con 0x7fcc7806afc0 2023-07-24T05:46:17.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.750+0000 7fcc7cc89700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc780b20b0 con 0x7fcc780d2df0 2023-07-24T05:46:17.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.750+0000 7fcc75d9b700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcc7815db20 0x7fcc780d28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:17.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.750+0000 7fcc75d9b700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcc7815db20 0x7fcc780d28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53344/0 (socket says 172.21.15.77:53344) 2023-07-24T05:46:17.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.750+0000 7fcc75d9b700 1 -- 172.21.15.77:0/2331292312 learned_addr learned my addr 172.21.15.77:0/2331292312 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:17.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.750+0000 7fcc7659c700 1 --2- 172.21.15.77:0/2331292312 >> v2:172.21.15.103:3300/0 conn(0x7fcc7806afc0 0x7fcc780b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:17.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.750+0000 7fcc76d9d700 1 --2- 172.21.15.77:0/2331292312 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcc780d2df0 0x7fcc780d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:17.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.750+0000 7fcc75d9b700 1 -- 172.21.15.77:0/2331292312 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcc780d2df0 msgr2=0x7fcc780d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:17.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.750+0000 7fcc75d9b700 1 --2- 172.21.15.77:0/2331292312 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcc780d2df0 0x7fcc780d1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:17.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.750+0000 7fcc75d9b700 1 -- 172.21.15.77:0/2331292312 >> v2:172.21.15.103:3300/0 conn(0x7fcc7806afc0 msgr2=0x7fcc780b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:17.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.750+0000 7fcc75d9b700 1 --2- 172.21.15.77:0/2331292312 >> v2:172.21.15.103:3300/0 conn(0x7fcc7806afc0 0x7fcc780b1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:17.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.750+0000 7fcc75d9b700 1 -- 172.21.15.77:0/2331292312 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc78160670 con 0x7fcc7815db20 2023-07-24T05:46:17.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.750+0000 7fcc76d9d700 1 --2- 172.21.15.77:0/2331292312 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcc780d2df0 0x7fcc780d1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:46:17.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.750+0000 7fcc7659c700 1 --2- 172.21.15.77:0/2331292312 >> v2:172.21.15.103:3300/0 conn(0x7fcc7806afc0 0x7fcc780b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:46:17.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.750+0000 7fcc75d9b700 1 --2- 172.21.15.77:0/2331292312 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc7815db20 0x7fcc780d28b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcc7806dc40 tx=0x7fcc6c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e919023d2d77e02 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:17.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.750+0000 7fcc7559a700 1 -- 172.21.15.77:0/2331292312 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c00b8a0 con 0x7fcc7815db20 2023-07-24T05:46:17.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.750+0000 7fcc7559a700 1 -- 172.21.15.77:0/2331292312 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc6c00ba00 con 0x7fcc7815db20 2023-07-24T05:46:17.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.750+0000 7fcc7559a700 1 -- 172.21.15.77:0/2331292312 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c00bd90 con 0x7fcc7815db20 2023-07-24T05:46:17.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.750+0000 7fcc7cc89700 1 -- 172.21.15.77:0/2331292312 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc7815db20 msgr2=0x7fcc780d28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:17.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.750+0000 7fcc7cc89700 1 --2- 172.21.15.77:0/2331292312 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc7815db20 0x7fcc780d28b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcc7806dc40 tx=0x7fcc6c009bf0 comp rx=0 tx=0).stop 2023-07-24T05:46:17.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.754+0000 7fcc7cc89700 1 -- 172.21.15.77:0/2331292312 shutdown_connections 2023-07-24T05:46:17.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.754+0000 7fcc7cc89700 1 --2- 172.21.15.77:0/2331292312 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcc780d2df0 0x7fcc780d1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:17.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.754+0000 7fcc7cc89700 1 --2- 172.21.15.77:0/2331292312 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc7815db20 0x7fcc780d28b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:17.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.754+0000 7fcc7cc89700 1 --2- 172.21.15.77:0/2331292312 >> v2:172.21.15.103:3300/0 conn(0x7fcc7806afc0 0x7fcc780b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:17.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.754+0000 7fcc7cc89700 1 -- 172.21.15.77:0/2331292312 >> 172.21.15.77:0/2331292312 conn(0x7fcc7809bc20 msgr2=0x7fcc780b7920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:17.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.754+0000 7fcc7cc89700 1 -- 172.21.15.77:0/2331292312 shutdown_connections 2023-07-24T05:46:17.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.754+0000 7fcc7cc89700 1 -- 172.21.15.77:0/2331292312 wait complete. 2023-07-24T05:46:17.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.758+0000 7fcc7cc89700 1 Processor -- start 2023-07-24T05:46:17.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.758+0000 7fcc7cc89700 1 -- start start 2023-07-24T05:46:17.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.758+0000 7fcc7cc89700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc7806afc0 0x7fcc78154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:17.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.758+0000 7fcc7cc89700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcc780d2df0 0x7fcc780b4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:17.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.758+0000 7fcc7cc89700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc7815db20 0x7fcc780af5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:17.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.758+0000 7fcc7cc89700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc780c9a10 con 0x7fcc7806afc0 2023-07-24T05:46:17.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.758+0000 7fcc7cc89700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc780c9cf0 con 0x7fcc7815db20 2023-07-24T05:46:17.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.758+0000 7fcc7cc89700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc780b4a80 con 0x7fcc780d2df0 2023-07-24T05:46:17.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.758+0000 7fcc7659c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc7806afc0 0x7fcc78154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:17.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.758+0000 7fcc7659c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc7806afc0 0x7fcc78154b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53348/0 (socket says 172.21.15.77:53348) 2023-07-24T05:46:17.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.758+0000 7fcc7659c700 1 -- 172.21.15.77:0/3874123367 learned_addr learned my addr 172.21.15.77:0/3874123367 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:17.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.758+0000 7fcc75d9b700 1 --2- 172.21.15.77:0/3874123367 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcc780d2df0 0x7fcc780b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:17.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.758+0000 7fcc76d9d700 1 --2- 172.21.15.77:0/3874123367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc7815db20 0x7fcc780af5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:17.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.758+0000 7fcc75d9b700 1 -- 172.21.15.77:0/3874123367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc7815db20 msgr2=0x7fcc780af5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:17.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.758+0000 7fcc75d9b700 1 --2- 172.21.15.77:0/3874123367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc7815db20 0x7fcc780af5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:17.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.758+0000 7fcc75d9b700 1 -- 172.21.15.77:0/3874123367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc7806afc0 msgr2=0x7fcc78154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:17.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.758+0000 7fcc75d9b700 1 --2- 172.21.15.77:0/3874123367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc7806afc0 0x7fcc78154b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:17.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.758+0000 7fcc75d9b700 1 -- 172.21.15.77:0/3874123367 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc6c009570 con 0x7fcc780d2df0 2023-07-24T05:46:17.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.758+0000 7fcc7659c700 1 --2- 172.21.15.77:0/3874123367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc7806afc0 0x7fcc78154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:46:17.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.762+0000 7fcc75d9b700 1 --2- 172.21.15.77:0/3874123367 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcc780d2df0 0x7fcc780b4030 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c016000 tx=0x7fcc6c004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:17.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.762+0000 7fcc66ffd700 1 -- 172.21.15.77:0/3874123367 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c012d20 con 0x7fcc780d2df0 2023-07-24T05:46:17.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.762+0000 7fcc66ffd700 1 -- 172.21.15.77:0/3874123367 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc6c01e070 con 0x7fcc780d2df0 2023-07-24T05:46:17.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.762+0000 7fcc7cc89700 1 -- 172.21.15.77:0/3874123367 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc780b4d60 con 0x7fcc780d2df0 2023-07-24T05:46:17.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.762+0000 7fcc66ffd700 1 -- 172.21.15.77:0/3874123367 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c01a660 con 0x7fcc780d2df0 2023-07-24T05:46:17.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.762+0000 7fcc7cc89700 1 -- 172.21.15.77:0/3874123367 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc78155080 con 0x7fcc780d2df0 2023-07-24T05:46:17.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.762+0000 7fcc7cc89700 1 -- 172.21.15.77:0/3874123367 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc780c9e60 con 0x7fcc780d2df0 2023-07-24T05:46:17.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.766+0000 7fcc66ffd700 1 -- 172.21.15.77:0/3874123367 <== mon.2 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcc6c01a7c0 con 0x7fcc780d2df0 2023-07-24T05:46:17.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.770+0000 7fcc66ffd700 1 --2- 172.21.15.77:0/3874123367 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fcc58066370 0x7fcc58068830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:17.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.770+0000 7fcc66ffd700 1 -- 172.21.15.77:0/3874123367 <== mon.2 v2:172.21.15.103:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcc6c0857a0 con 0x7fcc780d2df0 2023-07-24T05:46:17.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.770+0000 7fcc7659c700 1 --2- 172.21.15.77:0/3874123367 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fcc58066370 0x7fcc58068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:17.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.770+0000 7fcc7659c700 1 --2- 172.21.15.77:0/3874123367 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fcc58066370 0x7fcc58068830 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcc68006bc0 tx=0x7fcc68008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:17.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.774+0000 7fcc66ffd700 1 -- 172.21.15.77:0/3874123367 <== mon.2 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcc6c0529a0 con 0x7fcc780d2df0 2023-07-24T05:46:17.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.946+0000 7fcc7cc89700 1 -- 172.21.15.77:0/3874123367 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcc7804df10 con 0x7fcc780d2df0 2023-07-24T05:46:17.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.946+0000 7fcc66ffd700 1 -- 172.21.15.77:0/3874123367 <== mon.2 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcc6c055fc0 con 0x7fcc780d2df0 2023-07-24T05:46:17.951 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-07-24T05:46:17.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.950+0000 7fcc7cc89700 1 -- 172.21.15.77:0/3874123367 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fcc58066370 msgr2=0x7fcc58068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:17.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.950+0000 7fcc7cc89700 1 --2- 172.21.15.77:0/3874123367 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fcc58066370 0x7fcc58068830 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcc68006bc0 tx=0x7fcc68008040 comp rx=0 tx=0).stop 2023-07-24T05:46:17.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.950+0000 7fcc7cc89700 1 -- 172.21.15.77:0/3874123367 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcc780d2df0 msgr2=0x7fcc780b4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:17.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.950+0000 7fcc7cc89700 1 --2- 172.21.15.77:0/3874123367 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcc780d2df0 0x7fcc780b4030 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c016000 tx=0x7fcc6c004770 comp rx=0 tx=0).stop 2023-07-24T05:46:17.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.950+0000 7fcc7cc89700 1 -- 172.21.15.77:0/3874123367 shutdown_connections 2023-07-24T05:46:17.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.950+0000 7fcc7cc89700 1 --2- 172.21.15.77:0/3874123367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc7815db20 0x7fcc780af5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:17.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.950+0000 7fcc7cc89700 1 --2- 172.21.15.77:0/3874123367 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fcc58066370 0x7fcc58068830 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:17.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.950+0000 7fcc7cc89700 1 --2- 172.21.15.77:0/3874123367 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcc780d2df0 0x7fcc780b4030 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:17.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.950+0000 7fcc7cc89700 1 --2- 172.21.15.77:0/3874123367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcc7806afc0 0x7fcc78154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:17.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.950+0000 7fcc7cc89700 1 -- 172.21.15.77:0/3874123367 >> 172.21.15.77:0/3874123367 conn(0x7fcc7809bc20 msgr2=0x7fcc7806d220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:17.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.950+0000 7fcc7cc89700 1 -- 172.21.15.77:0/3874123367 shutdown_connections 2023-07-24T05:46:17.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:17.950+0000 7fcc7cc89700 1 -- 172.21.15.77:0/3874123367 wait complete. 2023-07-24T05:46:17.977 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-24T05:46:18.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.150+0000 7fc33ffff700 1 Processor -- start 2023-07-24T05:46:18.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.150+0000 7fc33ffff700 1 -- start start 2023-07-24T05:46:18.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.150+0000 7fc33ffff700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc34015ee00 0x7fc3400cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:18.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.150+0000 7fc33ffff700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc3400afd60 0x7fc3400b15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:18.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.154+0000 7fc33ffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc34006de90 0x7fc34006e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:18.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.154+0000 7fc33ffff700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc34006e860 con 0x7fc3400afd60 2023-07-24T05:46:18.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.154+0000 7fc33ffff700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3400b0540 con 0x7fc34006de90 2023-07-24T05:46:18.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.154+0000 7fc33ffff700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3400b0820 con 0x7fc34015ee00 2023-07-24T05:46:18.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.154+0000 7fc33e7fc700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc3400afd60 0x7fc3400b15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:18.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.154+0000 7fc33effd700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc34015ee00 0x7fc3400cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:18.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.154+0000 7fc33e7fc700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc3400afd60 0x7fc3400b15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53358/0 (socket says 172.21.15.77:53358) 2023-07-24T05:46:18.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.154+0000 7fc33f7fe700 1 --2- 172.21.15.77:0/3074080846 >> v2:172.21.15.103:3300/0 conn(0x7fc34006de90 0x7fc34006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:18.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.154+0000 7fc33e7fc700 1 -- 172.21.15.77:0/3074080846 learned_addr learned my addr 172.21.15.77:0/3074080846 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:18.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.154+0000 7fc33e7fc700 1 -- 172.21.15.77:0/3074080846 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc34015ee00 msgr2=0x7fc3400cc2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:18.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.154+0000 7fc33e7fc700 1 --2- 172.21.15.77:0/3074080846 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc34015ee00 0x7fc3400cc2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:18.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.154+0000 7fc33e7fc700 1 -- 172.21.15.77:0/3074080846 >> v2:172.21.15.103:3300/0 conn(0x7fc34006de90 msgr2=0x7fc34006e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:18.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.154+0000 7fc33e7fc700 1 --2- 172.21.15.77:0/3074080846 >> v2:172.21.15.103:3300/0 conn(0x7fc34006de90 0x7fc34006e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:18.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.154+0000 7fc33e7fc700 1 -- 172.21.15.77:0/3074080846 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3400b0b00 con 0x7fc3400afd60 2023-07-24T05:46:18.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.154+0000 7fc33e7fc700 1 --2- 172.21.15.77:0/3074080846 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3400afd60 0x7fc3400b15e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc3400d0510 tx=0x7fc334009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82b007395a969312 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:18.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.154+0000 7fc33dffb700 1 -- 172.21.15.77:0/3074080846 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc334011830 con 0x7fc3400afd60 2023-07-24T05:46:18.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.154+0000 7fc33dffb700 1 -- 172.21.15.77:0/3074080846 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc334011990 con 0x7fc3400afd60 2023-07-24T05:46:18.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.154+0000 7fc33dffb700 1 -- 172.21.15.77:0/3074080846 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc334011d20 con 0x7fc3400afd60 2023-07-24T05:46:18.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.154+0000 7fc33ffff700 1 -- 172.21.15.77:0/3074080846 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3400afd60 msgr2=0x7fc3400b15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:18.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.154+0000 7fc33ffff700 1 --2- 172.21.15.77:0/3074080846 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3400afd60 0x7fc3400b15e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc3400d0510 tx=0x7fc334009bf0 comp rx=0 tx=0).stop 2023-07-24T05:46:18.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.154+0000 7fc33ffff700 1 -- 172.21.15.77:0/3074080846 shutdown_connections 2023-07-24T05:46:18.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.154+0000 7fc33ffff700 1 --2- 172.21.15.77:0/3074080846 >> v2:172.21.15.103:3300/0 conn(0x7fc34006de90 0x7fc34006e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:18.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.154+0000 7fc33ffff700 1 --2- 172.21.15.77:0/3074080846 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3400afd60 0x7fc3400b15e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:18.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.154+0000 7fc33ffff700 1 --2- 172.21.15.77:0/3074080846 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc34015ee00 0x7fc3400cc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:18.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.154+0000 7fc33ffff700 1 -- 172.21.15.77:0/3074080846 >> 172.21.15.77:0/3074080846 conn(0x7fc340069cf0 msgr2=0x7fc3400d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:18.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.154+0000 7fc33ffff700 1 -- 172.21.15.77:0/3074080846 shutdown_connections 2023-07-24T05:46:18.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.154+0000 7fc33ffff700 1 -- 172.21.15.77:0/3074080846 wait complete. 2023-07-24T05:46:18.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.158+0000 7fc33ffff700 1 Processor -- start 2023-07-24T05:46:18.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.158+0000 7fc33ffff700 1 -- start start 2023-07-24T05:46:18.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.158+0000 7fc33ffff700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc34006de90 0x7fc3400c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:18.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.158+0000 7fc33ffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc34015ee00 0x7fc3400c8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:18.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.158+0000 7fc33ffff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc340156c30 0x7fc3400c9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:18.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.158+0000 7fc33ffff700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc340151370 con 0x7fc34015ee00 2023-07-24T05:46:18.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.158+0000 7fc33ffff700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc34015e670 con 0x7fc340156c30 2023-07-24T05:46:18.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.158+0000 7fc33ffff700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3400ca010 con 0x7fc34006de90 2023-07-24T05:46:18.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.158+0000 7fc33e7fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc34015ee00 0x7fc3400c8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:18.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.158+0000 7fc33effd700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc34006de90 0x7fc3400c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:18.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.158+0000 7fc33e7fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc34015ee00 0x7fc3400c8bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53362/0 (socket says 172.21.15.77:53362) 2023-07-24T05:46:18.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.158+0000 7fc33e7fc700 1 -- 172.21.15.77:0/1634944777 learned_addr learned my addr 172.21.15.77:0/1634944777 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:18.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.158+0000 7fc33f7fe700 1 --2- 172.21.15.77:0/1634944777 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc340156c30 0x7fc3400c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:18.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.162+0000 7fc33e7fc700 1 -- 172.21.15.77:0/1634944777 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc34006de90 msgr2=0x7fc3400c8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:18.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.162+0000 7fc33e7fc700 1 --2- 172.21.15.77:0/1634944777 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc34006de90 0x7fc3400c8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:18.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.162+0000 7fc33e7fc700 1 -- 172.21.15.77:0/1634944777 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc340156c30 msgr2=0x7fc3400c9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:18.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.162+0000 7fc33e7fc700 1 --2- 172.21.15.77:0/1634944777 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc340156c30 0x7fc3400c9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:18.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.162+0000 7fc33e7fc700 1 -- 172.21.15.77:0/1634944777 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc334009570 con 0x7fc34015ee00 2023-07-24T05:46:18.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.162+0000 7fc33f7fe700 1 --2- 172.21.15.77:0/1634944777 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc340156c30 0x7fc3400c9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:46:18.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.162+0000 7fc33effd700 1 --2- 172.21.15.77:0/1634944777 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc34006de90 0x7fc3400c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:46:18.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.162+0000 7fc33e7fc700 1 --2- 172.21.15.77:0/1634944777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc34015ee00 0x7fc3400c8bc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc3400ce0e0 tx=0x7fc334004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:18.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.162+0000 7fc3277fe700 1 -- 172.21.15.77:0/1634944777 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc334004240 con 0x7fc34015ee00 2023-07-24T05:46:18.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.162+0000 7fc3277fe700 1 -- 172.21.15.77:0/1634944777 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc33401f070 con 0x7fc34015ee00 2023-07-24T05:46:18.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.162+0000 7fc33ffff700 1 -- 172.21.15.77:0/1634944777 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc34006b5e0 con 0x7fc34015ee00 2023-07-24T05:46:18.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.162+0000 7fc3277fe700 1 -- 172.21.15.77:0/1634944777 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc334004600 con 0x7fc34015ee00 2023-07-24T05:46:18.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.162+0000 7fc33ffff700 1 -- 172.21.15.77:0/1634944777 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc340152ec0 con 0x7fc34015ee00 2023-07-24T05:46:18.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.162+0000 7fc33ffff700 1 -- 172.21.15.77:0/1634944777 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc34006b770 con 0x7fc34015ee00 2023-07-24T05:46:18.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.166+0000 7fc3277fe700 1 -- 172.21.15.77:0/1634944777 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc334021030 con 0x7fc34015ee00 2023-07-24T05:46:18.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.166+0000 7fc3277fe700 1 --2- 172.21.15.77:0/1634944777 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc32c0662f0 0x7fc32c0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:18.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.166+0000 7fc3277fe700 1 -- 172.21.15.77:0/1634944777 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc334084ed0 con 0x7fc34015ee00 2023-07-24T05:46:18.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.166+0000 7fc33effd700 1 --2- 172.21.15.77:0/1634944777 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc32c0662f0 0x7fc32c0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:18.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.170+0000 7fc33effd700 1 --2- 172.21.15.77:0/1634944777 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc32c0662f0 0x7fc32c0687b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc33000e740 tx=0x7fc33000b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:18.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.170+0000 7fc3277fe700 1 -- 172.21.15.77:0/1634944777 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc334052110 con 0x7fc34015ee00 2023-07-24T05:46:18.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.342+0000 7fc33ffff700 1 -- 172.21.15.77:0/1634944777 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc34006f180 con 0x7fc34015ee00 2023-07-24T05:46:18.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.342+0000 7fc3277fe700 1 -- 172.21.15.77:0/1634944777 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc334029020 con 0x7fc34015ee00 2023-07-24T05:46:18.347 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-07-24T05:46:18.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.346+0000 7fc33ffff700 1 -- 172.21.15.77:0/1634944777 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc32c0662f0 msgr2=0x7fc32c0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:18.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.346+0000 7fc33ffff700 1 --2- 172.21.15.77:0/1634944777 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc32c0662f0 0x7fc32c0687b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc33000e740 tx=0x7fc33000b040 comp rx=0 tx=0).stop 2023-07-24T05:46:18.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.346+0000 7fc33ffff700 1 -- 172.21.15.77:0/1634944777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc34015ee00 msgr2=0x7fc3400c8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:18.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.346+0000 7fc33ffff700 1 --2- 172.21.15.77:0/1634944777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc34015ee00 0x7fc3400c8bc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc3400ce0e0 tx=0x7fc334004770 comp rx=0 tx=0).stop 2023-07-24T05:46:18.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.346+0000 7fc33ffff700 1 -- 172.21.15.77:0/1634944777 shutdown_connections 2023-07-24T05:46:18.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.346+0000 7fc33ffff700 1 --2- 172.21.15.77:0/1634944777 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc340156c30 0x7fc3400c9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:18.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.346+0000 7fc33ffff700 1 --2- 172.21.15.77:0/1634944777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc34015ee00 0x7fc3400c8bc0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:18.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.346+0000 7fc33ffff700 1 --2- 172.21.15.77:0/1634944777 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc32c0662f0 0x7fc32c0687b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:18.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.346+0000 7fc33ffff700 1 --2- 172.21.15.77:0/1634944777 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc34006de90 0x7fc3400c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:18.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.346+0000 7fc33ffff700 1 -- 172.21.15.77:0/1634944777 >> 172.21.15.77:0/1634944777 conn(0x7fc340069cf0 msgr2=0x7fc3400ccd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:18.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.346+0000 7fc33ffff700 1 -- 172.21.15.77:0/1634944777 shutdown_connections 2023-07-24T05:46:18.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.346+0000 7fc33ffff700 1 -- 172.21.15.77:0/1634944777 wait complete. 2023-07-24T05:46:18.371 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-24T05:46:18.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.534+0000 7f034e72f700 1 Processor -- start 2023-07-24T05:46:18.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.534+0000 7f034e72f700 1 -- start start 2023-07-24T05:46:18.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.534+0000 7f034e72f700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f03480b13c0 0x7f034806adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:18.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.534+0000 7f034e72f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f03480a4580 0x7f034806fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:18.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.534+0000 7f034e72f700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03480adc40 con 0x7f0348069b10 2023-07-24T05:46:18.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.534+0000 7f034e72f700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f034806b330 con 0x7f03480b13c0 2023-07-24T05:46:18.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.534+0000 7f034e72f700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03480adee0 con 0x7f03480a4580 2023-07-24T05:46:18.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.538+0000 7f034cf2c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f03480a4580 0x7f034806fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:18.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.538+0000 7f034d72d700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f03480b13c0 0x7f034806adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:18.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.538+0000 7f034df2e700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f0348069b10 0x7f03480ae9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:52012/0 (socket says 172.21.15.77:52012) 2023-07-24T05:46:18.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.538+0000 7f034df2e700 1 -- 172.21.15.77:0/3950448596 learned_addr learned my addr 172.21.15.77:0/3950448596 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:18.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.538+0000 7f034cf2c700 1 -- 172.21.15.77:0/3950448596 >> v2:172.21.15.77:3300/0 conn(0x7f03480b13c0 msgr2=0x7f034806adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:18.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.538+0000 7f034cf2c700 1 --2- 172.21.15.77:0/3950448596 >> v2:172.21.15.77:3300/0 conn(0x7f03480b13c0 0x7f034806adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:18.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.538+0000 7f034cf2c700 1 -- 172.21.15.77:0/3950448596 >> v1:172.21.15.77:6789/0 conn(0x7f0348069b10 legacy=0x7f03480ae9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:18.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.538+0000 7f034cf2c700 1 -- 172.21.15.77:0/3950448596 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03480ae1c0 con 0x7f03480a4580 2023-07-24T05:46:18.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.538+0000 7f034cf2c700 1 --2- 172.21.15.77:0/3950448596 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03480a4580 0x7f034806fbe0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f034806e090 tx=0x7f0338009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ace46d75de0dc4a5 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:18.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.538+0000 7f033ffff700 1 -- 172.21.15.77:0/3950448596 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0338011830 con 0x7f03480a4580 2023-07-24T05:46:18.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.538+0000 7f033ffff700 1 -- 172.21.15.77:0/3950448596 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0338011990 con 0x7f03480a4580 2023-07-24T05:46:18.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.538+0000 7f033ffff700 1 -- 172.21.15.77:0/3950448596 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0338011d20 con 0x7f03480a4580 2023-07-24T05:46:18.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.538+0000 7f034e72f700 1 -- 172.21.15.77:0/3950448596 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03480a4580 msgr2=0x7f034806fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:18.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.538+0000 7f034e72f700 1 --2- 172.21.15.77:0/3950448596 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03480a4580 0x7f034806fbe0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f034806e090 tx=0x7f0338009b30 comp rx=0 tx=0).stop 2023-07-24T05:46:18.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.538+0000 7f034e72f700 1 -- 172.21.15.77:0/3950448596 shutdown_connections 2023-07-24T05:46:18.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.538+0000 7f034e72f700 1 --2- 172.21.15.77:0/3950448596 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f03480a4580 0x7f034806fbe0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:18.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.538+0000 7f034e72f700 1 --2- 172.21.15.77:0/3950448596 >> v2:172.21.15.77:3300/0 conn(0x7f03480b13c0 0x7f034806adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:18.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.538+0000 7f034e72f700 1 -- 172.21.15.77:0/3950448596 >> 172.21.15.77:0/3950448596 conn(0x7f03480cacc0 msgr2=0x7f03480cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:18.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.542+0000 7f034e72f700 1 -- 172.21.15.77:0/3950448596 shutdown_connections 2023-07-24T05:46:18.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.542+0000 7f034e72f700 1 -- 172.21.15.77:0/3950448596 wait complete. 2023-07-24T05:46:18.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.542+0000 7f034e72f700 1 Processor -- start 2023-07-24T05:46:18.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.542+0000 7f034e72f700 1 -- start start 2023-07-24T05:46:18.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.546+0000 7f034e72f700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0348069b10 0x7f0348151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:18.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.546+0000 7f034e72f700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f03480a4580 0x7f03480c3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:18.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.546+0000 7f034e72f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03480b13c0 0x7f034814dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:18.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.546+0000 7f034e72f700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03480c4fb0 con 0x7f03480b13c0 2023-07-24T05:46:18.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.546+0000 7f034e72f700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03480c9ff0 con 0x7f0348069b10 2023-07-24T05:46:18.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.546+0000 7f034e72f700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03480c20e0 con 0x7f03480a4580 2023-07-24T05:46:18.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.546+0000 7f034df2e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03480b13c0 0x7f034814dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:18.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.546+0000 7f034d72d700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0348069b10 0x7f0348151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:18.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.546+0000 7f034df2e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03480b13c0 0x7f034814dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53374/0 (socket says 172.21.15.77:53374) 2023-07-24T05:46:18.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.546+0000 7f034df2e700 1 -- 172.21.15.77:0/4045511542 learned_addr learned my addr 172.21.15.77:0/4045511542 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:18.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.546+0000 7f034cf2c700 1 --2- 172.21.15.77:0/4045511542 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f03480a4580 0x7f03480c3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:18.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.546+0000 7f034df2e700 1 -- 172.21.15.77:0/4045511542 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f03480a4580 msgr2=0x7f03480c3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:18.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.546+0000 7f034df2e700 1 --2- 172.21.15.77:0/4045511542 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f03480a4580 0x7f03480c3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:18.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.546+0000 7f034df2e700 1 -- 172.21.15.77:0/4045511542 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0348069b10 msgr2=0x7f0348151810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:18.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.546+0000 7f034df2e700 1 --2- 172.21.15.77:0/4045511542 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0348069b10 0x7f0348151810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:18.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.546+0000 7f034df2e700 1 -- 172.21.15.77:0/4045511542 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03380094b0 con 0x7f03480b13c0 2023-07-24T05:46:18.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.546+0000 7f034d72d700 1 --2- 172.21.15.77:0/4045511542 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0348069b10 0x7f0348151810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:46:18.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.546+0000 7f034df2e700 1 --2- 172.21.15.77:0/4045511542 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03480b13c0 0x7f034814dd50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f034000ca80 tx=0x7f034000cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:18.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.546+0000 7f033dffb700 1 -- 172.21.15.77:0/4045511542 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0340007480 con 0x7f03480b13c0 2023-07-24T05:46:18.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.546+0000 7f033dffb700 1 -- 172.21.15.77:0/4045511542 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03400075e0 con 0x7f03480b13c0 2023-07-24T05:46:18.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.546+0000 7f034e72f700 1 -- 172.21.15.77:0/4045511542 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03480c23c0 con 0x7f03480b13c0 2023-07-24T05:46:18.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.546+0000 7f033dffb700 1 -- 172.21.15.77:0/4045511542 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0340007950 con 0x7f03480b13c0 2023-07-24T05:46:18.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.550+0000 7f034e72f700 1 -- 172.21.15.77:0/4045511542 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03480c4a90 con 0x7f03480b13c0 2023-07-24T05:46:18.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.550+0000 7f034e72f700 1 -- 172.21.15.77:0/4045511542 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f034806cbf0 con 0x7f03480b13c0 2023-07-24T05:46:18.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.550+0000 7f033dffb700 1 -- 172.21.15.77:0/4045511542 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f034001b3b0 con 0x7f03480b13c0 2023-07-24T05:46:18.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.550+0000 7f033dffb700 1 --2- 172.21.15.77:0/4045511542 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f032c0662f0 0x7f032c0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:18.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.550+0000 7f033dffb700 1 -- 172.21.15.77:0/4045511542 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0340083850 con 0x7f03480b13c0 2023-07-24T05:46:18.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.550+0000 7f034d72d700 1 --2- 172.21.15.77:0/4045511542 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f032c0662f0 0x7f032c0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:18.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.554+0000 7f034d72d700 1 --2- 172.21.15.77:0/4045511542 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f032c0662f0 0x7f032c0687b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f03440112c0 tx=0x7f0344009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:18.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.558+0000 7f033dffb700 1 -- 172.21.15.77:0/4045511542 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0340050970 con 0x7f03480b13c0 2023-07-24T05:46:18.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.738+0000 7f034e72f700 1 -- 172.21.15.77:0/4045511542 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f03480c4c80 con 0x7f03480b13c0 2023-07-24T05:46:18.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.738+0000 7f033dffb700 1 -- 172.21.15.77:0/4045511542 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0340053f90 con 0x7f03480b13c0 2023-07-24T05:46:18.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.742+0000 7f034e72f700 1 -- 172.21.15.77:0/4045511542 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f032c0662f0 msgr2=0x7f032c0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:18.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.742+0000 7f034e72f700 1 --2- 172.21.15.77:0/4045511542 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f032c0662f0 0x7f032c0687b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f03440112c0 tx=0x7f0344009240 comp rx=0 tx=0).stop 2023-07-24T05:46:18.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.742+0000 7f034e72f700 1 -- 172.21.15.77:0/4045511542 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03480b13c0 msgr2=0x7f034814dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:18.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.742+0000 7f034e72f700 1 --2- 172.21.15.77:0/4045511542 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03480b13c0 0x7f034814dd50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f034000ca80 tx=0x7f034000cab0 comp rx=0 tx=0).stop 2023-07-24T05:46:18.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.742+0000 7f034e72f700 1 -- 172.21.15.77:0/4045511542 shutdown_connections 2023-07-24T05:46:18.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.742+0000 7f034e72f700 1 --2- 172.21.15.77:0/4045511542 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f03480b13c0 0x7f034814dd50 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:18.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.742+0000 7f034e72f700 1 --2- 172.21.15.77:0/4045511542 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f032c0662f0 0x7f032c0687b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:18.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.742+0000 7f034e72f700 1 --2- 172.21.15.77:0/4045511542 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f03480a4580 0x7f03480c3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:18.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.742+0000 7f034e72f700 1 --2- 172.21.15.77:0/4045511542 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0348069b10 0x7f0348151810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:18.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.742+0000 7f034e72f700 1 -- 172.21.15.77:0/4045511542 >> 172.21.15.77:0/4045511542 conn(0x7f03480cacc0 msgr2=0x7f03480cb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:18.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.742+0000 7f034e72f700 1 -- 172.21.15.77:0/4045511542 shutdown_connections 2023-07-24T05:46:18.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:18.742+0000 7f034e72f700 1 -- 172.21.15.77:0/4045511542 wait complete. 2023-07-24T05:46:18.749 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2023-07-24T05:46:18.770 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi077.front.sepia.ceph.com... 2023-07-24T05:46:18.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:18.770 DEBUG:teuthology.orchestra.run.smithi077:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-07-24T05:46:18.810 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi077.stderr:ceph-fuse[39892]: fuse finished with error 0 and tester_r 0 2023-07-24T05:46:18.815 INFO:teuthology.orchestra.run:waiting for 300 2023-07-24T05:46:24.732 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:46:24.738 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:46:24.916 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi077.front.sepia.ceph.com 2023-07-24T05:46:24.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:24.917 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-07-24T05:46:24.947 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-24T05:46:25.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.162+0000 7fb04d497700 1 Processor -- start 2023-07-24T05:46:25.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.162+0000 7fb04d497700 1 -- start start 2023-07-24T05:46:25.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.162+0000 7fb04d497700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb0480b13c0 0x7fb04806adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:25.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.162+0000 7fb04d497700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb048069b10 0x7fb048069fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:25.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.162+0000 7fb04d497700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0480702f0 con 0x7fb0480a4580 2023-07-24T05:46:25.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.162+0000 7fb04d497700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb04806a500 con 0x7fb0480b13c0 2023-07-24T05:46:25.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.162+0000 7fb04d497700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0480adc40 con 0x7fb048069b10 2023-07-24T05:46:25.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.166+0000 7fb046ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb0480b13c0 0x7fb04806adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:25.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.166+0000 7fb0477fe700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb048069b10 0x7fb048069fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:25.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.166+0000 7fb03ffff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fb0480a4580 0x7fb04806fbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.77:39230/0 (socket says 172.21.15.77:39230) 2023-07-24T05:46:25.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.166+0000 7fb03ffff700 1 -- 172.21.15.77:0/3845983966 learned_addr learned my addr 172.21.15.77:0/3845983966 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:25.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.166+0000 7fb0467fc700 1 -- 172.21.15.77:0/3845983966 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3566348885 0 0) 0x7fb0480702f0 con 0x7fb0480a4580 2023-07-24T05:46:25.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.166+0000 7fb0467fc700 1 -- 172.21.15.77:0/3845983966 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0280035d0 con 0x7fb0480a4580 2023-07-24T05:46:25.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.166+0000 7fb0477fe700 1 -- 172.21.15.77:0/3845983966 >> v2:172.21.15.103:3300/0 conn(0x7fb0480b13c0 msgr2=0x7fb04806adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:25.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.166+0000 7fb0477fe700 1 --2- 172.21.15.77:0/3845983966 >> v2:172.21.15.103:3300/0 conn(0x7fb0480b13c0 0x7fb04806adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:25.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.166+0000 7fb0477fe700 1 -- 172.21.15.77:0/3845983966 >> v1:172.21.15.103:6789/0 conn(0x7fb0480a4580 legacy=0x7fb04806fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:25.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.166+0000 7fb0477fe700 1 -- 172.21.15.77:0/3845983966 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04806b330 con 0x7fb048069b10 2023-07-24T05:46:25.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.166+0000 7fb046ffd700 1 --2- 172.21.15.77:0/3845983966 >> v2:172.21.15.103:3300/0 conn(0x7fb0480b13c0 0x7fb04806adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:46:25.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.166+0000 7fb0477fe700 1 --2- 172.21.15.77:0/3845983966 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb048069b10 0x7fb048069fc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb040009d90 tx=0x7fb04000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7af3ef1ddde13f09 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:25.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.166+0000 7fb0467fc700 1 -- 172.21.15.77:0/3845983966 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04000e070 con 0x7fb048069b10 2023-07-24T05:46:25.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.166+0000 7fb0467fc700 1 -- 172.21.15.77:0/3845983966 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04000bb20 con 0x7fb048069b10 2023-07-24T05:46:25.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.166+0000 7fb0467fc700 1 -- 172.21.15.77:0/3845983966 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb040012430 con 0x7fb048069b10 2023-07-24T05:46:25.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.170+0000 7fb04d497700 1 -- 172.21.15.77:0/3845983966 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb048069b10 msgr2=0x7fb048069fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:25.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.170+0000 7fb04d497700 1 --2- 172.21.15.77:0/3845983966 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb048069b10 0x7fb048069fc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb040009d90 tx=0x7fb04000b330 comp rx=0 tx=0).stop 2023-07-24T05:46:25.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.170+0000 7fb04d497700 1 -- 172.21.15.77:0/3845983966 shutdown_connections 2023-07-24T05:46:25.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.170+0000 7fb04d497700 1 --2- 172.21.15.77:0/3845983966 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb048069b10 0x7fb048069fc0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:25.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.170+0000 7fb04d497700 1 --2- 172.21.15.77:0/3845983966 >> v2:172.21.15.103:3300/0 conn(0x7fb0480b13c0 0x7fb04806adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:25.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.170+0000 7fb04d497700 1 -- 172.21.15.77:0/3845983966 >> 172.21.15.77:0/3845983966 conn(0x7fb0480cacc0 msgr2=0x7fb0480cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:25.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.170+0000 7fb04d497700 1 -- 172.21.15.77:0/3845983966 shutdown_connections 2023-07-24T05:46:25.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.170+0000 7fb04d497700 1 -- 172.21.15.77:0/3845983966 wait complete. 2023-07-24T05:46:25.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.170+0000 7fb04d497700 1 Processor -- start 2023-07-24T05:46:25.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.174+0000 7fb04d497700 1 -- start start 2023-07-24T05:46:25.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.174+0000 7fb04d497700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb048069b10 0x7fb04809b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:25.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.174+0000 7fb04d497700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb0480a4580 0x7fb048157810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:25.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.174+0000 7fb04d497700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0480b13c0 0x7fb0480704e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:25.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.174+0000 7fb04d497700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0481589e0 con 0x7fb0480b13c0 2023-07-24T05:46:25.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.174+0000 7fb04d497700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04815c910 con 0x7fb048069b10 2023-07-24T05:46:25.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.174+0000 7fb04d497700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb04809b9b0 con 0x7fb0480a4580 2023-07-24T05:46:25.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.174+0000 7fb0477fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0480b13c0 0x7fb0480704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:25.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.174+0000 7fb0477fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0480b13c0 0x7fb0480704e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58504/0 (socket says 172.21.15.77:58504) 2023-07-24T05:46:25.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.174+0000 7fb0477fe700 1 -- 172.21.15.77:0/1640549586 learned_addr learned my addr 172.21.15.77:0/1640549586 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:25.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.174+0000 7fb046ffd700 1 --2- 172.21.15.77:0/1640549586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb048069b10 0x7fb04809b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:25.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.174+0000 7fb03ffff700 1 --2- 172.21.15.77:0/1640549586 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb0480a4580 0x7fb048157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:25.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.174+0000 7fb0477fe700 1 -- 172.21.15.77:0/1640549586 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb0480a4580 msgr2=0x7fb048157810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:25.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.174+0000 7fb0477fe700 1 --2- 172.21.15.77:0/1640549586 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb0480a4580 0x7fb048157810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:25.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.174+0000 7fb0477fe700 1 -- 172.21.15.77:0/1640549586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb048069b10 msgr2=0x7fb04809b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:25.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.174+0000 7fb0477fe700 1 --2- 172.21.15.77:0/1640549586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb048069b10 0x7fb04809b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:25.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.174+0000 7fb0477fe700 1 -- 172.21.15.77:0/1640549586 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0380094b0 con 0x7fb0480b13c0 2023-07-24T05:46:25.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.174+0000 7fb03ffff700 1 --2- 172.21.15.77:0/1640549586 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb0480a4580 0x7fb048157810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:46:25.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.174+0000 7fb0477fe700 1 --2- 172.21.15.77:0/1640549586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0480b13c0 0x7fb0480704e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb040014040 tx=0x7fb040004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:25.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.178+0000 7fb03f7fe700 1 -- 172.21.15.77:0/1640549586 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb040012430 con 0x7fb0480b13c0 2023-07-24T05:46:25.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.178+0000 7fb03f7fe700 1 -- 172.21.15.77:0/1640549586 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb040020070 con 0x7fb0480b13c0 2023-07-24T05:46:25.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.178+0000 7fb04d497700 1 -- 172.21.15.77:0/1640549586 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb040009a70 con 0x7fb0480b13c0 2023-07-24T05:46:25.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.178+0000 7fb03f7fe700 1 -- 172.21.15.77:0/1640549586 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb040004280 con 0x7fb0480b13c0 2023-07-24T05:46:25.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.178+0000 7fb04d497700 1 -- 172.21.15.77:0/1640549586 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb04815cb00 con 0x7fb0480b13c0 2023-07-24T05:46:25.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.178+0000 7fb04d497700 1 -- 172.21.15.77:0/1640549586 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb048072490 con 0x7fb0480b13c0 2023-07-24T05:46:25.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.178+0000 7fb03f7fe700 1 -- 172.21.15.77:0/1640549586 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb0400043e0 con 0x7fb0480b13c0 2023-07-24T05:46:25.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.182+0000 7fb03f7fe700 1 --2- 172.21.15.77:0/1640549586 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb02c0662f0 0x7fb02c0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:25.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.182+0000 7fb03f7fe700 1 -- 172.21.15.77:0/1640549586 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb040022070 con 0x7fb0480b13c0 2023-07-24T05:46:25.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.182+0000 7fb046ffd700 1 --2- 172.21.15.77:0/1640549586 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb02c0662f0 0x7fb02c0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:25.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.182+0000 7fb046ffd700 1 --2- 172.21.15.77:0/1640549586 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb02c0662f0 0x7fb02c0687b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb038009d80 tx=0x7fb038009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:25.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.190+0000 7fb03f7fe700 1 -- 172.21.15.77:0/1640549586 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb0400531b0 con 0x7fb0480b13c0 2023-07-24T05:46:25.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.366+0000 7fb04d497700 1 -- 172.21.15.77:0/1640549586 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb04806bf20 con 0x7fb0480b13c0 2023-07-24T05:46:25.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.370+0000 7fb03f7fe700 1 -- 172.21.15.77:0/1640549586 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20108 (secure 0 0 0) 0x7fb0400567d0 con 0x7fb0480b13c0 2023-07-24T05:46:25.374 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:46:25.374 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":25,"fsid":"5aed5f7b-fb55-4d95-9c02-c6adbb1677b4","created":"2023-07-24T05:45:39.639731+0000","modified":"2023-07-24T05:46:05.445306+0000","last_up_change":"2023-07-24T05:45:52.319670+0000","last_in_change":"2023-07-24T05:45:43.643277+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-24T05:45:52.610430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-24T05:45:52.773787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-24T05:45:58.121732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-24T05:45:59.368726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-24T05:46:03.032057+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ffa0d496-461a-4053-b764-0627d969521b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6812","nonce":825987196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6817","nonce":825987196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6831","nonce":825987196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6824","nonce":825987196}]},"public_addr":"172.21.15.77:6812/825987196","cluster_addr":"172.21.15.77:6817/825987196","heartbeat_back_addr":"172.21.15.77:6831/825987196","heartbeat_front_addr":"172.21.15.77:6824/825987196","state":["exists","up"]},{"osd":1,"uuid":"9f595e5e-5c43-49bc-8ce4-ee70575c90da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6801","nonce":4133026815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6803","nonce":4133026815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6807","nonce":4133026815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6805","nonce":4133026815}]},"public_addr":"172.21.15.77:6801/4133026815","cluster_addr":"172.21.15.77:6803/4133026815","heartbeat_back_addr":"172.21.15.77:6807/4133026815","heartbeat_front_addr":"172.21.15.77:6805/4133026815","state":["exists","up"]},{"osd":2,"uuid":"2ac177aa-4d7d-4262-bd54-d2b9f29f4c3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6811","nonce":2394142159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6819","nonce":2394142159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6830","nonce":2394142159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6825","nonce":2394142159}]},"public_addr":"172.21.15.77:6811/2394142159","cluster_addr":"172.21.15.77:6819/2394142159","heartbeat_back_addr":"172.21.15.77:6830/2394142159","heartbeat_front_addr":"172.21.15.77:6825/2394142159","state":["exists","up"]},{"osd":3,"uuid":"17d7a251-19e8-484c-8172-a578ab3da153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6813","nonce":1492113982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6818","nonce":1492113982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6829","nonce":1492113982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6823","nonce":1492113982}]},"public_addr":"172.21.15.77:6813/1492113982","cluster_addr":"172.21.15.77:6818/1492113982","heartbeat_back_addr":"172.21.15.77:6829/1492113982","heartbeat_front_addr":"172.21.15.77:6823/1492113982","state":["exists","up"]},{"osd":4,"uuid":"bf63ca05-f06d-4e0f-ac44-2a416c70b919","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6825","nonce":1080481057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6827","nonce":1080481057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6831","nonce":1080481057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6829","nonce":1080481057}]},"public_addr":"172.21.15.103:6825/1080481057","cluster_addr":"172.21.15.103:6827/1080481057","heartbeat_back_addr":"172.21.15.103:6831/1080481057","heartbeat_front_addr":"172.21.15.103:6829/1080481057","state":["exists","up"]},{"osd":5,"uuid":"65a11a35-9e9f-4b3c-9fe3-b658d62b9318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6811","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6813","nonce":2756677504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6818","nonce":2756677504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6823","nonce":2756677504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6821","nonce":2756677504}]},"public_addr":"172.21.15.103:6813/2756677504","cluster_addr":"172.21.15.103:6818/2756677504","heartbeat_back_addr":"172.21.15.103:6823/2756677504","heartbeat_front_addr":"172.21.15.103:6821/2756677504","state":["exists","up"]},{"osd":6,"uuid":"750c1f87-686c-40b4-94a1-1a299dc78f3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6809","nonce":568977764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6812","nonce":568977764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6819","nonce":568977764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6815","nonce":568977764}]},"public_addr":"172.21.15.103:6809/568977764","cluster_addr":"172.21.15.103:6812/568977764","heartbeat_back_addr":"172.21.15.103:6819/568977764","heartbeat_front_addr":"172.21.15.103:6815/568977764","state":["exists","up"]},{"osd":7,"uuid":"d5fe4fb6-2e09-4158-885b-403803c85822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6801","nonce":1074557176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6803","nonce":1074557176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6807","nonce":1074557176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6805","nonce":1074557176}]},"public_addr":"172.21.15.103:6801/1074557176","cluster_addr":"172.21.15.103:6803/1074557176","heartbeat_back_addr":"172.21.15.103:6807/1074557176","heartbeat_front_addr":"172.21.15.103:6805/1074557176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.631032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.154109+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.398587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.679089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.311218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.353726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.314372+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.126212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-24T05:46:25.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.374+0000 7fb04d497700 1 -- 172.21.15.77:0/1640549586 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb02c0662f0 msgr2=0x7fb02c0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:25.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.374+0000 7fb04d497700 1 --2- 172.21.15.77:0/1640549586 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb02c0662f0 0x7fb02c0687b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb038009d80 tx=0x7fb038009240 comp rx=0 tx=0).stop 2023-07-24T05:46:25.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.374+0000 7fb04d497700 1 -- 172.21.15.77:0/1640549586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0480b13c0 msgr2=0x7fb0480704e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:25.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.374+0000 7fb04d497700 1 --2- 172.21.15.77:0/1640549586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0480b13c0 0x7fb0480704e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb040014040 tx=0x7fb040004af0 comp rx=0 tx=0).stop 2023-07-24T05:46:25.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.374+0000 7fb04d497700 1 -- 172.21.15.77:0/1640549586 shutdown_connections 2023-07-24T05:46:25.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.374+0000 7fb04d497700 1 --2- 172.21.15.77:0/1640549586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0480b13c0 0x7fb0480704e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:25.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.374+0000 7fb04d497700 1 --2- 172.21.15.77:0/1640549586 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb02c0662f0 0x7fb02c0687b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:25.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.374+0000 7fb04d497700 1 --2- 172.21.15.77:0/1640549586 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb0480a4580 0x7fb048157810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:25.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.374+0000 7fb04d497700 1 --2- 172.21.15.77:0/1640549586 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb048069b10 0x7fb04809b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:25.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.374+0000 7fb04d497700 1 -- 172.21.15.77:0/1640549586 >> 172.21.15.77:0/1640549586 conn(0x7fb0480cacc0 msgr2=0x7fb04806d330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:25.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.374+0000 7fb04d497700 1 -- 172.21.15.77:0/1640549586 shutdown_connections 2023-07-24T05:46:25.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.374+0000 7fb04d497700 1 -- 172.21.15.77:0/1640549586 wait complete. 2023-07-24T05:46:25.399 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-24T05:46:25.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.570+0000 7fe5e377e700 1 Processor -- start 2023-07-24T05:46:25.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.570+0000 7fe5e377e700 1 -- start start 2023-07-24T05:46:25.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.574+0000 7fe5e377e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe5dc141e80 0x7fe5dc06c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:25.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.574+0000 7fe5e377e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe5dc06a3a0 0x7fe5dc06c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:25.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.574+0000 7fe5e377e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5dc142c80 con 0x7fe5dc1423e0 2023-07-24T05:46:25.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.574+0000 7fe5e377e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5dc142260 con 0x7fe5dc06a3a0 2023-07-24T05:46:25.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.574+0000 7fe5e377e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5dc070700 con 0x7fe5dc141e80 2023-07-24T05:46:25.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.574+0000 7fe5e151a700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe5dc141e80 0x7fe5dc06c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:25.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.574+0000 7fe5e151a700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe5dc141e80 0x7fe5dc06c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.77:53598/0 (socket says 172.21.15.77:53598) 2023-07-24T05:46:25.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.574+0000 7fe5e151a700 1 -- 172.21.15.77:0/2159139015 learned_addr learned my addr 172.21.15.77:0/2159139015 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:25.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.574+0000 7fe5e0d19700 1 --2- 172.21.15.77:0/2159139015 >> v2:172.21.15.103:3300/0 conn(0x7fe5dc06a3a0 0x7fe5dc06c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:25.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.574+0000 7fe5e151a700 1 -- 172.21.15.77:0/2159139015 >> v2:172.21.15.103:3300/0 conn(0x7fe5dc06a3a0 msgr2=0x7fe5dc06c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:25.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.574+0000 7fe5e151a700 1 --2- 172.21.15.77:0/2159139015 >> v2:172.21.15.103:3300/0 conn(0x7fe5dc06a3a0 0x7fe5dc06c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:25.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.574+0000 7fe5e151a700 1 -- 172.21.15.77:0/2159139015 >> v1:172.21.15.103:6789/0 conn(0x7fe5dc1423e0 legacy=0x7fe5dc15ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:25.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.574+0000 7fe5e151a700 1 -- 172.21.15.77:0/2159139015 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5dc0709e0 con 0x7fe5dc141e80 2023-07-24T05:46:25.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.578+0000 7fe5e151a700 1 --2- 172.21.15.77:0/2159139015 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe5dc141e80 0x7fe5dc06c3f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe5d8009910 tx=0x7fe5d8009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d129909ebb0ba5d server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:25.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.578+0000 7fe5d3fff700 1 -- 172.21.15.77:0/2159139015 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d8011830 con 0x7fe5dc141e80 2023-07-24T05:46:25.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.578+0000 7fe5d3fff700 1 -- 172.21.15.77:0/2159139015 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d8011990 con 0x7fe5dc141e80 2023-07-24T05:46:25.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.578+0000 7fe5d3fff700 1 -- 172.21.15.77:0/2159139015 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d8011d40 con 0x7fe5dc141e80 2023-07-24T05:46:25.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.578+0000 7fe5e377e700 1 -- 172.21.15.77:0/2159139015 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe5dc141e80 msgr2=0x7fe5dc06c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:25.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.578+0000 7fe5e377e700 1 --2- 172.21.15.77:0/2159139015 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe5dc141e80 0x7fe5dc06c3f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe5d8009910 tx=0x7fe5d8009c20 comp rx=0 tx=0).stop 2023-07-24T05:46:25.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.578+0000 7fe5e377e700 1 -- 172.21.15.77:0/2159139015 shutdown_connections 2023-07-24T05:46:25.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.578+0000 7fe5e377e700 1 --2- 172.21.15.77:0/2159139015 >> v2:172.21.15.103:3300/0 conn(0x7fe5dc06a3a0 0x7fe5dc06c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:25.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.578+0000 7fe5e377e700 1 --2- 172.21.15.77:0/2159139015 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe5dc141e80 0x7fe5dc06c3f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:25.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.578+0000 7fe5e377e700 1 -- 172.21.15.77:0/2159139015 >> 172.21.15.77:0/2159139015 conn(0x7fe5dc0cb8d0 msgr2=0x7fe5dc0cbce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:25.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.578+0000 7fe5e377e700 1 -- 172.21.15.77:0/2159139015 shutdown_connections 2023-07-24T05:46:25.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.578+0000 7fe5e377e700 1 -- 172.21.15.77:0/2159139015 wait complete. 2023-07-24T05:46:25.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.582+0000 7fe5e377e700 1 Processor -- start 2023-07-24T05:46:25.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.582+0000 7fe5e377e700 1 -- start start 2023-07-24T05:46:25.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.582+0000 7fe5e377e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5dc06a3a0 0x7fe5dc159800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:25.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.582+0000 7fe5e377e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe5dc141e80 0x7fe5dc1584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:25.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.582+0000 7fe5e377e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5dc1423e0 0x7fe5dc158a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:25.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.582+0000 7fe5e377e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5dc142e60 con 0x7fe5dc06a3a0 2023-07-24T05:46:25.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.582+0000 7fe5e377e700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5dc140f50 con 0x7fe5dc1423e0 2023-07-24T05:46:25.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.582+0000 7fe5e377e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5dc141230 con 0x7fe5dc141e80 2023-07-24T05:46:25.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.586+0000 7fe5e151a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5dc06a3a0 0x7fe5dc159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:25.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.586+0000 7fe5e151a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5dc06a3a0 0x7fe5dc159800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58518/0 (socket says 172.21.15.77:58518) 2023-07-24T05:46:25.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.586+0000 7fe5e151a700 1 -- 172.21.15.77:0/3348592186 learned_addr learned my addr 172.21.15.77:0/3348592186 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:25.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.586+0000 7fe5e0d19700 1 --2- 172.21.15.77:0/3348592186 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe5dc141e80 0x7fe5dc1584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:25.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.586+0000 7fe5e1d1b700 1 --2- 172.21.15.77:0/3348592186 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5dc1423e0 0x7fe5dc158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:25.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.586+0000 7fe5e151a700 1 -- 172.21.15.77:0/3348592186 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe5dc141e80 msgr2=0x7fe5dc1584d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:25.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.586+0000 7fe5e151a700 1 --2- 172.21.15.77:0/3348592186 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe5dc141e80 0x7fe5dc1584d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:25.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.586+0000 7fe5e151a700 1 -- 172.21.15.77:0/3348592186 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5dc1423e0 msgr2=0x7fe5dc158a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:25.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.586+0000 7fe5e151a700 1 --2- 172.21.15.77:0/3348592186 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5dc1423e0 0x7fe5dc158a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:25.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.586+0000 7fe5e151a700 1 -- 172.21.15.77:0/3348592186 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d8009570 con 0x7fe5dc06a3a0 2023-07-24T05:46:25.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.586+0000 7fe5e151a700 1 --2- 172.21.15.77:0/3348592186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5dc06a3a0 0x7fe5dc159800 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe5d8000c00 tx=0x7fe5d8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:25.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.586+0000 7fe5d1ffb700 1 -- 172.21.15.77:0/3348592186 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d8004510 con 0x7fe5dc06a3a0 2023-07-24T05:46:25.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.586+0000 7fe5d1ffb700 1 -- 172.21.15.77:0/3348592186 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d80036c0 con 0x7fe5dc06a3a0 2023-07-24T05:46:25.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.586+0000 7fe5d1ffb700 1 -- 172.21.15.77:0/3348592186 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d8003a70 con 0x7fe5dc06a3a0 2023-07-24T05:46:25.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.586+0000 7fe5e377e700 1 -- 172.21.15.77:0/3348592186 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5dc141510 con 0x7fe5dc06a3a0 2023-07-24T05:46:25.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.586+0000 7fe5e377e700 1 -- 172.21.15.77:0/3348592186 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5dc159d40 con 0x7fe5dc06a3a0 2023-07-24T05:46:25.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.586+0000 7fe5e377e700 1 -- 172.21.15.77:0/3348592186 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5dc1416d0 con 0x7fe5dc06a3a0 2023-07-24T05:46:25.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.590+0000 7fe5d1ffb700 1 -- 172.21.15.77:0/3348592186 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe5d8003bd0 con 0x7fe5dc06a3a0 2023-07-24T05:46:25.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.590+0000 7fe5d1ffb700 1 --2- 172.21.15.77:0/3348592186 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe5c00662f0 0x7fe5c00687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:25.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.590+0000 7fe5d1ffb700 1 -- 172.21.15.77:0/3348592186 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe5d8085530 con 0x7fe5dc06a3a0 2023-07-24T05:46:25.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.590+0000 7fe5e0d19700 1 --2- 172.21.15.77:0/3348592186 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe5c00662f0 0x7fe5c00687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:25.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.594+0000 7fe5e0d19700 1 --2- 172.21.15.77:0/3348592186 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe5c00662f0 0x7fe5c00687b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc0cc7b0 tx=0x7fe5cc009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:25.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.598+0000 7fe5d1ffb700 1 -- 172.21.15.77:0/3348592186 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe5d80526b0 con 0x7fe5dc06a3a0 2023-07-24T05:46:25.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.766+0000 7fe5e377e700 1 -- 172.21.15.77:0/3348592186 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5dc04df10 con 0x7fe5dc06a3a0 2023-07-24T05:46:25.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.770+0000 7fe5d1ffb700 1 -- 172.21.15.77:0/3348592186 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20108 (secure 0 0 0) 0x7fe5d8055cd0 con 0x7fe5dc06a3a0 2023-07-24T05:46:25.775 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:46:25.776 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":25,"fsid":"5aed5f7b-fb55-4d95-9c02-c6adbb1677b4","created":"2023-07-24T05:45:39.639731+0000","modified":"2023-07-24T05:46:05.445306+0000","last_up_change":"2023-07-24T05:45:52.319670+0000","last_in_change":"2023-07-24T05:45:43.643277+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-24T05:45:52.610430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-24T05:45:52.773787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-24T05:45:58.121732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-24T05:45:59.368726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-24T05:46:03.032057+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ffa0d496-461a-4053-b764-0627d969521b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6812","nonce":825987196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6817","nonce":825987196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6831","nonce":825987196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6824","nonce":825987196}]},"public_addr":"172.21.15.77:6812/825987196","cluster_addr":"172.21.15.77:6817/825987196","heartbeat_back_addr":"172.21.15.77:6831/825987196","heartbeat_front_addr":"172.21.15.77:6824/825987196","state":["exists","up"]},{"osd":1,"uuid":"9f595e5e-5c43-49bc-8ce4-ee70575c90da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6801","nonce":4133026815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6803","nonce":4133026815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6807","nonce":4133026815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6805","nonce":4133026815}]},"public_addr":"172.21.15.77:6801/4133026815","cluster_addr":"172.21.15.77:6803/4133026815","heartbeat_back_addr":"172.21.15.77:6807/4133026815","heartbeat_front_addr":"172.21.15.77:6805/4133026815","state":["exists","up"]},{"osd":2,"uuid":"2ac177aa-4d7d-4262-bd54-d2b9f29f4c3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6811","nonce":2394142159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6819","nonce":2394142159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6830","nonce":2394142159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6825","nonce":2394142159}]},"public_addr":"172.21.15.77:6811/2394142159","cluster_addr":"172.21.15.77:6819/2394142159","heartbeat_back_addr":"172.21.15.77:6830/2394142159","heartbeat_front_addr":"172.21.15.77:6825/2394142159","state":["exists","up"]},{"osd":3,"uuid":"17d7a251-19e8-484c-8172-a578ab3da153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6813","nonce":1492113982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6818","nonce":1492113982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6829","nonce":1492113982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6823","nonce":1492113982}]},"public_addr":"172.21.15.77:6813/1492113982","cluster_addr":"172.21.15.77:6818/1492113982","heartbeat_back_addr":"172.21.15.77:6829/1492113982","heartbeat_front_addr":"172.21.15.77:6823/1492113982","state":["exists","up"]},{"osd":4,"uuid":"bf63ca05-f06d-4e0f-ac44-2a416c70b919","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6825","nonce":1080481057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6827","nonce":1080481057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6831","nonce":1080481057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6829","nonce":1080481057}]},"public_addr":"172.21.15.103:6825/1080481057","cluster_addr":"172.21.15.103:6827/1080481057","heartbeat_back_addr":"172.21.15.103:6831/1080481057","heartbeat_front_addr":"172.21.15.103:6829/1080481057","state":["exists","up"]},{"osd":5,"uuid":"65a11a35-9e9f-4b3c-9fe3-b658d62b9318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6811","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6813","nonce":2756677504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6818","nonce":2756677504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6823","nonce":2756677504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6821","nonce":2756677504}]},"public_addr":"172.21.15.103:6813/2756677504","cluster_addr":"172.21.15.103:6818/2756677504","heartbeat_back_addr":"172.21.15.103:6823/2756677504","heartbeat_front_addr":"172.21.15.103:6821/2756677504","state":["exists","up"]},{"osd":6,"uuid":"750c1f87-686c-40b4-94a1-1a299dc78f3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6809","nonce":568977764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6812","nonce":568977764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6819","nonce":568977764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6815","nonce":568977764}]},"public_addr":"172.21.15.103:6809/568977764","cluster_addr":"172.21.15.103:6812/568977764","heartbeat_back_addr":"172.21.15.103:6819/568977764","heartbeat_front_addr":"172.21.15.103:6815/568977764","state":["exists","up"]},{"osd":7,"uuid":"d5fe4fb6-2e09-4158-885b-403803c85822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6801","nonce":1074557176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6803","nonce":1074557176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6807","nonce":1074557176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6805","nonce":1074557176}]},"public_addr":"172.21.15.103:6801/1074557176","cluster_addr":"172.21.15.103:6803/1074557176","heartbeat_back_addr":"172.21.15.103:6807/1074557176","heartbeat_front_addr":"172.21.15.103:6805/1074557176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.631032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.154109+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.398587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.679089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.311218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.353726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.314372+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.126212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-24T05:46:25.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.774+0000 7fe5e377e700 1 -- 172.21.15.77:0/3348592186 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe5c00662f0 msgr2=0x7fe5c00687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:25.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.774+0000 7fe5e377e700 1 --2- 172.21.15.77:0/3348592186 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe5c00662f0 0x7fe5c00687b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc0cc7b0 tx=0x7fe5cc009240 comp rx=0 tx=0).stop 2023-07-24T05:46:25.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.774+0000 7fe5e377e700 1 -- 172.21.15.77:0/3348592186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5dc06a3a0 msgr2=0x7fe5dc159800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:25.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.774+0000 7fe5e377e700 1 --2- 172.21.15.77:0/3348592186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5dc06a3a0 0x7fe5dc159800 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe5d8000c00 tx=0x7fe5d8004770 comp rx=0 tx=0).stop 2023-07-24T05:46:25.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.774+0000 7fe5e377e700 1 -- 172.21.15.77:0/3348592186 shutdown_connections 2023-07-24T05:46:25.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.774+0000 7fe5e377e700 1 --2- 172.21.15.77:0/3348592186 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5dc1423e0 0x7fe5dc158a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:25.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.774+0000 7fe5e377e700 1 --2- 172.21.15.77:0/3348592186 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe5c00662f0 0x7fe5c00687b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:25.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.774+0000 7fe5e377e700 1 --2- 172.21.15.77:0/3348592186 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe5dc141e80 0x7fe5dc1584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:25.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.774+0000 7fe5e377e700 1 --2- 172.21.15.77:0/3348592186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5dc06a3a0 0x7fe5dc159800 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:25.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.774+0000 7fe5e377e700 1 -- 172.21.15.77:0/3348592186 >> 172.21.15.77:0/3348592186 conn(0x7fe5dc0cb8d0 msgr2=0x7fe5dc1633e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:25.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.774+0000 7fe5e377e700 1 -- 172.21.15.77:0/3348592186 shutdown_connections 2023-07-24T05:46:25.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.774+0000 7fe5e377e700 1 -- 172.21.15.77:0/3348592186 wait complete. 2023-07-24T05:46:25.800 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-24T05:46:25.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.970+0000 7fbdad2a9700 1 Processor -- start 2023-07-24T05:46:25.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.970+0000 7fbdad2a9700 1 -- start start 2023-07-24T05:46:25.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.974+0000 7fbdad2a9700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbda80ccf20 0x7fbda806bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:25.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.974+0000 7fbdad2a9700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbda80ada10 0x7fbda806fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:25.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.974+0000 7fbdad2a9700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbda806d450 con 0x7fbda806b9f0 2023-07-24T05:46:25.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.974+0000 7fbdad2a9700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbda80ad710 con 0x7fbda80ada10 2023-07-24T05:46:25.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.974+0000 7fbdad2a9700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda80cca20 con 0x7fbda80ccf20 2023-07-24T05:46:25.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.974+0000 7fbda77fe700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbda80ada10 0x7fbda806fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:25.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.974+0000 7fbda77fe700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbda80ada10 0x7fbda806fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58530/0 (socket says 172.21.15.77:58530) 2023-07-24T05:46:25.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.974+0000 7fbd9e7fc700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbda80ccf20 0x7fbda806bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:25.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.974+0000 7fbda77fe700 1 -- 172.21.15.77:0/1687536380 learned_addr learned my addr 172.21.15.77:0/1687536380 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:25.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.974+0000 7fbda77fe700 1 -- 172.21.15.77:0/1687536380 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbda80ccf20 msgr2=0x7fbda806bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:25.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.974+0000 7fbda77fe700 1 --2- 172.21.15.77:0/1687536380 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbda80ccf20 0x7fbda806bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:25.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.974+0000 7fbda77fe700 1 -- 172.21.15.77:0/1687536380 >> v1:172.21.15.103:6789/0 conn(0x7fbda806b9f0 legacy=0x7fbda806ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:25.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.974+0000 7fbda77fe700 1 -- 172.21.15.77:0/1687536380 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda806b330 con 0x7fbda80ada10 2023-07-24T05:46:25.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.974+0000 7fbda77fe700 1 --2- 172.21.15.77:0/1687536380 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbda80ada10 0x7fbda806fe50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbda0009910 tx=0x7fbda0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e52a25cd4f8a9175 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:25.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.974+0000 7fbda67fc700 1 -- 172.21.15.77:0/1687536380 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda0011830 con 0x7fbda80ada10 2023-07-24T05:46:25.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.974+0000 7fbda67fc700 1 -- 172.21.15.77:0/1687536380 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda0011990 con 0x7fbda80ada10 2023-07-24T05:46:25.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.974+0000 7fbda67fc700 1 -- 172.21.15.77:0/1687536380 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda0011d40 con 0x7fbda80ada10 2023-07-24T05:46:25.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.978+0000 7fbdad2a9700 1 -- 172.21.15.77:0/1687536380 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbda80ada10 msgr2=0x7fbda806fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:25.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.978+0000 7fbdad2a9700 1 --2- 172.21.15.77:0/1687536380 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbda80ada10 0x7fbda806fe50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbda0009910 tx=0x7fbda0009c20 comp rx=0 tx=0).stop 2023-07-24T05:46:25.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.978+0000 7fbdad2a9700 1 -- 172.21.15.77:0/1687536380 shutdown_connections 2023-07-24T05:46:25.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.978+0000 7fbdad2a9700 1 --2- 172.21.15.77:0/1687536380 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbda80ada10 0x7fbda806fe50 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:25.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.978+0000 7fbdad2a9700 1 --2- 172.21.15.77:0/1687536380 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbda80ccf20 0x7fbda806bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:25.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.978+0000 7fbdad2a9700 1 -- 172.21.15.77:0/1687536380 >> 172.21.15.77:0/1687536380 conn(0x7fbda80ce440 msgr2=0x7fbda80ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:25.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.978+0000 7fbdad2a9700 1 -- 172.21.15.77:0/1687536380 shutdown_connections 2023-07-24T05:46:25.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.978+0000 7fbdad2a9700 1 -- 172.21.15.77:0/1687536380 wait complete. 2023-07-24T05:46:25.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.978+0000 7fbdad2a9700 1 Processor -- start 2023-07-24T05:46:25.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.982+0000 7fbdad2a9700 1 -- start start 2023-07-24T05:46:25.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.982+0000 7fbdad2a9700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbda806b9f0 0x7fbda8155160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:25.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.982+0000 7fbdad2a9700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbda80ada10 0x7fbda8151320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:25.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.982+0000 7fbdad2a9700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbda80ccf20 0x7fbda80c31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:25.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.982+0000 7fbdad2a9700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda8096ee0 con 0x7fbda80ccf20 2023-07-24T05:46:25.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.982+0000 7fbdad2a9700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda80971c0 con 0x7fbda806b9f0 2023-07-24T05:46:25.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.982+0000 7fbdad2a9700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda80974a0 con 0x7fbda80ada10 2023-07-24T05:46:25.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.982+0000 7fbda77fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbda80ccf20 0x7fbda80c31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:25.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.982+0000 7fbda77fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbda80ccf20 0x7fbda80c31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58542/0 (socket says 172.21.15.77:58542) 2023-07-24T05:46:25.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.982+0000 7fbda77fe700 1 -- 172.21.15.77:0/2894192523 learned_addr learned my addr 172.21.15.77:0/2894192523 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:25.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.982+0000 7fbd9e7fc700 1 --2- 172.21.15.77:0/2894192523 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbda80ada10 0x7fbda8151320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:25.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.982+0000 7fbda6ffd700 1 --2- 172.21.15.77:0/2894192523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbda806b9f0 0x7fbda8155160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:25.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.982+0000 7fbda77fe700 1 -- 172.21.15.77:0/2894192523 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbda80ada10 msgr2=0x7fbda8151320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:25.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.982+0000 7fbda77fe700 1 --2- 172.21.15.77:0/2894192523 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbda80ada10 0x7fbda8151320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:25.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.982+0000 7fbda77fe700 1 -- 172.21.15.77:0/2894192523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbda806b9f0 msgr2=0x7fbda8155160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:25.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.982+0000 7fbda77fe700 1 --2- 172.21.15.77:0/2894192523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbda806b9f0 0x7fbda8155160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:25.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.982+0000 7fbda77fe700 1 -- 172.21.15.77:0/2894192523 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda0009570 con 0x7fbda80ccf20 2023-07-24T05:46:25.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.982+0000 7fbda77fe700 1 --2- 172.21.15.77:0/2894192523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbda80ccf20 0x7fbda80c31d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbda8072e30 tx=0x7fbda0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:25.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.982+0000 7fbd9ffff700 1 -- 172.21.15.77:0/2894192523 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda0004510 con 0x7fbda80ccf20 2023-07-24T05:46:25.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.982+0000 7fbd9ffff700 1 -- 172.21.15.77:0/2894192523 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda001e070 con 0x7fbda80ccf20 2023-07-24T05:46:25.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.982+0000 7fbdad2a9700 1 -- 172.21.15.77:0/2894192523 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbda8097780 con 0x7fbda80ccf20 2023-07-24T05:46:25.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.982+0000 7fbd9ffff700 1 -- 172.21.15.77:0/2894192523 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda0003900 con 0x7fbda80ccf20 2023-07-24T05:46:25.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.986+0000 7fbdad2a9700 1 -- 172.21.15.77:0/2894192523 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbda81556a0 con 0x7fbda80ccf20 2023-07-24T05:46:25.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.986+0000 7fbdad2a9700 1 -- 172.21.15.77:0/2894192523 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbda8155890 con 0x7fbda80ccf20 2023-07-24T05:46:25.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.986+0000 7fbd9ffff700 1 -- 172.21.15.77:0/2894192523 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbda0003a60 con 0x7fbda80ccf20 2023-07-24T05:46:25.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.990+0000 7fbd9ffff700 1 --2- 172.21.15.77:0/2894192523 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fbd880662f0 0x7fbd880687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:25.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.990+0000 7fbd9ffff700 1 -- 172.21.15.77:0/2894192523 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbda0085330 con 0x7fbda80ccf20 2023-07-24T05:46:25.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.990+0000 7fbda6ffd700 1 --2- 172.21.15.77:0/2894192523 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fbd880662f0 0x7fbd880687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:25.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.990+0000 7fbda6ffd700 1 --2- 172.21.15.77:0/2894192523 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fbd880662f0 0x7fbd880687b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbda80b0f10 tx=0x7fbd98009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:25.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:25.994+0000 7fbd9ffff700 1 -- 172.21.15.77:0/2894192523 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbda00524d0 con 0x7fbda80ccf20 2023-07-24T05:46:26.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.206+0000 7fbdad2a9700 1 -- 172.21.15.77:0/2894192523 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fbda8097ca0 con 0x7fbda80ccf20 2023-07-24T05:46:26.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.434+0000 7fbd9ffff700 1 -- 172.21.15.77:0/2894192523 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fbda8097ca0 con 0x7fbda80ccf20 2023-07-24T05:46:26.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.438+0000 7fbdad2a9700 1 -- 172.21.15.77:0/2894192523 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fbd880662f0 msgr2=0x7fbd880687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:26.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.438+0000 7fbdad2a9700 1 --2- 172.21.15.77:0/2894192523 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fbd880662f0 0x7fbd880687b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbda80b0f10 tx=0x7fbd98009040 comp rx=0 tx=0).stop 2023-07-24T05:46:26.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.438+0000 7fbdad2a9700 1 -- 172.21.15.77:0/2894192523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbda80ccf20 msgr2=0x7fbda80c31d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:26.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.438+0000 7fbdad2a9700 1 --2- 172.21.15.77:0/2894192523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbda80ccf20 0x7fbda80c31d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbda8072e30 tx=0x7fbda0004770 comp rx=0 tx=0).stop 2023-07-24T05:46:26.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.438+0000 7fbdad2a9700 1 -- 172.21.15.77:0/2894192523 shutdown_connections 2023-07-24T05:46:26.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.438+0000 7fbdad2a9700 1 --2- 172.21.15.77:0/2894192523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbda80ccf20 0x7fbda80c31d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:26.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.438+0000 7fbdad2a9700 1 --2- 172.21.15.77:0/2894192523 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fbd880662f0 0x7fbd880687b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:26.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.438+0000 7fbdad2a9700 1 --2- 172.21.15.77:0/2894192523 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbda80ada10 0x7fbda8151320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:26.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.438+0000 7fbdad2a9700 1 --2- 172.21.15.77:0/2894192523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbda806b9f0 0x7fbda8155160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:26.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.438+0000 7fbdad2a9700 1 -- 172.21.15.77:0/2894192523 >> 172.21.15.77:0/2894192523 conn(0x7fbda80ce440 msgr2=0x7fbda80ab050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:26.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.438+0000 7fbdad2a9700 1 -- 172.21.15.77:0/2894192523 shutdown_connections 2023-07-24T05:46:26.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.438+0000 7fbdad2a9700 1 -- 172.21.15.77:0/2894192523 wait complete. 2023-07-24T05:46:26.466 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-07-24T05:46:26.466 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-24T05:46:26.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.642+0000 7f492d2bf700 1 Processor -- start 2023-07-24T05:46:26.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.642+0000 7f492d2bf700 1 -- start start 2023-07-24T05:46:26.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.642+0000 7f492d2bf700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f492806a220 0x7f492806d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:26.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.642+0000 7f492d2bf700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49280b2620 con 0x7f49280c4e70 2023-07-24T05:46:26.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.642+0000 7f492d2bf700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f492806b000 con 0x7f492815a950 2023-07-24T05:46:26.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.642+0000 7f492d2bf700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49280b1ac0 con 0x7f492806a220 2023-07-24T05:46:26.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.642+0000 7f491f7fe700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f49280c4e70 0x7f4928069b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57074/0 (socket says 172.21.15.77:57074) 2023-07-24T05:46:26.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.642+0000 7f491f7fe700 1 -- 172.21.15.77:0/3590444331 learned_addr learned my addr 172.21.15.77:0/3590444331 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:26.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.642+0000 7f492cabe700 1 --2- 172.21.15.77:0/3590444331 >> v2:172.21.15.77:3300/0 conn(0x7f492806a220 0x7f492806d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:26.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.642+0000 7f492cabe700 1 -- 172.21.15.77:0/3590444331 >> v1:172.21.15.103:6789/0 conn(0x7f492815a950 legacy=0x7f49280b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:26.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.642+0000 7f492cabe700 1 -- 172.21.15.77:0/3590444331 >> v1:172.21.15.77:6789/0 conn(0x7f49280c4e70 legacy=0x7f4928069b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:26.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.642+0000 7f492cabe700 1 -- 172.21.15.77:0/3590444331 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f492806a7c0 con 0x7f492806a220 2023-07-24T05:46:26.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.642+0000 7f492cabe700 1 --2- 172.21.15.77:0/3590444331 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f492806a220 0x7f492806d3a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4920009d90 tx=0x7f492000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=417366b4f8eb5768 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:26.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.642+0000 7f49277fe700 1 -- 172.21.15.77:0/3590444331 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492000e070 con 0x7f492806a220 2023-07-24T05:46:26.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.642+0000 7f49277fe700 1 -- 172.21.15.77:0/3590444331 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492000bbd0 con 0x7f492806a220 2023-07-24T05:46:26.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.642+0000 7f49277fe700 1 -- 172.21.15.77:0/3590444331 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4920012430 con 0x7f492806a220 2023-07-24T05:46:26.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.646+0000 7f492d2bf700 1 -- 172.21.15.77:0/3590444331 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f492806a220 msgr2=0x7f492806d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:26.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.646+0000 7f492d2bf700 1 --2- 172.21.15.77:0/3590444331 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f492806a220 0x7f492806d3a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4920009d90 tx=0x7f492000b330 comp rx=0 tx=0).stop 2023-07-24T05:46:26.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.646+0000 7f492d2bf700 1 -- 172.21.15.77:0/3590444331 shutdown_connections 2023-07-24T05:46:26.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.646+0000 7f492d2bf700 1 --2- 172.21.15.77:0/3590444331 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f492806a220 0x7f492806d3a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:26.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.646+0000 7f492d2bf700 1 -- 172.21.15.77:0/3590444331 >> 172.21.15.77:0/3590444331 conn(0x7f49280ce260 msgr2=0x7f49280ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:26.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.646+0000 7f492d2bf700 1 -- 172.21.15.77:0/3590444331 shutdown_connections 2023-07-24T05:46:26.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.646+0000 7f492d2bf700 1 -- 172.21.15.77:0/3590444331 wait complete. 2023-07-24T05:46:26.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.646+0000 7f492d2bf700 1 Processor -- start 2023-07-24T05:46:26.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.646+0000 7f492d2bf700 1 -- start start 2023-07-24T05:46:26.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.650+0000 7f492d2bf700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f492806a220 0x7f49281f6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:26.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.650+0000 7f492d2bf700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49280c4e70 0x7f4928155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:26.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.650+0000 7f492d2bf700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f492815a950 0x7f49280aec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:26.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.650+0000 7f492d2bf700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49280ae870 con 0x7f49280c4e70 2023-07-24T05:46:26.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.650+0000 7f492d2bf700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49281f6d00 con 0x7f492806a220 2023-07-24T05:46:26.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.650+0000 7f492d2bf700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49281f6fe0 con 0x7f492815a950 2023-07-24T05:46:26.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.650+0000 7f491f7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49280c4e70 0x7f4928155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:26.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.650+0000 7f491f7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49280c4e70 0x7f4928155970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58564/0 (socket says 172.21.15.77:58564) 2023-07-24T05:46:26.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.650+0000 7f491f7fe700 1 -- 172.21.15.77:0/3181114049 learned_addr learned my addr 172.21.15.77:0/3181114049 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:26.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.650+0000 7f4927fff700 1 --2- 172.21.15.77:0/3181114049 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f492806a220 0x7f49281f6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:26.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.650+0000 7f492cabe700 1 --2- 172.21.15.77:0/3181114049 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f492815a950 0x7f49280aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:26.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.650+0000 7f491f7fe700 1 -- 172.21.15.77:0/3181114049 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f492815a950 msgr2=0x7f49280aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:26.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.650+0000 7f491f7fe700 1 --2- 172.21.15.77:0/3181114049 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f492815a950 0x7f49280aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:26.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.650+0000 7f491f7fe700 1 -- 172.21.15.77:0/3181114049 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f492806a220 msgr2=0x7f49281f6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:26.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.650+0000 7f491f7fe700 1 --2- 172.21.15.77:0/3181114049 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f492806a220 0x7f49281f6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:26.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.650+0000 7f491f7fe700 1 -- 172.21.15.77:0/3181114049 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4920009a70 con 0x7f49280c4e70 2023-07-24T05:46:26.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.650+0000 7f491f7fe700 1 --2- 172.21.15.77:0/3181114049 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49280c4e70 0x7f4928155970 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4910001eb0 tx=0x7f491000c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:26.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.650+0000 7f49257fa700 1 -- 172.21.15.77:0/3181114049 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4910005d90 con 0x7f49280c4e70 2023-07-24T05:46:26.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.650+0000 7f49257fa700 1 -- 172.21.15.77:0/3181114049 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49100070d0 con 0x7f49280c4e70 2023-07-24T05:46:26.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.650+0000 7f49257fa700 1 -- 172.21.15.77:0/3181114049 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4910007440 con 0x7f49280c4e70 2023-07-24T05:46:26.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.650+0000 7f492d2bf700 1 -- 172.21.15.77:0/3181114049 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49281f72c0 con 0x7f49280c4e70 2023-07-24T05:46:26.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.650+0000 7f492d2bf700 1 -- 172.21.15.77:0/3181114049 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49281f69a0 con 0x7f49280c4e70 2023-07-24T05:46:26.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.654+0000 7f492d2bf700 1 -- 172.21.15.77:0/3181114049 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49280ae9b0 con 0x7f49280c4e70 2023-07-24T05:46:26.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.654+0000 7f49257fa700 1 -- 172.21.15.77:0/3181114049 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f49100075a0 con 0x7f49280c4e70 2023-07-24T05:46:26.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.654+0000 7f49257fa700 1 --2- 172.21.15.77:0/3181114049 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f49080662f0 0x7f49080687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:26.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.658+0000 7f49257fa700 1 -- 172.21.15.77:0/3181114049 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4910083150 con 0x7f49280c4e70 2023-07-24T05:46:26.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.658+0000 7f4927fff700 1 --2- 172.21.15.77:0/3181114049 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f49080662f0 0x7f49080687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:26.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.658+0000 7f4927fff700 1 --2- 172.21.15.77:0/3181114049 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f49080662f0 0x7f49080687b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f49280c4b40 tx=0x7f4918009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:26.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.662+0000 7f49257fa700 1 -- 172.21.15.77:0/3181114049 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f49280ae9b0 con 0x7f49280c4e70 2023-07-24T05:46:26.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:26.870+0000 7f492d2bf700 1 -- 172.21.15.77:0/3181114049 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f49280ae9b0 con 0x7f49280c4e70 2023-07-24T05:46:27.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.450+0000 7f49257fa700 1 -- 172.21.15.77:0/3181114049 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f49280ae9b0 con 0x7f49280c4e70 2023-07-24T05:46:27.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.450+0000 7f492d2bf700 1 -- 172.21.15.77:0/3181114049 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f49080662f0 msgr2=0x7f49080687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:27.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.450+0000 7f492d2bf700 1 --2- 172.21.15.77:0/3181114049 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f49080662f0 0x7f49080687b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f49280c4b40 tx=0x7f4918009040 comp rx=0 tx=0).stop 2023-07-24T05:46:27.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.454+0000 7f492d2bf700 1 -- 172.21.15.77:0/3181114049 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49280c4e70 msgr2=0x7f4928155970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:27.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.454+0000 7f492d2bf700 1 --2- 172.21.15.77:0/3181114049 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49280c4e70 0x7f4928155970 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4910001eb0 tx=0x7f491000c7b0 comp rx=0 tx=0).stop 2023-07-24T05:46:27.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.454+0000 7f492d2bf700 1 -- 172.21.15.77:0/3181114049 shutdown_connections 2023-07-24T05:46:27.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.454+0000 7f492d2bf700 1 --2- 172.21.15.77:0/3181114049 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f49080662f0 0x7f49080687b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:27.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.454+0000 7f492d2bf700 1 --2- 172.21.15.77:0/3181114049 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f492815a950 0x7f49280aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:27.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.454+0000 7f492d2bf700 1 --2- 172.21.15.77:0/3181114049 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f49280c4e70 0x7f4928155970 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:27.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.454+0000 7f492d2bf700 1 --2- 172.21.15.77:0/3181114049 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f492806a220 0x7f49281f6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:27.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.454+0000 7f492d2bf700 1 -- 172.21.15.77:0/3181114049 >> 172.21.15.77:0/3181114049 conn(0x7f49280ce260 msgr2=0x7f49280cc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:27.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.454+0000 7f492d2bf700 1 -- 172.21.15.77:0/3181114049 shutdown_connections 2023-07-24T05:46:27.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.454+0000 7f492d2bf700 1 -- 172.21.15.77:0/3181114049 wait complete. 2023-07-24T05:46:27.480 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-24T05:46:27.480 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-24T05:46:27.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.650+0000 7fd100bcd700 1 Processor -- start 2023-07-24T05:46:27.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.650+0000 7fd100bcd700 1 -- start start 2023-07-24T05:46:27.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.654+0000 7fd100bcd700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd0fc15ca90 0x7fd0fc0b8280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:27.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.654+0000 7fd100bcd700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0fc0b5a00 con 0x7fd0fc0d1f00 2023-07-24T05:46:27.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.654+0000 7fd100bcd700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0fc06a8a0 con 0x7fd0fc0b4420 2023-07-24T05:46:27.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.654+0000 7fd100bcd700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0fc161590 con 0x7fd0fc15ca90 2023-07-24T05:46:27.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.654+0000 7fd0fa59c700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd0fc15ca90 0x7fd0fc0b8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:27.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.654+0000 7fd0fad9d700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd0fc0d1f00 0x7fd0fc160e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57080/0 (socket says 172.21.15.77:57080) 2023-07-24T05:46:27.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.654+0000 7fd0fad9d700 1 -- 172.21.15.77:0/408431265 learned_addr learned my addr 172.21.15.77:0/408431265 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:27.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.654+0000 7fd0fa59c700 1 -- 172.21.15.77:0/408431265 >> v1:172.21.15.103:6789/0 conn(0x7fd0fc0b4420 legacy=0x7fd0fc160770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:27.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.654+0000 7fd0fa59c700 1 -- 172.21.15.77:0/408431265 >> v1:172.21.15.77:6789/0 conn(0x7fd0fc0d1f00 legacy=0x7fd0fc160e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:27.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.654+0000 7fd0fa59c700 1 -- 172.21.15.77:0/408431265 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0fc069c90 con 0x7fd0fc15ca90 2023-07-24T05:46:27.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.654+0000 7fd0fa59c700 1 --2- 172.21.15.77:0/408431265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0fc15ca90 0x7fd0fc0b8280 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec009850 tx=0x7fd0ec009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc009496c43758bf server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:27.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.654+0000 7fd0f959a700 1 -- 172.21.15.77:0/408431265 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec004230 con 0x7fd0fc15ca90 2023-07-24T05:46:27.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.654+0000 7fd0f959a700 1 -- 172.21.15.77:0/408431265 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0ec004390 con 0x7fd0fc15ca90 2023-07-24T05:46:27.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.654+0000 7fd0f959a700 1 -- 172.21.15.77:0/408431265 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec0036c0 con 0x7fd0fc15ca90 2023-07-24T05:46:27.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.654+0000 7fd100bcd700 1 -- 172.21.15.77:0/408431265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0fc15ca90 msgr2=0x7fd0fc0b8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:27.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.654+0000 7fd100bcd700 1 --2- 172.21.15.77:0/408431265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0fc15ca90 0x7fd0fc0b8280 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec009850 tx=0x7fd0ec009b60 comp rx=0 tx=0).stop 2023-07-24T05:46:27.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.654+0000 7fd100bcd700 1 -- 172.21.15.77:0/408431265 shutdown_connections 2023-07-24T05:46:27.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.654+0000 7fd100bcd700 1 --2- 172.21.15.77:0/408431265 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0fc15ca90 0x7fd0fc0b8280 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:27.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.654+0000 7fd100bcd700 1 -- 172.21.15.77:0/408431265 >> 172.21.15.77:0/408431265 conn(0x7fd0fc0cf420 msgr2=0x7fd0fc0cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:27.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.654+0000 7fd100bcd700 1 -- 172.21.15.77:0/408431265 shutdown_connections 2023-07-24T05:46:27.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.654+0000 7fd100bcd700 1 -- 172.21.15.77:0/408431265 wait complete. 2023-07-24T05:46:27.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.658+0000 7fd100bcd700 1 Processor -- start 2023-07-24T05:46:27.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.658+0000 7fd100bcd700 1 -- start start 2023-07-24T05:46:27.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.662+0000 7fd100bcd700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0fc0b4420 0x7fd0fc0c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:27.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.662+0000 7fd100bcd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0fc0d1f00 0x7fd0fc15ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:27.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.662+0000 7fd100bcd700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd0fc15ca90 0x7fd0fc15e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:27.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.662+0000 7fd100bcd700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc0ada80 con 0x7fd0fc0d1f00 2023-07-24T05:46:27.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.662+0000 7fd100bcd700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc0aee60 con 0x7fd0fc0b4420 2023-07-24T05:46:27.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.662+0000 7fd100bcd700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc0aa210 con 0x7fd0fc15ca90 2023-07-24T05:46:27.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.662+0000 7fd0f9d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0fc0d1f00 0x7fd0fc15ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:27.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.662+0000 7fd0fa59c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0fc0b4420 0x7fd0fc0c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:27.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.662+0000 7fd0f9d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0fc0d1f00 0x7fd0fc15ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58588/0 (socket says 172.21.15.77:58588) 2023-07-24T05:46:27.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.662+0000 7fd0fa59c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0fc0b4420 0x7fd0fc0c8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:33814/0 (socket says 172.21.15.77:33814) 2023-07-24T05:46:27.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.662+0000 7fd0f9d9b700 1 -- 172.21.15.77:0/2305622956 learned_addr learned my addr 172.21.15.77:0/2305622956 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:27.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.662+0000 7fd0fad9d700 1 --2- 172.21.15.77:0/2305622956 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd0fc15ca90 0x7fd0fc15e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:27.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.662+0000 7fd0f9d9b700 1 -- 172.21.15.77:0/2305622956 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd0fc15ca90 msgr2=0x7fd0fc15e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:27.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.662+0000 7fd0f9d9b700 1 --2- 172.21.15.77:0/2305622956 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd0fc15ca90 0x7fd0fc15e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:27.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.662+0000 7fd0f9d9b700 1 -- 172.21.15.77:0/2305622956 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0fc0b4420 msgr2=0x7fd0fc0c8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:27.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.662+0000 7fd0f9d9b700 1 --2- 172.21.15.77:0/2305622956 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0fc0b4420 0x7fd0fc0c8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:27.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.662+0000 7fd0f9d9b700 1 -- 172.21.15.77:0/2305622956 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0ec0094b0 con 0x7fd0fc0d1f00 2023-07-24T05:46:27.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.662+0000 7fd0f9d9b700 1 --2- 172.21.15.77:0/2305622956 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0fc0d1f00 0x7fd0fc15ddd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd0f000c4d0 tx=0x7fd0f000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:27.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.662+0000 7fd0eaffd700 1 -- 172.21.15.77:0/2305622956 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f00054e0 con 0x7fd0fc0d1f00 2023-07-24T05:46:27.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.662+0000 7fd0eaffd700 1 -- 172.21.15.77:0/2305622956 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f00036a0 con 0x7fd0fc0d1f00 2023-07-24T05:46:27.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.662+0000 7fd100bcd700 1 -- 172.21.15.77:0/2305622956 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0fc0a9f30 con 0x7fd0fc0d1f00 2023-07-24T05:46:27.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.662+0000 7fd0eaffd700 1 -- 172.21.15.77:0/2305622956 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f0003a50 con 0x7fd0fc0d1f00 2023-07-24T05:46:27.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.662+0000 7fd100bcd700 1 -- 172.21.15.77:0/2305622956 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0fc149fb0 con 0x7fd0fc0d1f00 2023-07-24T05:46:27.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.666+0000 7fd100bcd700 1 -- 172.21.15.77:0/2305622956 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0fc0ce580 con 0x7fd0fc0d1f00 2023-07-24T05:46:27.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.666+0000 7fd0eaffd700 1 -- 172.21.15.77:0/2305622956 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd0f0003bb0 con 0x7fd0fc0d1f00 2023-07-24T05:46:27.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.670+0000 7fd0eaffd700 1 --2- 172.21.15.77:0/2305622956 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd0dc0662f0 0x7fd0dc0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:27.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.670+0000 7fd0eaffd700 1 -- 172.21.15.77:0/2305622956 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd0f0082fc0 con 0x7fd0fc0d1f00 2023-07-24T05:46:27.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.670+0000 7fd0fa59c700 1 --2- 172.21.15.77:0/2305622956 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd0dc0662f0 0x7fd0dc0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:27.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.670+0000 7fd0fa59c700 1 --2- 172.21.15.77:0/2305622956 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd0dc0662f0 0x7fd0dc0687b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec009850 tx=0x7fd0ec008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:27.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.674+0000 7fd0eaffd700 1 -- 172.21.15.77:0/2305622956 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd0f0050140 con 0x7fd0fc0d1f00 2023-07-24T05:46:27.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.874+0000 7fd100bcd700 1 -- 172.21.15.77:0/2305622956 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd0fc04df10 con 0x7fd0fc0d1f00 2023-07-24T05:46:27.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.878+0000 7fd0eaffd700 1 -- 172.21.15.77:0/2305622956 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7fd0f0003e60 con 0x7fd0fc0d1f00 2023-07-24T05:46:27.882 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:46:27.882 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/4201639271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4201639271},{"type":"v1","addr":"172.21.15.77:6834","nonce":4201639271}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/993116623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":993116623},{"type":"v1","addr":"172.21.15.103:6835","nonce":993116623}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/1196529067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":1196529067},{"type":"v1","addr":"172.21.15.103:6837","nonce":1196529067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-24T05:46:00.395327+0000","modified":"2023-07-24T05:46:27.438873+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6835/2428690206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2428690206},{"type":"v1","addr":"172.21.15.77:6835","nonce":2428690206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-24T05:46:27.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.878+0000 7fd100bcd700 1 -- 172.21.15.77:0/2305622956 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd0dc0662f0 msgr2=0x7fd0dc0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:27.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.878+0000 7fd100bcd700 1 --2- 172.21.15.77:0/2305622956 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd0dc0662f0 0x7fd0dc0687b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec009850 tx=0x7fd0ec008030 comp rx=0 tx=0).stop 2023-07-24T05:46:27.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.878+0000 7fd100bcd700 1 -- 172.21.15.77:0/2305622956 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0fc0d1f00 msgr2=0x7fd0fc15ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:27.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.878+0000 7fd100bcd700 1 --2- 172.21.15.77:0/2305622956 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0fc0d1f00 0x7fd0fc15ddd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd0f000c4d0 tx=0x7fd0f000c7e0 comp rx=0 tx=0).stop 2023-07-24T05:46:27.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.878+0000 7fd100bcd700 1 -- 172.21.15.77:0/2305622956 shutdown_connections 2023-07-24T05:46:27.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.878+0000 7fd100bcd700 1 --2- 172.21.15.77:0/2305622956 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd0dc0662f0 0x7fd0dc0687b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:27.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.878+0000 7fd100bcd700 1 --2- 172.21.15.77:0/2305622956 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd0fc15ca90 0x7fd0fc15e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:27.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.878+0000 7fd100bcd700 1 --2- 172.21.15.77:0/2305622956 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0fc0d1f00 0x7fd0fc15ddd0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:27.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.878+0000 7fd100bcd700 1 --2- 172.21.15.77:0/2305622956 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0fc0b4420 0x7fd0fc0c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:27.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.878+0000 7fd100bcd700 1 -- 172.21.15.77:0/2305622956 >> 172.21.15.77:0/2305622956 conn(0x7fd0fc0cf420 msgr2=0x7fd0fc15cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:27.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.878+0000 7fd100bcd700 1 -- 172.21.15.77:0/2305622956 shutdown_connections 2023-07-24T05:46:27.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:27.878+0000 7fd100bcd700 1 -- 172.21.15.77:0/2305622956 wait complete. 2023-07-24T05:46:27.887 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 9 2023-07-24T05:46:27.907 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-24T05:46:28.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.078+0000 7fce6c977700 1 Processor -- start 2023-07-24T05:46:28.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.078+0000 7fce6c977700 1 -- start start 2023-07-24T05:46:28.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.078+0000 7fce6c977700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fce6815ca00 0x7fce680d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:28.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.078+0000 7fce6c977700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fce680b4800 0x7fce680b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:28.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.078+0000 7fce6c977700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce680d0300 con 0x7fce6806d450 2023-07-24T05:46:28.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.078+0000 7fce6c977700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce6815cde0 con 0x7fce680b4800 2023-07-24T05:46:28.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.078+0000 7fce6c977700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce680d2870 con 0x7fce6815ca00 2023-07-24T05:46:28.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.082+0000 7fce67fff700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fce680b4800 0x7fce680b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:28.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.082+0000 7fce67fff700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fce680b4800 0x7fce680b11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58598/0 (socket says 172.21.15.77:58598) 2023-07-24T05:46:28.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.082+0000 7fce67fff700 1 -- 172.21.15.77:0/1064599752 learned_addr learned my addr 172.21.15.77:0/1064599752 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:28.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.082+0000 7fce677fe700 1 --2- 172.21.15.77:0/1064599752 >> v2:172.21.15.103:3300/0 conn(0x7fce6815ca00 0x7fce680d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:28.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.082+0000 7fce67fff700 1 -- 172.21.15.77:0/1064599752 >> v2:172.21.15.103:3300/0 conn(0x7fce6815ca00 msgr2=0x7fce680d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:28.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.082+0000 7fce67fff700 1 --2- 172.21.15.77:0/1064599752 >> v2:172.21.15.103:3300/0 conn(0x7fce6815ca00 0x7fce680d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:28.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.082+0000 7fce67fff700 1 -- 172.21.15.77:0/1064599752 >> v1:172.21.15.103:6789/0 conn(0x7fce6806d450 legacy=0x7fce680b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:28.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.082+0000 7fce67fff700 1 -- 172.21.15.77:0/1064599752 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce680d2b50 con 0x7fce680b4800 2023-07-24T05:46:28.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.082+0000 7fce67fff700 1 --2- 172.21.15.77:0/1064599752 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce680b4800 0x7fce680b11e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fce6808c470 tx=0x7fce6000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3af3b8b7c235482 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:28.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.082+0000 7fce667fc700 1 -- 172.21.15.77:0/1064599752 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6000e070 con 0x7fce680b4800 2023-07-24T05:46:28.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.082+0000 7fce667fc700 1 -- 172.21.15.77:0/1064599752 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce6000b910 con 0x7fce680b4800 2023-07-24T05:46:28.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.082+0000 7fce667fc700 1 -- 172.21.15.77:0/1064599752 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6000bcc0 con 0x7fce680b4800 2023-07-24T05:46:28.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.082+0000 7fce6c977700 1 -- 172.21.15.77:0/1064599752 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce680b4800 msgr2=0x7fce680b11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:28.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.082+0000 7fce6c977700 1 --2- 172.21.15.77:0/1064599752 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce680b4800 0x7fce680b11e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fce6808c470 tx=0x7fce6000b330 comp rx=0 tx=0).stop 2023-07-24T05:46:28.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.082+0000 7fce6c977700 1 -- 172.21.15.77:0/1064599752 shutdown_connections 2023-07-24T05:46:28.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.082+0000 7fce6c977700 1 --2- 172.21.15.77:0/1064599752 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce680b4800 0x7fce680b11e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:28.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.082+0000 7fce6c977700 1 --2- 172.21.15.77:0/1064599752 >> v2:172.21.15.103:3300/0 conn(0x7fce6815ca00 0x7fce680d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:28.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.082+0000 7fce6c977700 1 -- 172.21.15.77:0/1064599752 >> 172.21.15.77:0/1064599752 conn(0x7fce680b7610 msgr2=0x7fce680b7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:28.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.082+0000 7fce6c977700 1 -- 172.21.15.77:0/1064599752 shutdown_connections 2023-07-24T05:46:28.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.082+0000 7fce6c977700 1 -- 172.21.15.77:0/1064599752 wait complete. 2023-07-24T05:46:28.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.086+0000 7fce6c977700 1 Processor -- start 2023-07-24T05:46:28.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.086+0000 7fce6c977700 1 -- start start 2023-07-24T05:46:28.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.086+0000 7fce6c977700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fce6806d450 0x7fce68156f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:28.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.086+0000 7fce6c977700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce680b4800 0x7fce6815f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:28.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.086+0000 7fce6c977700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce6815ca00 0x7fce680c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:28.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.086+0000 7fce6c977700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6809e410 con 0x7fce680b4800 2023-07-24T05:46:28.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.086+0000 7fce6c977700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce681574c0 con 0x7fce6815ca00 2023-07-24T05:46:28.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.086+0000 7fce6c977700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce6809d330 con 0x7fce6806d450 2023-07-24T05:46:28.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.086+0000 7fce66ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce680b4800 0x7fce6815f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:28.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.086+0000 7fce66ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce680b4800 0x7fce6815f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58600/0 (socket says 172.21.15.77:58600) 2023-07-24T05:46:28.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.086+0000 7fce66ffd700 1 -- 172.21.15.77:0/1805359147 learned_addr learned my addr 172.21.15.77:0/1805359147 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:28.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.090+0000 7fce67fff700 1 --2- 172.21.15.77:0/1805359147 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce6815ca00 0x7fce680c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:28.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.090+0000 7fce677fe700 1 --2- 172.21.15.77:0/1805359147 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fce6806d450 0x7fce68156f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:28.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.090+0000 7fce66ffd700 1 -- 172.21.15.77:0/1805359147 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fce6806d450 msgr2=0x7fce68156f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:28.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.090+0000 7fce66ffd700 1 --2- 172.21.15.77:0/1805359147 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fce6806d450 0x7fce68156f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:28.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.090+0000 7fce66ffd700 1 -- 172.21.15.77:0/1805359147 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce6815ca00 msgr2=0x7fce680c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:28.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.090+0000 7fce66ffd700 1 --2- 172.21.15.77:0/1805359147 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce6815ca00 0x7fce680c84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:28.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.090+0000 7fce66ffd700 1 -- 172.21.15.77:0/1805359147 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce60009b30 con 0x7fce680b4800 2023-07-24T05:46:28.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.090+0000 7fce66ffd700 1 --2- 172.21.15.77:0/1805359147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce680b4800 0x7fce6815f480 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fce5c00c530 tx=0x7fce5c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:28.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.090+0000 7fce4ffff700 1 -- 172.21.15.77:0/1805359147 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5c00cea0 con 0x7fce680b4800 2023-07-24T05:46:28.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.090+0000 7fce4ffff700 1 -- 172.21.15.77:0/1805359147 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce5c0052d0 con 0x7fce680b4800 2023-07-24T05:46:28.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.090+0000 7fce6c977700 1 -- 172.21.15.77:0/1805359147 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce6809d050 con 0x7fce680b4800 2023-07-24T05:46:28.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.090+0000 7fce4ffff700 1 -- 172.21.15.77:0/1805359147 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5c0036a0 con 0x7fce680b4800 2023-07-24T05:46:28.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.090+0000 7fce6c977700 1 -- 172.21.15.77:0/1805359147 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce6809e030 con 0x7fce680b4800 2023-07-24T05:46:28.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.090+0000 7fce6c977700 1 -- 172.21.15.77:0/1805359147 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce6809e550 con 0x7fce680b4800 2023-07-24T05:46:28.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.094+0000 7fce4ffff700 1 -- 172.21.15.77:0/1805359147 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fce5c003800 con 0x7fce680b4800 2023-07-24T05:46:28.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.094+0000 7fce4ffff700 1 --2- 172.21.15.77:0/1805359147 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fce540662f0 0x7fce540687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:28.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.094+0000 7fce4ffff700 1 -- 172.21.15.77:0/1805359147 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fce5c083320 con 0x7fce680b4800 2023-07-24T05:46:28.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.094+0000 7fce677fe700 1 --2- 172.21.15.77:0/1805359147 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fce540662f0 0x7fce540687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:28.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.098+0000 7fce677fe700 1 --2- 172.21.15.77:0/1805359147 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fce540662f0 0x7fce540687b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fce58009b40 tx=0x7fce580091c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:28.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.102+0000 7fce4ffff700 1 -- 172.21.15.77:0/1805359147 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fce5c0504a0 con 0x7fce680b4800 2023-07-24T05:46:28.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.274+0000 7fce6c977700 1 -- 172.21.15.77:0/1805359147 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce68072490 con 0x7fce680b4800 2023-07-24T05:46:28.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.278+0000 7fce4ffff700 1 -- 172.21.15.77:0/1805359147 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20108 (secure 0 0 0) 0x7fce5c053ac0 con 0x7fce680b4800 2023-07-24T05:46:28.283 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:46:28.283 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":25,"fsid":"5aed5f7b-fb55-4d95-9c02-c6adbb1677b4","created":"2023-07-24T05:45:39.639731+0000","modified":"2023-07-24T05:46:05.445306+0000","last_up_change":"2023-07-24T05:45:52.319670+0000","last_in_change":"2023-07-24T05:45:43.643277+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-24T05:45:52.610430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-24T05:45:52.773787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-24T05:45:58.121732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-24T05:45:59.368726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-24T05:46:03.032057+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ffa0d496-461a-4053-b764-0627d969521b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6812","nonce":825987196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6817","nonce":825987196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6831","nonce":825987196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6824","nonce":825987196}]},"public_addr":"172.21.15.77:6812/825987196","cluster_addr":"172.21.15.77:6817/825987196","heartbeat_back_addr":"172.21.15.77:6831/825987196","heartbeat_front_addr":"172.21.15.77:6824/825987196","state":["exists","up"]},{"osd":1,"uuid":"9f595e5e-5c43-49bc-8ce4-ee70575c90da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6801","nonce":4133026815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6803","nonce":4133026815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6807","nonce":4133026815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6805","nonce":4133026815}]},"public_addr":"172.21.15.77:6801/4133026815","cluster_addr":"172.21.15.77:6803/4133026815","heartbeat_back_addr":"172.21.15.77:6807/4133026815","heartbeat_front_addr":"172.21.15.77:6805/4133026815","state":["exists","up"]},{"osd":2,"uuid":"2ac177aa-4d7d-4262-bd54-d2b9f29f4c3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6811","nonce":2394142159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6819","nonce":2394142159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6830","nonce":2394142159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6825","nonce":2394142159}]},"public_addr":"172.21.15.77:6811/2394142159","cluster_addr":"172.21.15.77:6819/2394142159","heartbeat_back_addr":"172.21.15.77:6830/2394142159","heartbeat_front_addr":"172.21.15.77:6825/2394142159","state":["exists","up"]},{"osd":3,"uuid":"17d7a251-19e8-484c-8172-a578ab3da153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6813","nonce":1492113982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6818","nonce":1492113982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6829","nonce":1492113982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6823","nonce":1492113982}]},"public_addr":"172.21.15.77:6813/1492113982","cluster_addr":"172.21.15.77:6818/1492113982","heartbeat_back_addr":"172.21.15.77:6829/1492113982","heartbeat_front_addr":"172.21.15.77:6823/1492113982","state":["exists","up"]},{"osd":4,"uuid":"bf63ca05-f06d-4e0f-ac44-2a416c70b919","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6825","nonce":1080481057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6827","nonce":1080481057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6831","nonce":1080481057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6829","nonce":1080481057}]},"public_addr":"172.21.15.103:6825/1080481057","cluster_addr":"172.21.15.103:6827/1080481057","heartbeat_back_addr":"172.21.15.103:6831/1080481057","heartbeat_front_addr":"172.21.15.103:6829/1080481057","state":["exists","up"]},{"osd":5,"uuid":"65a11a35-9e9f-4b3c-9fe3-b658d62b9318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6811","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6813","nonce":2756677504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6818","nonce":2756677504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6823","nonce":2756677504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6821","nonce":2756677504}]},"public_addr":"172.21.15.103:6813/2756677504","cluster_addr":"172.21.15.103:6818/2756677504","heartbeat_back_addr":"172.21.15.103:6823/2756677504","heartbeat_front_addr":"172.21.15.103:6821/2756677504","state":["exists","up"]},{"osd":6,"uuid":"750c1f87-686c-40b4-94a1-1a299dc78f3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6809","nonce":568977764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6812","nonce":568977764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6819","nonce":568977764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6815","nonce":568977764}]},"public_addr":"172.21.15.103:6809/568977764","cluster_addr":"172.21.15.103:6812/568977764","heartbeat_back_addr":"172.21.15.103:6819/568977764","heartbeat_front_addr":"172.21.15.103:6815/568977764","state":["exists","up"]},{"osd":7,"uuid":"d5fe4fb6-2e09-4158-885b-403803c85822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6801","nonce":1074557176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6803","nonce":1074557176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6807","nonce":1074557176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6805","nonce":1074557176}]},"public_addr":"172.21.15.103:6801/1074557176","cluster_addr":"172.21.15.103:6803/1074557176","heartbeat_back_addr":"172.21.15.103:6807/1074557176","heartbeat_front_addr":"172.21.15.103:6805/1074557176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.631032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.154109+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.398587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.679089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.311218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.353726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.314372+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.126212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-24T05:46:28.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.282+0000 7fce6c977700 1 -- 172.21.15.77:0/1805359147 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fce540662f0 msgr2=0x7fce540687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:28.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.282+0000 7fce6c977700 1 --2- 172.21.15.77:0/1805359147 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fce540662f0 0x7fce540687b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fce58009b40 tx=0x7fce580091c0 comp rx=0 tx=0).stop 2023-07-24T05:46:28.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.282+0000 7fce6c977700 1 -- 172.21.15.77:0/1805359147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce680b4800 msgr2=0x7fce6815f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:28.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.282+0000 7fce6c977700 1 --2- 172.21.15.77:0/1805359147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce680b4800 0x7fce6815f480 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fce5c00c530 tx=0x7fce5c00c840 comp rx=0 tx=0).stop 2023-07-24T05:46:28.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.282+0000 7fce6c977700 1 -- 172.21.15.77:0/1805359147 shutdown_connections 2023-07-24T05:46:28.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.282+0000 7fce6c977700 1 --2- 172.21.15.77:0/1805359147 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce6815ca00 0x7fce680c84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:28.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.282+0000 7fce6c977700 1 --2- 172.21.15.77:0/1805359147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce680b4800 0x7fce6815f480 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:28.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.282+0000 7fce6c977700 1 --2- 172.21.15.77:0/1805359147 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fce540662f0 0x7fce540687b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:28.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.282+0000 7fce6c977700 1 --2- 172.21.15.77:0/1805359147 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fce6806d450 0x7fce68156f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:28.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.282+0000 7fce6c977700 1 -- 172.21.15.77:0/1805359147 >> 172.21.15.77:0/1805359147 conn(0x7fce680b7610 msgr2=0x7fce6815a730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:28.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.282+0000 7fce6c977700 1 -- 172.21.15.77:0/1805359147 shutdown_connections 2023-07-24T05:46:28.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.282+0000 7fce6c977700 1 -- 172.21.15.77:0/1805359147 wait complete. 2023-07-24T05:46:28.307 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-24T05:46:28.308 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-24T05:46:28.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.474+0000 7fba1b59e700 1 Processor -- start 2023-07-24T05:46:28.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.474+0000 7fba1b59e700 1 -- start start 2023-07-24T05:46:28.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.478+0000 7fba1b59e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fba1c0b13c0 0x7fba1c06adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:28.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.478+0000 7fba1b59e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fba1c0a4580 0x7fba1c06fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:28.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.478+0000 7fba1b59e700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fba1c069b10 0x7fba1c069fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:28.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.478+0000 7fba1b59e700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba1c06a4e0 con 0x7fba1c069b10 2023-07-24T05:46:28.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.478+0000 7fba1b59e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba1c0adc40 con 0x7fba1c0b13c0 2023-07-24T05:46:28.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.478+0000 7fba1b59e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c06b330 con 0x7fba1c0a4580 2023-07-24T05:46:28.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.478+0000 7fba1ad9d700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fba1c069b10 0x7fba1c069fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:28.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.478+0000 7fba1ad9d700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fba1c069b10 0x7fba1c069fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58614/0 (socket says 172.21.15.77:58614) 2023-07-24T05:46:28.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.478+0000 7fba1ad9d700 1 -- 172.21.15.77:0/1325931677 learned_addr learned my addr 172.21.15.77:0/1325931677 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:28.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.478+0000 7fba11d9b700 1 --2- 172.21.15.77:0/1325931677 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fba1c0a4580 0x7fba1c06fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:28.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.478+0000 7fba1a59c700 1 --2- 172.21.15.77:0/1325931677 >> v2:172.21.15.103:3300/0 conn(0x7fba1c0b13c0 0x7fba1c06adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:28.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.478+0000 7fba1ad9d700 1 -- 172.21.15.77:0/1325931677 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fba1c0a4580 msgr2=0x7fba1c06fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:28.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.478+0000 7fba1ad9d700 1 --2- 172.21.15.77:0/1325931677 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fba1c0a4580 0x7fba1c06fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:28.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.478+0000 7fba1ad9d700 1 -- 172.21.15.77:0/1325931677 >> v2:172.21.15.103:3300/0 conn(0x7fba1c0b13c0 msgr2=0x7fba1c06adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:28.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.478+0000 7fba1ad9d700 1 --2- 172.21.15.77:0/1325931677 >> v2:172.21.15.103:3300/0 conn(0x7fba1c0b13c0 0x7fba1c06adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:28.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.478+0000 7fba1ad9d700 1 -- 172.21.15.77:0/1325931677 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba1c0adee0 con 0x7fba1c069b10 2023-07-24T05:46:28.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.478+0000 7fba11d9b700 1 --2- 172.21.15.77:0/1325931677 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fba1c0a4580 0x7fba1c06fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:46:28.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.478+0000 7fba1ad9d700 1 --2- 172.21.15.77:0/1325931677 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba1c069b10 0x7fba1c069fa0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fba1c06f1a0 tx=0x7fba1400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20596ac69b7d155c server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:28.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.478+0000 7fba19d9b700 1 -- 172.21.15.77:0/1325931677 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1400e070 con 0x7fba1c069b10 2023-07-24T05:46:28.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.478+0000 7fba19d9b700 1 -- 172.21.15.77:0/1325931677 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba1400b910 con 0x7fba1c069b10 2023-07-24T05:46:28.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.478+0000 7fba19d9b700 1 -- 172.21.15.77:0/1325931677 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1400bcc0 con 0x7fba1c069b10 2023-07-24T05:46:28.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.482+0000 7fba1b59e700 1 -- 172.21.15.77:0/1325931677 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba1c069b10 msgr2=0x7fba1c069fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:28.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.482+0000 7fba1b59e700 1 --2- 172.21.15.77:0/1325931677 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba1c069b10 0x7fba1c069fa0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fba1c06f1a0 tx=0x7fba1400b330 comp rx=0 tx=0).stop 2023-07-24T05:46:28.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.482+0000 7fba1b59e700 1 -- 172.21.15.77:0/1325931677 shutdown_connections 2023-07-24T05:46:28.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.482+0000 7fba1b59e700 1 --2- 172.21.15.77:0/1325931677 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba1c069b10 0x7fba1c069fa0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:28.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.482+0000 7fba1b59e700 1 --2- 172.21.15.77:0/1325931677 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fba1c0a4580 0x7fba1c06fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:28.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.482+0000 7fba1b59e700 1 --2- 172.21.15.77:0/1325931677 >> v2:172.21.15.103:3300/0 conn(0x7fba1c0b13c0 0x7fba1c06adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:28.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.482+0000 7fba1b59e700 1 -- 172.21.15.77:0/1325931677 >> 172.21.15.77:0/1325931677 conn(0x7fba1c0cacc0 msgr2=0x7fba1c0cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:28.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.482+0000 7fba1b59e700 1 -- 172.21.15.77:0/1325931677 shutdown_connections 2023-07-24T05:46:28.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.482+0000 7fba1b59e700 1 -- 172.21.15.77:0/1325931677 wait complete. 2023-07-24T05:46:28.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.482+0000 7fba1b59e700 1 Processor -- start 2023-07-24T05:46:28.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.482+0000 7fba1b59e700 1 -- start start 2023-07-24T05:46:28.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.486+0000 7fba1b59e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba1c069b10 0x7fba1c158820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:28.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.486+0000 7fba1b59e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba1c0a4580 0x7fba1c158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:28.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.486+0000 7fba1b59e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fba1c0b13c0 0x7fba1c1f4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:28.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.486+0000 7fba1b59e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c15d950 con 0x7fba1c069b10 2023-07-24T05:46:28.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.486+0000 7fba1b59e700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c15c160 con 0x7fba1c0a4580 2023-07-24T05:46:28.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.486+0000 7fba1b59e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c15d300 con 0x7fba1c0b13c0 2023-07-24T05:46:28.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.486+0000 7fba1a59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba1c069b10 0x7fba1c158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:28.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.486+0000 7fba1a59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba1c069b10 0x7fba1c158820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58622/0 (socket says 172.21.15.77:58622) 2023-07-24T05:46:28.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.486+0000 7fba1a59c700 1 -- 172.21.15.77:0/3214729526 learned_addr learned my addr 172.21.15.77:0/3214729526 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:28.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.486+0000 7fba11d9b700 1 --2- 172.21.15.77:0/3214729526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba1c0a4580 0x7fba1c158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:28.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.486+0000 7fba1ad9d700 1 --2- 172.21.15.77:0/3214729526 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fba1c0b13c0 0x7fba1c1f4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:28.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.486+0000 7fba1a59c700 1 -- 172.21.15.77:0/3214729526 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fba1c0b13c0 msgr2=0x7fba1c1f4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:28.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.486+0000 7fba1a59c700 1 --2- 172.21.15.77:0/3214729526 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fba1c0b13c0 0x7fba1c1f4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:28.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.486+0000 7fba1a59c700 1 -- 172.21.15.77:0/3214729526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba1c0a4580 msgr2=0x7fba1c158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:28.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.486+0000 7fba1a59c700 1 --2- 172.21.15.77:0/3214729526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba1c0a4580 0x7fba1c158d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:28.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.486+0000 7fba1a59c700 1 -- 172.21.15.77:0/3214729526 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba040094b0 con 0x7fba1c069b10 2023-07-24T05:46:28.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.486+0000 7fba1a59c700 1 --2- 172.21.15.77:0/3214729526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba1c069b10 0x7fba1c158820 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fba0c00e9d0 tx=0x7fba0c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:28.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.486+0000 7fba137fe700 1 -- 172.21.15.77:0/3214729526 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c009720 con 0x7fba1c069b10 2023-07-24T05:46:28.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.486+0000 7fba1b59e700 1 -- 172.21.15.77:0/3214729526 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba14009b30 con 0x7fba1c069b10 2023-07-24T05:46:28.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.486+0000 7fba137fe700 1 -- 172.21.15.77:0/3214729526 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0c00ee70 con 0x7fba1c069b10 2023-07-24T05:46:28.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.486+0000 7fba137fe700 1 -- 172.21.15.77:0/3214729526 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0c00ca50 con 0x7fba1c069b10 2023-07-24T05:46:28.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.486+0000 7fba1b59e700 1 -- 172.21.15.77:0/3214729526 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba1c1592a0 con 0x7fba1c069b10 2023-07-24T05:46:28.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.490+0000 7fba1b59e700 1 -- 172.21.15.77:0/3214729526 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba1c15d160 con 0x7fba1c069b10 2023-07-24T05:46:28.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.490+0000 7fba137fe700 1 -- 172.21.15.77:0/3214729526 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fba0c00cbb0 con 0x7fba1c069b10 2023-07-24T05:46:28.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.490+0000 7fba137fe700 1 --2- 172.21.15.77:0/3214729526 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb9fc0662f0 0x7fb9fc0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:28.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.490+0000 7fba137fe700 1 -- 172.21.15.77:0/3214729526 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fba0c084380 con 0x7fba1c069b10 2023-07-24T05:46:28.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.494+0000 7fba11d9b700 1 --2- 172.21.15.77:0/3214729526 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb9fc0662f0 0x7fb9fc0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:28.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.494+0000 7fba11d9b700 1 --2- 172.21.15.77:0/3214729526 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb9fc0662f0 0x7fb9fc0687b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fba1c0ac8a0 tx=0x7fba04009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:28.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.498+0000 7fba137fe700 1 -- 172.21.15.77:0/3214729526 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fba1c15d160 con 0x7fba1c069b10 2023-07-24T05:46:28.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.670+0000 7fba1b59e700 1 -- 172.21.15.77:0/3214729526 --> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fba1c0ae4a0 con 0x7fb9fc0662f0 2023-07-24T05:46:28.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.690+0000 7fba137fe700 1 -- 172.21.15.77:0/3214729526 <== mgr.4108 v2:172.21.15.103:6832/1305366540 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367130 (secure 0 0 0) 0x7fba04009980 con 0x7fb9fc0662f0 2023-07-24T05:46:28.697 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:46:28.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.702+0000 7fba1b59e700 1 -- 172.21.15.77:0/3214729526 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb9fc0662f0 msgr2=0x7fb9fc0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:28.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.702+0000 7fba1b59e700 1 --2- 172.21.15.77:0/3214729526 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb9fc0662f0 0x7fb9fc0687b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fba1c0ac8a0 tx=0x7fba04009240 comp rx=0 tx=0).stop 2023-07-24T05:46:28.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.702+0000 7fba1b59e700 1 -- 172.21.15.77:0/3214729526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba1c069b10 msgr2=0x7fba1c158820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:28.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.702+0000 7fba1b59e700 1 --2- 172.21.15.77:0/3214729526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba1c069b10 0x7fba1c158820 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fba0c00e9d0 tx=0x7fba0c00ece0 comp rx=0 tx=0).stop 2023-07-24T05:46:28.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.702+0000 7fba1b59e700 1 -- 172.21.15.77:0/3214729526 shutdown_connections 2023-07-24T05:46:28.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.702+0000 7fba1b59e700 1 --2- 172.21.15.77:0/3214729526 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb9fc0662f0 0x7fb9fc0687b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:28.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.702+0000 7fba1b59e700 1 --2- 172.21.15.77:0/3214729526 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fba1c0b13c0 0x7fba1c1f4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:28.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.702+0000 7fba1b59e700 1 --2- 172.21.15.77:0/3214729526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba1c0a4580 0x7fba1c158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:28.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.702+0000 7fba1b59e700 1 --2- 172.21.15.77:0/3214729526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba1c069b10 0x7fba1c158820 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:28.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.702+0000 7fba1b59e700 1 -- 172.21.15.77:0/3214729526 >> 172.21.15.77:0/3214729526 conn(0x7fba1c0cacc0 msgr2=0x7fba1c0710a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:28.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.702+0000 7fba1b59e700 1 -- 172.21.15.77:0/3214729526 shutdown_connections 2023-07-24T05:46:28.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.702+0000 7fba1b59e700 1 -- 172.21.15.77:0/3214729526 wait complete. 2023-07-24T05:46:28.708 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-07-24T05:46:28.725 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2023-07-24T05:46:28.535321+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594959,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219412,"kb_used_data":3260,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755308,"statfs":{"total":773094113280,"available":772869435392,"internally_reserved":0,"allocated":3338240,"data_stored":2049379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004849"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.485697+0000","last_change":"2023-07-24T05:46:05.018571+0000","last_active":"2023-07-24T05:46:07.485697+0000","last_peered":"2023-07-24T05:46:07.485697+0000","last_clean":"2023-07-24T05:46:07.485697+0000","last_became_active":"2023-07-24T05:46:05.017995+0000","last_became_peered":"2023-07-24T05:46:05.017995+0000","last_unstale":"2023-07-24T05:46:07.485697+0000","last_undegraded":"2023-07-24T05:46:07.485697+0000","last_fullsized":"2023-07-24T05:46:07.485697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:09:07.896789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.720068+0000","last_change":"2023-07-24T05:45:59.909905+0000","last_active":"2023-07-24T05:46:06.720068+0000","last_peered":"2023-07-24T05:46:06.720068+0000","last_clean":"2023-07-24T05:46:06.720068+0000","last_became_active":"2023-07-24T05:45:59.909674+0000","last_became_peered":"2023-07-24T05:45:59.909674+0000","last_unstale":"2023-07-24T05:46:06.720068+0000","last_undegraded":"2023-07-24T05:46:06.720068+0000","last_fullsized":"2023-07-24T05:46:06.720068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:52:15.728826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.020712+0000","last_change":"2023-07-24T05:46:00.933508+0000","last_active":"2023-07-24T05:46:06.020712+0000","last_peered":"2023-07-24T05:46:06.020712+0000","last_clean":"2023-07-24T05:46:06.020712+0000","last_became_active":"2023-07-24T05:46:00.933149+0000","last_became_peered":"2023-07-24T05:46:00.933149+0000","last_unstale":"2023-07-24T05:46:06.020712+0000","last_undegraded":"2023-07-24T05:46:06.020712+0000","last_fullsized":"2023-07-24T05:46:06.020712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:48:28.674504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.020411+0000","last_change":"2023-07-24T05:46:05.015347+0000","last_active":"2023-07-24T05:46:06.020411+0000","last_peered":"2023-07-24T05:46:06.020411+0000","last_clean":"2023-07-24T05:46:06.020411+0000","last_became_active":"2023-07-24T05:46:05.014821+0000","last_became_peered":"2023-07-24T05:46:05.014821+0000","last_unstale":"2023-07-24T05:46:06.020411+0000","last_undegraded":"2023-07-24T05:46:06.020411+0000","last_fullsized":"2023-07-24T05:46:06.020411+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:18:33.791257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.484589+0000","last_change":"2023-07-24T05:45:59.894586+0000","last_active":"2023-07-24T05:46:07.484589+0000","last_peered":"2023-07-24T05:46:07.484589+0000","last_clean":"2023-07-24T05:46:07.484589+0000","last_became_active":"2023-07-24T05:45:59.894286+0000","last_became_peered":"2023-07-24T05:45:59.894286+0000","last_unstale":"2023-07-24T05:46:07.484589+0000","last_undegraded":"2023-07-24T05:46:07.484589+0000","last_fullsized":"2023-07-24T05:46:07.484589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:35:04.605981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.484398+0000","last_change":"2023-07-24T05:46:00.933761+0000","last_active":"2023-07-24T05:46:07.484398+0000","last_peered":"2023-07-24T05:46:07.484398+0000","last_clean":"2023-07-24T05:46:07.484398+0000","last_became_active":"2023-07-24T05:46:00.933321+0000","last_became_peered":"2023-07-24T05:46:00.933321+0000","last_unstale":"2023-07-24T05:46:07.484398+0000","last_undegraded":"2023-07-24T05:46:07.484398+0000","last_fullsized":"2023-07-24T05:46:07.484398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:28:13.314710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486274+0000","last_change":"2023-07-24T05:46:05.020875+0000","last_active":"2023-07-24T05:46:07.486274+0000","last_peered":"2023-07-24T05:46:07.486274+0000","last_clean":"2023-07-24T05:46:07.486274+0000","last_became_active":"2023-07-24T05:46:05.020425+0000","last_became_peered":"2023-07-24T05:46:05.020425+0000","last_unstale":"2023-07-24T05:46:07.486274+0000","last_undegraded":"2023-07-24T05:46:07.486274+0000","last_fullsized":"2023-07-24T05:46:07.486274+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T16:13:44.814663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486774+0000","last_change":"2023-07-24T05:45:59.917608+0000","last_active":"2023-07-24T05:46:07.486774+0000","last_peered":"2023-07-24T05:46:07.486774+0000","last_clean":"2023-07-24T05:46:07.486774+0000","last_became_active":"2023-07-24T05:45:59.917276+0000","last_became_peered":"2023-07-24T05:45:59.917276+0000","last_unstale":"2023-07-24T05:46:07.486774+0000","last_undegraded":"2023-07-24T05:46:07.486774+0000","last_fullsized":"2023-07-24T05:46:07.486774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:26:41.573346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.021965+0000","last_change":"2023-07-24T05:46:00.937906+0000","last_active":"2023-07-24T05:46:06.021965+0000","last_peered":"2023-07-24T05:46:06.021965+0000","last_clean":"2023-07-24T05:46:06.021965+0000","last_became_active":"2023-07-24T05:46:00.937395+0000","last_became_peered":"2023-07-24T05:46:00.937395+0000","last_unstale":"2023-07-24T05:46:06.021965+0000","last_undegraded":"2023-07-24T05:46:06.021965+0000","last_fullsized":"2023-07-24T05:46:06.021965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T16:29:11.391157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.481461+0000","last_change":"2023-07-24T05:46:05.025366+0000","last_active":"2023-07-24T05:46:06.481461+0000","last_peered":"2023-07-24T05:46:06.481461+0000","last_clean":"2023-07-24T05:46:06.481461+0000","last_became_active":"2023-07-24T05:46:05.024220+0000","last_became_peered":"2023-07-24T05:46:05.024220+0000","last_unstale":"2023-07-24T05:46:06.481461+0000","last_undegraded":"2023-07-24T05:46:06.481461+0000","last_fullsized":"2023-07-24T05:46:06.481461+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:56:32.485103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486003+0000","last_change":"2023-07-24T05:45:59.917558+0000","last_active":"2023-07-24T05:46:07.486003+0000","last_peered":"2023-07-24T05:46:07.486003+0000","last_clean":"2023-07-24T05:46:07.486003+0000","last_became_active":"2023-07-24T05:45:59.917247+0000","last_became_peered":"2023-07-24T05:45:59.917247+0000","last_unstale":"2023-07-24T05:46:07.486003+0000","last_undegraded":"2023-07-24T05:46:07.486003+0000","last_fullsized":"2023-07-24T05:46:07.486003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:07:11.420006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.022778+0000","last_change":"2023-07-24T05:46:00.937863+0000","last_active":"2023-07-24T05:46:06.022778+0000","last_peered":"2023-07-24T05:46:06.022778+0000","last_clean":"2023-07-24T05:46:06.022778+0000","last_became_active":"2023-07-24T05:46:00.937533+0000","last_became_peered":"2023-07-24T05:46:00.937533+0000","last_unstale":"2023-07-24T05:46:06.022778+0000","last_undegraded":"2023-07-24T05:46:06.022778+0000","last_fullsized":"2023-07-24T05:46:06.022778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:22:28.252629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486901+0000","last_change":"2023-07-24T05:46:05.021105+0000","last_active":"2023-07-24T05:46:07.486901+0000","last_peered":"2023-07-24T05:46:07.486901+0000","last_clean":"2023-07-24T05:46:07.486901+0000","last_became_active":"2023-07-24T05:46:05.020568+0000","last_became_peered":"2023-07-24T05:46:05.020568+0000","last_unstale":"2023-07-24T05:46:07.486901+0000","last_undegraded":"2023-07-24T05:46:07.486901+0000","last_fullsized":"2023-07-24T05:46:07.486901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:37:20.869353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.720347+0000","last_change":"2023-07-24T05:45:59.904446+0000","last_active":"2023-07-24T05:46:06.720347+0000","last_peered":"2023-07-24T05:46:06.720347+0000","last_clean":"2023-07-24T05:46:06.720347+0000","last_became_active":"2023-07-24T05:45:59.900231+0000","last_became_peered":"2023-07-24T05:45:59.900231+0000","last_unstale":"2023-07-24T05:46:06.720347+0000","last_undegraded":"2023-07-24T05:46:06.720347+0000","last_fullsized":"2023-07-24T05:46:06.720347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:44:12.555935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.018863+0000","last_change":"2023-07-24T05:46:00.951996+0000","last_active":"2023-07-24T05:46:06.018863+0000","last_peered":"2023-07-24T05:46:06.018863+0000","last_clean":"2023-07-24T05:46:06.018863+0000","last_became_active":"2023-07-24T05:46:00.951595+0000","last_became_peered":"2023-07-24T05:46:00.951595+0000","last_unstale":"2023-07-24T05:46:06.018863+0000","last_undegraded":"2023-07-24T05:46:06.018863+0000","last_fullsized":"2023-07-24T05:46:06.018863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:12:50.748120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023300+0000","last_change":"2023-07-24T05:46:05.017525+0000","last_active":"2023-07-24T05:46:06.023300+0000","last_peered":"2023-07-24T05:46:06.023300+0000","last_clean":"2023-07-24T05:46:06.023300+0000","last_became_active":"2023-07-24T05:46:05.015341+0000","last_became_peered":"2023-07-24T05:46:05.015341+0000","last_unstale":"2023-07-24T05:46:06.023300+0000","last_undegraded":"2023-07-24T05:46:06.023300+0000","last_fullsized":"2023-07-24T05:46:06.023300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:21:43.930293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.022219+0000","last_change":"2023-07-24T05:45:59.908228+0000","last_active":"2023-07-24T05:46:06.022219+0000","last_peered":"2023-07-24T05:46:06.022219+0000","last_clean":"2023-07-24T05:46:06.022219+0000","last_became_active":"2023-07-24T05:45:59.907944+0000","last_became_peered":"2023-07-24T05:45:59.907944+0000","last_unstale":"2023-07-24T05:46:06.022219+0000","last_undegraded":"2023-07-24T05:46:06.022219+0000","last_fullsized":"2023-07-24T05:46:06.022219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:52:47.698647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.484788+0000","last_change":"2023-07-24T05:46:00.952847+0000","last_active":"2023-07-24T05:46:07.484788+0000","last_peered":"2023-07-24T05:46:07.484788+0000","last_clean":"2023-07-24T05:46:07.484788+0000","last_became_active":"2023-07-24T05:46:00.952573+0000","last_became_peered":"2023-07-24T05:46:00.952573+0000","last_unstale":"2023-07-24T05:46:07.484788+0000","last_undegraded":"2023-07-24T05:46:07.484788+0000","last_fullsized":"2023-07-24T05:46:07.484788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:41:28.929137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.022213+0000","last_change":"2023-07-24T05:46:05.014357+0000","last_active":"2023-07-24T05:46:06.022213+0000","last_peered":"2023-07-24T05:46:06.022213+0000","last_clean":"2023-07-24T05:46:06.022213+0000","last_became_active":"2023-07-24T05:46:05.013964+0000","last_became_peered":"2023-07-24T05:46:05.013964+0000","last_unstale":"2023-07-24T05:46:06.022213+0000","last_undegraded":"2023-07-24T05:46:06.022213+0000","last_fullsized":"2023-07-24T05:46:06.022213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:56:47.701279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486215+0000","last_change":"2023-07-24T05:45:59.907153+0000","last_active":"2023-07-24T05:46:07.486215+0000","last_peered":"2023-07-24T05:46:07.486215+0000","last_clean":"2023-07-24T05:46:07.486215+0000","last_became_active":"2023-07-24T05:45:59.906816+0000","last_became_peered":"2023-07-24T05:45:59.906816+0000","last_unstale":"2023-07-24T05:46:07.486215+0000","last_undegraded":"2023-07-24T05:46:07.486215+0000","last_fullsized":"2023-07-24T05:46:07.486215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T05:59:19.607892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.719904+0000","last_change":"2023-07-24T05:46:00.931260+0000","last_active":"2023-07-24T05:46:06.719904+0000","last_peered":"2023-07-24T05:46:06.719904+0000","last_clean":"2023-07-24T05:46:06.719904+0000","last_became_active":"2023-07-24T05:46:00.930959+0000","last_became_peered":"2023-07-24T05:46:00.930959+0000","last_unstale":"2023-07-24T05:46:06.719904+0000","last_undegraded":"2023-07-24T05:46:06.719904+0000","last_fullsized":"2023-07-24T05:46:06.719904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:56:23.036353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.719736+0000","last_change":"2023-07-24T05:46:05.017693+0000","last_active":"2023-07-24T05:46:06.719736+0000","last_peered":"2023-07-24T05:46:06.719736+0000","last_clean":"2023-07-24T05:46:06.719736+0000","last_became_active":"2023-07-24T05:46:05.015057+0000","last_became_peered":"2023-07-24T05:46:05.015057+0000","last_unstale":"2023-07-24T05:46:06.719736+0000","last_undegraded":"2023-07-24T05:46:06.719736+0000","last_fullsized":"2023-07-24T05:46:06.719736+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:21:43.441226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.483452+0000","last_change":"2023-07-24T05:45:59.908355+0000","last_active":"2023-07-24T05:46:07.483452+0000","last_peered":"2023-07-24T05:46:07.483452+0000","last_clean":"2023-07-24T05:46:07.483452+0000","last_became_active":"2023-07-24T05:45:59.907240+0000","last_became_peered":"2023-07-24T05:45:59.907240+0000","last_unstale":"2023-07-24T05:46:07.483452+0000","last_undegraded":"2023-07-24T05:46:07.483452+0000","last_fullsized":"2023-07-24T05:46:07.483452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:15:19.009984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.022429+0000","last_change":"2023-07-24T05:46:00.933306+0000","last_active":"2023-07-24T05:46:06.022429+0000","last_peered":"2023-07-24T05:46:06.022429+0000","last_clean":"2023-07-24T05:46:06.022429+0000","last_became_active":"2023-07-24T05:46:00.932306+0000","last_became_peered":"2023-07-24T05:46:00.932306+0000","last_unstale":"2023-07-24T05:46:06.022429+0000","last_undegraded":"2023-07-24T05:46:06.022429+0000","last_fullsized":"2023-07-24T05:46:06.022429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:06:46.941549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.483132+0000","last_change":"2023-07-24T05:46:00.941623+0000","last_active":"2023-07-24T05:46:07.483132+0000","last_peered":"2023-07-24T05:46:07.483132+0000","last_clean":"2023-07-24T05:46:07.483132+0000","last_became_active":"2023-07-24T05:46:00.941341+0000","last_became_peered":"2023-07-24T05:46:00.941341+0000","last_unstale":"2023-07-24T05:46:07.483132+0000","last_undegraded":"2023-07-24T05:46:07.483132+0000","last_fullsized":"2023-07-24T05:46:07.483132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:08:22.272136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.720265+0000","last_change":"2023-07-24T05:45:59.909261+0000","last_active":"2023-07-24T05:46:06.720265+0000","last_peered":"2023-07-24T05:46:06.720265+0000","last_clean":"2023-07-24T05:46:06.720265+0000","last_became_active":"2023-07-24T05:45:59.908962+0000","last_became_peered":"2023-07-24T05:45:59.908962+0000","last_unstale":"2023-07-24T05:46:06.720265+0000","last_undegraded":"2023-07-24T05:46:06.720265+0000","last_fullsized":"2023-07-24T05:46:06.720265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:56:19.698866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.021043+0000","last_change":"2023-07-24T05:46:05.012927+0000","last_active":"2023-07-24T05:46:06.021043+0000","last_peered":"2023-07-24T05:46:06.021043+0000","last_clean":"2023-07-24T05:46:06.021043+0000","last_became_active":"2023-07-24T05:46:05.012506+0000","last_became_peered":"2023-07-24T05:46:05.012506+0000","last_unstale":"2023-07-24T05:46:06.021043+0000","last_undegraded":"2023-07-24T05:46:06.021043+0000","last_fullsized":"2023-07-24T05:46:06.021043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:48:07.287011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.483976+0000","last_change":"2023-07-24T05:46:00.931782+0000","last_active":"2023-07-24T05:46:07.483976+0000","last_peered":"2023-07-24T05:46:07.483976+0000","last_clean":"2023-07-24T05:46:07.483976+0000","last_became_active":"2023-07-24T05:46:00.931488+0000","last_became_peered":"2023-07-24T05:46:00.931488+0000","last_unstale":"2023-07-24T05:46:07.483976+0000","last_undegraded":"2023-07-24T05:46:07.483976+0000","last_fullsized":"2023-07-24T05:46:07.483976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:34:32.612133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486848+0000","last_change":"2023-07-24T05:45:59.909882+0000","last_active":"2023-07-24T05:46:07.486848+0000","last_peered":"2023-07-24T05:46:07.486848+0000","last_clean":"2023-07-24T05:46:07.486848+0000","last_became_active":"2023-07-24T05:45:59.909623+0000","last_became_peered":"2023-07-24T05:45:59.909623+0000","last_unstale":"2023-07-24T05:46:07.486848+0000","last_undegraded":"2023-07-24T05:46:07.486848+0000","last_fullsized":"2023-07-24T05:46:07.486848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:39:16.199623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.480977+0000","last_change":"2023-07-24T05:46:05.025942+0000","last_active":"2023-07-24T05:46:06.480977+0000","last_peered":"2023-07-24T05:46:06.480977+0000","last_clean":"2023-07-24T05:46:06.480977+0000","last_became_active":"2023-07-24T05:46:05.025150+0000","last_became_peered":"2023-07-24T05:46:05.025150+0000","last_unstale":"2023-07-24T05:46:06.480977+0000","last_undegraded":"2023-07-24T05:46:06.480977+0000","last_fullsized":"2023-07-24T05:46:06.480977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:18:59.759729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.482301+0000","last_change":"2023-07-24T05:45:59.916471+0000","last_active":"2023-07-24T05:46:06.482301+0000","last_peered":"2023-07-24T05:46:06.482301+0000","last_clean":"2023-07-24T05:46:06.482301+0000","last_became_active":"2023-07-24T05:45:59.914483+0000","last_became_peered":"2023-07-24T05:45:59.914483+0000","last_unstale":"2023-07-24T05:46:06.482301+0000","last_undegraded":"2023-07-24T05:46:06.482301+0000","last_fullsized":"2023-07-24T05:46:06.482301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:14:26.354550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486144+0000","last_change":"2023-07-24T05:46:00.946206+0000","last_active":"2023-07-24T05:46:07.486144+0000","last_peered":"2023-07-24T05:46:07.486144+0000","last_clean":"2023-07-24T05:46:07.486144+0000","last_became_active":"2023-07-24T05:46:00.941357+0000","last_became_peered":"2023-07-24T05:46:00.941357+0000","last_unstale":"2023-07-24T05:46:07.486144+0000","last_undegraded":"2023-07-24T05:46:07.486144+0000","last_fullsized":"2023-07-24T05:46:07.486144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:57:39.660342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.483625+0000","last_change":"2023-07-24T05:46:05.011477+0000","last_active":"2023-07-24T05:46:07.483625+0000","last_peered":"2023-07-24T05:46:07.483625+0000","last_clean":"2023-07-24T05:46:07.483625+0000","last_became_active":"2023-07-24T05:46:05.011080+0000","last_became_peered":"2023-07-24T05:46:05.011080+0000","last_unstale":"2023-07-24T05:46:07.483625+0000","last_undegraded":"2023-07-24T05:46:07.483625+0000","last_fullsized":"2023-07-24T05:46:07.483625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:20:27.076589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"25'10","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:18.816659+0000","last_change":"2023-07-24T05:45:59.909189+0000","last_active":"2023-07-24T05:46:18.816659+0000","last_peered":"2023-07-24T05:46:18.816659+0000","last_clean":"2023-07-24T05:46:18.816659+0000","last_became_active":"2023-07-24T05:45:59.908248+0000","last_became_peered":"2023-07-24T05:45:59.908248+0000","last_unstale":"2023-07-24T05:46:18.816659+0000","last_undegraded":"2023-07-24T05:46:18.816659+0000","last_fullsized":"2023-07-24T05:46:18.816659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:04:41.772179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3793,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023001+0000","last_change":"2023-07-24T05:46:00.930080+0000","last_active":"2023-07-24T05:46:06.023001+0000","last_peered":"2023-07-24T05:46:06.023001+0000","last_clean":"2023-07-24T05:46:06.023001+0000","last_became_active":"2023-07-24T05:46:00.929737+0000","last_became_peered":"2023-07-24T05:46:00.929737+0000","last_unstale":"2023-07-24T05:46:06.023001+0000","last_undegraded":"2023-07-24T05:46:06.023001+0000","last_fullsized":"2023-07-24T05:46:06.023001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:13:45.155446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.485916+0000","last_change":"2023-07-24T05:46:05.017936+0000","last_active":"2023-07-24T05:46:07.485916+0000","last_peered":"2023-07-24T05:46:07.485916+0000","last_clean":"2023-07-24T05:46:07.485916+0000","last_became_active":"2023-07-24T05:46:05.017553+0000","last_became_peered":"2023-07-24T05:46:05.017553+0000","last_unstale":"2023-07-24T05:46:07.485916+0000","last_undegraded":"2023-07-24T05:46:07.485916+0000","last_fullsized":"2023-07-24T05:46:07.485916+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:18:15.042584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.022842+0000","last_change":"2023-07-24T05:46:00.933560+0000","last_active":"2023-07-24T05:46:06.022842+0000","last_peered":"2023-07-24T05:46:06.022842+0000","last_clean":"2023-07-24T05:46:06.022842+0000","last_became_active":"2023-07-24T05:46:00.933176+0000","last_became_peered":"2023-07-24T05:46:00.933176+0000","last_unstale":"2023-07-24T05:46:06.022842+0000","last_undegraded":"2023-07-24T05:46:06.022842+0000","last_fullsized":"2023-07-24T05:46:06.022842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:22:28.734087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.022569+0000","last_change":"2023-07-24T05:45:54.350738+0000","last_active":"2023-07-24T05:46:06.022569+0000","last_peered":"2023-07-24T05:46:06.022569+0000","last_clean":"2023-07-24T05:46:06.022569+0000","last_became_active":"2023-07-24T05:45:54.350347+0000","last_became_peered":"2023-07-24T05:45:54.350347+0000","last_unstale":"2023-07-24T05:46:06.022569+0000","last_undegraded":"2023-07-24T05:46:06.022569+0000","last_fullsized":"2023-07-24T05:46:06.022569+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:15:33.932270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.720381+0000","last_change":"2023-07-24T05:45:59.904262+0000","last_active":"2023-07-24T05:46:06.720381+0000","last_peered":"2023-07-24T05:46:06.720381+0000","last_clean":"2023-07-24T05:46:06.720381+0000","last_became_active":"2023-07-24T05:45:59.901334+0000","last_became_peered":"2023-07-24T05:45:59.901334+0000","last_unstale":"2023-07-24T05:46:06.720381+0000","last_undegraded":"2023-07-24T05:46:06.720381+0000","last_fullsized":"2023-07-24T05:46:06.720381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:58:01.493567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.483100+0000","last_change":"2023-07-24T05:46:05.016239+0000","last_active":"2023-07-24T05:46:07.483100+0000","last_peered":"2023-07-24T05:46:07.483100+0000","last_clean":"2023-07-24T05:46:07.483100+0000","last_became_active":"2023-07-24T05:46:05.015792+0000","last_became_peered":"2023-07-24T05:46:05.015792+0000","last_unstale":"2023-07-24T05:46:07.483100+0000","last_undegraded":"2023-07-24T05:46:07.483100+0000","last_fullsized":"2023-07-24T05:46:07.483100+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:52:03.648761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.483288+0000","last_change":"2023-07-24T05:46:00.933134+0000","last_active":"2023-07-24T05:46:07.483288+0000","last_peered":"2023-07-24T05:46:07.483288+0000","last_clean":"2023-07-24T05:46:07.483288+0000","last_became_active":"2023-07-24T05:46:00.932531+0000","last_became_peered":"2023-07-24T05:46:00.932531+0000","last_unstale":"2023-07-24T05:46:07.483288+0000","last_undegraded":"2023-07-24T05:46:07.483288+0000","last_fullsized":"2023-07-24T05:46:07.483288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:21:40.350408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.487206+0000","last_change":"2023-07-24T05:45:54.346766+0000","last_active":"2023-07-24T05:46:07.487206+0000","last_peered":"2023-07-24T05:46:07.487206+0000","last_clean":"2023-07-24T05:46:07.487206+0000","last_became_active":"2023-07-24T05:45:54.346404+0000","last_became_peered":"2023-07-24T05:45:54.346404+0000","last_unstale":"2023-07-24T05:46:07.487206+0000","last_undegraded":"2023-07-24T05:46:07.487206+0000","last_fullsized":"2023-07-24T05:46:07.487206+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:41:48.652814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.484987+0000","last_change":"2023-07-24T05:45:59.909030+0000","last_active":"2023-07-24T05:46:07.484987+0000","last_peered":"2023-07-24T05:46:07.484987+0000","last_clean":"2023-07-24T05:46:07.484987+0000","last_became_active":"2023-07-24T05:45:59.908731+0000","last_became_peered":"2023-07-24T05:45:59.908731+0000","last_unstale":"2023-07-24T05:46:07.484987+0000","last_undegraded":"2023-07-24T05:46:07.484987+0000","last_fullsized":"2023-07-24T05:46:07.484987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:47:28.208042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.020418+0000","last_change":"2023-07-24T05:46:05.014582+0000","last_active":"2023-07-24T05:46:06.020418+0000","last_peered":"2023-07-24T05:46:06.020418+0000","last_clean":"2023-07-24T05:46:06.020418+0000","last_became_active":"2023-07-24T05:46:05.014202+0000","last_became_peered":"2023-07-24T05:46:05.014202+0000","last_unstale":"2023-07-24T05:46:06.020418+0000","last_undegraded":"2023-07-24T05:46:06.020418+0000","last_fullsized":"2023-07-24T05:46:06.020418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:08:46.149814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.719886+0000","last_change":"2023-07-24T05:46:00.935075+0000","last_active":"2023-07-24T05:46:06.719886+0000","last_peered":"2023-07-24T05:46:06.719886+0000","last_clean":"2023-07-24T05:46:06.719886+0000","last_became_active":"2023-07-24T05:46:00.934789+0000","last_became_peered":"2023-07-24T05:46:00.934789+0000","last_unstale":"2023-07-24T05:46:06.719886+0000","last_undegraded":"2023-07-24T05:46:06.719886+0000","last_fullsized":"2023-07-24T05:46:06.719886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:35:30.780605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.482573+0000","last_change":"2023-07-24T05:45:54.355858+0000","last_active":"2023-07-24T05:46:06.482573+0000","last_peered":"2023-07-24T05:46:06.482573+0000","last_clean":"2023-07-24T05:46:06.482573+0000","last_became_active":"2023-07-24T05:45:54.355598+0000","last_became_peered":"2023-07-24T05:45:54.355598+0000","last_unstale":"2023-07-24T05:46:06.482573+0000","last_undegraded":"2023-07-24T05:46:06.482573+0000","last_fullsized":"2023-07-24T05:46:06.482573+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:04:55.110927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486464+0000","last_change":"2023-07-24T05:45:59.902462+0000","last_active":"2023-07-24T05:46:07.486464+0000","last_peered":"2023-07-24T05:46:07.486464+0000","last_clean":"2023-07-24T05:46:07.486464+0000","last_became_active":"2023-07-24T05:45:59.902137+0000","last_became_peered":"2023-07-24T05:45:59.902137+0000","last_unstale":"2023-07-24T05:46:07.486464+0000","last_undegraded":"2023-07-24T05:46:07.486464+0000","last_fullsized":"2023-07-24T05:46:07.486464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:29:00.215998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.021410+0000","last_change":"2023-07-24T05:46:05.020732+0000","last_active":"2023-07-24T05:46:06.021410+0000","last_peered":"2023-07-24T05:46:06.021410+0000","last_clean":"2023-07-24T05:46:06.021410+0000","last_became_active":"2023-07-24T05:46:05.020404+0000","last_became_peered":"2023-07-24T05:46:05.020404+0000","last_unstale":"2023-07-24T05:46:06.021410+0000","last_undegraded":"2023-07-24T05:46:06.021410+0000","last_fullsized":"2023-07-24T05:46:06.021410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:19:13.139942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486329+0000","last_change":"2023-07-24T05:46:00.932855+0000","last_active":"2023-07-24T05:46:07.486329+0000","last_peered":"2023-07-24T05:46:07.486329+0000","last_clean":"2023-07-24T05:46:07.486329+0000","last_became_active":"2023-07-24T05:46:00.932529+0000","last_became_peered":"2023-07-24T05:46:00.932529+0000","last_unstale":"2023-07-24T05:46:07.486329+0000","last_undegraded":"2023-07-24T05:46:07.486329+0000","last_fullsized":"2023-07-24T05:46:07.486329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:26:42.584506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486661+0000","last_change":"2023-07-24T05:45:54.354128+0000","last_active":"2023-07-24T05:46:07.486661+0000","last_peered":"2023-07-24T05:46:07.486661+0000","last_clean":"2023-07-24T05:46:07.486661+0000","last_became_active":"2023-07-24T05:45:54.353816+0000","last_became_peered":"2023-07-24T05:45:54.353816+0000","last_unstale":"2023-07-24T05:46:07.486661+0000","last_undegraded":"2023-07-24T05:46:07.486661+0000","last_fullsized":"2023-07-24T05:46:07.486661+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:18:49.117398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486818+0000","last_change":"2023-07-24T05:45:59.910016+0000","last_active":"2023-07-24T05:46:07.486818+0000","last_peered":"2023-07-24T05:46:07.486818+0000","last_clean":"2023-07-24T05:46:07.486818+0000","last_became_active":"2023-07-24T05:45:59.909740+0000","last_became_peered":"2023-07-24T05:45:59.909740+0000","last_unstale":"2023-07-24T05:46:07.486818+0000","last_undegraded":"2023-07-24T05:46:07.486818+0000","last_fullsized":"2023-07-24T05:46:07.486818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:29:00.215998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.719697+0000","last_change":"2023-07-24T05:46:05.024839+0000","last_active":"2023-07-24T05:46:06.719697+0000","last_peered":"2023-07-24T05:46:06.719697+0000","last_clean":"2023-07-24T05:46:06.719697+0000","last_became_active":"2023-07-24T05:46:05.024447+0000","last_became_peered":"2023-07-24T05:46:05.024447+0000","last_unstale":"2023-07-24T05:46:06.719697+0000","last_undegraded":"2023-07-24T05:46:06.719697+0000","last_fullsized":"2023-07-24T05:46:06.719697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:39:44.669092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486397+0000","last_change":"2023-07-24T05:46:00.938782+0000","last_active":"2023-07-24T05:46:07.486397+0000","last_peered":"2023-07-24T05:46:07.486397+0000","last_clean":"2023-07-24T05:46:07.486397+0000","last_became_active":"2023-07-24T05:46:00.938402+0000","last_became_peered":"2023-07-24T05:46:00.938402+0000","last_unstale":"2023-07-24T05:46:07.486397+0000","last_undegraded":"2023-07-24T05:46:07.486397+0000","last_fullsized":"2023-07-24T05:46:07.486397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:18:26.734018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023120+0000","last_change":"2023-07-24T05:45:59.909892+0000","last_active":"2023-07-24T05:46:06.023120+0000","last_peered":"2023-07-24T05:46:06.023120+0000","last_clean":"2023-07-24T05:46:06.023120+0000","last_became_active":"2023-07-24T05:45:59.909552+0000","last_became_peered":"2023-07-24T05:45:59.909552+0000","last_unstale":"2023-07-24T05:46:06.023120+0000","last_undegraded":"2023-07-24T05:46:06.023120+0000","last_fullsized":"2023-07-24T05:46:06.023120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:32:56.241515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486150+0000","last_change":"2023-07-24T05:45:54.353232+0000","last_active":"2023-07-24T05:46:07.486150+0000","last_peered":"2023-07-24T05:46:07.486150+0000","last_clean":"2023-07-24T05:46:07.486150+0000","last_became_active":"2023-07-24T05:45:54.352983+0000","last_became_peered":"2023-07-24T05:45:54.352983+0000","last_unstale":"2023-07-24T05:46:07.486150+0000","last_undegraded":"2023-07-24T05:46:07.486150+0000","last_fullsized":"2023-07-24T05:46:07.486150+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:13:51.706275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.720334+0000","last_change":"2023-07-24T05:46:05.026068+0000","last_active":"2023-07-24T05:46:06.720334+0000","last_peered":"2023-07-24T05:46:06.720334+0000","last_clean":"2023-07-24T05:46:06.720334+0000","last_became_active":"2023-07-24T05:46:05.025042+0000","last_became_peered":"2023-07-24T05:46:05.025042+0000","last_unstale":"2023-07-24T05:46:06.720334+0000","last_undegraded":"2023-07-24T05:46:06.720334+0000","last_fullsized":"2023-07-24T05:46:06.720334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:35:03.922426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.487482+0000","last_change":"2023-07-24T05:46:00.937728+0000","last_active":"2023-07-24T05:46:07.487482+0000","last_peered":"2023-07-24T05:46:07.487482+0000","last_clean":"2023-07-24T05:46:07.487482+0000","last_became_active":"2023-07-24T05:46:00.937334+0000","last_became_peered":"2023-07-24T05:46:00.937334+0000","last_unstale":"2023-07-24T05:46:07.487482+0000","last_undegraded":"2023-07-24T05:46:07.487482+0000","last_fullsized":"2023-07-24T05:46:07.487482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:44:23.859944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.485666+0000","last_change":"2023-07-24T05:45:59.902663+0000","last_active":"2023-07-24T05:46:07.485666+0000","last_peered":"2023-07-24T05:46:07.485666+0000","last_clean":"2023-07-24T05:46:07.485666+0000","last_became_active":"2023-07-24T05:45:59.902383+0000","last_became_peered":"2023-07-24T05:45:59.902383+0000","last_unstale":"2023-07-24T05:46:07.485666+0000","last_undegraded":"2023-07-24T05:46:07.485666+0000","last_fullsized":"2023-07-24T05:46:07.485666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T05:47:06.412190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.017303+0000","last_change":"2023-07-24T05:45:54.349000+0000","last_active":"2023-07-24T05:46:06.017303+0000","last_peered":"2023-07-24T05:46:06.017303+0000","last_clean":"2023-07-24T05:46:06.017303+0000","last_became_active":"2023-07-24T05:45:54.348646+0000","last_became_peered":"2023-07-24T05:45:54.348646+0000","last_unstale":"2023-07-24T05:46:06.017303+0000","last_undegraded":"2023-07-24T05:46:06.017303+0000","last_fullsized":"2023-07-24T05:46:06.017303+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:25:22.452188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.018595+0000","last_change":"2023-07-24T05:46:05.015931+0000","last_active":"2023-07-24T05:46:06.018595+0000","last_peered":"2023-07-24T05:46:06.018595+0000","last_clean":"2023-07-24T05:46:06.018595+0000","last_became_active":"2023-07-24T05:46:05.013649+0000","last_became_peered":"2023-07-24T05:46:05.013649+0000","last_unstale":"2023-07-24T05:46:06.018595+0000","last_undegraded":"2023-07-24T05:46:06.018595+0000","last_fullsized":"2023-07-24T05:46:06.018595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:02:14.273821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.720047+0000","last_change":"2023-07-24T05:46:00.942679+0000","last_active":"2023-07-24T05:46:06.720047+0000","last_peered":"2023-07-24T05:46:06.720047+0000","last_clean":"2023-07-24T05:46:06.720047+0000","last_became_active":"2023-07-24T05:46:00.941904+0000","last_became_peered":"2023-07-24T05:46:00.941904+0000","last_unstale":"2023-07-24T05:46:06.720047+0000","last_undegraded":"2023-07-24T05:46:06.720047+0000","last_fullsized":"2023-07-24T05:46:06.720047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:37:25.195905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.718941+0000","last_change":"2023-07-24T05:45:59.905040+0000","last_active":"2023-07-24T05:46:06.718941+0000","last_peered":"2023-07-24T05:46:06.718941+0000","last_clean":"2023-07-24T05:46:06.718941+0000","last_became_active":"2023-07-24T05:45:59.904704+0000","last_became_peered":"2023-07-24T05:45:59.904704+0000","last_unstale":"2023-07-24T05:46:06.718941+0000","last_undegraded":"2023-07-24T05:46:06.718941+0000","last_fullsized":"2023-07-24T05:46:06.718941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:14:26.074102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.481364+0000","last_change":"2023-07-24T05:45:54.350803+0000","last_active":"2023-07-24T05:46:06.481364+0000","last_peered":"2023-07-24T05:46:06.481364+0000","last_clean":"2023-07-24T05:46:06.481364+0000","last_became_active":"2023-07-24T05:45:54.350427+0000","last_became_peered":"2023-07-24T05:45:54.350427+0000","last_unstale":"2023-07-24T05:46:06.481364+0000","last_undegraded":"2023-07-24T05:46:06.481364+0000","last_fullsized":"2023-07-24T05:46:06.481364+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:41:48.652814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486965+0000","last_change":"2023-07-24T05:46:05.021436+0000","last_active":"2023-07-24T05:46:07.486965+0000","last_peered":"2023-07-24T05:46:07.486965+0000","last_clean":"2023-07-24T05:46:07.486965+0000","last_became_active":"2023-07-24T05:46:05.020835+0000","last_became_peered":"2023-07-24T05:46:05.020835+0000","last_unstale":"2023-07-24T05:46:07.486965+0000","last_undegraded":"2023-07-24T05:46:07.486965+0000","last_fullsized":"2023-07-24T05:46:07.486965+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:37:20.869353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.021744+0000","last_change":"2023-07-24T05:46:00.936580+0000","last_active":"2023-07-24T05:46:06.021744+0000","last_peered":"2023-07-24T05:46:06.021744+0000","last_clean":"2023-07-24T05:46:06.021744+0000","last_became_active":"2023-07-24T05:46:00.936229+0000","last_became_peered":"2023-07-24T05:46:00.936229+0000","last_unstale":"2023-07-24T05:46:06.021744+0000","last_undegraded":"2023-07-24T05:46:06.021744+0000","last_fullsized":"2023-07-24T05:46:06.021744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:56:32.104824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.483869+0000","last_change":"2023-07-24T05:45:59.909952+0000","last_active":"2023-07-24T05:46:07.483869+0000","last_peered":"2023-07-24T05:46:07.483869+0000","last_clean":"2023-07-24T05:46:07.483869+0000","last_became_active":"2023-07-24T05:45:59.909649+0000","last_became_peered":"2023-07-24T05:45:59.909649+0000","last_unstale":"2023-07-24T05:46:07.483869+0000","last_undegraded":"2023-07-24T05:46:07.483869+0000","last_fullsized":"2023-07-24T05:46:07.483869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T16:11:54.051701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486355+0000","last_change":"2023-07-24T05:45:54.351103+0000","last_active":"2023-07-24T05:46:07.486355+0000","last_peered":"2023-07-24T05:46:07.486355+0000","last_clean":"2023-07-24T05:46:07.486355+0000","last_became_active":"2023-07-24T05:45:54.350628+0000","last_became_peered":"2023-07-24T05:45:54.350628+0000","last_unstale":"2023-07-24T05:46:07.486355+0000","last_undegraded":"2023-07-24T05:46:07.486355+0000","last_fullsized":"2023-07-24T05:46:07.486355+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T05:47:00.879682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":177,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.481430+0000","last_change":"2023-07-24T05:45:54.356765+0000","last_active":"2023-07-24T05:46:06.481430+0000","last_peered":"2023-07-24T05:46:06.481430+0000","last_clean":"2023-07-24T05:46:06.481430+0000","last_became_active":"2023-07-24T05:45:54.355687+0000","last_became_peered":"2023-07-24T05:45:54.355687+0000","last_unstale":"2023-07-24T05:46:06.481430+0000","last_undegraded":"2023-07-24T05:46:06.481430+0000","last_fullsized":"2023-07-24T05:46:06.481430+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:54:08.245065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.481843+0000","last_change":"2023-07-24T05:46:05.031446+0000","last_active":"2023-07-24T05:46:06.481843+0000","last_peered":"2023-07-24T05:46:06.481843+0000","last_clean":"2023-07-24T05:46:06.481843+0000","last_became_active":"2023-07-24T05:46:05.024845+0000","last_became_peered":"2023-07-24T05:46:05.024845+0000","last_unstale":"2023-07-24T05:46:06.481843+0000","last_undegraded":"2023-07-24T05:46:06.481843+0000","last_fullsized":"2023-07-24T05:46:06.481843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:21:24.557827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.487407+0000","last_change":"2023-07-24T05:46:00.951820+0000","last_active":"2023-07-24T05:46:07.487407+0000","last_peered":"2023-07-24T05:46:07.487407+0000","last_clean":"2023-07-24T05:46:07.487407+0000","last_became_active":"2023-07-24T05:46:00.951559+0000","last_became_peered":"2023-07-24T05:46:00.951559+0000","last_unstale":"2023-07-24T05:46:07.487407+0000","last_undegraded":"2023-07-24T05:46:07.487407+0000","last_fullsized":"2023-07-24T05:46:07.487407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:54:14.788733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.483532+0000","last_change":"2023-07-24T05:45:59.900996+0000","last_active":"2023-07-24T05:46:07.483532+0000","last_peered":"2023-07-24T05:46:07.483532+0000","last_clean":"2023-07-24T05:46:07.483532+0000","last_became_active":"2023-07-24T05:45:59.900724+0000","last_became_peered":"2023-07-24T05:45:59.900724+0000","last_unstale":"2023-07-24T05:46:07.483532+0000","last_undegraded":"2023-07-24T05:46:07.483532+0000","last_fullsized":"2023-07-24T05:46:07.483532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T05:50:54.789729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023915+0000","last_change":"2023-07-24T05:46:05.016680+0000","last_active":"2023-07-24T05:46:06.023915+0000","last_peered":"2023-07-24T05:46:06.023915+0000","last_clean":"2023-07-24T05:46:06.023915+0000","last_became_active":"2023-07-24T05:46:05.016328+0000","last_became_peered":"2023-07-24T05:46:05.016328+0000","last_unstale":"2023-07-24T05:46:06.023915+0000","last_undegraded":"2023-07-24T05:46:06.023915+0000","last_fullsized":"2023-07-24T05:46:06.023915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:23:56.011534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023923+0000","last_change":"2023-07-24T05:46:00.929728+0000","last_active":"2023-07-24T05:46:06.023923+0000","last_peered":"2023-07-24T05:46:06.023923+0000","last_clean":"2023-07-24T05:46:06.023923+0000","last_became_active":"2023-07-24T05:46:00.929370+0000","last_became_peered":"2023-07-24T05:46:00.929370+0000","last_unstale":"2023-07-24T05:46:06.023923+0000","last_undegraded":"2023-07-24T05:46:06.023923+0000","last_fullsized":"2023-07-24T05:46:06.023923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:21:03.638024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.022985+0000","last_change":"2023-07-24T05:45:59.898271+0000","last_active":"2023-07-24T05:46:06.022985+0000","last_peered":"2023-07-24T05:46:06.022985+0000","last_clean":"2023-07-24T05:46:06.022985+0000","last_became_active":"2023-07-24T05:45:59.897886+0000","last_became_peered":"2023-07-24T05:45:59.897886+0000","last_unstale":"2023-07-24T05:46:06.022985+0000","last_undegraded":"2023-07-24T05:46:06.022985+0000","last_fullsized":"2023-07-24T05:46:06.022985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:25:43.491840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486953+0000","last_change":"2023-07-24T05:46:05.028021+0000","last_active":"2023-07-24T05:46:07.486953+0000","last_peered":"2023-07-24T05:46:07.486953+0000","last_clean":"2023-07-24T05:46:07.486953+0000","last_became_active":"2023-07-24T05:46:05.027497+0000","last_became_peered":"2023-07-24T05:46:05.027497+0000","last_unstale":"2023-07-24T05:46:07.486953+0000","last_undegraded":"2023-07-24T05:46:07.486953+0000","last_fullsized":"2023-07-24T05:46:07.486953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:18:59.759729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023787+0000","last_change":"2023-07-24T05:46:00.934906+0000","last_active":"2023-07-24T05:46:06.023787+0000","last_peered":"2023-07-24T05:46:06.023787+0000","last_clean":"2023-07-24T05:46:06.023787+0000","last_became_active":"2023-07-24T05:46:00.934638+0000","last_became_peered":"2023-07-24T05:46:00.934638+0000","last_unstale":"2023-07-24T05:46:06.023787+0000","last_undegraded":"2023-07-24T05:46:06.023787+0000","last_fullsized":"2023-07-24T05:46:06.023787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:41:49.497015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.021959+0000","last_change":"2023-07-24T05:45:59.905289+0000","last_active":"2023-07-24T05:46:06.021959+0000","last_peered":"2023-07-24T05:46:06.021959+0000","last_clean":"2023-07-24T05:46:06.021959+0000","last_became_active":"2023-07-24T05:45:59.904879+0000","last_became_peered":"2023-07-24T05:45:59.904879+0000","last_unstale":"2023-07-24T05:46:06.021959+0000","last_undegraded":"2023-07-24T05:46:06.021959+0000","last_fullsized":"2023-07-24T05:46:06.021959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:27:08.531843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486029+0000","last_change":"2023-07-24T05:46:05.027486+0000","last_active":"2023-07-24T05:46:07.486029+0000","last_peered":"2023-07-24T05:46:07.486029+0000","last_clean":"2023-07-24T05:46:07.486029+0000","last_became_active":"2023-07-24T05:46:05.027085+0000","last_became_peered":"2023-07-24T05:46:05.027085+0000","last_unstale":"2023-07-24T05:46:07.486029+0000","last_undegraded":"2023-07-24T05:46:07.486029+0000","last_fullsized":"2023-07-24T05:46:07.486029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:16:02.948425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023538+0000","last_change":"2023-07-24T05:46:00.934235+0000","last_active":"2023-07-24T05:46:06.023538+0000","last_peered":"2023-07-24T05:46:06.023538+0000","last_clean":"2023-07-24T05:46:06.023538+0000","last_became_active":"2023-07-24T05:46:00.933521+0000","last_became_peered":"2023-07-24T05:46:00.933521+0000","last_unstale":"2023-07-24T05:46:06.023538+0000","last_undegraded":"2023-07-24T05:46:06.023538+0000","last_fullsized":"2023-07-24T05:46:06.023538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:20:03.823702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.484224+0000","last_change":"2023-07-24T05:45:59.908218+0000","last_active":"2023-07-24T05:46:07.484224+0000","last_peered":"2023-07-24T05:46:07.484224+0000","last_clean":"2023-07-24T05:46:07.484224+0000","last_became_active":"2023-07-24T05:45:59.905094+0000","last_became_peered":"2023-07-24T05:45:59.905094+0000","last_unstale":"2023-07-24T05:46:07.484224+0000","last_undegraded":"2023-07-24T05:46:07.484224+0000","last_fullsized":"2023-07-24T05:46:07.484224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:59:25.131271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.018333+0000","last_change":"2023-07-24T05:46:05.014000+0000","last_active":"2023-07-24T05:46:06.018333+0000","last_peered":"2023-07-24T05:46:06.018333+0000","last_clean":"2023-07-24T05:46:06.018333+0000","last_became_active":"2023-07-24T05:46:05.013545+0000","last_became_peered":"2023-07-24T05:46:05.013545+0000","last_unstale":"2023-07-24T05:46:06.018333+0000","last_undegraded":"2023-07-24T05:46:06.018333+0000","last_fullsized":"2023-07-24T05:46:06.018333+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:30:34.177072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.719968+0000","last_change":"2023-07-24T05:46:00.942615+0000","last_active":"2023-07-24T05:46:06.719968+0000","last_peered":"2023-07-24T05:46:06.719968+0000","last_clean":"2023-07-24T05:46:06.719968+0000","last_became_active":"2023-07-24T05:46:00.942343+0000","last_became_peered":"2023-07-24T05:46:00.942343+0000","last_unstale":"2023-07-24T05:46:06.719968+0000","last_undegraded":"2023-07-24T05:46:06.719968+0000","last_fullsized":"2023-07-24T05:46:06.719968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:16:15.816474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486385+0000","last_change":"2023-07-24T05:45:59.904112+0000","last_active":"2023-07-24T05:46:07.486385+0000","last_peered":"2023-07-24T05:46:07.486385+0000","last_clean":"2023-07-24T05:46:07.486385+0000","last_became_active":"2023-07-24T05:45:59.903760+0000","last_became_peered":"2023-07-24T05:45:59.903760+0000","last_unstale":"2023-07-24T05:46:07.486385+0000","last_undegraded":"2023-07-24T05:46:07.486385+0000","last_fullsized":"2023-07-24T05:46:07.486385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:18:09.932761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.017429+0000","last_change":"2023-07-24T05:46:05.014076+0000","last_active":"2023-07-24T05:46:06.017429+0000","last_peered":"2023-07-24T05:46:06.017429+0000","last_clean":"2023-07-24T05:46:06.017429+0000","last_became_active":"2023-07-24T05:46:05.013619+0000","last_became_peered":"2023-07-24T05:46:05.013619+0000","last_unstale":"2023-07-24T05:46:06.017429+0000","last_undegraded":"2023-07-24T05:46:06.017429+0000","last_fullsized":"2023-07-24T05:46:06.017429+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:43:11.918523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.021542+0000","last_change":"2023-07-24T05:46:00.940659+0000","last_active":"2023-07-24T05:46:06.021542+0000","last_peered":"2023-07-24T05:46:06.021542+0000","last_clean":"2023-07-24T05:46:06.021542+0000","last_became_active":"2023-07-24T05:46:00.940369+0000","last_became_peered":"2023-07-24T05:46:00.940369+0000","last_unstale":"2023-07-24T05:46:06.021542+0000","last_undegraded":"2023-07-24T05:46:06.021542+0000","last_fullsized":"2023-07-24T05:46:06.021542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:52:54.919489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.482583+0000","last_change":"2023-07-24T05:45:59.912501+0000","last_active":"2023-07-24T05:46:06.482583+0000","last_peered":"2023-07-24T05:46:06.482583+0000","last_clean":"2023-07-24T05:46:06.482583+0000","last_became_active":"2023-07-24T05:45:59.912147+0000","last_became_peered":"2023-07-24T05:45:59.912147+0000","last_unstale":"2023-07-24T05:46:06.482583+0000","last_undegraded":"2023-07-24T05:46:06.482583+0000","last_fullsized":"2023-07-24T05:46:06.482583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:21:00.823778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.018222+0000","last_change":"2023-07-24T05:46:05.015069+0000","last_active":"2023-07-24T05:46:06.018222+0000","last_peered":"2023-07-24T05:46:06.018222+0000","last_clean":"2023-07-24T05:46:06.018222+0000","last_became_active":"2023-07-24T05:46:05.014697+0000","last_became_peered":"2023-07-24T05:46:05.014697+0000","last_unstale":"2023-07-24T05:46:06.018222+0000","last_undegraded":"2023-07-24T05:46:06.018222+0000","last_fullsized":"2023-07-24T05:46:06.018222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:20:31.902334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.020882+0000","last_change":"2023-07-24T05:46:00.943156+0000","last_active":"2023-07-24T05:46:06.020882+0000","last_peered":"2023-07-24T05:46:06.020882+0000","last_clean":"2023-07-24T05:46:06.020882+0000","last_became_active":"2023-07-24T05:46:00.942833+0000","last_became_peered":"2023-07-24T05:46:00.942833+0000","last_unstale":"2023-07-24T05:46:06.020882+0000","last_undegraded":"2023-07-24T05:46:06.020882+0000","last_fullsized":"2023-07-24T05:46:06.020882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:20:21.843640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.482833+0000","last_change":"2023-07-24T05:45:59.915627+0000","last_active":"2023-07-24T05:46:06.482833+0000","last_peered":"2023-07-24T05:46:06.482833+0000","last_clean":"2023-07-24T05:46:06.482833+0000","last_became_active":"2023-07-24T05:45:59.914637+0000","last_became_peered":"2023-07-24T05:45:59.914637+0000","last_unstale":"2023-07-24T05:46:06.482833+0000","last_undegraded":"2023-07-24T05:46:06.482833+0000","last_fullsized":"2023-07-24T05:46:06.482833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:39:35.102402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.017196+0000","last_change":"2023-07-24T05:46:05.011172+0000","last_active":"2023-07-24T05:46:06.017196+0000","last_peered":"2023-07-24T05:46:06.017196+0000","last_clean":"2023-07-24T05:46:06.017196+0000","last_became_active":"2023-07-24T05:46:05.010777+0000","last_became_peered":"2023-07-24T05:46:05.010777+0000","last_unstale":"2023-07-24T05:46:06.017196+0000","last_undegraded":"2023-07-24T05:46:06.017196+0000","last_fullsized":"2023-07-24T05:46:06.017196+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:26:39.193132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.485649+0000","last_change":"2023-07-24T05:46:00.934405+0000","last_active":"2023-07-24T05:46:07.485649+0000","last_peered":"2023-07-24T05:46:07.485649+0000","last_clean":"2023-07-24T05:46:07.485649+0000","last_became_active":"2023-07-24T05:46:00.934126+0000","last_became_peered":"2023-07-24T05:46:00.934126+0000","last_unstale":"2023-07-24T05:46:07.485649+0000","last_undegraded":"2023-07-24T05:46:07.485649+0000","last_fullsized":"2023-07-24T05:46:07.485649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:05:57.654666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.482743+0000","last_change":"2023-07-24T05:45:59.917679+0000","last_active":"2023-07-24T05:46:06.482743+0000","last_peered":"2023-07-24T05:46:06.482743+0000","last_clean":"2023-07-24T05:46:06.482743+0000","last_became_active":"2023-07-24T05:45:59.917405+0000","last_became_peered":"2023-07-24T05:45:59.917405+0000","last_unstale":"2023-07-24T05:46:06.482743+0000","last_undegraded":"2023-07-24T05:46:06.482743+0000","last_fullsized":"2023-07-24T05:46:06.482743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:34:24.141383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.481505+0000","last_change":"2023-07-24T05:46:05.024741+0000","last_active":"2023-07-24T05:46:06.481505+0000","last_peered":"2023-07-24T05:46:06.481505+0000","last_clean":"2023-07-24T05:46:06.481505+0000","last_became_active":"2023-07-24T05:46:05.024355+0000","last_became_peered":"2023-07-24T05:46:05.024355+0000","last_unstale":"2023-07-24T05:46:06.481505+0000","last_undegraded":"2023-07-24T05:46:06.481505+0000","last_fullsized":"2023-07-24T05:46:06.481505+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:01:06.159423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486150+0000","last_change":"2023-07-24T05:46:05.025607+0000","last_active":"2023-07-24T05:46:07.486150+0000","last_peered":"2023-07-24T05:46:07.486150+0000","last_clean":"2023-07-24T05:46:07.486150+0000","last_became_active":"2023-07-24T05:46:05.025184+0000","last_became_peered":"2023-07-24T05:46:05.025184+0000","last_unstale":"2023-07-24T05:46:07.486150+0000","last_undegraded":"2023-07-24T05:46:07.486150+0000","last_fullsized":"2023-07-24T05:46:07.486150+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:07:04.576293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.020902+0000","last_change":"2023-07-24T05:45:59.893932+0000","last_active":"2023-07-24T05:46:06.020902+0000","last_peered":"2023-07-24T05:46:06.020902+0000","last_clean":"2023-07-24T05:46:06.020902+0000","last_became_active":"2023-07-24T05:45:59.893642+0000","last_became_peered":"2023-07-24T05:45:59.893642+0000","last_unstale":"2023-07-24T05:46:06.020902+0000","last_undegraded":"2023-07-24T05:46:06.020902+0000","last_fullsized":"2023-07-24T05:46:06.020902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:52:27.141526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.484842+0000","last_change":"2023-07-24T05:46:00.945824+0000","last_active":"2023-07-24T05:46:07.484842+0000","last_peered":"2023-07-24T05:46:07.484842+0000","last_clean":"2023-07-24T05:46:07.484842+0000","last_became_active":"2023-07-24T05:46:00.945507+0000","last_became_peered":"2023-07-24T05:46:00.945507+0000","last_unstale":"2023-07-24T05:46:07.484842+0000","last_undegraded":"2023-07-24T05:46:07.484842+0000","last_fullsized":"2023-07-24T05:46:07.484842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:45:28.785621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.484595+0000","last_change":"2023-07-24T05:46:05.012722+0000","last_active":"2023-07-24T05:46:07.484595+0000","last_peered":"2023-07-24T05:46:07.484595+0000","last_clean":"2023-07-24T05:46:07.484595+0000","last_became_active":"2023-07-24T05:46:05.012277+0000","last_became_peered":"2023-07-24T05:46:05.012277+0000","last_unstale":"2023-07-24T05:46:07.484595+0000","last_undegraded":"2023-07-24T05:46:07.484595+0000","last_fullsized":"2023-07-24T05:46:07.484595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:52:02.115068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.481785+0000","last_change":"2023-07-24T05:45:59.917206+0000","last_active":"2023-07-24T05:46:06.481785+0000","last_peered":"2023-07-24T05:46:06.481785+0000","last_clean":"2023-07-24T05:46:06.481785+0000","last_became_active":"2023-07-24T05:45:59.916943+0000","last_became_peered":"2023-07-24T05:45:59.916943+0000","last_unstale":"2023-07-24T05:46:06.481785+0000","last_undegraded":"2023-07-24T05:46:06.481785+0000","last_fullsized":"2023-07-24T05:46:06.481785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:27:17.744313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.720189+0000","last_change":"2023-07-24T05:46:00.936641+0000","last_active":"2023-07-24T05:46:06.720189+0000","last_peered":"2023-07-24T05:46:06.720189+0000","last_clean":"2023-07-24T05:46:06.720189+0000","last_became_active":"2023-07-24T05:46:00.936319+0000","last_became_peered":"2023-07-24T05:46:00.936319+0000","last_unstale":"2023-07-24T05:46:06.720189+0000","last_undegraded":"2023-07-24T05:46:06.720189+0000","last_fullsized":"2023-07-24T05:46:06.720189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:10:55.303833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.719149+0000","last_change":"2023-07-24T05:45:59.900013+0000","last_active":"2023-07-24T05:46:06.719149+0000","last_peered":"2023-07-24T05:46:06.719149+0000","last_clean":"2023-07-24T05:46:06.719149+0000","last_became_active":"2023-07-24T05:45:59.899700+0000","last_became_peered":"2023-07-24T05:45:59.899700+0000","last_unstale":"2023-07-24T05:46:06.719149+0000","last_undegraded":"2023-07-24T05:46:06.719149+0000","last_fullsized":"2023-07-24T05:46:06.719149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:33:29.936263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486499+0000","last_change":"2023-07-24T05:46:00.940858+0000","last_active":"2023-07-24T05:46:07.486499+0000","last_peered":"2023-07-24T05:46:07.486499+0000","last_clean":"2023-07-24T05:46:07.486499+0000","last_became_active":"2023-07-24T05:46:00.940529+0000","last_became_peered":"2023-07-24T05:46:00.940529+0000","last_unstale":"2023-07-24T05:46:07.486499+0000","last_undegraded":"2023-07-24T05:46:07.486499+0000","last_fullsized":"2023-07-24T05:46:07.486499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:15:58.849762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.483911+0000","last_change":"2023-07-24T05:46:05.014910+0000","last_active":"2023-07-24T05:46:07.483911+0000","last_peered":"2023-07-24T05:46:07.483911+0000","last_clean":"2023-07-24T05:46:07.483911+0000","last_became_active":"2023-07-24T05:46:05.014511+0000","last_became_peered":"2023-07-24T05:46:05.014511+0000","last_unstale":"2023-07-24T05:46:07.483911+0000","last_undegraded":"2023-07-24T05:46:07.483911+0000","last_fullsized":"2023-07-24T05:46:07.483911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:34:15.032724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.481980+0000","last_change":"2023-07-24T05:45:59.916266+0000","last_active":"2023-07-24T05:46:06.481980+0000","last_peered":"2023-07-24T05:46:06.481980+0000","last_clean":"2023-07-24T05:46:06.481980+0000","last_became_active":"2023-07-24T05:45:59.914544+0000","last_became_peered":"2023-07-24T05:45:59.914544+0000","last_unstale":"2023-07-24T05:46:06.481980+0000","last_undegraded":"2023-07-24T05:46:06.481980+0000","last_fullsized":"2023-07-24T05:46:06.481980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:33:27.607916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.484475+0000","last_change":"2023-07-24T05:46:00.953089+0000","last_active":"2023-07-24T05:46:07.484475+0000","last_peered":"2023-07-24T05:46:07.484475+0000","last_clean":"2023-07-24T05:46:07.484475+0000","last_became_active":"2023-07-24T05:46:00.952556+0000","last_became_peered":"2023-07-24T05:46:00.952556+0000","last_unstale":"2023-07-24T05:46:07.484475+0000","last_undegraded":"2023-07-24T05:46:07.484475+0000","last_fullsized":"2023-07-24T05:46:07.484475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:17:13.270600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486360+0000","last_change":"2023-07-24T05:46:05.019474+0000","last_active":"2023-07-24T05:46:07.486360+0000","last_peered":"2023-07-24T05:46:07.486360+0000","last_clean":"2023-07-24T05:46:07.486360+0000","last_became_active":"2023-07-24T05:46:05.019086+0000","last_became_peered":"2023-07-24T05:46:05.019086+0000","last_unstale":"2023-07-24T05:46:07.486360+0000","last_undegraded":"2023-07-24T05:46:07.486360+0000","last_fullsized":"2023-07-24T05:46:07.486360+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:09:07.896789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.020739+0000","last_change":"2023-07-24T05:46:00.936747+0000","last_active":"2023-07-24T05:46:06.020739+0000","last_peered":"2023-07-24T05:46:06.020739+0000","last_clean":"2023-07-24T05:46:06.020739+0000","last_became_active":"2023-07-24T05:46:00.936461+0000","last_became_peered":"2023-07-24T05:46:00.936461+0000","last_unstale":"2023-07-24T05:46:06.020739+0000","last_undegraded":"2023-07-24T05:46:06.020739+0000","last_fullsized":"2023-07-24T05:46:06.020739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:55:23.971299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.483640+0000","last_change":"2023-07-24T05:46:00.943313+0000","last_active":"2023-07-24T05:46:07.483640+0000","last_peered":"2023-07-24T05:46:07.483640+0000","last_clean":"2023-07-24T05:46:07.483640+0000","last_became_active":"2023-07-24T05:46:00.943036+0000","last_became_peered":"2023-07-24T05:46:00.943036+0000","last_unstale":"2023-07-24T05:46:07.483640+0000","last_undegraded":"2023-07-24T05:46:07.483640+0000","last_fullsized":"2023-07-24T05:46:07.483640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:00:32.924792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023237+0000","last_change":"2023-07-24T05:46:00.930795+0000","last_active":"2023-07-24T05:46:06.023237+0000","last_peered":"2023-07-24T05:46:06.023237+0000","last_clean":"2023-07-24T05:46:06.023237+0000","last_became_active":"2023-07-24T05:46:00.930447+0000","last_became_peered":"2023-07-24T05:46:00.930447+0000","last_unstale":"2023-07-24T05:46:06.023237+0000","last_undegraded":"2023-07-24T05:46:06.023237+0000","last_fullsized":"2023-07-24T05:46:06.023237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:28:47.348353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.484078+0000","last_change":"2023-07-24T05:46:00.945856+0000","last_active":"2023-07-24T05:46:07.484078+0000","last_peered":"2023-07-24T05:46:07.484078+0000","last_clean":"2023-07-24T05:46:07.484078+0000","last_became_active":"2023-07-24T05:46:00.945620+0000","last_became_peered":"2023-07-24T05:46:00.945620+0000","last_unstale":"2023-07-24T05:46:07.484078+0000","last_undegraded":"2023-07-24T05:46:07.484078+0000","last_fullsized":"2023-07-24T05:46:07.484078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:02:38.151470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486593+0000","last_change":"2023-07-24T05:46:00.946115+0000","last_active":"2023-07-24T05:46:07.486593+0000","last_peered":"2023-07-24T05:46:07.486593+0000","last_clean":"2023-07-24T05:46:07.486593+0000","last_became_active":"2023-07-24T05:46:00.945731+0000","last_became_peered":"2023-07-24T05:46:00.945731+0000","last_unstale":"2023-07-24T05:46:07.486593+0000","last_undegraded":"2023-07-24T05:46:07.486593+0000","last_fullsized":"2023-07-24T05:46:07.486593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:39:17.210783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486565+0000","last_change":"2023-07-24T05:46:00.935106+0000","last_active":"2023-07-24T05:46:07.486565+0000","last_peered":"2023-07-24T05:46:07.486565+0000","last_clean":"2023-07-24T05:46:07.486565+0000","last_became_active":"2023-07-24T05:46:00.934759+0000","last_became_peered":"2023-07-24T05:46:00.934759+0000","last_unstale":"2023-07-24T05:46:07.486565+0000","last_undegraded":"2023-07-24T05:46:07.486565+0000","last_fullsized":"2023-07-24T05:46:07.486565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T05:59:20.619052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.487093+0000","last_change":"2023-07-24T05:46:00.937903+0000","last_active":"2023-07-24T05:46:07.487093+0000","last_peered":"2023-07-24T05:46:07.487093+0000","last_clean":"2023-07-24T05:46:07.487093+0000","last_became_active":"2023-07-24T05:46:00.937520+0000","last_became_peered":"2023-07-24T05:46:00.937520+0000","last_unstale":"2023-07-24T05:46:07.487093+0000","last_undegraded":"2023-07-24T05:46:07.487093+0000","last_fullsized":"2023-07-24T05:46:07.487093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:56:28.386440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.487373+0000","last_change":"2023-07-24T05:46:00.950064+0000","last_active":"2023-07-24T05:46:07.487373+0000","last_peered":"2023-07-24T05:46:07.487373+0000","last_clean":"2023-07-24T05:46:07.487373+0000","last_became_active":"2023-07-24T05:46:00.949415+0000","last_became_peered":"2023-07-24T05:46:00.949415+0000","last_unstale":"2023-07-24T05:46:07.487373+0000","last_undegraded":"2023-07-24T05:46:07.487373+0000","last_fullsized":"2023-07-24T05:46:07.487373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:01:02.060760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.481115+0000","last_change":"2023-07-24T05:46:00.945119+0000","last_active":"2023-07-24T05:46:06.481115+0000","last_peered":"2023-07-24T05:46:06.481115+0000","last_clean":"2023-07-24T05:46:06.481115+0000","last_became_active":"2023-07-24T05:46:00.944813+0000","last_became_peered":"2023-07-24T05:46:00.944813+0000","last_unstale":"2023-07-24T05:46:06.481115+0000","last_undegraded":"2023-07-24T05:46:06.481115+0000","last_fullsized":"2023-07-24T05:46:06.481115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:37:16.770689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.483093+0000","last_change":"2023-07-24T05:46:00.935631+0000","last_active":"2023-07-24T05:46:07.483093+0000","last_peered":"2023-07-24T05:46:07.483093+0000","last_clean":"2023-07-24T05:46:07.483093+0000","last_became_active":"2023-07-24T05:46:00.935367+0000","last_became_peered":"2023-07-24T05:46:00.935367+0000","last_unstale":"2023-07-24T05:46:07.483093+0000","last_undegraded":"2023-07-24T05:46:07.483093+0000","last_fullsized":"2023-07-24T05:46:07.483093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:29:21.153570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.718880+0000","last_change":"2023-07-24T05:46:00.942370+0000","last_active":"2023-07-24T05:46:06.718880+0000","last_peered":"2023-07-24T05:46:06.718880+0000","last_clean":"2023-07-24T05:46:06.718880+0000","last_became_active":"2023-07-24T05:46:00.941928+0000","last_became_peered":"2023-07-24T05:46:00.941928+0000","last_unstale":"2023-07-24T05:46:06.718880+0000","last_undegraded":"2023-07-24T05:46:06.718880+0000","last_fullsized":"2023-07-24T05:46:06.718880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:19:59.555194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.481503+0000","last_change":"2023-07-24T05:46:00.946457+0000","last_active":"2023-07-24T05:46:06.481503+0000","last_peered":"2023-07-24T05:46:06.481503+0000","last_clean":"2023-07-24T05:46:06.481503+0000","last_became_active":"2023-07-24T05:46:00.944937+0000","last_became_peered":"2023-07-24T05:46:00.944937+0000","last_unstale":"2023-07-24T05:46:06.481503+0000","last_undegraded":"2023-07-24T05:46:06.481503+0000","last_fullsized":"2023-07-24T05:46:06.481503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:44:23.859944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023427+0000","last_change":"2023-07-24T05:46:00.934582+0000","last_active":"2023-07-24T05:46:06.023427+0000","last_peered":"2023-07-24T05:46:06.023427+0000","last_clean":"2023-07-24T05:46:06.023427+0000","last_became_active":"2023-07-24T05:46:00.933907+0000","last_became_peered":"2023-07-24T05:46:00.933907+0000","last_unstale":"2023-07-24T05:46:06.023427+0000","last_undegraded":"2023-07-24T05:46:06.023427+0000","last_fullsized":"2023-07-24T05:46:06.023427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:41:12.173555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.018439+0000","last_change":"2023-07-24T05:46:00.928680+0000","last_active":"2023-07-24T05:46:06.018439+0000","last_peered":"2023-07-24T05:46:06.018439+0000","last_clean":"2023-07-24T05:46:06.018439+0000","last_became_active":"2023-07-24T05:46:00.928276+0000","last_became_peered":"2023-07-24T05:46:00.928276+0000","last_unstale":"2023-07-24T05:46:06.018439+0000","last_undegraded":"2023-07-24T05:46:06.018439+0000","last_fullsized":"2023-07-24T05:46:06.018439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:15:26.395482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023672+0000","last_change":"2023-07-24T05:46:00.936679+0000","last_active":"2023-07-24T05:46:06.023672+0000","last_peered":"2023-07-24T05:46:06.023672+0000","last_clean":"2023-07-24T05:46:06.023672+0000","last_became_active":"2023-07-24T05:46:00.936176+0000","last_became_peered":"2023-07-24T05:46:00.936176+0000","last_unstale":"2023-07-24T05:46:06.023672+0000","last_undegraded":"2023-07-24T05:46:06.023672+0000","last_fullsized":"2023-07-24T05:46:06.023672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:46:01.670959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.720022+0000","last_change":"2023-07-24T05:46:00.940299+0000","last_active":"2023-07-24T05:46:06.720022+0000","last_peered":"2023-07-24T05:46:06.720022+0000","last_clean":"2023-07-24T05:46:06.720022+0000","last_became_active":"2023-07-24T05:46:00.940008+0000","last_became_peered":"2023-07-24T05:46:00.940008+0000","last_unstale":"2023-07-24T05:46:06.720022+0000","last_undegraded":"2023-07-24T05:46:06.720022+0000","last_fullsized":"2023-07-24T05:46:06.720022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:07:54.914500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.020567+0000","last_change":"2023-07-24T05:46:00.938329+0000","last_active":"2023-07-24T05:46:06.020567+0000","last_peered":"2023-07-24T05:46:06.020567+0000","last_clean":"2023-07-24T05:46:06.020567+0000","last_became_active":"2023-07-24T05:46:00.938046+0000","last_became_peered":"2023-07-24T05:46:00.938046+0000","last_unstale":"2023-07-24T05:46:06.020567+0000","last_undegraded":"2023-07-24T05:46:06.020567+0000","last_fullsized":"2023-07-24T05:46:06.020567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:26:06.142105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.481708+0000","last_change":"2023-07-24T05:46:00.955136+0000","last_active":"2023-07-24T05:46:06.481708+0000","last_peered":"2023-07-24T05:46:06.481708+0000","last_clean":"2023-07-24T05:46:06.481708+0000","last_became_active":"2023-07-24T05:46:00.954432+0000","last_became_peered":"2023-07-24T05:46:00.954432+0000","last_unstale":"2023-07-24T05:46:06.481708+0000","last_undegraded":"2023-07-24T05:46:06.481708+0000","last_fullsized":"2023-07-24T05:46:06.481708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:59:08.440089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.485847+0000","last_change":"2023-07-24T05:46:00.936021+0000","last_active":"2023-07-24T05:46:07.485847+0000","last_peered":"2023-07-24T05:46:07.485847+0000","last_clean":"2023-07-24T05:46:07.485847+0000","last_became_active":"2023-07-24T05:46:00.935648+0000","last_became_peered":"2023-07-24T05:46:00.935648+0000","last_unstale":"2023-07-24T05:46:07.485847+0000","last_undegraded":"2023-07-24T05:46:07.485847+0000","last_fullsized":"2023-07-24T05:46:07.485847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:04:34.146477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.018120+0000","last_change":"2023-07-24T05:46:00.944450+0000","last_active":"2023-07-24T05:46:06.018120+0000","last_peered":"2023-07-24T05:46:06.018120+0000","last_clean":"2023-07-24T05:46:06.018120+0000","last_became_active":"2023-07-24T05:46:00.943241+0000","last_became_peered":"2023-07-24T05:46:00.943241+0000","last_unstale":"2023-07-24T05:46:06.018120+0000","last_undegraded":"2023-07-24T05:46:06.018120+0000","last_fullsized":"2023-07-24T05:46:06.018120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:53:07.116935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.018724+0000","last_change":"2023-07-24T05:46:00.933437+0000","last_active":"2023-07-24T05:46:06.018724+0000","last_peered":"2023-07-24T05:46:06.018724+0000","last_clean":"2023-07-24T05:46:06.018724+0000","last_became_active":"2023-07-24T05:46:00.933148+0000","last_became_peered":"2023-07-24T05:46:00.933148+0000","last_unstale":"2023-07-24T05:46:06.018724+0000","last_undegraded":"2023-07-24T05:46:06.018724+0000","last_fullsized":"2023-07-24T05:46:06.018724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:43:12.724407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023680+0000","last_change":"2023-07-24T05:46:00.940814+0000","last_active":"2023-07-24T05:46:06.023680+0000","last_peered":"2023-07-24T05:46:06.023680+0000","last_clean":"2023-07-24T05:46:06.023680+0000","last_became_active":"2023-07-24T05:46:00.940490+0000","last_became_peered":"2023-07-24T05:46:00.940490+0000","last_unstale":"2023-07-24T05:46:06.023680+0000","last_undegraded":"2023-07-24T05:46:06.023680+0000","last_fullsized":"2023-07-24T05:46:06.023680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T16:55:24.415034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486791+0000","last_change":"2023-07-24T05:46:00.941947+0000","last_active":"2023-07-24T05:46:07.486791+0000","last_peered":"2023-07-24T05:46:07.486791+0000","last_clean":"2023-07-24T05:46:07.486791+0000","last_became_active":"2023-07-24T05:46:00.941624+0000","last_became_peered":"2023-07-24T05:46:00.941624+0000","last_unstale":"2023-07-24T05:46:07.486791+0000","last_undegraded":"2023-07-24T05:46:07.486791+0000","last_fullsized":"2023-07-24T05:46:07.486791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:18:26.734018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.719673+0000","last_change":"2023-07-24T05:46:00.933586+0000","last_active":"2023-07-24T05:46:06.719673+0000","last_peered":"2023-07-24T05:46:06.719673+0000","last_clean":"2023-07-24T05:46:06.719673+0000","last_became_active":"2023-07-24T05:46:00.933231+0000","last_became_peered":"2023-07-24T05:46:00.933231+0000","last_unstale":"2023-07-24T05:46:06.719673+0000","last_undegraded":"2023-07-24T05:46:06.719673+0000","last_fullsized":"2023-07-24T05:46:06.719673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:35:19.732787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.485426+0000","last_change":"2023-07-24T05:46:00.936425+0000","last_active":"2023-07-24T05:46:07.485426+0000","last_peered":"2023-07-24T05:46:07.485426+0000","last_clean":"2023-07-24T05:46:07.485426+0000","last_became_active":"2023-07-24T05:46:00.936057+0000","last_became_peered":"2023-07-24T05:46:00.936057+0000","last_unstale":"2023-07-24T05:46:07.485426+0000","last_undegraded":"2023-07-24T05:46:07.485426+0000","last_fullsized":"2023-07-24T05:46:07.485426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:17:32.903393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.481478+0000","last_change":"2023-07-24T05:46:00.955358+0000","last_active":"2023-07-24T05:46:06.481478+0000","last_peered":"2023-07-24T05:46:06.481478+0000","last_clean":"2023-07-24T05:46:06.481478+0000","last_became_active":"2023-07-24T05:46:00.954790+0000","last_became_peered":"2023-07-24T05:46:00.954790+0000","last_unstale":"2023-07-24T05:46:06.481478+0000","last_undegraded":"2023-07-24T05:46:06.481478+0000","last_fullsized":"2023-07-24T05:46:06.481478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:21:55.302838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.021627+0000","last_change":"2023-07-24T05:46:00.937697+0000","last_active":"2023-07-24T05:46:06.021627+0000","last_peered":"2023-07-24T05:46:06.021627+0000","last_clean":"2023-07-24T05:46:06.021627+0000","last_became_active":"2023-07-24T05:46:00.937034+0000","last_became_peered":"2023-07-24T05:46:00.937034+0000","last_unstale":"2023-07-24T05:46:06.021627+0000","last_undegraded":"2023-07-24T05:46:06.021627+0000","last_fullsized":"2023-07-24T05:46:06.021627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:39:26.893324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.720200+0000","last_change":"2023-07-24T05:46:00.936120+0000","last_active":"2023-07-24T05:46:06.720200+0000","last_peered":"2023-07-24T05:46:06.720200+0000","last_clean":"2023-07-24T05:46:06.720200+0000","last_became_active":"2023-07-24T05:46:00.935837+0000","last_became_peered":"2023-07-24T05:46:00.935837+0000","last_unstale":"2023-07-24T05:46:06.720200+0000","last_undegraded":"2023-07-24T05:46:06.720200+0000","last_fullsized":"2023-07-24T05:46:06.720200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:57:12.671093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.021362+0000","last_change":"2023-07-24T05:46:00.938400+0000","last_active":"2023-07-24T05:46:06.021362+0000","last_peered":"2023-07-24T05:46:06.021362+0000","last_clean":"2023-07-24T05:46:06.021362+0000","last_became_active":"2023-07-24T05:46:00.938021+0000","last_became_peered":"2023-07-24T05:46:00.938021+0000","last_unstale":"2023-07-24T05:46:06.021362+0000","last_undegraded":"2023-07-24T05:46:06.021362+0000","last_fullsized":"2023-07-24T05:46:06.021362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:50:30.095794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023656+0000","last_change":"2023-07-24T05:46:00.938957+0000","last_active":"2023-07-24T05:46:06.023656+0000","last_peered":"2023-07-24T05:46:06.023656+0000","last_clean":"2023-07-24T05:46:06.023656+0000","last_became_active":"2023-07-24T05:46:00.938684+0000","last_became_peered":"2023-07-24T05:46:00.938684+0000","last_unstale":"2023-07-24T05:46:06.023656+0000","last_undegraded":"2023-07-24T05:46:06.023656+0000","last_fullsized":"2023-07-24T05:46:06.023656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:54:20.745792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486581+0000","last_change":"2023-07-24T05:46:00.954433+0000","last_active":"2023-07-24T05:46:07.486581+0000","last_peered":"2023-07-24T05:46:07.486581+0000","last_clean":"2023-07-24T05:46:07.486581+0000","last_became_active":"2023-07-24T05:46:00.954144+0000","last_became_peered":"2023-07-24T05:46:00.954144+0000","last_unstale":"2023-07-24T05:46:07.486581+0000","last_undegraded":"2023-07-24T05:46:07.486581+0000","last_fullsized":"2023-07-24T05:46:07.486581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:57:39.660342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.018621+0000","last_change":"2023-07-24T05:46:00.943903+0000","last_active":"2023-07-24T05:46:06.018621+0000","last_peered":"2023-07-24T05:46:06.018621+0000","last_clean":"2023-07-24T05:46:06.018621+0000","last_became_active":"2023-07-24T05:46:00.943590+0000","last_became_peered":"2023-07-24T05:46:00.943590+0000","last_unstale":"2023-07-24T05:46:06.018621+0000","last_undegraded":"2023-07-24T05:46:06.018621+0000","last_fullsized":"2023-07-24T05:46:06.018621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:34:19.494683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4591,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":880640,"data_stored":700959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.512}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6060000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4570000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.387}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5580000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":107943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.573}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4179999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.617}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.262}]}]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":107234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2210000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.292}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.375}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.05}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4890000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":111792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3420000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2589999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.391}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.306}]}]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":108033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.357}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]}]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":107943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.159}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2290000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":107943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.343}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4810000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6559999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5189999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":697532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4910000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.288}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.407}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.22}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-24T05:46:28.733 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-24T05:46:28.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.938+0000 7f88b69af700 1 Processor -- start 2023-07-24T05:46:28.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.938+0000 7f88b69af700 1 -- start start 2023-07-24T05:46:28.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.942+0000 7f88b69af700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f88b0160d20 0x7f88b00adba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:28.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.942+0000 7f88b69af700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f88b00ae0e0 0x7f88b00b1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:28.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.942+0000 7f88b69af700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88b00af170 con 0x7f88b0161100 2023-07-24T05:46:28.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.942+0000 7f88b69af700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88b00ae5f0 con 0x7f88b00ae0e0 2023-07-24T05:46:28.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.942+0000 7f88b69af700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88b00ae8d0 con 0x7f88b0160d20 2023-07-24T05:46:28.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.942+0000 7f88b51ac700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f88b00ae0e0 0x7f88b00b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:28.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.942+0000 7f88b59ad700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f88b0160d20 0x7f88b00adba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:28.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.942+0000 7f88b51ac700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f88b00ae0e0 0x7f88b00b1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58628/0 (socket says 172.21.15.77:58628) 2023-07-24T05:46:28.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.942+0000 7f88b51ac700 1 -- 172.21.15.77:0/3812430131 learned_addr learned my addr 172.21.15.77:0/3812430131 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:28.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.942+0000 7f88b59ad700 1 -- 172.21.15.77:0/3812430131 >> v2:172.21.15.77:3300/0 conn(0x7f88b00ae0e0 msgr2=0x7f88b00b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:28.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.942+0000 7f88b59ad700 1 --2- 172.21.15.77:0/3812430131 >> v2:172.21.15.77:3300/0 conn(0x7f88b00ae0e0 0x7f88b00b1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:28.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.942+0000 7f88b59ad700 1 -- 172.21.15.77:0/3812430131 >> v1:172.21.15.103:6789/0 conn(0x7f88b0161100 legacy=0x7f88b0164b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:28.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.942+0000 7f88b59ad700 1 -- 172.21.15.77:0/3812430131 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b00aebb0 con 0x7f88b0160d20 2023-07-24T05:46:28.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.942+0000 7f88b51ac700 1 --2- 172.21.15.77:0/3812430131 >> v2:172.21.15.77:3300/0 conn(0x7f88b00ae0e0 0x7f88b00b1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:46:28.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.942+0000 7f88b59ad700 1 --2- 172.21.15.77:0/3812430131 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88b0160d20 0x7f88b00adba0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f88b00a4c10 tx=0x7f88ac009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6259027779ff8a2b server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:28.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.942+0000 7f88b49ab700 1 -- 172.21.15.77:0/3812430131 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ac011830 con 0x7f88b0160d20 2023-07-24T05:46:28.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.942+0000 7f88b49ab700 1 -- 172.21.15.77:0/3812430131 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88ac011990 con 0x7f88b0160d20 2023-07-24T05:46:28.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.942+0000 7f88b49ab700 1 -- 172.21.15.77:0/3812430131 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ac011d20 con 0x7f88b0160d20 2023-07-24T05:46:28.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.946+0000 7f88b69af700 1 -- 172.21.15.77:0/3812430131 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88b0160d20 msgr2=0x7f88b00adba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:28.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.946+0000 7f88b69af700 1 --2- 172.21.15.77:0/3812430131 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88b0160d20 0x7f88b00adba0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f88b00a4c10 tx=0x7f88ac009b30 comp rx=0 tx=0).stop 2023-07-24T05:46:28.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.946+0000 7f88b69af700 1 -- 172.21.15.77:0/3812430131 shutdown_connections 2023-07-24T05:46:28.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.946+0000 7f88b69af700 1 --2- 172.21.15.77:0/3812430131 >> v2:172.21.15.77:3300/0 conn(0x7f88b00ae0e0 0x7f88b00b1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:28.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.946+0000 7f88b69af700 1 --2- 172.21.15.77:0/3812430131 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88b0160d20 0x7f88b00adba0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:28.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.946+0000 7f88b69af700 1 -- 172.21.15.77:0/3812430131 >> 172.21.15.77:0/3812430131 conn(0x7f88b00cacc0 msgr2=0x7f88b00cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:28.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.946+0000 7f88b69af700 1 -- 172.21.15.77:0/3812430131 shutdown_connections 2023-07-24T05:46:28.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.946+0000 7f88b69af700 1 -- 172.21.15.77:0/3812430131 wait complete. 2023-07-24T05:46:28.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.950+0000 7f88b69af700 1 Processor -- start 2023-07-24T05:46:28.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.950+0000 7f88b69af700 1 -- start start 2023-07-24T05:46:28.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.950+0000 7f88b69af700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88b00ae0e0 0x7f88b01f5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:28.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.950+0000 7f88b69af700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f88b0160d20 0x7f88b00c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:28.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.950+0000 7f88b69af700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88b0161100 0x7f88b00c1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:28.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.950+0000 7f88b69af700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b009a3a0 con 0x7f88b0161100 2023-07-24T05:46:28.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.950+0000 7f88b69af700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b009a640 con 0x7f88b00ae0e0 2023-07-24T05:46:28.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.950+0000 7f88b69af700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b009a920 con 0x7f88b0160d20 2023-07-24T05:46:28.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.950+0000 7f88b61ae700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88b0161100 0x7f88b00c1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:28.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.950+0000 7f88b61ae700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88b0161100 0x7f88b00c1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58638/0 (socket says 172.21.15.77:58638) 2023-07-24T05:46:28.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.950+0000 7f88b61ae700 1 -- 172.21.15.77:0/3850229173 learned_addr learned my addr 172.21.15.77:0/3850229173 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:28.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.950+0000 7f88b59ad700 1 --2- 172.21.15.77:0/3850229173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88b00ae0e0 0x7f88b01f5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:28.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.950+0000 7f88b51ac700 1 --2- 172.21.15.77:0/3850229173 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f88b0160d20 0x7f88b00c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:28.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.950+0000 7f88b61ae700 1 -- 172.21.15.77:0/3850229173 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f88b0160d20 msgr2=0x7f88b00c49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:28.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.950+0000 7f88b61ae700 1 --2- 172.21.15.77:0/3850229173 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f88b0160d20 0x7f88b00c49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:28.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.950+0000 7f88b61ae700 1 -- 172.21.15.77:0/3850229173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88b00ae0e0 msgr2=0x7f88b01f5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:28.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.950+0000 7f88b61ae700 1 --2- 172.21.15.77:0/3850229173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88b00ae0e0 0x7f88b01f5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:28.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.950+0000 7f88b61ae700 1 -- 172.21.15.77:0/3850229173 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a0009570 con 0x7f88b0161100 2023-07-24T05:46:28.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.950+0000 7f88b51ac700 1 --2- 172.21.15.77:0/3850229173 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f88b0160d20 0x7f88b00c49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:46:28.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.950+0000 7f88b59ad700 1 --2- 172.21.15.77:0/3850229173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88b00ae0e0 0x7f88b01f5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:46:28.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.950+0000 7f88b61ae700 1 --2- 172.21.15.77:0/3850229173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88b0161100 0x7f88b00c1d70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f88a800cb50 tx=0x7f88a800cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:28.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.950+0000 7f88a67fc700 1 -- 172.21.15.77:0/3850229173 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a8003c20 con 0x7f88b0161100 2023-07-24T05:46:28.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.954+0000 7f88a67fc700 1 -- 172.21.15.77:0/3850229173 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a8003d80 con 0x7f88b0161100 2023-07-24T05:46:28.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.954+0000 7f88b69af700 1 -- 172.21.15.77:0/3850229173 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88ac0094b0 con 0x7f88b0161100 2023-07-24T05:46:28.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.954+0000 7f88a67fc700 1 -- 172.21.15.77:0/3850229173 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a800ab70 con 0x7f88b0161100 2023-07-24T05:46:28.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.954+0000 7f88b69af700 1 -- 172.21.15.77:0/3850229173 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88b009aee0 con 0x7f88b0161100 2023-07-24T05:46:28.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.954+0000 7f88b69af700 1 -- 172.21.15.77:0/3850229173 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88b0072490 con 0x7f88b0161100 2023-07-24T05:46:28.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.958+0000 7f88a67fc700 1 -- 172.21.15.77:0/3850229173 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f88a800acd0 con 0x7f88b0161100 2023-07-24T05:46:28.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.958+0000 7f88a67fc700 1 --2- 172.21.15.77:0/3850229173 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f88940662f0 0x7f88940687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:28.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.958+0000 7f88a67fc700 1 -- 172.21.15.77:0/3850229173 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f88a80840f0 con 0x7f88b0161100 2023-07-24T05:46:28.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.958+0000 7f88b59ad700 1 --2- 172.21.15.77:0/3850229173 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f88940662f0 0x7f88940687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:28.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.958+0000 7f88b59ad700 1 --2- 172.21.15.77:0/3850229173 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f88940662f0 0x7f88940687b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f88ac000c00 tx=0x7f88ac008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:28.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:28.962+0000 7f88a67fc700 1 -- 172.21.15.77:0/3850229173 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f88a80511e0 con 0x7f88b0161100 2023-07-24T05:46:29.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.134+0000 7f88b69af700 1 -- 172.21.15.77:0/3850229173 --> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f88b009aa90 con 0x7f88940662f0 2023-07-24T05:46:29.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.154+0000 7f88a67fc700 1 -- 172.21.15.77:0/3850229173 <== mgr.4108 v2:172.21.15.103:6832/1305366540 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367130 (secure 0 0 0) 0x7f88b009aa90 con 0x7f88940662f0 2023-07-24T05:46:29.161 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:46:29.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.162+0000 7f88b69af700 1 -- 172.21.15.77:0/3850229173 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f88940662f0 msgr2=0x7f88940687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:29.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.162+0000 7f88b69af700 1 --2- 172.21.15.77:0/3850229173 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f88940662f0 0x7f88940687b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f88ac000c00 tx=0x7f88ac008030 comp rx=0 tx=0).stop 2023-07-24T05:46:29.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.162+0000 7f88b69af700 1 -- 172.21.15.77:0/3850229173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88b0161100 msgr2=0x7f88b00c1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:29.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.162+0000 7f88b69af700 1 --2- 172.21.15.77:0/3850229173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88b0161100 0x7f88b00c1d70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f88a800cb50 tx=0x7f88a800cf10 comp rx=0 tx=0).stop 2023-07-24T05:46:29.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.162+0000 7f88b69af700 1 -- 172.21.15.77:0/3850229173 shutdown_connections 2023-07-24T05:46:29.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.162+0000 7f88b69af700 1 --2- 172.21.15.77:0/3850229173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88b0161100 0x7f88b00c1d70 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:29.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.162+0000 7f88b69af700 1 --2- 172.21.15.77:0/3850229173 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f88940662f0 0x7f88940687b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:29.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.162+0000 7f88b69af700 1 --2- 172.21.15.77:0/3850229173 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f88b0160d20 0x7f88b00c49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:29.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.162+0000 7f88b69af700 1 --2- 172.21.15.77:0/3850229173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88b00ae0e0 0x7f88b01f5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:29.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.162+0000 7f88b69af700 1 -- 172.21.15.77:0/3850229173 >> 172.21.15.77:0/3850229173 conn(0x7f88b00cacc0 msgr2=0x7f88b006d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:29.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.162+0000 7f88b69af700 1 -- 172.21.15.77:0/3850229173 shutdown_connections 2023-07-24T05:46:29.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.162+0000 7f88b69af700 1 -- 172.21.15.77:0/3850229173 wait complete. 2023-07-24T05:46:29.169 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-07-24T05:46:29.189 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2023-07-24T05:46:28.535321+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594959,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219412,"kb_used_data":3260,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755308,"statfs":{"total":773094113280,"available":772869435392,"internally_reserved":0,"allocated":3338240,"data_stored":2049379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004849"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.485697+0000","last_change":"2023-07-24T05:46:05.018571+0000","last_active":"2023-07-24T05:46:07.485697+0000","last_peered":"2023-07-24T05:46:07.485697+0000","last_clean":"2023-07-24T05:46:07.485697+0000","last_became_active":"2023-07-24T05:46:05.017995+0000","last_became_peered":"2023-07-24T05:46:05.017995+0000","last_unstale":"2023-07-24T05:46:07.485697+0000","last_undegraded":"2023-07-24T05:46:07.485697+0000","last_fullsized":"2023-07-24T05:46:07.485697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:09:07.896789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.720068+0000","last_change":"2023-07-24T05:45:59.909905+0000","last_active":"2023-07-24T05:46:06.720068+0000","last_peered":"2023-07-24T05:46:06.720068+0000","last_clean":"2023-07-24T05:46:06.720068+0000","last_became_active":"2023-07-24T05:45:59.909674+0000","last_became_peered":"2023-07-24T05:45:59.909674+0000","last_unstale":"2023-07-24T05:46:06.720068+0000","last_undegraded":"2023-07-24T05:46:06.720068+0000","last_fullsized":"2023-07-24T05:46:06.720068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:52:15.728826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.020712+0000","last_change":"2023-07-24T05:46:00.933508+0000","last_active":"2023-07-24T05:46:06.020712+0000","last_peered":"2023-07-24T05:46:06.020712+0000","last_clean":"2023-07-24T05:46:06.020712+0000","last_became_active":"2023-07-24T05:46:00.933149+0000","last_became_peered":"2023-07-24T05:46:00.933149+0000","last_unstale":"2023-07-24T05:46:06.020712+0000","last_undegraded":"2023-07-24T05:46:06.020712+0000","last_fullsized":"2023-07-24T05:46:06.020712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:48:28.674504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.020411+0000","last_change":"2023-07-24T05:46:05.015347+0000","last_active":"2023-07-24T05:46:06.020411+0000","last_peered":"2023-07-24T05:46:06.020411+0000","last_clean":"2023-07-24T05:46:06.020411+0000","last_became_active":"2023-07-24T05:46:05.014821+0000","last_became_peered":"2023-07-24T05:46:05.014821+0000","last_unstale":"2023-07-24T05:46:06.020411+0000","last_undegraded":"2023-07-24T05:46:06.020411+0000","last_fullsized":"2023-07-24T05:46:06.020411+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:18:33.791257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.484589+0000","last_change":"2023-07-24T05:45:59.894586+0000","last_active":"2023-07-24T05:46:07.484589+0000","last_peered":"2023-07-24T05:46:07.484589+0000","last_clean":"2023-07-24T05:46:07.484589+0000","last_became_active":"2023-07-24T05:45:59.894286+0000","last_became_peered":"2023-07-24T05:45:59.894286+0000","last_unstale":"2023-07-24T05:46:07.484589+0000","last_undegraded":"2023-07-24T05:46:07.484589+0000","last_fullsized":"2023-07-24T05:46:07.484589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:35:04.605981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.484398+0000","last_change":"2023-07-24T05:46:00.933761+0000","last_active":"2023-07-24T05:46:07.484398+0000","last_peered":"2023-07-24T05:46:07.484398+0000","last_clean":"2023-07-24T05:46:07.484398+0000","last_became_active":"2023-07-24T05:46:00.933321+0000","last_became_peered":"2023-07-24T05:46:00.933321+0000","last_unstale":"2023-07-24T05:46:07.484398+0000","last_undegraded":"2023-07-24T05:46:07.484398+0000","last_fullsized":"2023-07-24T05:46:07.484398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:28:13.314710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486274+0000","last_change":"2023-07-24T05:46:05.020875+0000","last_active":"2023-07-24T05:46:07.486274+0000","last_peered":"2023-07-24T05:46:07.486274+0000","last_clean":"2023-07-24T05:46:07.486274+0000","last_became_active":"2023-07-24T05:46:05.020425+0000","last_became_peered":"2023-07-24T05:46:05.020425+0000","last_unstale":"2023-07-24T05:46:07.486274+0000","last_undegraded":"2023-07-24T05:46:07.486274+0000","last_fullsized":"2023-07-24T05:46:07.486274+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T16:13:44.814663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486774+0000","last_change":"2023-07-24T05:45:59.917608+0000","last_active":"2023-07-24T05:46:07.486774+0000","last_peered":"2023-07-24T05:46:07.486774+0000","last_clean":"2023-07-24T05:46:07.486774+0000","last_became_active":"2023-07-24T05:45:59.917276+0000","last_became_peered":"2023-07-24T05:45:59.917276+0000","last_unstale":"2023-07-24T05:46:07.486774+0000","last_undegraded":"2023-07-24T05:46:07.486774+0000","last_fullsized":"2023-07-24T05:46:07.486774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:26:41.573346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.021965+0000","last_change":"2023-07-24T05:46:00.937906+0000","last_active":"2023-07-24T05:46:06.021965+0000","last_peered":"2023-07-24T05:46:06.021965+0000","last_clean":"2023-07-24T05:46:06.021965+0000","last_became_active":"2023-07-24T05:46:00.937395+0000","last_became_peered":"2023-07-24T05:46:00.937395+0000","last_unstale":"2023-07-24T05:46:06.021965+0000","last_undegraded":"2023-07-24T05:46:06.021965+0000","last_fullsized":"2023-07-24T05:46:06.021965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T16:29:11.391157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.481461+0000","last_change":"2023-07-24T05:46:05.025366+0000","last_active":"2023-07-24T05:46:06.481461+0000","last_peered":"2023-07-24T05:46:06.481461+0000","last_clean":"2023-07-24T05:46:06.481461+0000","last_became_active":"2023-07-24T05:46:05.024220+0000","last_became_peered":"2023-07-24T05:46:05.024220+0000","last_unstale":"2023-07-24T05:46:06.481461+0000","last_undegraded":"2023-07-24T05:46:06.481461+0000","last_fullsized":"2023-07-24T05:46:06.481461+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:56:32.485103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486003+0000","last_change":"2023-07-24T05:45:59.917558+0000","last_active":"2023-07-24T05:46:07.486003+0000","last_peered":"2023-07-24T05:46:07.486003+0000","last_clean":"2023-07-24T05:46:07.486003+0000","last_became_active":"2023-07-24T05:45:59.917247+0000","last_became_peered":"2023-07-24T05:45:59.917247+0000","last_unstale":"2023-07-24T05:46:07.486003+0000","last_undegraded":"2023-07-24T05:46:07.486003+0000","last_fullsized":"2023-07-24T05:46:07.486003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:07:11.420006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.022778+0000","last_change":"2023-07-24T05:46:00.937863+0000","last_active":"2023-07-24T05:46:06.022778+0000","last_peered":"2023-07-24T05:46:06.022778+0000","last_clean":"2023-07-24T05:46:06.022778+0000","last_became_active":"2023-07-24T05:46:00.937533+0000","last_became_peered":"2023-07-24T05:46:00.937533+0000","last_unstale":"2023-07-24T05:46:06.022778+0000","last_undegraded":"2023-07-24T05:46:06.022778+0000","last_fullsized":"2023-07-24T05:46:06.022778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:22:28.252629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486901+0000","last_change":"2023-07-24T05:46:05.021105+0000","last_active":"2023-07-24T05:46:07.486901+0000","last_peered":"2023-07-24T05:46:07.486901+0000","last_clean":"2023-07-24T05:46:07.486901+0000","last_became_active":"2023-07-24T05:46:05.020568+0000","last_became_peered":"2023-07-24T05:46:05.020568+0000","last_unstale":"2023-07-24T05:46:07.486901+0000","last_undegraded":"2023-07-24T05:46:07.486901+0000","last_fullsized":"2023-07-24T05:46:07.486901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:37:20.869353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.720347+0000","last_change":"2023-07-24T05:45:59.904446+0000","last_active":"2023-07-24T05:46:06.720347+0000","last_peered":"2023-07-24T05:46:06.720347+0000","last_clean":"2023-07-24T05:46:06.720347+0000","last_became_active":"2023-07-24T05:45:59.900231+0000","last_became_peered":"2023-07-24T05:45:59.900231+0000","last_unstale":"2023-07-24T05:46:06.720347+0000","last_undegraded":"2023-07-24T05:46:06.720347+0000","last_fullsized":"2023-07-24T05:46:06.720347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:44:12.555935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.018863+0000","last_change":"2023-07-24T05:46:00.951996+0000","last_active":"2023-07-24T05:46:06.018863+0000","last_peered":"2023-07-24T05:46:06.018863+0000","last_clean":"2023-07-24T05:46:06.018863+0000","last_became_active":"2023-07-24T05:46:00.951595+0000","last_became_peered":"2023-07-24T05:46:00.951595+0000","last_unstale":"2023-07-24T05:46:06.018863+0000","last_undegraded":"2023-07-24T05:46:06.018863+0000","last_fullsized":"2023-07-24T05:46:06.018863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:12:50.748120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023300+0000","last_change":"2023-07-24T05:46:05.017525+0000","last_active":"2023-07-24T05:46:06.023300+0000","last_peered":"2023-07-24T05:46:06.023300+0000","last_clean":"2023-07-24T05:46:06.023300+0000","last_became_active":"2023-07-24T05:46:05.015341+0000","last_became_peered":"2023-07-24T05:46:05.015341+0000","last_unstale":"2023-07-24T05:46:06.023300+0000","last_undegraded":"2023-07-24T05:46:06.023300+0000","last_fullsized":"2023-07-24T05:46:06.023300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:21:43.930293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.022219+0000","last_change":"2023-07-24T05:45:59.908228+0000","last_active":"2023-07-24T05:46:06.022219+0000","last_peered":"2023-07-24T05:46:06.022219+0000","last_clean":"2023-07-24T05:46:06.022219+0000","last_became_active":"2023-07-24T05:45:59.907944+0000","last_became_peered":"2023-07-24T05:45:59.907944+0000","last_unstale":"2023-07-24T05:46:06.022219+0000","last_undegraded":"2023-07-24T05:46:06.022219+0000","last_fullsized":"2023-07-24T05:46:06.022219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:52:47.698647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.484788+0000","last_change":"2023-07-24T05:46:00.952847+0000","last_active":"2023-07-24T05:46:07.484788+0000","last_peered":"2023-07-24T05:46:07.484788+0000","last_clean":"2023-07-24T05:46:07.484788+0000","last_became_active":"2023-07-24T05:46:00.952573+0000","last_became_peered":"2023-07-24T05:46:00.952573+0000","last_unstale":"2023-07-24T05:46:07.484788+0000","last_undegraded":"2023-07-24T05:46:07.484788+0000","last_fullsized":"2023-07-24T05:46:07.484788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:41:28.929137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.022213+0000","last_change":"2023-07-24T05:46:05.014357+0000","last_active":"2023-07-24T05:46:06.022213+0000","last_peered":"2023-07-24T05:46:06.022213+0000","last_clean":"2023-07-24T05:46:06.022213+0000","last_became_active":"2023-07-24T05:46:05.013964+0000","last_became_peered":"2023-07-24T05:46:05.013964+0000","last_unstale":"2023-07-24T05:46:06.022213+0000","last_undegraded":"2023-07-24T05:46:06.022213+0000","last_fullsized":"2023-07-24T05:46:06.022213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:56:47.701279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486215+0000","last_change":"2023-07-24T05:45:59.907153+0000","last_active":"2023-07-24T05:46:07.486215+0000","last_peered":"2023-07-24T05:46:07.486215+0000","last_clean":"2023-07-24T05:46:07.486215+0000","last_became_active":"2023-07-24T05:45:59.906816+0000","last_became_peered":"2023-07-24T05:45:59.906816+0000","last_unstale":"2023-07-24T05:46:07.486215+0000","last_undegraded":"2023-07-24T05:46:07.486215+0000","last_fullsized":"2023-07-24T05:46:07.486215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T05:59:19.607892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.719904+0000","last_change":"2023-07-24T05:46:00.931260+0000","last_active":"2023-07-24T05:46:06.719904+0000","last_peered":"2023-07-24T05:46:06.719904+0000","last_clean":"2023-07-24T05:46:06.719904+0000","last_became_active":"2023-07-24T05:46:00.930959+0000","last_became_peered":"2023-07-24T05:46:00.930959+0000","last_unstale":"2023-07-24T05:46:06.719904+0000","last_undegraded":"2023-07-24T05:46:06.719904+0000","last_fullsized":"2023-07-24T05:46:06.719904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:56:23.036353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.719736+0000","last_change":"2023-07-24T05:46:05.017693+0000","last_active":"2023-07-24T05:46:06.719736+0000","last_peered":"2023-07-24T05:46:06.719736+0000","last_clean":"2023-07-24T05:46:06.719736+0000","last_became_active":"2023-07-24T05:46:05.015057+0000","last_became_peered":"2023-07-24T05:46:05.015057+0000","last_unstale":"2023-07-24T05:46:06.719736+0000","last_undegraded":"2023-07-24T05:46:06.719736+0000","last_fullsized":"2023-07-24T05:46:06.719736+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:21:43.441226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.483452+0000","last_change":"2023-07-24T05:45:59.908355+0000","last_active":"2023-07-24T05:46:07.483452+0000","last_peered":"2023-07-24T05:46:07.483452+0000","last_clean":"2023-07-24T05:46:07.483452+0000","last_became_active":"2023-07-24T05:45:59.907240+0000","last_became_peered":"2023-07-24T05:45:59.907240+0000","last_unstale":"2023-07-24T05:46:07.483452+0000","last_undegraded":"2023-07-24T05:46:07.483452+0000","last_fullsized":"2023-07-24T05:46:07.483452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:15:19.009984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.022429+0000","last_change":"2023-07-24T05:46:00.933306+0000","last_active":"2023-07-24T05:46:06.022429+0000","last_peered":"2023-07-24T05:46:06.022429+0000","last_clean":"2023-07-24T05:46:06.022429+0000","last_became_active":"2023-07-24T05:46:00.932306+0000","last_became_peered":"2023-07-24T05:46:00.932306+0000","last_unstale":"2023-07-24T05:46:06.022429+0000","last_undegraded":"2023-07-24T05:46:06.022429+0000","last_fullsized":"2023-07-24T05:46:06.022429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:06:46.941549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.483132+0000","last_change":"2023-07-24T05:46:00.941623+0000","last_active":"2023-07-24T05:46:07.483132+0000","last_peered":"2023-07-24T05:46:07.483132+0000","last_clean":"2023-07-24T05:46:07.483132+0000","last_became_active":"2023-07-24T05:46:00.941341+0000","last_became_peered":"2023-07-24T05:46:00.941341+0000","last_unstale":"2023-07-24T05:46:07.483132+0000","last_undegraded":"2023-07-24T05:46:07.483132+0000","last_fullsized":"2023-07-24T05:46:07.483132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:08:22.272136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.720265+0000","last_change":"2023-07-24T05:45:59.909261+0000","last_active":"2023-07-24T05:46:06.720265+0000","last_peered":"2023-07-24T05:46:06.720265+0000","last_clean":"2023-07-24T05:46:06.720265+0000","last_became_active":"2023-07-24T05:45:59.908962+0000","last_became_peered":"2023-07-24T05:45:59.908962+0000","last_unstale":"2023-07-24T05:46:06.720265+0000","last_undegraded":"2023-07-24T05:46:06.720265+0000","last_fullsized":"2023-07-24T05:46:06.720265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:56:19.698866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.021043+0000","last_change":"2023-07-24T05:46:05.012927+0000","last_active":"2023-07-24T05:46:06.021043+0000","last_peered":"2023-07-24T05:46:06.021043+0000","last_clean":"2023-07-24T05:46:06.021043+0000","last_became_active":"2023-07-24T05:46:05.012506+0000","last_became_peered":"2023-07-24T05:46:05.012506+0000","last_unstale":"2023-07-24T05:46:06.021043+0000","last_undegraded":"2023-07-24T05:46:06.021043+0000","last_fullsized":"2023-07-24T05:46:06.021043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:48:07.287011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.483976+0000","last_change":"2023-07-24T05:46:00.931782+0000","last_active":"2023-07-24T05:46:07.483976+0000","last_peered":"2023-07-24T05:46:07.483976+0000","last_clean":"2023-07-24T05:46:07.483976+0000","last_became_active":"2023-07-24T05:46:00.931488+0000","last_became_peered":"2023-07-24T05:46:00.931488+0000","last_unstale":"2023-07-24T05:46:07.483976+0000","last_undegraded":"2023-07-24T05:46:07.483976+0000","last_fullsized":"2023-07-24T05:46:07.483976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:34:32.612133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486848+0000","last_change":"2023-07-24T05:45:59.909882+0000","last_active":"2023-07-24T05:46:07.486848+0000","last_peered":"2023-07-24T05:46:07.486848+0000","last_clean":"2023-07-24T05:46:07.486848+0000","last_became_active":"2023-07-24T05:45:59.909623+0000","last_became_peered":"2023-07-24T05:45:59.909623+0000","last_unstale":"2023-07-24T05:46:07.486848+0000","last_undegraded":"2023-07-24T05:46:07.486848+0000","last_fullsized":"2023-07-24T05:46:07.486848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:39:16.199623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.480977+0000","last_change":"2023-07-24T05:46:05.025942+0000","last_active":"2023-07-24T05:46:06.480977+0000","last_peered":"2023-07-24T05:46:06.480977+0000","last_clean":"2023-07-24T05:46:06.480977+0000","last_became_active":"2023-07-24T05:46:05.025150+0000","last_became_peered":"2023-07-24T05:46:05.025150+0000","last_unstale":"2023-07-24T05:46:06.480977+0000","last_undegraded":"2023-07-24T05:46:06.480977+0000","last_fullsized":"2023-07-24T05:46:06.480977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:18:59.759729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.482301+0000","last_change":"2023-07-24T05:45:59.916471+0000","last_active":"2023-07-24T05:46:06.482301+0000","last_peered":"2023-07-24T05:46:06.482301+0000","last_clean":"2023-07-24T05:46:06.482301+0000","last_became_active":"2023-07-24T05:45:59.914483+0000","last_became_peered":"2023-07-24T05:45:59.914483+0000","last_unstale":"2023-07-24T05:46:06.482301+0000","last_undegraded":"2023-07-24T05:46:06.482301+0000","last_fullsized":"2023-07-24T05:46:06.482301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:14:26.354550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486144+0000","last_change":"2023-07-24T05:46:00.946206+0000","last_active":"2023-07-24T05:46:07.486144+0000","last_peered":"2023-07-24T05:46:07.486144+0000","last_clean":"2023-07-24T05:46:07.486144+0000","last_became_active":"2023-07-24T05:46:00.941357+0000","last_became_peered":"2023-07-24T05:46:00.941357+0000","last_unstale":"2023-07-24T05:46:07.486144+0000","last_undegraded":"2023-07-24T05:46:07.486144+0000","last_fullsized":"2023-07-24T05:46:07.486144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:57:39.660342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.483625+0000","last_change":"2023-07-24T05:46:05.011477+0000","last_active":"2023-07-24T05:46:07.483625+0000","last_peered":"2023-07-24T05:46:07.483625+0000","last_clean":"2023-07-24T05:46:07.483625+0000","last_became_active":"2023-07-24T05:46:05.011080+0000","last_became_peered":"2023-07-24T05:46:05.011080+0000","last_unstale":"2023-07-24T05:46:07.483625+0000","last_undegraded":"2023-07-24T05:46:07.483625+0000","last_fullsized":"2023-07-24T05:46:07.483625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:20:27.076589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"25'10","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:18.816659+0000","last_change":"2023-07-24T05:45:59.909189+0000","last_active":"2023-07-24T05:46:18.816659+0000","last_peered":"2023-07-24T05:46:18.816659+0000","last_clean":"2023-07-24T05:46:18.816659+0000","last_became_active":"2023-07-24T05:45:59.908248+0000","last_became_peered":"2023-07-24T05:45:59.908248+0000","last_unstale":"2023-07-24T05:46:18.816659+0000","last_undegraded":"2023-07-24T05:46:18.816659+0000","last_fullsized":"2023-07-24T05:46:18.816659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:04:41.772179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3793,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023001+0000","last_change":"2023-07-24T05:46:00.930080+0000","last_active":"2023-07-24T05:46:06.023001+0000","last_peered":"2023-07-24T05:46:06.023001+0000","last_clean":"2023-07-24T05:46:06.023001+0000","last_became_active":"2023-07-24T05:46:00.929737+0000","last_became_peered":"2023-07-24T05:46:00.929737+0000","last_unstale":"2023-07-24T05:46:06.023001+0000","last_undegraded":"2023-07-24T05:46:06.023001+0000","last_fullsized":"2023-07-24T05:46:06.023001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:13:45.155446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.485916+0000","last_change":"2023-07-24T05:46:05.017936+0000","last_active":"2023-07-24T05:46:07.485916+0000","last_peered":"2023-07-24T05:46:07.485916+0000","last_clean":"2023-07-24T05:46:07.485916+0000","last_became_active":"2023-07-24T05:46:05.017553+0000","last_became_peered":"2023-07-24T05:46:05.017553+0000","last_unstale":"2023-07-24T05:46:07.485916+0000","last_undegraded":"2023-07-24T05:46:07.485916+0000","last_fullsized":"2023-07-24T05:46:07.485916+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:18:15.042584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.022842+0000","last_change":"2023-07-24T05:46:00.933560+0000","last_active":"2023-07-24T05:46:06.022842+0000","last_peered":"2023-07-24T05:46:06.022842+0000","last_clean":"2023-07-24T05:46:06.022842+0000","last_became_active":"2023-07-24T05:46:00.933176+0000","last_became_peered":"2023-07-24T05:46:00.933176+0000","last_unstale":"2023-07-24T05:46:06.022842+0000","last_undegraded":"2023-07-24T05:46:06.022842+0000","last_fullsized":"2023-07-24T05:46:06.022842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:22:28.734087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.022569+0000","last_change":"2023-07-24T05:45:54.350738+0000","last_active":"2023-07-24T05:46:06.022569+0000","last_peered":"2023-07-24T05:46:06.022569+0000","last_clean":"2023-07-24T05:46:06.022569+0000","last_became_active":"2023-07-24T05:45:54.350347+0000","last_became_peered":"2023-07-24T05:45:54.350347+0000","last_unstale":"2023-07-24T05:46:06.022569+0000","last_undegraded":"2023-07-24T05:46:06.022569+0000","last_fullsized":"2023-07-24T05:46:06.022569+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:15:33.932270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.720381+0000","last_change":"2023-07-24T05:45:59.904262+0000","last_active":"2023-07-24T05:46:06.720381+0000","last_peered":"2023-07-24T05:46:06.720381+0000","last_clean":"2023-07-24T05:46:06.720381+0000","last_became_active":"2023-07-24T05:45:59.901334+0000","last_became_peered":"2023-07-24T05:45:59.901334+0000","last_unstale":"2023-07-24T05:46:06.720381+0000","last_undegraded":"2023-07-24T05:46:06.720381+0000","last_fullsized":"2023-07-24T05:46:06.720381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:58:01.493567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.483100+0000","last_change":"2023-07-24T05:46:05.016239+0000","last_active":"2023-07-24T05:46:07.483100+0000","last_peered":"2023-07-24T05:46:07.483100+0000","last_clean":"2023-07-24T05:46:07.483100+0000","last_became_active":"2023-07-24T05:46:05.015792+0000","last_became_peered":"2023-07-24T05:46:05.015792+0000","last_unstale":"2023-07-24T05:46:07.483100+0000","last_undegraded":"2023-07-24T05:46:07.483100+0000","last_fullsized":"2023-07-24T05:46:07.483100+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:52:03.648761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.483288+0000","last_change":"2023-07-24T05:46:00.933134+0000","last_active":"2023-07-24T05:46:07.483288+0000","last_peered":"2023-07-24T05:46:07.483288+0000","last_clean":"2023-07-24T05:46:07.483288+0000","last_became_active":"2023-07-24T05:46:00.932531+0000","last_became_peered":"2023-07-24T05:46:00.932531+0000","last_unstale":"2023-07-24T05:46:07.483288+0000","last_undegraded":"2023-07-24T05:46:07.483288+0000","last_fullsized":"2023-07-24T05:46:07.483288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:21:40.350408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.487206+0000","last_change":"2023-07-24T05:45:54.346766+0000","last_active":"2023-07-24T05:46:07.487206+0000","last_peered":"2023-07-24T05:46:07.487206+0000","last_clean":"2023-07-24T05:46:07.487206+0000","last_became_active":"2023-07-24T05:45:54.346404+0000","last_became_peered":"2023-07-24T05:45:54.346404+0000","last_unstale":"2023-07-24T05:46:07.487206+0000","last_undegraded":"2023-07-24T05:46:07.487206+0000","last_fullsized":"2023-07-24T05:46:07.487206+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:41:48.652814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.484987+0000","last_change":"2023-07-24T05:45:59.909030+0000","last_active":"2023-07-24T05:46:07.484987+0000","last_peered":"2023-07-24T05:46:07.484987+0000","last_clean":"2023-07-24T05:46:07.484987+0000","last_became_active":"2023-07-24T05:45:59.908731+0000","last_became_peered":"2023-07-24T05:45:59.908731+0000","last_unstale":"2023-07-24T05:46:07.484987+0000","last_undegraded":"2023-07-24T05:46:07.484987+0000","last_fullsized":"2023-07-24T05:46:07.484987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:47:28.208042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.020418+0000","last_change":"2023-07-24T05:46:05.014582+0000","last_active":"2023-07-24T05:46:06.020418+0000","last_peered":"2023-07-24T05:46:06.020418+0000","last_clean":"2023-07-24T05:46:06.020418+0000","last_became_active":"2023-07-24T05:46:05.014202+0000","last_became_peered":"2023-07-24T05:46:05.014202+0000","last_unstale":"2023-07-24T05:46:06.020418+0000","last_undegraded":"2023-07-24T05:46:06.020418+0000","last_fullsized":"2023-07-24T05:46:06.020418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:08:46.149814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.719886+0000","last_change":"2023-07-24T05:46:00.935075+0000","last_active":"2023-07-24T05:46:06.719886+0000","last_peered":"2023-07-24T05:46:06.719886+0000","last_clean":"2023-07-24T05:46:06.719886+0000","last_became_active":"2023-07-24T05:46:00.934789+0000","last_became_peered":"2023-07-24T05:46:00.934789+0000","last_unstale":"2023-07-24T05:46:06.719886+0000","last_undegraded":"2023-07-24T05:46:06.719886+0000","last_fullsized":"2023-07-24T05:46:06.719886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:35:30.780605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.482573+0000","last_change":"2023-07-24T05:45:54.355858+0000","last_active":"2023-07-24T05:46:06.482573+0000","last_peered":"2023-07-24T05:46:06.482573+0000","last_clean":"2023-07-24T05:46:06.482573+0000","last_became_active":"2023-07-24T05:45:54.355598+0000","last_became_peered":"2023-07-24T05:45:54.355598+0000","last_unstale":"2023-07-24T05:46:06.482573+0000","last_undegraded":"2023-07-24T05:46:06.482573+0000","last_fullsized":"2023-07-24T05:46:06.482573+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:04:55.110927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486464+0000","last_change":"2023-07-24T05:45:59.902462+0000","last_active":"2023-07-24T05:46:07.486464+0000","last_peered":"2023-07-24T05:46:07.486464+0000","last_clean":"2023-07-24T05:46:07.486464+0000","last_became_active":"2023-07-24T05:45:59.902137+0000","last_became_peered":"2023-07-24T05:45:59.902137+0000","last_unstale":"2023-07-24T05:46:07.486464+0000","last_undegraded":"2023-07-24T05:46:07.486464+0000","last_fullsized":"2023-07-24T05:46:07.486464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:29:00.215998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.021410+0000","last_change":"2023-07-24T05:46:05.020732+0000","last_active":"2023-07-24T05:46:06.021410+0000","last_peered":"2023-07-24T05:46:06.021410+0000","last_clean":"2023-07-24T05:46:06.021410+0000","last_became_active":"2023-07-24T05:46:05.020404+0000","last_became_peered":"2023-07-24T05:46:05.020404+0000","last_unstale":"2023-07-24T05:46:06.021410+0000","last_undegraded":"2023-07-24T05:46:06.021410+0000","last_fullsized":"2023-07-24T05:46:06.021410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:19:13.139942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486329+0000","last_change":"2023-07-24T05:46:00.932855+0000","last_active":"2023-07-24T05:46:07.486329+0000","last_peered":"2023-07-24T05:46:07.486329+0000","last_clean":"2023-07-24T05:46:07.486329+0000","last_became_active":"2023-07-24T05:46:00.932529+0000","last_became_peered":"2023-07-24T05:46:00.932529+0000","last_unstale":"2023-07-24T05:46:07.486329+0000","last_undegraded":"2023-07-24T05:46:07.486329+0000","last_fullsized":"2023-07-24T05:46:07.486329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:26:42.584506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486661+0000","last_change":"2023-07-24T05:45:54.354128+0000","last_active":"2023-07-24T05:46:07.486661+0000","last_peered":"2023-07-24T05:46:07.486661+0000","last_clean":"2023-07-24T05:46:07.486661+0000","last_became_active":"2023-07-24T05:45:54.353816+0000","last_became_peered":"2023-07-24T05:45:54.353816+0000","last_unstale":"2023-07-24T05:46:07.486661+0000","last_undegraded":"2023-07-24T05:46:07.486661+0000","last_fullsized":"2023-07-24T05:46:07.486661+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:18:49.117398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486818+0000","last_change":"2023-07-24T05:45:59.910016+0000","last_active":"2023-07-24T05:46:07.486818+0000","last_peered":"2023-07-24T05:46:07.486818+0000","last_clean":"2023-07-24T05:46:07.486818+0000","last_became_active":"2023-07-24T05:45:59.909740+0000","last_became_peered":"2023-07-24T05:45:59.909740+0000","last_unstale":"2023-07-24T05:46:07.486818+0000","last_undegraded":"2023-07-24T05:46:07.486818+0000","last_fullsized":"2023-07-24T05:46:07.486818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:29:00.215998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.719697+0000","last_change":"2023-07-24T05:46:05.024839+0000","last_active":"2023-07-24T05:46:06.719697+0000","last_peered":"2023-07-24T05:46:06.719697+0000","last_clean":"2023-07-24T05:46:06.719697+0000","last_became_active":"2023-07-24T05:46:05.024447+0000","last_became_peered":"2023-07-24T05:46:05.024447+0000","last_unstale":"2023-07-24T05:46:06.719697+0000","last_undegraded":"2023-07-24T05:46:06.719697+0000","last_fullsized":"2023-07-24T05:46:06.719697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:39:44.669092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486397+0000","last_change":"2023-07-24T05:46:00.938782+0000","last_active":"2023-07-24T05:46:07.486397+0000","last_peered":"2023-07-24T05:46:07.486397+0000","last_clean":"2023-07-24T05:46:07.486397+0000","last_became_active":"2023-07-24T05:46:00.938402+0000","last_became_peered":"2023-07-24T05:46:00.938402+0000","last_unstale":"2023-07-24T05:46:07.486397+0000","last_undegraded":"2023-07-24T05:46:07.486397+0000","last_fullsized":"2023-07-24T05:46:07.486397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:18:26.734018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023120+0000","last_change":"2023-07-24T05:45:59.909892+0000","last_active":"2023-07-24T05:46:06.023120+0000","last_peered":"2023-07-24T05:46:06.023120+0000","last_clean":"2023-07-24T05:46:06.023120+0000","last_became_active":"2023-07-24T05:45:59.909552+0000","last_became_peered":"2023-07-24T05:45:59.909552+0000","last_unstale":"2023-07-24T05:46:06.023120+0000","last_undegraded":"2023-07-24T05:46:06.023120+0000","last_fullsized":"2023-07-24T05:46:06.023120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:32:56.241515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486150+0000","last_change":"2023-07-24T05:45:54.353232+0000","last_active":"2023-07-24T05:46:07.486150+0000","last_peered":"2023-07-24T05:46:07.486150+0000","last_clean":"2023-07-24T05:46:07.486150+0000","last_became_active":"2023-07-24T05:45:54.352983+0000","last_became_peered":"2023-07-24T05:45:54.352983+0000","last_unstale":"2023-07-24T05:46:07.486150+0000","last_undegraded":"2023-07-24T05:46:07.486150+0000","last_fullsized":"2023-07-24T05:46:07.486150+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:13:51.706275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.720334+0000","last_change":"2023-07-24T05:46:05.026068+0000","last_active":"2023-07-24T05:46:06.720334+0000","last_peered":"2023-07-24T05:46:06.720334+0000","last_clean":"2023-07-24T05:46:06.720334+0000","last_became_active":"2023-07-24T05:46:05.025042+0000","last_became_peered":"2023-07-24T05:46:05.025042+0000","last_unstale":"2023-07-24T05:46:06.720334+0000","last_undegraded":"2023-07-24T05:46:06.720334+0000","last_fullsized":"2023-07-24T05:46:06.720334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:35:03.922426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.487482+0000","last_change":"2023-07-24T05:46:00.937728+0000","last_active":"2023-07-24T05:46:07.487482+0000","last_peered":"2023-07-24T05:46:07.487482+0000","last_clean":"2023-07-24T05:46:07.487482+0000","last_became_active":"2023-07-24T05:46:00.937334+0000","last_became_peered":"2023-07-24T05:46:00.937334+0000","last_unstale":"2023-07-24T05:46:07.487482+0000","last_undegraded":"2023-07-24T05:46:07.487482+0000","last_fullsized":"2023-07-24T05:46:07.487482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:44:23.859944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.485666+0000","last_change":"2023-07-24T05:45:59.902663+0000","last_active":"2023-07-24T05:46:07.485666+0000","last_peered":"2023-07-24T05:46:07.485666+0000","last_clean":"2023-07-24T05:46:07.485666+0000","last_became_active":"2023-07-24T05:45:59.902383+0000","last_became_peered":"2023-07-24T05:45:59.902383+0000","last_unstale":"2023-07-24T05:46:07.485666+0000","last_undegraded":"2023-07-24T05:46:07.485666+0000","last_fullsized":"2023-07-24T05:46:07.485666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T05:47:06.412190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.017303+0000","last_change":"2023-07-24T05:45:54.349000+0000","last_active":"2023-07-24T05:46:06.017303+0000","last_peered":"2023-07-24T05:46:06.017303+0000","last_clean":"2023-07-24T05:46:06.017303+0000","last_became_active":"2023-07-24T05:45:54.348646+0000","last_became_peered":"2023-07-24T05:45:54.348646+0000","last_unstale":"2023-07-24T05:46:06.017303+0000","last_undegraded":"2023-07-24T05:46:06.017303+0000","last_fullsized":"2023-07-24T05:46:06.017303+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:25:22.452188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.018595+0000","last_change":"2023-07-24T05:46:05.015931+0000","last_active":"2023-07-24T05:46:06.018595+0000","last_peered":"2023-07-24T05:46:06.018595+0000","last_clean":"2023-07-24T05:46:06.018595+0000","last_became_active":"2023-07-24T05:46:05.013649+0000","last_became_peered":"2023-07-24T05:46:05.013649+0000","last_unstale":"2023-07-24T05:46:06.018595+0000","last_undegraded":"2023-07-24T05:46:06.018595+0000","last_fullsized":"2023-07-24T05:46:06.018595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:02:14.273821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.720047+0000","last_change":"2023-07-24T05:46:00.942679+0000","last_active":"2023-07-24T05:46:06.720047+0000","last_peered":"2023-07-24T05:46:06.720047+0000","last_clean":"2023-07-24T05:46:06.720047+0000","last_became_active":"2023-07-24T05:46:00.941904+0000","last_became_peered":"2023-07-24T05:46:00.941904+0000","last_unstale":"2023-07-24T05:46:06.720047+0000","last_undegraded":"2023-07-24T05:46:06.720047+0000","last_fullsized":"2023-07-24T05:46:06.720047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:37:25.195905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.718941+0000","last_change":"2023-07-24T05:45:59.905040+0000","last_active":"2023-07-24T05:46:06.718941+0000","last_peered":"2023-07-24T05:46:06.718941+0000","last_clean":"2023-07-24T05:46:06.718941+0000","last_became_active":"2023-07-24T05:45:59.904704+0000","last_became_peered":"2023-07-24T05:45:59.904704+0000","last_unstale":"2023-07-24T05:46:06.718941+0000","last_undegraded":"2023-07-24T05:46:06.718941+0000","last_fullsized":"2023-07-24T05:46:06.718941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:14:26.074102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.481364+0000","last_change":"2023-07-24T05:45:54.350803+0000","last_active":"2023-07-24T05:46:06.481364+0000","last_peered":"2023-07-24T05:46:06.481364+0000","last_clean":"2023-07-24T05:46:06.481364+0000","last_became_active":"2023-07-24T05:45:54.350427+0000","last_became_peered":"2023-07-24T05:45:54.350427+0000","last_unstale":"2023-07-24T05:46:06.481364+0000","last_undegraded":"2023-07-24T05:46:06.481364+0000","last_fullsized":"2023-07-24T05:46:06.481364+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:41:48.652814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486965+0000","last_change":"2023-07-24T05:46:05.021436+0000","last_active":"2023-07-24T05:46:07.486965+0000","last_peered":"2023-07-24T05:46:07.486965+0000","last_clean":"2023-07-24T05:46:07.486965+0000","last_became_active":"2023-07-24T05:46:05.020835+0000","last_became_peered":"2023-07-24T05:46:05.020835+0000","last_unstale":"2023-07-24T05:46:07.486965+0000","last_undegraded":"2023-07-24T05:46:07.486965+0000","last_fullsized":"2023-07-24T05:46:07.486965+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:37:20.869353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.021744+0000","last_change":"2023-07-24T05:46:00.936580+0000","last_active":"2023-07-24T05:46:06.021744+0000","last_peered":"2023-07-24T05:46:06.021744+0000","last_clean":"2023-07-24T05:46:06.021744+0000","last_became_active":"2023-07-24T05:46:00.936229+0000","last_became_peered":"2023-07-24T05:46:00.936229+0000","last_unstale":"2023-07-24T05:46:06.021744+0000","last_undegraded":"2023-07-24T05:46:06.021744+0000","last_fullsized":"2023-07-24T05:46:06.021744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:56:32.104824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.483869+0000","last_change":"2023-07-24T05:45:59.909952+0000","last_active":"2023-07-24T05:46:07.483869+0000","last_peered":"2023-07-24T05:46:07.483869+0000","last_clean":"2023-07-24T05:46:07.483869+0000","last_became_active":"2023-07-24T05:45:59.909649+0000","last_became_peered":"2023-07-24T05:45:59.909649+0000","last_unstale":"2023-07-24T05:46:07.483869+0000","last_undegraded":"2023-07-24T05:46:07.483869+0000","last_fullsized":"2023-07-24T05:46:07.483869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T16:11:54.051701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486355+0000","last_change":"2023-07-24T05:45:54.351103+0000","last_active":"2023-07-24T05:46:07.486355+0000","last_peered":"2023-07-24T05:46:07.486355+0000","last_clean":"2023-07-24T05:46:07.486355+0000","last_became_active":"2023-07-24T05:45:54.350628+0000","last_became_peered":"2023-07-24T05:45:54.350628+0000","last_unstale":"2023-07-24T05:46:07.486355+0000","last_undegraded":"2023-07-24T05:46:07.486355+0000","last_fullsized":"2023-07-24T05:46:07.486355+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T05:47:00.879682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":177,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.481430+0000","last_change":"2023-07-24T05:45:54.356765+0000","last_active":"2023-07-24T05:46:06.481430+0000","last_peered":"2023-07-24T05:46:06.481430+0000","last_clean":"2023-07-24T05:46:06.481430+0000","last_became_active":"2023-07-24T05:45:54.355687+0000","last_became_peered":"2023-07-24T05:45:54.355687+0000","last_unstale":"2023-07-24T05:46:06.481430+0000","last_undegraded":"2023-07-24T05:46:06.481430+0000","last_fullsized":"2023-07-24T05:46:06.481430+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:54:08.245065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.481843+0000","last_change":"2023-07-24T05:46:05.031446+0000","last_active":"2023-07-24T05:46:06.481843+0000","last_peered":"2023-07-24T05:46:06.481843+0000","last_clean":"2023-07-24T05:46:06.481843+0000","last_became_active":"2023-07-24T05:46:05.024845+0000","last_became_peered":"2023-07-24T05:46:05.024845+0000","last_unstale":"2023-07-24T05:46:06.481843+0000","last_undegraded":"2023-07-24T05:46:06.481843+0000","last_fullsized":"2023-07-24T05:46:06.481843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:21:24.557827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.487407+0000","last_change":"2023-07-24T05:46:00.951820+0000","last_active":"2023-07-24T05:46:07.487407+0000","last_peered":"2023-07-24T05:46:07.487407+0000","last_clean":"2023-07-24T05:46:07.487407+0000","last_became_active":"2023-07-24T05:46:00.951559+0000","last_became_peered":"2023-07-24T05:46:00.951559+0000","last_unstale":"2023-07-24T05:46:07.487407+0000","last_undegraded":"2023-07-24T05:46:07.487407+0000","last_fullsized":"2023-07-24T05:46:07.487407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:54:14.788733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.483532+0000","last_change":"2023-07-24T05:45:59.900996+0000","last_active":"2023-07-24T05:46:07.483532+0000","last_peered":"2023-07-24T05:46:07.483532+0000","last_clean":"2023-07-24T05:46:07.483532+0000","last_became_active":"2023-07-24T05:45:59.900724+0000","last_became_peered":"2023-07-24T05:45:59.900724+0000","last_unstale":"2023-07-24T05:46:07.483532+0000","last_undegraded":"2023-07-24T05:46:07.483532+0000","last_fullsized":"2023-07-24T05:46:07.483532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T05:50:54.789729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023915+0000","last_change":"2023-07-24T05:46:05.016680+0000","last_active":"2023-07-24T05:46:06.023915+0000","last_peered":"2023-07-24T05:46:06.023915+0000","last_clean":"2023-07-24T05:46:06.023915+0000","last_became_active":"2023-07-24T05:46:05.016328+0000","last_became_peered":"2023-07-24T05:46:05.016328+0000","last_unstale":"2023-07-24T05:46:06.023915+0000","last_undegraded":"2023-07-24T05:46:06.023915+0000","last_fullsized":"2023-07-24T05:46:06.023915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:23:56.011534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023923+0000","last_change":"2023-07-24T05:46:00.929728+0000","last_active":"2023-07-24T05:46:06.023923+0000","last_peered":"2023-07-24T05:46:06.023923+0000","last_clean":"2023-07-24T05:46:06.023923+0000","last_became_active":"2023-07-24T05:46:00.929370+0000","last_became_peered":"2023-07-24T05:46:00.929370+0000","last_unstale":"2023-07-24T05:46:06.023923+0000","last_undegraded":"2023-07-24T05:46:06.023923+0000","last_fullsized":"2023-07-24T05:46:06.023923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:21:03.638024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.022985+0000","last_change":"2023-07-24T05:45:59.898271+0000","last_active":"2023-07-24T05:46:06.022985+0000","last_peered":"2023-07-24T05:46:06.022985+0000","last_clean":"2023-07-24T05:46:06.022985+0000","last_became_active":"2023-07-24T05:45:59.897886+0000","last_became_peered":"2023-07-24T05:45:59.897886+0000","last_unstale":"2023-07-24T05:46:06.022985+0000","last_undegraded":"2023-07-24T05:46:06.022985+0000","last_fullsized":"2023-07-24T05:46:06.022985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:25:43.491840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486953+0000","last_change":"2023-07-24T05:46:05.028021+0000","last_active":"2023-07-24T05:46:07.486953+0000","last_peered":"2023-07-24T05:46:07.486953+0000","last_clean":"2023-07-24T05:46:07.486953+0000","last_became_active":"2023-07-24T05:46:05.027497+0000","last_became_peered":"2023-07-24T05:46:05.027497+0000","last_unstale":"2023-07-24T05:46:07.486953+0000","last_undegraded":"2023-07-24T05:46:07.486953+0000","last_fullsized":"2023-07-24T05:46:07.486953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:18:59.759729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023787+0000","last_change":"2023-07-24T05:46:00.934906+0000","last_active":"2023-07-24T05:46:06.023787+0000","last_peered":"2023-07-24T05:46:06.023787+0000","last_clean":"2023-07-24T05:46:06.023787+0000","last_became_active":"2023-07-24T05:46:00.934638+0000","last_became_peered":"2023-07-24T05:46:00.934638+0000","last_unstale":"2023-07-24T05:46:06.023787+0000","last_undegraded":"2023-07-24T05:46:06.023787+0000","last_fullsized":"2023-07-24T05:46:06.023787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:41:49.497015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.021959+0000","last_change":"2023-07-24T05:45:59.905289+0000","last_active":"2023-07-24T05:46:06.021959+0000","last_peered":"2023-07-24T05:46:06.021959+0000","last_clean":"2023-07-24T05:46:06.021959+0000","last_became_active":"2023-07-24T05:45:59.904879+0000","last_became_peered":"2023-07-24T05:45:59.904879+0000","last_unstale":"2023-07-24T05:46:06.021959+0000","last_undegraded":"2023-07-24T05:46:06.021959+0000","last_fullsized":"2023-07-24T05:46:06.021959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:27:08.531843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486029+0000","last_change":"2023-07-24T05:46:05.027486+0000","last_active":"2023-07-24T05:46:07.486029+0000","last_peered":"2023-07-24T05:46:07.486029+0000","last_clean":"2023-07-24T05:46:07.486029+0000","last_became_active":"2023-07-24T05:46:05.027085+0000","last_became_peered":"2023-07-24T05:46:05.027085+0000","last_unstale":"2023-07-24T05:46:07.486029+0000","last_undegraded":"2023-07-24T05:46:07.486029+0000","last_fullsized":"2023-07-24T05:46:07.486029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:16:02.948425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023538+0000","last_change":"2023-07-24T05:46:00.934235+0000","last_active":"2023-07-24T05:46:06.023538+0000","last_peered":"2023-07-24T05:46:06.023538+0000","last_clean":"2023-07-24T05:46:06.023538+0000","last_became_active":"2023-07-24T05:46:00.933521+0000","last_became_peered":"2023-07-24T05:46:00.933521+0000","last_unstale":"2023-07-24T05:46:06.023538+0000","last_undegraded":"2023-07-24T05:46:06.023538+0000","last_fullsized":"2023-07-24T05:46:06.023538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:20:03.823702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.484224+0000","last_change":"2023-07-24T05:45:59.908218+0000","last_active":"2023-07-24T05:46:07.484224+0000","last_peered":"2023-07-24T05:46:07.484224+0000","last_clean":"2023-07-24T05:46:07.484224+0000","last_became_active":"2023-07-24T05:45:59.905094+0000","last_became_peered":"2023-07-24T05:45:59.905094+0000","last_unstale":"2023-07-24T05:46:07.484224+0000","last_undegraded":"2023-07-24T05:46:07.484224+0000","last_fullsized":"2023-07-24T05:46:07.484224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:59:25.131271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.018333+0000","last_change":"2023-07-24T05:46:05.014000+0000","last_active":"2023-07-24T05:46:06.018333+0000","last_peered":"2023-07-24T05:46:06.018333+0000","last_clean":"2023-07-24T05:46:06.018333+0000","last_became_active":"2023-07-24T05:46:05.013545+0000","last_became_peered":"2023-07-24T05:46:05.013545+0000","last_unstale":"2023-07-24T05:46:06.018333+0000","last_undegraded":"2023-07-24T05:46:06.018333+0000","last_fullsized":"2023-07-24T05:46:06.018333+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:30:34.177072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.719968+0000","last_change":"2023-07-24T05:46:00.942615+0000","last_active":"2023-07-24T05:46:06.719968+0000","last_peered":"2023-07-24T05:46:06.719968+0000","last_clean":"2023-07-24T05:46:06.719968+0000","last_became_active":"2023-07-24T05:46:00.942343+0000","last_became_peered":"2023-07-24T05:46:00.942343+0000","last_unstale":"2023-07-24T05:46:06.719968+0000","last_undegraded":"2023-07-24T05:46:06.719968+0000","last_fullsized":"2023-07-24T05:46:06.719968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:16:15.816474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486385+0000","last_change":"2023-07-24T05:45:59.904112+0000","last_active":"2023-07-24T05:46:07.486385+0000","last_peered":"2023-07-24T05:46:07.486385+0000","last_clean":"2023-07-24T05:46:07.486385+0000","last_became_active":"2023-07-24T05:45:59.903760+0000","last_became_peered":"2023-07-24T05:45:59.903760+0000","last_unstale":"2023-07-24T05:46:07.486385+0000","last_undegraded":"2023-07-24T05:46:07.486385+0000","last_fullsized":"2023-07-24T05:46:07.486385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:18:09.932761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.017429+0000","last_change":"2023-07-24T05:46:05.014076+0000","last_active":"2023-07-24T05:46:06.017429+0000","last_peered":"2023-07-24T05:46:06.017429+0000","last_clean":"2023-07-24T05:46:06.017429+0000","last_became_active":"2023-07-24T05:46:05.013619+0000","last_became_peered":"2023-07-24T05:46:05.013619+0000","last_unstale":"2023-07-24T05:46:06.017429+0000","last_undegraded":"2023-07-24T05:46:06.017429+0000","last_fullsized":"2023-07-24T05:46:06.017429+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:43:11.918523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.021542+0000","last_change":"2023-07-24T05:46:00.940659+0000","last_active":"2023-07-24T05:46:06.021542+0000","last_peered":"2023-07-24T05:46:06.021542+0000","last_clean":"2023-07-24T05:46:06.021542+0000","last_became_active":"2023-07-24T05:46:00.940369+0000","last_became_peered":"2023-07-24T05:46:00.940369+0000","last_unstale":"2023-07-24T05:46:06.021542+0000","last_undegraded":"2023-07-24T05:46:06.021542+0000","last_fullsized":"2023-07-24T05:46:06.021542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:52:54.919489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.482583+0000","last_change":"2023-07-24T05:45:59.912501+0000","last_active":"2023-07-24T05:46:06.482583+0000","last_peered":"2023-07-24T05:46:06.482583+0000","last_clean":"2023-07-24T05:46:06.482583+0000","last_became_active":"2023-07-24T05:45:59.912147+0000","last_became_peered":"2023-07-24T05:45:59.912147+0000","last_unstale":"2023-07-24T05:46:06.482583+0000","last_undegraded":"2023-07-24T05:46:06.482583+0000","last_fullsized":"2023-07-24T05:46:06.482583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:21:00.823778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.018222+0000","last_change":"2023-07-24T05:46:05.015069+0000","last_active":"2023-07-24T05:46:06.018222+0000","last_peered":"2023-07-24T05:46:06.018222+0000","last_clean":"2023-07-24T05:46:06.018222+0000","last_became_active":"2023-07-24T05:46:05.014697+0000","last_became_peered":"2023-07-24T05:46:05.014697+0000","last_unstale":"2023-07-24T05:46:06.018222+0000","last_undegraded":"2023-07-24T05:46:06.018222+0000","last_fullsized":"2023-07-24T05:46:06.018222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:20:31.902334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.020882+0000","last_change":"2023-07-24T05:46:00.943156+0000","last_active":"2023-07-24T05:46:06.020882+0000","last_peered":"2023-07-24T05:46:06.020882+0000","last_clean":"2023-07-24T05:46:06.020882+0000","last_became_active":"2023-07-24T05:46:00.942833+0000","last_became_peered":"2023-07-24T05:46:00.942833+0000","last_unstale":"2023-07-24T05:46:06.020882+0000","last_undegraded":"2023-07-24T05:46:06.020882+0000","last_fullsized":"2023-07-24T05:46:06.020882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:20:21.843640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.482833+0000","last_change":"2023-07-24T05:45:59.915627+0000","last_active":"2023-07-24T05:46:06.482833+0000","last_peered":"2023-07-24T05:46:06.482833+0000","last_clean":"2023-07-24T05:46:06.482833+0000","last_became_active":"2023-07-24T05:45:59.914637+0000","last_became_peered":"2023-07-24T05:45:59.914637+0000","last_unstale":"2023-07-24T05:46:06.482833+0000","last_undegraded":"2023-07-24T05:46:06.482833+0000","last_fullsized":"2023-07-24T05:46:06.482833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:39:35.102402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.017196+0000","last_change":"2023-07-24T05:46:05.011172+0000","last_active":"2023-07-24T05:46:06.017196+0000","last_peered":"2023-07-24T05:46:06.017196+0000","last_clean":"2023-07-24T05:46:06.017196+0000","last_became_active":"2023-07-24T05:46:05.010777+0000","last_became_peered":"2023-07-24T05:46:05.010777+0000","last_unstale":"2023-07-24T05:46:06.017196+0000","last_undegraded":"2023-07-24T05:46:06.017196+0000","last_fullsized":"2023-07-24T05:46:06.017196+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:26:39.193132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.485649+0000","last_change":"2023-07-24T05:46:00.934405+0000","last_active":"2023-07-24T05:46:07.485649+0000","last_peered":"2023-07-24T05:46:07.485649+0000","last_clean":"2023-07-24T05:46:07.485649+0000","last_became_active":"2023-07-24T05:46:00.934126+0000","last_became_peered":"2023-07-24T05:46:00.934126+0000","last_unstale":"2023-07-24T05:46:07.485649+0000","last_undegraded":"2023-07-24T05:46:07.485649+0000","last_fullsized":"2023-07-24T05:46:07.485649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:05:57.654666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.482743+0000","last_change":"2023-07-24T05:45:59.917679+0000","last_active":"2023-07-24T05:46:06.482743+0000","last_peered":"2023-07-24T05:46:06.482743+0000","last_clean":"2023-07-24T05:46:06.482743+0000","last_became_active":"2023-07-24T05:45:59.917405+0000","last_became_peered":"2023-07-24T05:45:59.917405+0000","last_unstale":"2023-07-24T05:46:06.482743+0000","last_undegraded":"2023-07-24T05:46:06.482743+0000","last_fullsized":"2023-07-24T05:46:06.482743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:34:24.141383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.481505+0000","last_change":"2023-07-24T05:46:05.024741+0000","last_active":"2023-07-24T05:46:06.481505+0000","last_peered":"2023-07-24T05:46:06.481505+0000","last_clean":"2023-07-24T05:46:06.481505+0000","last_became_active":"2023-07-24T05:46:05.024355+0000","last_became_peered":"2023-07-24T05:46:05.024355+0000","last_unstale":"2023-07-24T05:46:06.481505+0000","last_undegraded":"2023-07-24T05:46:06.481505+0000","last_fullsized":"2023-07-24T05:46:06.481505+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:01:06.159423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486150+0000","last_change":"2023-07-24T05:46:05.025607+0000","last_active":"2023-07-24T05:46:07.486150+0000","last_peered":"2023-07-24T05:46:07.486150+0000","last_clean":"2023-07-24T05:46:07.486150+0000","last_became_active":"2023-07-24T05:46:05.025184+0000","last_became_peered":"2023-07-24T05:46:05.025184+0000","last_unstale":"2023-07-24T05:46:07.486150+0000","last_undegraded":"2023-07-24T05:46:07.486150+0000","last_fullsized":"2023-07-24T05:46:07.486150+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:07:04.576293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.020902+0000","last_change":"2023-07-24T05:45:59.893932+0000","last_active":"2023-07-24T05:46:06.020902+0000","last_peered":"2023-07-24T05:46:06.020902+0000","last_clean":"2023-07-24T05:46:06.020902+0000","last_became_active":"2023-07-24T05:45:59.893642+0000","last_became_peered":"2023-07-24T05:45:59.893642+0000","last_unstale":"2023-07-24T05:46:06.020902+0000","last_undegraded":"2023-07-24T05:46:06.020902+0000","last_fullsized":"2023-07-24T05:46:06.020902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:52:27.141526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.484842+0000","last_change":"2023-07-24T05:46:00.945824+0000","last_active":"2023-07-24T05:46:07.484842+0000","last_peered":"2023-07-24T05:46:07.484842+0000","last_clean":"2023-07-24T05:46:07.484842+0000","last_became_active":"2023-07-24T05:46:00.945507+0000","last_became_peered":"2023-07-24T05:46:00.945507+0000","last_unstale":"2023-07-24T05:46:07.484842+0000","last_undegraded":"2023-07-24T05:46:07.484842+0000","last_fullsized":"2023-07-24T05:46:07.484842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:45:28.785621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.484595+0000","last_change":"2023-07-24T05:46:05.012722+0000","last_active":"2023-07-24T05:46:07.484595+0000","last_peered":"2023-07-24T05:46:07.484595+0000","last_clean":"2023-07-24T05:46:07.484595+0000","last_became_active":"2023-07-24T05:46:05.012277+0000","last_became_peered":"2023-07-24T05:46:05.012277+0000","last_unstale":"2023-07-24T05:46:07.484595+0000","last_undegraded":"2023-07-24T05:46:07.484595+0000","last_fullsized":"2023-07-24T05:46:07.484595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:52:02.115068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.481785+0000","last_change":"2023-07-24T05:45:59.917206+0000","last_active":"2023-07-24T05:46:06.481785+0000","last_peered":"2023-07-24T05:46:06.481785+0000","last_clean":"2023-07-24T05:46:06.481785+0000","last_became_active":"2023-07-24T05:45:59.916943+0000","last_became_peered":"2023-07-24T05:45:59.916943+0000","last_unstale":"2023-07-24T05:46:06.481785+0000","last_undegraded":"2023-07-24T05:46:06.481785+0000","last_fullsized":"2023-07-24T05:46:06.481785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:27:17.744313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.720189+0000","last_change":"2023-07-24T05:46:00.936641+0000","last_active":"2023-07-24T05:46:06.720189+0000","last_peered":"2023-07-24T05:46:06.720189+0000","last_clean":"2023-07-24T05:46:06.720189+0000","last_became_active":"2023-07-24T05:46:00.936319+0000","last_became_peered":"2023-07-24T05:46:00.936319+0000","last_unstale":"2023-07-24T05:46:06.720189+0000","last_undegraded":"2023-07-24T05:46:06.720189+0000","last_fullsized":"2023-07-24T05:46:06.720189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:10:55.303833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.719149+0000","last_change":"2023-07-24T05:45:59.900013+0000","last_active":"2023-07-24T05:46:06.719149+0000","last_peered":"2023-07-24T05:46:06.719149+0000","last_clean":"2023-07-24T05:46:06.719149+0000","last_became_active":"2023-07-24T05:45:59.899700+0000","last_became_peered":"2023-07-24T05:45:59.899700+0000","last_unstale":"2023-07-24T05:46:06.719149+0000","last_undegraded":"2023-07-24T05:46:06.719149+0000","last_fullsized":"2023-07-24T05:46:06.719149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:33:29.936263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486499+0000","last_change":"2023-07-24T05:46:00.940858+0000","last_active":"2023-07-24T05:46:07.486499+0000","last_peered":"2023-07-24T05:46:07.486499+0000","last_clean":"2023-07-24T05:46:07.486499+0000","last_became_active":"2023-07-24T05:46:00.940529+0000","last_became_peered":"2023-07-24T05:46:00.940529+0000","last_unstale":"2023-07-24T05:46:07.486499+0000","last_undegraded":"2023-07-24T05:46:07.486499+0000","last_fullsized":"2023-07-24T05:46:07.486499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:15:58.849762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.483911+0000","last_change":"2023-07-24T05:46:05.014910+0000","last_active":"2023-07-24T05:46:07.483911+0000","last_peered":"2023-07-24T05:46:07.483911+0000","last_clean":"2023-07-24T05:46:07.483911+0000","last_became_active":"2023-07-24T05:46:05.014511+0000","last_became_peered":"2023-07-24T05:46:05.014511+0000","last_unstale":"2023-07-24T05:46:07.483911+0000","last_undegraded":"2023-07-24T05:46:07.483911+0000","last_fullsized":"2023-07-24T05:46:07.483911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:34:15.032724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.481980+0000","last_change":"2023-07-24T05:45:59.916266+0000","last_active":"2023-07-24T05:46:06.481980+0000","last_peered":"2023-07-24T05:46:06.481980+0000","last_clean":"2023-07-24T05:46:06.481980+0000","last_became_active":"2023-07-24T05:45:59.914544+0000","last_became_peered":"2023-07-24T05:45:59.914544+0000","last_unstale":"2023-07-24T05:46:06.481980+0000","last_undegraded":"2023-07-24T05:46:06.481980+0000","last_fullsized":"2023-07-24T05:46:06.481980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:33:27.607916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.484475+0000","last_change":"2023-07-24T05:46:00.953089+0000","last_active":"2023-07-24T05:46:07.484475+0000","last_peered":"2023-07-24T05:46:07.484475+0000","last_clean":"2023-07-24T05:46:07.484475+0000","last_became_active":"2023-07-24T05:46:00.952556+0000","last_became_peered":"2023-07-24T05:46:00.952556+0000","last_unstale":"2023-07-24T05:46:07.484475+0000","last_undegraded":"2023-07-24T05:46:07.484475+0000","last_fullsized":"2023-07-24T05:46:07.484475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:17:13.270600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486360+0000","last_change":"2023-07-24T05:46:05.019474+0000","last_active":"2023-07-24T05:46:07.486360+0000","last_peered":"2023-07-24T05:46:07.486360+0000","last_clean":"2023-07-24T05:46:07.486360+0000","last_became_active":"2023-07-24T05:46:05.019086+0000","last_became_peered":"2023-07-24T05:46:05.019086+0000","last_unstale":"2023-07-24T05:46:07.486360+0000","last_undegraded":"2023-07-24T05:46:07.486360+0000","last_fullsized":"2023-07-24T05:46:07.486360+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:09:07.896789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.020739+0000","last_change":"2023-07-24T05:46:00.936747+0000","last_active":"2023-07-24T05:46:06.020739+0000","last_peered":"2023-07-24T05:46:06.020739+0000","last_clean":"2023-07-24T05:46:06.020739+0000","last_became_active":"2023-07-24T05:46:00.936461+0000","last_became_peered":"2023-07-24T05:46:00.936461+0000","last_unstale":"2023-07-24T05:46:06.020739+0000","last_undegraded":"2023-07-24T05:46:06.020739+0000","last_fullsized":"2023-07-24T05:46:06.020739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:55:23.971299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.483640+0000","last_change":"2023-07-24T05:46:00.943313+0000","last_active":"2023-07-24T05:46:07.483640+0000","last_peered":"2023-07-24T05:46:07.483640+0000","last_clean":"2023-07-24T05:46:07.483640+0000","last_became_active":"2023-07-24T05:46:00.943036+0000","last_became_peered":"2023-07-24T05:46:00.943036+0000","last_unstale":"2023-07-24T05:46:07.483640+0000","last_undegraded":"2023-07-24T05:46:07.483640+0000","last_fullsized":"2023-07-24T05:46:07.483640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:00:32.924792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023237+0000","last_change":"2023-07-24T05:46:00.930795+0000","last_active":"2023-07-24T05:46:06.023237+0000","last_peered":"2023-07-24T05:46:06.023237+0000","last_clean":"2023-07-24T05:46:06.023237+0000","last_became_active":"2023-07-24T05:46:00.930447+0000","last_became_peered":"2023-07-24T05:46:00.930447+0000","last_unstale":"2023-07-24T05:46:06.023237+0000","last_undegraded":"2023-07-24T05:46:06.023237+0000","last_fullsized":"2023-07-24T05:46:06.023237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:28:47.348353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.484078+0000","last_change":"2023-07-24T05:46:00.945856+0000","last_active":"2023-07-24T05:46:07.484078+0000","last_peered":"2023-07-24T05:46:07.484078+0000","last_clean":"2023-07-24T05:46:07.484078+0000","last_became_active":"2023-07-24T05:46:00.945620+0000","last_became_peered":"2023-07-24T05:46:00.945620+0000","last_unstale":"2023-07-24T05:46:07.484078+0000","last_undegraded":"2023-07-24T05:46:07.484078+0000","last_fullsized":"2023-07-24T05:46:07.484078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:02:38.151470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486593+0000","last_change":"2023-07-24T05:46:00.946115+0000","last_active":"2023-07-24T05:46:07.486593+0000","last_peered":"2023-07-24T05:46:07.486593+0000","last_clean":"2023-07-24T05:46:07.486593+0000","last_became_active":"2023-07-24T05:46:00.945731+0000","last_became_peered":"2023-07-24T05:46:00.945731+0000","last_unstale":"2023-07-24T05:46:07.486593+0000","last_undegraded":"2023-07-24T05:46:07.486593+0000","last_fullsized":"2023-07-24T05:46:07.486593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:39:17.210783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486565+0000","last_change":"2023-07-24T05:46:00.935106+0000","last_active":"2023-07-24T05:46:07.486565+0000","last_peered":"2023-07-24T05:46:07.486565+0000","last_clean":"2023-07-24T05:46:07.486565+0000","last_became_active":"2023-07-24T05:46:00.934759+0000","last_became_peered":"2023-07-24T05:46:00.934759+0000","last_unstale":"2023-07-24T05:46:07.486565+0000","last_undegraded":"2023-07-24T05:46:07.486565+0000","last_fullsized":"2023-07-24T05:46:07.486565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T05:59:20.619052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.487093+0000","last_change":"2023-07-24T05:46:00.937903+0000","last_active":"2023-07-24T05:46:07.487093+0000","last_peered":"2023-07-24T05:46:07.487093+0000","last_clean":"2023-07-24T05:46:07.487093+0000","last_became_active":"2023-07-24T05:46:00.937520+0000","last_became_peered":"2023-07-24T05:46:00.937520+0000","last_unstale":"2023-07-24T05:46:07.487093+0000","last_undegraded":"2023-07-24T05:46:07.487093+0000","last_fullsized":"2023-07-24T05:46:07.487093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:56:28.386440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.487373+0000","last_change":"2023-07-24T05:46:00.950064+0000","last_active":"2023-07-24T05:46:07.487373+0000","last_peered":"2023-07-24T05:46:07.487373+0000","last_clean":"2023-07-24T05:46:07.487373+0000","last_became_active":"2023-07-24T05:46:00.949415+0000","last_became_peered":"2023-07-24T05:46:00.949415+0000","last_unstale":"2023-07-24T05:46:07.487373+0000","last_undegraded":"2023-07-24T05:46:07.487373+0000","last_fullsized":"2023-07-24T05:46:07.487373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:01:02.060760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.481115+0000","last_change":"2023-07-24T05:46:00.945119+0000","last_active":"2023-07-24T05:46:06.481115+0000","last_peered":"2023-07-24T05:46:06.481115+0000","last_clean":"2023-07-24T05:46:06.481115+0000","last_became_active":"2023-07-24T05:46:00.944813+0000","last_became_peered":"2023-07-24T05:46:00.944813+0000","last_unstale":"2023-07-24T05:46:06.481115+0000","last_undegraded":"2023-07-24T05:46:06.481115+0000","last_fullsized":"2023-07-24T05:46:06.481115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:37:16.770689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.483093+0000","last_change":"2023-07-24T05:46:00.935631+0000","last_active":"2023-07-24T05:46:07.483093+0000","last_peered":"2023-07-24T05:46:07.483093+0000","last_clean":"2023-07-24T05:46:07.483093+0000","last_became_active":"2023-07-24T05:46:00.935367+0000","last_became_peered":"2023-07-24T05:46:00.935367+0000","last_unstale":"2023-07-24T05:46:07.483093+0000","last_undegraded":"2023-07-24T05:46:07.483093+0000","last_fullsized":"2023-07-24T05:46:07.483093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:29:21.153570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.718880+0000","last_change":"2023-07-24T05:46:00.942370+0000","last_active":"2023-07-24T05:46:06.718880+0000","last_peered":"2023-07-24T05:46:06.718880+0000","last_clean":"2023-07-24T05:46:06.718880+0000","last_became_active":"2023-07-24T05:46:00.941928+0000","last_became_peered":"2023-07-24T05:46:00.941928+0000","last_unstale":"2023-07-24T05:46:06.718880+0000","last_undegraded":"2023-07-24T05:46:06.718880+0000","last_fullsized":"2023-07-24T05:46:06.718880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:19:59.555194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.481503+0000","last_change":"2023-07-24T05:46:00.946457+0000","last_active":"2023-07-24T05:46:06.481503+0000","last_peered":"2023-07-24T05:46:06.481503+0000","last_clean":"2023-07-24T05:46:06.481503+0000","last_became_active":"2023-07-24T05:46:00.944937+0000","last_became_peered":"2023-07-24T05:46:00.944937+0000","last_unstale":"2023-07-24T05:46:06.481503+0000","last_undegraded":"2023-07-24T05:46:06.481503+0000","last_fullsized":"2023-07-24T05:46:06.481503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:44:23.859944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023427+0000","last_change":"2023-07-24T05:46:00.934582+0000","last_active":"2023-07-24T05:46:06.023427+0000","last_peered":"2023-07-24T05:46:06.023427+0000","last_clean":"2023-07-24T05:46:06.023427+0000","last_became_active":"2023-07-24T05:46:00.933907+0000","last_became_peered":"2023-07-24T05:46:00.933907+0000","last_unstale":"2023-07-24T05:46:06.023427+0000","last_undegraded":"2023-07-24T05:46:06.023427+0000","last_fullsized":"2023-07-24T05:46:06.023427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:41:12.173555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.018439+0000","last_change":"2023-07-24T05:46:00.928680+0000","last_active":"2023-07-24T05:46:06.018439+0000","last_peered":"2023-07-24T05:46:06.018439+0000","last_clean":"2023-07-24T05:46:06.018439+0000","last_became_active":"2023-07-24T05:46:00.928276+0000","last_became_peered":"2023-07-24T05:46:00.928276+0000","last_unstale":"2023-07-24T05:46:06.018439+0000","last_undegraded":"2023-07-24T05:46:06.018439+0000","last_fullsized":"2023-07-24T05:46:06.018439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:15:26.395482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023672+0000","last_change":"2023-07-24T05:46:00.936679+0000","last_active":"2023-07-24T05:46:06.023672+0000","last_peered":"2023-07-24T05:46:06.023672+0000","last_clean":"2023-07-24T05:46:06.023672+0000","last_became_active":"2023-07-24T05:46:00.936176+0000","last_became_peered":"2023-07-24T05:46:00.936176+0000","last_unstale":"2023-07-24T05:46:06.023672+0000","last_undegraded":"2023-07-24T05:46:06.023672+0000","last_fullsized":"2023-07-24T05:46:06.023672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:46:01.670959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.720022+0000","last_change":"2023-07-24T05:46:00.940299+0000","last_active":"2023-07-24T05:46:06.720022+0000","last_peered":"2023-07-24T05:46:06.720022+0000","last_clean":"2023-07-24T05:46:06.720022+0000","last_became_active":"2023-07-24T05:46:00.940008+0000","last_became_peered":"2023-07-24T05:46:00.940008+0000","last_unstale":"2023-07-24T05:46:06.720022+0000","last_undegraded":"2023-07-24T05:46:06.720022+0000","last_fullsized":"2023-07-24T05:46:06.720022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:07:54.914500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.020567+0000","last_change":"2023-07-24T05:46:00.938329+0000","last_active":"2023-07-24T05:46:06.020567+0000","last_peered":"2023-07-24T05:46:06.020567+0000","last_clean":"2023-07-24T05:46:06.020567+0000","last_became_active":"2023-07-24T05:46:00.938046+0000","last_became_peered":"2023-07-24T05:46:00.938046+0000","last_unstale":"2023-07-24T05:46:06.020567+0000","last_undegraded":"2023-07-24T05:46:06.020567+0000","last_fullsized":"2023-07-24T05:46:06.020567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:26:06.142105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.481708+0000","last_change":"2023-07-24T05:46:00.955136+0000","last_active":"2023-07-24T05:46:06.481708+0000","last_peered":"2023-07-24T05:46:06.481708+0000","last_clean":"2023-07-24T05:46:06.481708+0000","last_became_active":"2023-07-24T05:46:00.954432+0000","last_became_peered":"2023-07-24T05:46:00.954432+0000","last_unstale":"2023-07-24T05:46:06.481708+0000","last_undegraded":"2023-07-24T05:46:06.481708+0000","last_fullsized":"2023-07-24T05:46:06.481708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:59:08.440089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.485847+0000","last_change":"2023-07-24T05:46:00.936021+0000","last_active":"2023-07-24T05:46:07.485847+0000","last_peered":"2023-07-24T05:46:07.485847+0000","last_clean":"2023-07-24T05:46:07.485847+0000","last_became_active":"2023-07-24T05:46:00.935648+0000","last_became_peered":"2023-07-24T05:46:00.935648+0000","last_unstale":"2023-07-24T05:46:07.485847+0000","last_undegraded":"2023-07-24T05:46:07.485847+0000","last_fullsized":"2023-07-24T05:46:07.485847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:04:34.146477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.018120+0000","last_change":"2023-07-24T05:46:00.944450+0000","last_active":"2023-07-24T05:46:06.018120+0000","last_peered":"2023-07-24T05:46:06.018120+0000","last_clean":"2023-07-24T05:46:06.018120+0000","last_became_active":"2023-07-24T05:46:00.943241+0000","last_became_peered":"2023-07-24T05:46:00.943241+0000","last_unstale":"2023-07-24T05:46:06.018120+0000","last_undegraded":"2023-07-24T05:46:06.018120+0000","last_fullsized":"2023-07-24T05:46:06.018120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:53:07.116935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.018724+0000","last_change":"2023-07-24T05:46:00.933437+0000","last_active":"2023-07-24T05:46:06.018724+0000","last_peered":"2023-07-24T05:46:06.018724+0000","last_clean":"2023-07-24T05:46:06.018724+0000","last_became_active":"2023-07-24T05:46:00.933148+0000","last_became_peered":"2023-07-24T05:46:00.933148+0000","last_unstale":"2023-07-24T05:46:06.018724+0000","last_undegraded":"2023-07-24T05:46:06.018724+0000","last_fullsized":"2023-07-24T05:46:06.018724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:43:12.724407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023680+0000","last_change":"2023-07-24T05:46:00.940814+0000","last_active":"2023-07-24T05:46:06.023680+0000","last_peered":"2023-07-24T05:46:06.023680+0000","last_clean":"2023-07-24T05:46:06.023680+0000","last_became_active":"2023-07-24T05:46:00.940490+0000","last_became_peered":"2023-07-24T05:46:00.940490+0000","last_unstale":"2023-07-24T05:46:06.023680+0000","last_undegraded":"2023-07-24T05:46:06.023680+0000","last_fullsized":"2023-07-24T05:46:06.023680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T16:55:24.415034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486791+0000","last_change":"2023-07-24T05:46:00.941947+0000","last_active":"2023-07-24T05:46:07.486791+0000","last_peered":"2023-07-24T05:46:07.486791+0000","last_clean":"2023-07-24T05:46:07.486791+0000","last_became_active":"2023-07-24T05:46:00.941624+0000","last_became_peered":"2023-07-24T05:46:00.941624+0000","last_unstale":"2023-07-24T05:46:07.486791+0000","last_undegraded":"2023-07-24T05:46:07.486791+0000","last_fullsized":"2023-07-24T05:46:07.486791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:18:26.734018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.719673+0000","last_change":"2023-07-24T05:46:00.933586+0000","last_active":"2023-07-24T05:46:06.719673+0000","last_peered":"2023-07-24T05:46:06.719673+0000","last_clean":"2023-07-24T05:46:06.719673+0000","last_became_active":"2023-07-24T05:46:00.933231+0000","last_became_peered":"2023-07-24T05:46:00.933231+0000","last_unstale":"2023-07-24T05:46:06.719673+0000","last_undegraded":"2023-07-24T05:46:06.719673+0000","last_fullsized":"2023-07-24T05:46:06.719673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:35:19.732787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.485426+0000","last_change":"2023-07-24T05:46:00.936425+0000","last_active":"2023-07-24T05:46:07.485426+0000","last_peered":"2023-07-24T05:46:07.485426+0000","last_clean":"2023-07-24T05:46:07.485426+0000","last_became_active":"2023-07-24T05:46:00.936057+0000","last_became_peered":"2023-07-24T05:46:00.936057+0000","last_unstale":"2023-07-24T05:46:07.485426+0000","last_undegraded":"2023-07-24T05:46:07.485426+0000","last_fullsized":"2023-07-24T05:46:07.485426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:17:32.903393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.481478+0000","last_change":"2023-07-24T05:46:00.955358+0000","last_active":"2023-07-24T05:46:06.481478+0000","last_peered":"2023-07-24T05:46:06.481478+0000","last_clean":"2023-07-24T05:46:06.481478+0000","last_became_active":"2023-07-24T05:46:00.954790+0000","last_became_peered":"2023-07-24T05:46:00.954790+0000","last_unstale":"2023-07-24T05:46:06.481478+0000","last_undegraded":"2023-07-24T05:46:06.481478+0000","last_fullsized":"2023-07-24T05:46:06.481478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:21:55.302838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.021627+0000","last_change":"2023-07-24T05:46:00.937697+0000","last_active":"2023-07-24T05:46:06.021627+0000","last_peered":"2023-07-24T05:46:06.021627+0000","last_clean":"2023-07-24T05:46:06.021627+0000","last_became_active":"2023-07-24T05:46:00.937034+0000","last_became_peered":"2023-07-24T05:46:00.937034+0000","last_unstale":"2023-07-24T05:46:06.021627+0000","last_undegraded":"2023-07-24T05:46:06.021627+0000","last_fullsized":"2023-07-24T05:46:06.021627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:39:26.893324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.720200+0000","last_change":"2023-07-24T05:46:00.936120+0000","last_active":"2023-07-24T05:46:06.720200+0000","last_peered":"2023-07-24T05:46:06.720200+0000","last_clean":"2023-07-24T05:46:06.720200+0000","last_became_active":"2023-07-24T05:46:00.935837+0000","last_became_peered":"2023-07-24T05:46:00.935837+0000","last_unstale":"2023-07-24T05:46:06.720200+0000","last_undegraded":"2023-07-24T05:46:06.720200+0000","last_fullsized":"2023-07-24T05:46:06.720200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:57:12.671093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.021362+0000","last_change":"2023-07-24T05:46:00.938400+0000","last_active":"2023-07-24T05:46:06.021362+0000","last_peered":"2023-07-24T05:46:06.021362+0000","last_clean":"2023-07-24T05:46:06.021362+0000","last_became_active":"2023-07-24T05:46:00.938021+0000","last_became_peered":"2023-07-24T05:46:00.938021+0000","last_unstale":"2023-07-24T05:46:06.021362+0000","last_undegraded":"2023-07-24T05:46:06.021362+0000","last_fullsized":"2023-07-24T05:46:06.021362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:50:30.095794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023656+0000","last_change":"2023-07-24T05:46:00.938957+0000","last_active":"2023-07-24T05:46:06.023656+0000","last_peered":"2023-07-24T05:46:06.023656+0000","last_clean":"2023-07-24T05:46:06.023656+0000","last_became_active":"2023-07-24T05:46:00.938684+0000","last_became_peered":"2023-07-24T05:46:00.938684+0000","last_unstale":"2023-07-24T05:46:06.023656+0000","last_undegraded":"2023-07-24T05:46:06.023656+0000","last_fullsized":"2023-07-24T05:46:06.023656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:54:20.745792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486581+0000","last_change":"2023-07-24T05:46:00.954433+0000","last_active":"2023-07-24T05:46:07.486581+0000","last_peered":"2023-07-24T05:46:07.486581+0000","last_clean":"2023-07-24T05:46:07.486581+0000","last_became_active":"2023-07-24T05:46:00.954144+0000","last_became_peered":"2023-07-24T05:46:00.954144+0000","last_unstale":"2023-07-24T05:46:07.486581+0000","last_undegraded":"2023-07-24T05:46:07.486581+0000","last_fullsized":"2023-07-24T05:46:07.486581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:57:39.660342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.018621+0000","last_change":"2023-07-24T05:46:00.943903+0000","last_active":"2023-07-24T05:46:06.018621+0000","last_peered":"2023-07-24T05:46:06.018621+0000","last_clean":"2023-07-24T05:46:06.018621+0000","last_became_active":"2023-07-24T05:46:00.943590+0000","last_became_peered":"2023-07-24T05:46:00.943590+0000","last_unstale":"2023-07-24T05:46:06.018621+0000","last_undegraded":"2023-07-24T05:46:06.018621+0000","last_fullsized":"2023-07-24T05:46:06.018621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:34:19.494683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4591,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":880640,"data_stored":700959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.512}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6060000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4570000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.387}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5580000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":107943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.573}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4179999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.617}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.262}]}]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":107234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2210000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.292}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.375}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.05}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4890000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":111792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3420000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2589999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.391}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.306}]}]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":108033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.167}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.357}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]}]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":107943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.159}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2290000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":107943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.343}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4810000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6559999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5189999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":697532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4910000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.288}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.407}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.22}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-24T05:46:29.196 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-24T05:46:29.197 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-07-24T05:46:29.197 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-07-24T05:46:29.197 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-07-24T05:46:29.198 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-07-24T05:46:29.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.402+0000 7f3c45645700 1 Processor -- start 2023-07-24T05:46:29.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.402+0000 7f3c45645700 1 -- start start 2023-07-24T05:46:29.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.406+0000 7f3c45645700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c400cdb30 0x7f3c400ca340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:29.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.406+0000 7f3c45645700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3c400cdf10 0x7f3c400ca880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:29.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.406+0000 7f3c45645700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c400c2b10 con 0x7f3c400b2300 2023-07-24T05:46:29.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.406+0000 7f3c45645700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c400c3320 con 0x7f3c400cdf10 2023-07-24T05:46:29.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.406+0000 7f3c45645700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c400c2d60 con 0x7f3c400cdb30 2023-07-24T05:46:29.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.406+0000 7f3c367fc700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3c400cdf10 0x7f3c400ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:29.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.406+0000 7f3c367fc700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3c400cdf10 0x7f3c400ca880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58654/0 (socket says 172.21.15.77:58654) 2023-07-24T05:46:29.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.406+0000 7f3c367fc700 1 -- 172.21.15.77:0/3243399582 learned_addr learned my addr 172.21.15.77:0/3243399582 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:29.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.406+0000 7f3c3effd700 1 --2- 172.21.15.77:0/3243399582 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c400cdb30 0x7f3c400ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:29.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.406+0000 7f3c367fc700 1 -- 172.21.15.77:0/3243399582 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c400cdb30 msgr2=0x7f3c400ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:29.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.406+0000 7f3c367fc700 1 --2- 172.21.15.77:0/3243399582 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c400cdb30 0x7f3c400ca340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:29.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.406+0000 7f3c367fc700 1 -- 172.21.15.77:0/3243399582 >> v1:172.21.15.77:6789/0 conn(0x7f3c400b2300 legacy=0x7f3c401650a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:29.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.406+0000 7f3c367fc700 1 -- 172.21.15.77:0/3243399582 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c400c3040 con 0x7f3c400cdf10 2023-07-24T05:46:29.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.406+0000 7f3c3e7fc700 1 -- 172.21.15.77:0/3243399582 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2336486413 0 0) 0x7f3c400c2b10 con 0x7f3c400b2300 2023-07-24T05:46:29.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.406+0000 7f3c367fc700 1 --2- 172.21.15.77:0/3243399582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c400cdf10 0x7f3c400ca880 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3c28009910 tx=0x7f3c28009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c89b64c0017cbdc3 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:29.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.410+0000 7f3c3e7fc700 1 -- 172.21.15.77:0/3243399582 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c28011830 con 0x7f3c400cdf10 2023-07-24T05:46:29.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.410+0000 7f3c3e7fc700 1 -- 172.21.15.77:0/3243399582 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c28011990 con 0x7f3c400cdf10 2023-07-24T05:46:29.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.410+0000 7f3c3e7fc700 1 -- 172.21.15.77:0/3243399582 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c28011d40 con 0x7f3c400cdf10 2023-07-24T05:46:29.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.410+0000 7f3c45645700 1 -- 172.21.15.77:0/3243399582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c400cdf10 msgr2=0x7f3c400ca880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:29.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.410+0000 7f3c45645700 1 --2- 172.21.15.77:0/3243399582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c400cdf10 0x7f3c400ca880 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3c28009910 tx=0x7f3c28009c20 comp rx=0 tx=0).stop 2023-07-24T05:46:29.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.410+0000 7f3c45645700 1 -- 172.21.15.77:0/3243399582 shutdown_connections 2023-07-24T05:46:29.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.410+0000 7f3c45645700 1 --2- 172.21.15.77:0/3243399582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c400cdf10 0x7f3c400ca880 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:29.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.410+0000 7f3c45645700 1 --2- 172.21.15.77:0/3243399582 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c400cdb30 0x7f3c400ca340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:29.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.410+0000 7f3c45645700 1 -- 172.21.15.77:0/3243399582 >> 172.21.15.77:0/3243399582 conn(0x7f3c400b17e0 msgr2=0x7f3c400b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:29.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.410+0000 7f3c45645700 1 -- 172.21.15.77:0/3243399582 shutdown_connections 2023-07-24T05:46:29.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.410+0000 7f3c45645700 1 -- 172.21.15.77:0/3243399582 wait complete. 2023-07-24T05:46:29.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.414+0000 7f3c45645700 1 Processor -- start 2023-07-24T05:46:29.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.414+0000 7f3c45645700 1 -- start start 2023-07-24T05:46:29.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.414+0000 7f3c45645700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c400b2300 0x7f3c401f65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:29.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.414+0000 7f3c45645700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c400cdb30 0x7f3c4015eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:29.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.414+0000 7f3c45645700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c400cdf10 0x7f3c400c20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:29.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.414+0000 7f3c45645700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c40161ad0 con 0x7f3c400cdf10 2023-07-24T05:46:29.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.414+0000 7f3c45645700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c40161db0 con 0x7f3c400b2300 2023-07-24T05:46:29.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.414+0000 7f3c45645700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c40162090 con 0x7f3c400cdb30 2023-07-24T05:46:29.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.414+0000 7f3c3ffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c400cdf10 0x7f3c400c20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:29.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.414+0000 7f3c3effd700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c400b2300 0x7f3c401f65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:29.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.414+0000 7f3c3ffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c400cdf10 0x7f3c400c20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58670/0 (socket says 172.21.15.77:58670) 2023-07-24T05:46:29.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.414+0000 7f3c3ffff700 1 -- 172.21.15.77:0/1927431272 learned_addr learned my addr 172.21.15.77:0/1927431272 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:29.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.414+0000 7f3c3effd700 1 --2- 172.21.15.77:0/1927431272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c400b2300 0x7f3c401f65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:33878/0 (socket says 172.21.15.77:33878) 2023-07-24T05:46:29.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.414+0000 7f3c367fc700 1 --2- 172.21.15.77:0/1927431272 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c400cdb30 0x7f3c4015eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:29.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.414+0000 7f3c3ffff700 1 -- 172.21.15.77:0/1927431272 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c400cdb30 msgr2=0x7f3c4015eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:29.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.414+0000 7f3c3ffff700 1 --2- 172.21.15.77:0/1927431272 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c400cdb30 0x7f3c4015eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:29.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.414+0000 7f3c3ffff700 1 -- 172.21.15.77:0/1927431272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c400b2300 msgr2=0x7f3c401f65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:29.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.414+0000 7f3c3ffff700 1 --2- 172.21.15.77:0/1927431272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c400b2300 0x7f3c401f65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:29.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.414+0000 7f3c3ffff700 1 -- 172.21.15.77:0/1927431272 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c28009570 con 0x7f3c400cdf10 2023-07-24T05:46:29.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.414+0000 7f3c3ffff700 1 --2- 172.21.15.77:0/1927431272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c400cdf10 0x7f3c400c20c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3c3800cc10 tx=0x7f3c3800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:29.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.414+0000 7f3c37fff700 1 -- 172.21.15.77:0/1927431272 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c38003e50 con 0x7f3c400cdf10 2023-07-24T05:46:29.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.414+0000 7f3c37fff700 1 -- 172.21.15.77:0/1927431272 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3800a650 con 0x7f3c400cdf10 2023-07-24T05:46:29.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.414+0000 7f3c45645700 1 -- 172.21.15.77:0/1927431272 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c40162370 con 0x7f3c400cdf10 2023-07-24T05:46:29.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.418+0000 7f3c37fff700 1 -- 172.21.15.77:0/1927431272 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3800aa00 con 0x7f3c400cdf10 2023-07-24T05:46:29.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.418+0000 7f3c45645700 1 -- 172.21.15.77:0/1927431272 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c4015f400 con 0x7f3c400cdf10 2023-07-24T05:46:29.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.418+0000 7f3c45645700 1 -- 172.21.15.77:0/1927431272 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c40162890 con 0x7f3c400cdf10 2023-07-24T05:46:29.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.418+0000 7f3c37fff700 1 -- 172.21.15.77:0/1927431272 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3c3800ab60 con 0x7f3c400cdf10 2023-07-24T05:46:29.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.422+0000 7f3c37fff700 1 --2- 172.21.15.77:0/1927431272 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3c240662f0 0x7f3c240687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:29.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.422+0000 7f3c37fff700 1 -- 172.21.15.77:0/1927431272 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3c380839f0 con 0x7f3c400cdf10 2023-07-24T05:46:29.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.422+0000 7f3c3effd700 1 --2- 172.21.15.77:0/1927431272 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3c240662f0 0x7f3c240687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:29.427 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.422+0000 7f3c3effd700 1 --2- 172.21.15.77:0/1927431272 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3c240662f0 0x7f3c240687b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3c30009b50 tx=0x7f3c30009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:29.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.426+0000 7f3c37fff700 1 -- 172.21.15.77:0/1927431272 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3c38050b70 con 0x7f3c400cdf10 2023-07-24T05:46:29.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.638+0000 7f3c45645700 1 -- 172.21.15.77:0/1927431272 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f3c4004df10 con 0x7f3c400cdf10 2023-07-24T05:46:29.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.642+0000 7f3c37fff700 1 -- 172.21.15.77:0/1927431272 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164248 (secure 0 0 0) 0x7f3c38054190 con 0x7f3c400cdf10 2023-07-24T05:46:29.649 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:46:29.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.650+0000 7f3c45645700 1 -- 172.21.15.77:0/1927431272 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3c240662f0 msgr2=0x7f3c240687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:29.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.650+0000 7f3c45645700 1 --2- 172.21.15.77:0/1927431272 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3c240662f0 0x7f3c240687b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3c30009b50 tx=0x7f3c30009240 comp rx=0 tx=0).stop 2023-07-24T05:46:29.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.650+0000 7f3c45645700 1 -- 172.21.15.77:0/1927431272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c400cdf10 msgr2=0x7f3c400c20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:29.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.650+0000 7f3c45645700 1 --2- 172.21.15.77:0/1927431272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c400cdf10 0x7f3c400c20c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3c3800cc10 tx=0x7f3c3800cf20 comp rx=0 tx=0).stop 2023-07-24T05:46:29.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.650+0000 7f3c45645700 1 -- 172.21.15.77:0/1927431272 shutdown_connections 2023-07-24T05:46:29.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.650+0000 7f3c45645700 1 --2- 172.21.15.77:0/1927431272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c400cdf10 0x7f3c400c20c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:29.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.650+0000 7f3c45645700 1 --2- 172.21.15.77:0/1927431272 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3c240662f0 0x7f3c240687b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:29.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.650+0000 7f3c45645700 1 --2- 172.21.15.77:0/1927431272 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c400cdb30 0x7f3c4015eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:29.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.650+0000 7f3c45645700 1 --2- 172.21.15.77:0/1927431272 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c400b2300 0x7f3c401f65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:29.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.650+0000 7f3c45645700 1 -- 172.21.15.77:0/1927431272 >> 172.21.15.77:0/1927431272 conn(0x7f3c400b17e0 msgr2=0x7f3c4006aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:29.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.650+0000 7f3c45645700 1 -- 172.21.15.77:0/1927431272 shutdown_connections 2023-07-24T05:46:29.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.650+0000 7f3c45645700 1 -- 172.21.15.77:0/1927431272 wait complete. 2023-07-24T05:46:29.675 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":5,"active_gid":4108,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":1305366540},{"type":"v1","addr":"172.21.15.103:6833","nonce":1305366540}]},"active_addr":"172.21.15.103:6833/1305366540","active_change":"2023-07-24T05:45:46.501422+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4101,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":2267098293}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":373504990}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":1362477259}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":1252516496}]}]} 2023-07-24T05:46:29.679 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-07-24T05:46:29.680 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-07-24T05:46:29.680 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-24T05:46:29.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.846+0000 7fef79a7b700 1 Processor -- start 2023-07-24T05:46:29.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.846+0000 7fef79a7b700 1 -- start start 2023-07-24T05:46:29.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.850+0000 7fef79a7b700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fef740c9bd0 0x7fef74163c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:29.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.850+0000 7fef79a7b700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef7406b460 con 0x7fef740b1fb0 2023-07-24T05:46:29.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.850+0000 7fef79a7b700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef7406a930 con 0x7fef740b1090 2023-07-24T05:46:29.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.850+0000 7fef79a7b700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef740c1bf0 con 0x7fef740c9bd0 2023-07-24T05:46:29.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.850+0000 7fef78a79700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fef740b1fb0 0x7fef74069b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57096/0 (socket says 172.21.15.77:57096) 2023-07-24T05:46:29.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.850+0000 7fef78a79700 1 -- 172.21.15.77:0/282721652 learned_addr learned my addr 172.21.15.77:0/282721652 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:29.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.850+0000 7fef7927a700 1 --2- 172.21.15.77:0/282721652 >> v2:172.21.15.77:3300/0 conn(0x7fef740c9bd0 0x7fef74163c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:29.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.850+0000 7fef7927a700 1 -- 172.21.15.77:0/282721652 >> v1:172.21.15.103:6789/0 conn(0x7fef740b1090 legacy=0x7fef7406a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:29.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.850+0000 7fef737fe700 1 -- 172.21.15.77:0/282721652 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 766176154 0 0) 0x7fef7406b460 con 0x7fef740b1fb0 2023-07-24T05:46:29.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.850+0000 7fef7927a700 1 -- 172.21.15.77:0/282721652 >> v1:172.21.15.77:6789/0 conn(0x7fef740b1fb0 legacy=0x7fef74069b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:29.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.850+0000 7fef7927a700 1 -- 172.21.15.77:0/282721652 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef740cd820 con 0x7fef740c9bd0 2023-07-24T05:46:29.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.850+0000 7fef7927a700 1 --2- 172.21.15.77:0/282721652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef740c9bd0 0x7fef74163c20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fef6c00a9f0 tx=0x7fef6c00ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7d45090289bb2f7 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:29.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.850+0000 7fef737fe700 1 -- 172.21.15.77:0/282721652 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c00cb70 con 0x7fef740c9bd0 2023-07-24T05:46:29.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.850+0000 7fef737fe700 1 -- 172.21.15.77:0/282721652 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6c00ccd0 con 0x7fef740c9bd0 2023-07-24T05:46:29.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.850+0000 7fef737fe700 1 -- 172.21.15.77:0/282721652 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c018620 con 0x7fef740c9bd0 2023-07-24T05:46:29.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.850+0000 7fef79a7b700 1 -- 172.21.15.77:0/282721652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef740c9bd0 msgr2=0x7fef74163c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:29.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.850+0000 7fef79a7b700 1 --2- 172.21.15.77:0/282721652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef740c9bd0 0x7fef74163c20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fef6c00a9f0 tx=0x7fef6c00ad00 comp rx=0 tx=0).stop 2023-07-24T05:46:29.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.850+0000 7fef79a7b700 1 -- 172.21.15.77:0/282721652 shutdown_connections 2023-07-24T05:46:29.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.850+0000 7fef79a7b700 1 --2- 172.21.15.77:0/282721652 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef740c9bd0 0x7fef74163c20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:29.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.850+0000 7fef79a7b700 1 -- 172.21.15.77:0/282721652 >> 172.21.15.77:0/282721652 conn(0x7fef740cacc0 msgr2=0x7fef740cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:29.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.854+0000 7fef79a7b700 1 -- 172.21.15.77:0/282721652 shutdown_connections 2023-07-24T05:46:29.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.854+0000 7fef79a7b700 1 -- 172.21.15.77:0/282721652 wait complete. 2023-07-24T05:46:29.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.854+0000 7fef79a7b700 1 Processor -- start 2023-07-24T05:46:29.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.854+0000 7fef79a7b700 1 -- start start 2023-07-24T05:46:29.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.854+0000 7fef79a7b700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef740b1090 0x7fef74156970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:29.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.854+0000 7fef79a7b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef740b1fb0 0x7fef740989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:29.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.854+0000 7fef79a7b700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fef740c9bd0 0x7fef74156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:29.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.854+0000 7fef79a7b700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef740c28f0 con 0x7fef740b1fb0 2023-07-24T05:46:29.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.854+0000 7fef79a7b700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef740c2bd0 con 0x7fef740b1090 2023-07-24T05:46:29.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.854+0000 7fef79a7b700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef740c2eb0 con 0x7fef740c9bd0 2023-07-24T05:46:29.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.854+0000 7fef73fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef740b1fb0 0x7fef740989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:29.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.858+0000 7fef73fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef740b1fb0 0x7fef740989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58686/0 (socket says 172.21.15.77:58686) 2023-07-24T05:46:29.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.858+0000 7fef73fff700 1 -- 172.21.15.77:0/2947416050 learned_addr learned my addr 172.21.15.77:0/2947416050 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:29.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.858+0000 7fef78a79700 1 --2- 172.21.15.77:0/2947416050 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef740b1090 0x7fef74156970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:29.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.858+0000 7fef7927a700 1 --2- 172.21.15.77:0/2947416050 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fef740c9bd0 0x7fef74156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:29.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.858+0000 7fef73fff700 1 -- 172.21.15.77:0/2947416050 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fef740c9bd0 msgr2=0x7fef74156300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:29.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.858+0000 7fef73fff700 1 --2- 172.21.15.77:0/2947416050 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fef740c9bd0 0x7fef74156300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:29.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.858+0000 7fef73fff700 1 -- 172.21.15.77:0/2947416050 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef740b1090 msgr2=0x7fef74156970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:29.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.858+0000 7fef73fff700 1 --2- 172.21.15.77:0/2947416050 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef740b1090 0x7fef74156970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:29.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.858+0000 7fef73fff700 1 -- 172.21.15.77:0/2947416050 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6c00a650 con 0x7fef740b1fb0 2023-07-24T05:46:29.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.858+0000 7fef73fff700 1 --2- 172.21.15.77:0/2947416050 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef740b1fb0 0x7fef740989f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fef6800c500 tx=0x7fef6800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:29.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.858+0000 7fef717fa700 1 -- 172.21.15.77:0/2947416050 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef680052d0 con 0x7fef740b1fb0 2023-07-24T05:46:29.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.858+0000 7fef717fa700 1 -- 172.21.15.77:0/2947416050 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef68005430 con 0x7fef740b1fb0 2023-07-24T05:46:29.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.858+0000 7fef79a7b700 1 -- 172.21.15.77:0/2947416050 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef740c3190 con 0x7fef740b1fb0 2023-07-24T05:46:29.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.858+0000 7fef717fa700 1 -- 172.21.15.77:0/2947416050 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef680055a0 con 0x7fef740b1fb0 2023-07-24T05:46:29.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.858+0000 7fef79a7b700 1 -- 172.21.15.77:0/2947416050 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef740c7d80 con 0x7fef740b1fb0 2023-07-24T05:46:29.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.858+0000 7fef79a7b700 1 -- 172.21.15.77:0/2947416050 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef740c36b0 con 0x7fef740b1fb0 2023-07-24T05:46:29.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.862+0000 7fef717fa700 1 -- 172.21.15.77:0/2947416050 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fef680038e0 con 0x7fef740b1fb0 2023-07-24T05:46:29.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.862+0000 7fef717fa700 1 --2- 172.21.15.77:0/2947416050 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fef60066320 0x7fef600687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:29.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.862+0000 7fef717fa700 1 -- 172.21.15.77:0/2947416050 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fef680834c0 con 0x7fef740b1fb0 2023-07-24T05:46:29.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.862+0000 7fef78a79700 1 --2- 172.21.15.77:0/2947416050 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fef60066320 0x7fef600687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:29.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.866+0000 7fef78a79700 1 --2- 172.21.15.77:0/2947416050 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fef60066320 0x7fef600687e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fef640012e0 tx=0x7fef64001930 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:29.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:29.866+0000 7fef717fa700 1 -- 172.21.15.77:0/2947416050 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fef740c36b0 con 0x7fef740b1fb0 2023-07-24T05:46:30.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.038+0000 7fef79a7b700 1 -- 172.21.15.77:0/2947416050 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef740c36b0 con 0x7fef740b1fb0 2023-07-24T05:46:30.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.042+0000 7fef717fa700 1 -- 172.21.15.77:0/2947416050 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20108 (secure 0 0 0) 0x7fef740c36b0 con 0x7fef740b1fb0 2023-07-24T05:46:30.047 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:46:30.047 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":25,"fsid":"5aed5f7b-fb55-4d95-9c02-c6adbb1677b4","created":"2023-07-24T05:45:39.639731+0000","modified":"2023-07-24T05:46:05.445306+0000","last_up_change":"2023-07-24T05:45:52.319670+0000","last_in_change":"2023-07-24T05:45:43.643277+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-24T05:45:52.610430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-24T05:45:52.773787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-24T05:45:58.121732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-24T05:45:59.368726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-24T05:46:03.032057+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ffa0d496-461a-4053-b764-0627d969521b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6812","nonce":825987196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6817","nonce":825987196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6831","nonce":825987196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6824","nonce":825987196}]},"public_addr":"172.21.15.77:6812/825987196","cluster_addr":"172.21.15.77:6817/825987196","heartbeat_back_addr":"172.21.15.77:6831/825987196","heartbeat_front_addr":"172.21.15.77:6824/825987196","state":["exists","up"]},{"osd":1,"uuid":"9f595e5e-5c43-49bc-8ce4-ee70575c90da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6801","nonce":4133026815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6803","nonce":4133026815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6807","nonce":4133026815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6805","nonce":4133026815}]},"public_addr":"172.21.15.77:6801/4133026815","cluster_addr":"172.21.15.77:6803/4133026815","heartbeat_back_addr":"172.21.15.77:6807/4133026815","heartbeat_front_addr":"172.21.15.77:6805/4133026815","state":["exists","up"]},{"osd":2,"uuid":"2ac177aa-4d7d-4262-bd54-d2b9f29f4c3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6811","nonce":2394142159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6819","nonce":2394142159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6830","nonce":2394142159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6825","nonce":2394142159}]},"public_addr":"172.21.15.77:6811/2394142159","cluster_addr":"172.21.15.77:6819/2394142159","heartbeat_back_addr":"172.21.15.77:6830/2394142159","heartbeat_front_addr":"172.21.15.77:6825/2394142159","state":["exists","up"]},{"osd":3,"uuid":"17d7a251-19e8-484c-8172-a578ab3da153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6813","nonce":1492113982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6818","nonce":1492113982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6829","nonce":1492113982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6823","nonce":1492113982}]},"public_addr":"172.21.15.77:6813/1492113982","cluster_addr":"172.21.15.77:6818/1492113982","heartbeat_back_addr":"172.21.15.77:6829/1492113982","heartbeat_front_addr":"172.21.15.77:6823/1492113982","state":["exists","up"]},{"osd":4,"uuid":"bf63ca05-f06d-4e0f-ac44-2a416c70b919","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6825","nonce":1080481057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6827","nonce":1080481057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6831","nonce":1080481057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6829","nonce":1080481057}]},"public_addr":"172.21.15.103:6825/1080481057","cluster_addr":"172.21.15.103:6827/1080481057","heartbeat_back_addr":"172.21.15.103:6831/1080481057","heartbeat_front_addr":"172.21.15.103:6829/1080481057","state":["exists","up"]},{"osd":5,"uuid":"65a11a35-9e9f-4b3c-9fe3-b658d62b9318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6811","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6813","nonce":2756677504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6818","nonce":2756677504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6823","nonce":2756677504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6821","nonce":2756677504}]},"public_addr":"172.21.15.103:6813/2756677504","cluster_addr":"172.21.15.103:6818/2756677504","heartbeat_back_addr":"172.21.15.103:6823/2756677504","heartbeat_front_addr":"172.21.15.103:6821/2756677504","state":["exists","up"]},{"osd":6,"uuid":"750c1f87-686c-40b4-94a1-1a299dc78f3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6809","nonce":568977764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6812","nonce":568977764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6819","nonce":568977764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6815","nonce":568977764}]},"public_addr":"172.21.15.103:6809/568977764","cluster_addr":"172.21.15.103:6812/568977764","heartbeat_back_addr":"172.21.15.103:6819/568977764","heartbeat_front_addr":"172.21.15.103:6815/568977764","state":["exists","up"]},{"osd":7,"uuid":"d5fe4fb6-2e09-4158-885b-403803c85822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6801","nonce":1074557176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6803","nonce":1074557176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6807","nonce":1074557176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6805","nonce":1074557176}]},"public_addr":"172.21.15.103:6801/1074557176","cluster_addr":"172.21.15.103:6803/1074557176","heartbeat_back_addr":"172.21.15.103:6807/1074557176","heartbeat_front_addr":"172.21.15.103:6805/1074557176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.631032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.154109+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.398587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.679089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.311218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.353726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.314372+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.126212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-24T05:46:30.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.046+0000 7fef79a7b700 1 -- 172.21.15.77:0/2947416050 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fef60066320 msgr2=0x7fef600687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.046+0000 7fef79a7b700 1 --2- 172.21.15.77:0/2947416050 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fef60066320 0x7fef600687e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fef640012e0 tx=0x7fef64001930 comp rx=0 tx=0).stop 2023-07-24T05:46:30.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.046+0000 7fef79a7b700 1 -- 172.21.15.77:0/2947416050 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef740b1fb0 msgr2=0x7fef740989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.051 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.046+0000 7fef79a7b700 1 --2- 172.21.15.77:0/2947416050 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef740b1fb0 0x7fef740989f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fef6800c500 tx=0x7fef6800c8c0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.046+0000 7fef79a7b700 1 -- 172.21.15.77:0/2947416050 shutdown_connections 2023-07-24T05:46:30.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.046+0000 7fef79a7b700 1 --2- 172.21.15.77:0/2947416050 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fef60066320 0x7fef600687e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.046+0000 7fef79a7b700 1 --2- 172.21.15.77:0/2947416050 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fef740c9bd0 0x7fef74156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.046+0000 7fef79a7b700 1 --2- 172.21.15.77:0/2947416050 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef740b1fb0 0x7fef740989f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.046+0000 7fef79a7b700 1 --2- 172.21.15.77:0/2947416050 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef740b1090 0x7fef74156970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.046+0000 7fef79a7b700 1 -- 172.21.15.77:0/2947416050 >> 172.21.15.77:0/2947416050 conn(0x7fef740cacc0 msgr2=0x7fef740cc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:30.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.046+0000 7fef79a7b700 1 -- 172.21.15.77:0/2947416050 shutdown_connections 2023-07-24T05:46:30.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.046+0000 7fef79a7b700 1 -- 172.21.15.77:0/2947416050 wait complete. 2023-07-24T05:46:30.073 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-07-24T05:46:30.074 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-24T05:46:30.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.238+0000 7ff74faa2700 1 Processor -- start 2023-07-24T05:46:30.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.238+0000 7ff74faa2700 1 -- start start 2023-07-24T05:46:30.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.242+0000 7ff74faa2700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff748160350 0x7ff7480ad870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.242+0000 7ff74faa2700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff7480ad320 0x7ff7480c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.242+0000 7ff74faa2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff74806ccf0 0x7ff74806d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.242+0000 7ff74faa2700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7480ccc20 con 0x7ff748160350 2023-07-24T05:46:30.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.242+0000 7ff74faa2700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff74806d6c0 con 0x7ff74806ccf0 2023-07-24T05:46:30.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.242+0000 7ff74faa2700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7480cb870 con 0x7ff7480ad320 2023-07-24T05:46:30.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.242+0000 7ff74d83e700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff748160350 0x7ff7480ad870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.242+0000 7ff74d83e700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff748160350 0x7ff7480ad870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58702/0 (socket says 172.21.15.77:58702) 2023-07-24T05:46:30.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.242+0000 7ff74d83e700 1 -- 172.21.15.77:0/150487376 learned_addr learned my addr 172.21.15.77:0/150487376 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:30.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.242+0000 7ff74e03f700 1 --2- 172.21.15.77:0/150487376 >> v2:172.21.15.103:3300/0 conn(0x7ff74806ccf0 0x7ff74806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.242+0000 7ff74d03d700 1 --2- 172.21.15.77:0/150487376 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff7480ad320 0x7ff7480c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.242+0000 7ff74d83e700 1 -- 172.21.15.77:0/150487376 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff7480ad320 msgr2=0x7ff7480c8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:30.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.242+0000 7ff74d83e700 1 --2- 172.21.15.77:0/150487376 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff7480ad320 0x7ff7480c8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.242+0000 7ff74d83e700 1 -- 172.21.15.77:0/150487376 >> v2:172.21.15.103:3300/0 conn(0x7ff74806ccf0 msgr2=0x7ff74806d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:30.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.242+0000 7ff74d83e700 1 --2- 172.21.15.77:0/150487376 >> v2:172.21.15.103:3300/0 conn(0x7ff74806ccf0 0x7ff74806d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.242+0000 7ff74d83e700 1 -- 172.21.15.77:0/150487376 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7480cac60 con 0x7ff748160350 2023-07-24T05:46:30.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.242+0000 7ff74e03f700 1 --2- 172.21.15.77:0/150487376 >> v2:172.21.15.103:3300/0 conn(0x7ff74806ccf0 0x7ff74806d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:46:30.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.242+0000 7ff74d03d700 1 --2- 172.21.15.77:0/150487376 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff7480ad320 0x7ff7480c8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:46:30.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.242+0000 7ff74d83e700 1 --2- 172.21.15.77:0/150487376 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff748160350 0x7ff7480ad870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff74806fde0 tx=0x7ff744009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b09ad35846f31d2 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:30.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.242+0000 7ff74c83c700 1 -- 172.21.15.77:0/150487376 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff744005e50 con 0x7ff748160350 2023-07-24T05:46:30.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.242+0000 7ff74c83c700 1 -- 172.21.15.77:0/150487376 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff744006030 con 0x7ff748160350 2023-07-24T05:46:30.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.242+0000 7ff74c83c700 1 -- 172.21.15.77:0/150487376 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7440063c0 con 0x7ff748160350 2023-07-24T05:46:30.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.246+0000 7ff74faa2700 1 -- 172.21.15.77:0/150487376 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff748160350 msgr2=0x7ff7480ad870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.246+0000 7ff74faa2700 1 --2- 172.21.15.77:0/150487376 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff748160350 0x7ff7480ad870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff74806fde0 tx=0x7ff744009bf0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.246+0000 7ff74faa2700 1 -- 172.21.15.77:0/150487376 shutdown_connections 2023-07-24T05:46:30.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.246+0000 7ff74faa2700 1 --2- 172.21.15.77:0/150487376 >> v2:172.21.15.103:3300/0 conn(0x7ff74806ccf0 0x7ff74806d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.246+0000 7ff74faa2700 1 --2- 172.21.15.77:0/150487376 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff7480ad320 0x7ff7480c8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.246+0000 7ff74faa2700 1 --2- 172.21.15.77:0/150487376 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff748160350 0x7ff7480ad870 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.246+0000 7ff74faa2700 1 -- 172.21.15.77:0/150487376 >> 172.21.15.77:0/150487376 conn(0x7ff7480ce410 msgr2=0x7ff7480ce7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:30.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.246+0000 7ff74faa2700 1 -- 172.21.15.77:0/150487376 shutdown_connections 2023-07-24T05:46:30.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.246+0000 7ff74faa2700 1 -- 172.21.15.77:0/150487376 wait complete. 2023-07-24T05:46:30.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.250+0000 7ff74faa2700 1 Processor -- start 2023-07-24T05:46:30.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.250+0000 7ff74faa2700 1 -- start start 2023-07-24T05:46:30.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.250+0000 7ff74faa2700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff74806ccf0 0x7ff748152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.250+0000 7ff74faa2700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7480ad320 0x7ff74806fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.250+0000 7ff74faa2700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff748160350 0x7ff7480703e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.250+0000 7ff74faa2700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7481527b0 con 0x7ff74806ccf0 2023-07-24T05:46:30.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.250+0000 7ff74faa2700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7480c1cf0 con 0x7ff7480ad320 2023-07-24T05:46:30.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.250+0000 7ff74faa2700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7480c1f90 con 0x7ff748160350 2023-07-24T05:46:30.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.250+0000 7ff74d83e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff74806ccf0 0x7ff748152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.250+0000 7ff74d83e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff74806ccf0 0x7ff748152270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58714/0 (socket says 172.21.15.77:58714) 2023-07-24T05:46:30.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.250+0000 7ff74d83e700 1 -- 172.21.15.77:0/3067287864 learned_addr learned my addr 172.21.15.77:0/3067287864 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:30.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.250+0000 7ff74d03d700 1 --2- 172.21.15.77:0/3067287864 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7480ad320 0x7ff74806fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.250+0000 7ff74e03f700 1 --2- 172.21.15.77:0/3067287864 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff748160350 0x7ff7480703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.250+0000 7ff74d83e700 1 -- 172.21.15.77:0/3067287864 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff748160350 msgr2=0x7ff7480703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.250+0000 7ff74d83e700 1 --2- 172.21.15.77:0/3067287864 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff748160350 0x7ff7480703e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.250+0000 7ff74d83e700 1 -- 172.21.15.77:0/3067287864 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7480ad320 msgr2=0x7ff74806fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.250+0000 7ff74d83e700 1 --2- 172.21.15.77:0/3067287864 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7480ad320 0x7ff74806fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.250+0000 7ff74d83e700 1 -- 172.21.15.77:0/3067287864 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff744009520 con 0x7ff74806ccf0 2023-07-24T05:46:30.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.254+0000 7ff74d83e700 1 --2- 172.21.15.77:0/3067287864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff74806ccf0 0x7ff748152270 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff744000c00 tx=0x7ff744004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:30.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.254+0000 7ff73e7fc700 1 -- 172.21.15.77:0/3067287864 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74400b690 con 0x7ff74806ccf0 2023-07-24T05:46:30.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.254+0000 7ff73e7fc700 1 -- 172.21.15.77:0/3067287864 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff744020070 con 0x7ff74806ccf0 2023-07-24T05:46:30.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.254+0000 7ff73e7fc700 1 -- 172.21.15.77:0/3067287864 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74400ba50 con 0x7ff74806ccf0 2023-07-24T05:46:30.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.254+0000 7ff74faa2700 1 -- 172.21.15.77:0/3067287864 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7480c2270 con 0x7ff74806ccf0 2023-07-24T05:46:30.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.254+0000 7ff74faa2700 1 -- 172.21.15.77:0/3067287864 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7480c2830 con 0x7ff74806ccf0 2023-07-24T05:46:30.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.254+0000 7ff74faa2700 1 -- 172.21.15.77:0/3067287864 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff74804df10 con 0x7ff74806ccf0 2023-07-24T05:46:30.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.254+0000 7ff73e7fc700 1 -- 172.21.15.77:0/3067287864 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff744022030 con 0x7ff74806ccf0 2023-07-24T05:46:30.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.258+0000 7ff73e7fc700 1 --2- 172.21.15.77:0/3067287864 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff72c0662f0 0x7ff72c0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.258+0000 7ff73e7fc700 1 -- 172.21.15.77:0/3067287864 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff7440859c0 con 0x7ff74806ccf0 2023-07-24T05:46:30.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.258+0000 7ff74d03d700 1 --2- 172.21.15.77:0/3067287864 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff72c0662f0 0x7ff72c0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.258+0000 7ff74d03d700 1 --2- 172.21.15.77:0/3067287864 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff72c0662f0 0x7ff72c0687b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff74815c940 tx=0x7ff738008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:30.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.262+0000 7ff73e7fc700 1 -- 172.21.15.77:0/3067287864 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff744052b40 con 0x7ff74806ccf0 2023-07-24T05:46:30.437 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.434+0000 7ff74faa2700 1 -- 172.21.15.77:0/3067287864 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff74815f5c0 con 0x7ff74806ccf0 2023-07-24T05:46:30.441 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.438+0000 7ff73e7fc700 1 -- 172.21.15.77:0/3067287864 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20108 (secure 0 0 0) 0x7ff744056160 con 0x7ff74806ccf0 2023-07-24T05:46:30.441 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:46:30.441 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":25,"fsid":"5aed5f7b-fb55-4d95-9c02-c6adbb1677b4","created":"2023-07-24T05:45:39.639731+0000","modified":"2023-07-24T05:46:05.445306+0000","last_up_change":"2023-07-24T05:45:52.319670+0000","last_in_change":"2023-07-24T05:45:43.643277+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-24T05:45:52.610430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-24T05:45:52.773787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-24T05:45:58.121732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-24T05:45:59.368726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-24T05:46:03.032057+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ffa0d496-461a-4053-b764-0627d969521b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6812","nonce":825987196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6817","nonce":825987196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6831","nonce":825987196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6824","nonce":825987196}]},"public_addr":"172.21.15.77:6812/825987196","cluster_addr":"172.21.15.77:6817/825987196","heartbeat_back_addr":"172.21.15.77:6831/825987196","heartbeat_front_addr":"172.21.15.77:6824/825987196","state":["exists","up"]},{"osd":1,"uuid":"9f595e5e-5c43-49bc-8ce4-ee70575c90da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6801","nonce":4133026815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6803","nonce":4133026815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6807","nonce":4133026815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6805","nonce":4133026815}]},"public_addr":"172.21.15.77:6801/4133026815","cluster_addr":"172.21.15.77:6803/4133026815","heartbeat_back_addr":"172.21.15.77:6807/4133026815","heartbeat_front_addr":"172.21.15.77:6805/4133026815","state":["exists","up"]},{"osd":2,"uuid":"2ac177aa-4d7d-4262-bd54-d2b9f29f4c3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6811","nonce":2394142159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6819","nonce":2394142159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6830","nonce":2394142159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6825","nonce":2394142159}]},"public_addr":"172.21.15.77:6811/2394142159","cluster_addr":"172.21.15.77:6819/2394142159","heartbeat_back_addr":"172.21.15.77:6830/2394142159","heartbeat_front_addr":"172.21.15.77:6825/2394142159","state":["exists","up"]},{"osd":3,"uuid":"17d7a251-19e8-484c-8172-a578ab3da153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6813","nonce":1492113982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6818","nonce":1492113982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6829","nonce":1492113982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6823","nonce":1492113982}]},"public_addr":"172.21.15.77:6813/1492113982","cluster_addr":"172.21.15.77:6818/1492113982","heartbeat_back_addr":"172.21.15.77:6829/1492113982","heartbeat_front_addr":"172.21.15.77:6823/1492113982","state":["exists","up"]},{"osd":4,"uuid":"bf63ca05-f06d-4e0f-ac44-2a416c70b919","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6825","nonce":1080481057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6827","nonce":1080481057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6831","nonce":1080481057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6829","nonce":1080481057}]},"public_addr":"172.21.15.103:6825/1080481057","cluster_addr":"172.21.15.103:6827/1080481057","heartbeat_back_addr":"172.21.15.103:6831/1080481057","heartbeat_front_addr":"172.21.15.103:6829/1080481057","state":["exists","up"]},{"osd":5,"uuid":"65a11a35-9e9f-4b3c-9fe3-b658d62b9318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6811","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6813","nonce":2756677504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6818","nonce":2756677504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6823","nonce":2756677504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6821","nonce":2756677504}]},"public_addr":"172.21.15.103:6813/2756677504","cluster_addr":"172.21.15.103:6818/2756677504","heartbeat_back_addr":"172.21.15.103:6823/2756677504","heartbeat_front_addr":"172.21.15.103:6821/2756677504","state":["exists","up"]},{"osd":6,"uuid":"750c1f87-686c-40b4-94a1-1a299dc78f3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6809","nonce":568977764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6812","nonce":568977764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6819","nonce":568977764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6815","nonce":568977764}]},"public_addr":"172.21.15.103:6809/568977764","cluster_addr":"172.21.15.103:6812/568977764","heartbeat_back_addr":"172.21.15.103:6819/568977764","heartbeat_front_addr":"172.21.15.103:6815/568977764","state":["exists","up"]},{"osd":7,"uuid":"d5fe4fb6-2e09-4158-885b-403803c85822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6801","nonce":1074557176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6803","nonce":1074557176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6807","nonce":1074557176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6805","nonce":1074557176}]},"public_addr":"172.21.15.103:6801/1074557176","cluster_addr":"172.21.15.103:6803/1074557176","heartbeat_back_addr":"172.21.15.103:6807/1074557176","heartbeat_front_addr":"172.21.15.103:6805/1074557176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.631032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.154109+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.398587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.679089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.311218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.353726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.314372+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.126212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-24T05:46:30.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.438+0000 7ff74faa2700 1 -- 172.21.15.77:0/3067287864 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff72c0662f0 msgr2=0x7ff72c0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.438+0000 7ff74faa2700 1 --2- 172.21.15.77:0/3067287864 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff72c0662f0 0x7ff72c0687b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff74815c940 tx=0x7ff738008040 comp rx=0 tx=0).stop 2023-07-24T05:46:30.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.438+0000 7ff74faa2700 1 -- 172.21.15.77:0/3067287864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff74806ccf0 msgr2=0x7ff748152270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.443 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.438+0000 7ff74faa2700 1 --2- 172.21.15.77:0/3067287864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff74806ccf0 0x7ff748152270 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff744000c00 tx=0x7ff744004770 comp rx=0 tx=0).stop 2023-07-24T05:46:30.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.438+0000 7ff74faa2700 1 -- 172.21.15.77:0/3067287864 shutdown_connections 2023-07-24T05:46:30.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.438+0000 7ff74faa2700 1 --2- 172.21.15.77:0/3067287864 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff72c0662f0 0x7ff72c0687b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.438+0000 7ff74faa2700 1 --2- 172.21.15.77:0/3067287864 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff748160350 0x7ff7480703e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.438+0000 7ff74faa2700 1 --2- 172.21.15.77:0/3067287864 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7480ad320 0x7ff74806fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.438+0000 7ff74faa2700 1 --2- 172.21.15.77:0/3067287864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff74806ccf0 0x7ff748152270 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.438+0000 7ff74faa2700 1 -- 172.21.15.77:0/3067287864 >> 172.21.15.77:0/3067287864 conn(0x7ff7480ce410 msgr2=0x7ff7480afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:30.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.438+0000 7ff74faa2700 1 -- 172.21.15.77:0/3067287864 shutdown_connections 2023-07-24T05:46:30.445 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.438+0000 7ff74faa2700 1 -- 172.21.15.77:0/3067287864 wait complete. 2023-07-24T05:46:30.465 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-07-24T05:46:30.466 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-07-24T05:46:30.466 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-07-24T05:46:30.466 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-07-24T05:46:30.467 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-07-24T05:46:30.467 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-07-24T05:46:30.468 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-07-24T05:46:30.468 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-07-24T05:46:30.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.690+0000 7f324e5ae700 1 Processor -- start 2023-07-24T05:46:30.696 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.690+0000 7f324e5ae700 1 -- start start 2023-07-24T05:46:30.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.694+0000 7f324e5ae700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f32480c9f90 0x7f32480ca370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.694+0000 7f324e5ae700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f324806b050 0x7f324815d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.694+0000 7f324e5ae700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3248161220 con 0x7f32480b1090 2023-07-24T05:46:30.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.694+0000 7f324e5ae700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f324815ceb0 con 0x7f32480c9f90 2023-07-24T05:46:30.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.694+0000 7f324e5ae700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f324815df10 con 0x7f324806b050 2023-07-24T05:46:30.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.694+0000 7f3247fff700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f32480c9f90 0x7f32480ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.694+0000 7f3247fff700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f32480c9f90 0x7f32480ca370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58728/0 (socket says 172.21.15.77:58728) 2023-07-24T05:46:30.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.694+0000 7f3247fff700 1 -- 172.21.15.77:0/4206461823 learned_addr learned my addr 172.21.15.77:0/4206461823 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:30.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.694+0000 7f32477fe700 1 --2- 172.21.15.77:0/4206461823 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f324806b050 0x7f324815d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.694+0000 7f3247fff700 1 -- 172.21.15.77:0/4206461823 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f324806b050 msgr2=0x7f324815d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:30.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.694+0000 7f3247fff700 1 --2- 172.21.15.77:0/4206461823 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f324806b050 0x7f324815d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.694+0000 7f3247fff700 1 -- 172.21.15.77:0/4206461823 >> v1:172.21.15.103:6789/0 conn(0x7f32480b1090 legacy=0x7f32480afbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.694+0000 7f3247fff700 1 -- 172.21.15.77:0/4206461823 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3248160610 con 0x7f32480c9f90 2023-07-24T05:46:30.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.694+0000 7f32477fe700 1 --2- 172.21.15.77:0/4206461823 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f324806b050 0x7f324815d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:46:30.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.694+0000 7f3247fff700 1 --2- 172.21.15.77:0/4206461823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32480c9f90 0x7f32480ca370 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f323c009910 tx=0x7f323c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6fb2acf4b860be6 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:30.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.698+0000 7f3246ffd700 1 -- 172.21.15.77:0/4206461823 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323c00ba60 con 0x7f32480c9f90 2023-07-24T05:46:30.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.698+0000 7f3246ffd700 1 -- 172.21.15.77:0/4206461823 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f323c00bbc0 con 0x7f32480c9f90 2023-07-24T05:46:30.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.698+0000 7f3246ffd700 1 -- 172.21.15.77:0/4206461823 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323c009e60 con 0x7f32480c9f90 2023-07-24T05:46:30.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.698+0000 7f324e5ae700 1 -- 172.21.15.77:0/4206461823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32480c9f90 msgr2=0x7f32480ca370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.698+0000 7f324e5ae700 1 --2- 172.21.15.77:0/4206461823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32480c9f90 0x7f32480ca370 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f323c009910 tx=0x7f323c009c20 comp rx=0 tx=0).stop 2023-07-24T05:46:30.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.698+0000 7f324e5ae700 1 -- 172.21.15.77:0/4206461823 shutdown_connections 2023-07-24T05:46:30.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.698+0000 7f324e5ae700 1 --2- 172.21.15.77:0/4206461823 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f324806b050 0x7f324815d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.698+0000 7f324e5ae700 1 --2- 172.21.15.77:0/4206461823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f32480c9f90 0x7f32480ca370 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.698+0000 7f324e5ae700 1 -- 172.21.15.77:0/4206461823 >> 172.21.15.77:0/4206461823 conn(0x7f32480cacc0 msgr2=0x7f32480cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:30.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.698+0000 7f324e5ae700 1 -- 172.21.15.77:0/4206461823 shutdown_connections 2023-07-24T05:46:30.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.698+0000 7f324e5ae700 1 -- 172.21.15.77:0/4206461823 wait complete. 2023-07-24T05:46:30.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.702+0000 7f324e5ae700 1 Processor -- start 2023-07-24T05:46:30.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.702+0000 7f324e5ae700 1 -- start start 2023-07-24T05:46:30.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.702+0000 7fe32b59e700 1 Processor -- start 2023-07-24T05:46:30.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.702+0000 7fcfbde27700 1 Processor -- start 2023-07-24T05:46:30.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.702+0000 7fe32b59e700 1 -- start start 2023-07-24T05:46:30.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.702+0000 7fcfbde27700 1 -- start start 2023-07-24T05:46:30.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.702+0000 7f324e5ae700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f324806b050 0x7f32480c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.702+0000 7f324e5ae700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f32480b1090 0x7f324815bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.702+0000 7f324e5ae700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32480709f0 0x7f32480c5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.702+0000 7f324e5ae700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f324815c640 con 0x7f324806b050 2023-07-24T05:46:30.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.702+0000 7f324e5ae700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32480c5850 con 0x7f32480709f0 2023-07-24T05:46:30.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.702+0000 7f324e5ae700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32480c6690 con 0x7f32480b1090 2023-07-24T05:46:30.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.702+0000 7f3247fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f324806b050 0x7f32480c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.702+0000 7f324cb4b700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32480709f0 0x7f32480c5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.702+0000 7f324cb4b700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32480709f0 0x7f32480c5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:33906/0 (socket says 172.21.15.77:33906) 2023-07-24T05:46:30.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.702+0000 7f324cb4b700 1 -- 172.21.15.77:0/2126216011 learned_addr learned my addr 172.21.15.77:0/2126216011 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:30.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.702+0000 7fcfbde27700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcfb00eb7e0 0x7fcfb0007100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.702+0000 7fcfbde27700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb0050420 con 0x7fcfb00eb3a0 2023-07-24T05:46:30.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.702+0000 7fcfbde27700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb0006560 con 0x7fcfb00e7990 2023-07-24T05:46:30.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.702+0000 7fcfbde27700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb004fe60 con 0x7fcfb00eb7e0 2023-07-24T05:46:30.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7f32477fe700 1 --2- 172.21.15.77:0/2126216011 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f32480b1090 0x7f324815bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7f324cb4b700 1 -- 172.21.15.77:0/2126216011 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f32480b1090 msgr2=0x7f324815bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7f324cb4b700 1 --2- 172.21.15.77:0/2126216011 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f32480b1090 0x7f324815bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7f324cb4b700 1 -- 172.21.15.77:0/2126216011 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f324806b050 msgr2=0x7f32480c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7f324cb4b700 1 --2- 172.21.15.77:0/2126216011 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f324806b050 0x7f32480c6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7fcfbd626700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcfb00eb7e0 0x7fcfb0007100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7fcfbd626700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fcfb00eb7e0 0x7fcfb0007100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58744/0 (socket says 172.21.15.77:58744) 2023-07-24T05:46:30.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7fcfbd626700 1 -- 172.21.15.77:0/1325660251 learned_addr learned my addr 172.21.15.77:0/1325660251 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:30.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7f324cb4b700 1 -- 172.21.15.77:0/2126216011 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f323c009570 con 0x7f32480709f0 2023-07-24T05:46:30.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.702+0000 7f2ce5bbc700 1 Processor -- start 2023-07-24T05:46:30.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7f3247fff700 1 --2- 172.21.15.77:0/2126216011 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f324806b050 0x7f32480c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:46:30.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7fcfbd626700 1 -- 172.21.15.77:0/1325660251 >> v1:172.21.15.103:6789/0 conn(0x7fcfb00e7990 legacy=0x7fcfb004f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7fcfbd626700 1 -- 172.21.15.77:0/1325660251 >> v1:172.21.15.77:6789/0 conn(0x7fcfb00eb3a0 legacy=0x7fcfb00069f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:30.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7fcfbd626700 1 -- 172.21.15.77:0/1325660251 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb0050140 con 0x7fcfb00eb7e0 2023-07-24T05:46:30.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7f2ce5bbc700 1 -- start start 2023-07-24T05:46:30.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7f324cb4b700 1 --2- 172.21.15.77:0/2126216011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32480709f0 0x7f32480c5310 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f324000cc50 tx=0x7f324000cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:30.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7f3244ff9700 1 -- 172.21.15.77:0/2126216011 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3240003c20 con 0x7f32480709f0 2023-07-24T05:46:30.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7f324e5ae700 1 -- 172.21.15.77:0/2126216011 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32480c5a80 con 0x7f32480709f0 2023-07-24T05:46:30.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7fcfbd626700 1 --2- 172.21.15.77:0/1325660251 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcfb00eb7e0 0x7fcfb0007100 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4009910 tx=0x7fcfa4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cca95e05d41832b server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:30.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.702+0000 7fe32b59e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe32c06ac20 0x7fe32c0b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.702+0000 7fe32b59e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe32c0b2990 0x7fe32c0cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7fe32b59e700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe32c0cce50 con 0x7fe32c0ae5a0 2023-07-24T05:46:30.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7f87edceb700 1 Processor -- start 2023-07-24T05:46:30.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7f87edceb700 1 -- start start 2023-07-24T05:46:30.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7fe32b59e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe32c159bf0 con 0x7fe32c06ac20 2023-07-24T05:46:30.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7fe32b59e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c0cd130 con 0x7fe32c0b2990 2023-07-24T05:46:30.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7fe329d9b700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fe32c0ae5a0 0x7fe32c06b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57106/0 (socket says 172.21.15.77:57106) 2023-07-24T05:46:30.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7fe329d9b700 1 -- 172.21.15.77:0/3565877357 learned_addr learned my addr 172.21.15.77:0/3565877357 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:30.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7fe32a59c700 1 --2- 172.21.15.77:0/3565877357 >> v2:172.21.15.103:3300/0 conn(0x7fe32c06ac20 0x7fe32c0b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7fe32ad9d700 1 --2- 172.21.15.77:0/3565877357 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe32c0b2990 0x7fe32c0cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7fe32a59c700 1 -- 172.21.15.77:0/3565877357 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe32c0b2990 msgr2=0x7fe32c0cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:30.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7fe32a59c700 1 --2- 172.21.15.77:0/3565877357 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe32c0b2990 0x7fe32c0cdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7fe32a59c700 1 -- 172.21.15.77:0/3565877357 >> v1:172.21.15.77:6789/0 conn(0x7fe32c0ae5a0 legacy=0x7fe32c06b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7fcfb77fe700 1 -- 172.21.15.77:0/1325660251 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa4004230 con 0x7fcfb00eb7e0 2023-07-24T05:46:30.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7fe32a59c700 1 -- 172.21.15.77:0/3565877357 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe32c0cd410 con 0x7fe32c06ac20 2023-07-24T05:46:30.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7fcfb77fe700 1 -- 172.21.15.77:0/1325660251 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa4004390 con 0x7fcfb00eb7e0 2023-07-24T05:46:30.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7fcfb77fe700 1 -- 172.21.15.77:0/1325660251 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa4009e60 con 0x7fcfb00eb7e0 2023-07-24T05:46:30.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7f324e5ae700 1 -- 172.21.15.77:0/2126216011 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32480c6040 con 0x7f32480709f0 2023-07-24T05:46:30.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7f2ce5bbc700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2ce01642d0 0x7f2ce009bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7f2ce5bbc700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2ce00b0740 0x7f2ce006ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7f2ce5bbc700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ce00b0ba0 con 0x7f2ce006b390 2023-07-24T05:46:30.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7f2ce5bbc700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ce00ae290 con 0x7f2ce01642d0 2023-07-24T05:46:30.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7f2ce5bbc700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce00af770 con 0x7f2ce00b0740 2023-07-24T05:46:30.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7f2ce4bba700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2ce01642d0 0x7f2ce009bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7f2ce4bba700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2ce01642d0 0x7f2ce009bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58758/0 (socket says 172.21.15.77:58758) 2023-07-24T05:46:30.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7f2ce4bba700 1 -- 172.21.15.77:0/711764197 learned_addr learned my addr 172.21.15.77:0/711764197 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:30.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7f3244ff9700 1 -- 172.21.15.77:0/2126216011 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3240003d80 con 0x7f32480709f0 2023-07-24T05:46:30.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7f3244ff9700 1 -- 172.21.15.77:0/2126216011 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324000ab00 con 0x7f32480709f0 2023-07-24T05:46:30.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7fcfbde27700 1 -- 172.21.15.77:0/1325660251 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcfb00eb7e0 msgr2=0x7fcfb0007100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7fcfbde27700 1 --2- 172.21.15.77:0/1325660251 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcfb00eb7e0 0x7fcfb0007100 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4009910 tx=0x7fcfa4009c20 comp rx=0 tx=0).stop 2023-07-24T05:46:30.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7fe32a59c700 1 --2- 172.21.15.77:0/3565877357 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe32c06ac20 0x7fe32c0b1670 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe31c009850 tx=0x7fe31c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a198ad2556beaea4 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:30.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7f2cd7fff700 1 --2- 172.21.15.77:0/711764197 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2ce00b0740 0x7f2ce006ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7f5ff4e68700 1 Processor -- start 2023-07-24T05:46:30.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.706+0000 7f5ff4e68700 1 -- start start 2023-07-24T05:46:30.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7f87edceb700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f87e80ae9a0 0x7f87e80adea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7f324e5ae700 1 -- 172.21.15.77:0/2126216011 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3228000fc0 con 0x7f32480709f0 2023-07-24T05:46:30.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7f2ce4bba700 1 -- 172.21.15.77:0/711764197 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2ce00b0740 msgr2=0x7f2ce006ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:30.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7f2ce4bba700 1 --2- 172.21.15.77:0/711764197 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2ce00b0740 0x7f2ce006ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7f2ce4bba700 1 -- 172.21.15.77:0/711764197 >> v1:172.21.15.77:6789/0 conn(0x7f2ce006b390 legacy=0x7f2ce0164760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7f2ce4bba700 1 -- 172.21.15.77:0/711764197 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce00ab9e0 con 0x7f2ce01642d0 2023-07-24T05:46:30.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7fe32959a700 1 -- 172.21.15.77:0/3565877357 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c011830 con 0x7fe32c06ac20 2023-07-24T05:46:30.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7fcfbde27700 1 -- 172.21.15.77:0/1325660251 shutdown_connections 2023-07-24T05:46:30.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7fcfbde27700 1 --2- 172.21.15.77:0/1325660251 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcfb00eb7e0 0x7fcfb0007100 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7fcfbde27700 1 -- 172.21.15.77:0/1325660251 >> 172.21.15.77:0/1325660251 conn(0x7fcfb0054cf0 msgr2=0x7fcfb00550d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:30.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7fe32959a700 1 -- 172.21.15.77:0/3565877357 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe31c011990 con 0x7fe32c06ac20 2023-07-24T05:46:30.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7f5ff4e68700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5ff01642d0 0x7f5ff009bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7fcfbde27700 1 -- 172.21.15.77:0/1325660251 shutdown_connections 2023-07-24T05:46:30.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7f2ce4bba700 1 --2- 172.21.15.77:0/711764197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ce01642d0 0x7f2ce009bc30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc009910 tx=0x7f2cdc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e45e5e504d8def82 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:30.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7fe32959a700 1 -- 172.21.15.77:0/3565877357 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c011d20 con 0x7fe32c06ac20 2023-07-24T05:46:30.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7f5ff4e68700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5ff00b0740 0x7f5ff006ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7f35d74bc700 1 Processor -- start 2023-07-24T05:46:30.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7f5fef7fe700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5ff01642d0 0x7f5ff009bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7f5fef7fe700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5ff01642d0 0x7f5ff009bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.77:53766/0 (socket says 172.21.15.77:53766) 2023-07-24T05:46:30.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7f5fef7fe700 1 -- 172.21.15.77:0/884353682 learned_addr learned my addr 172.21.15.77:0/884353682 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:30.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7f2cd77fe700 1 -- 172.21.15.77:0/711764197 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc011830 con 0x7f2ce01642d0 2023-07-24T05:46:30.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7fe32b59e700 1 -- 172.21.15.77:0/3565877357 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe32c06ac20 msgr2=0x7fe32c0b1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7fe32b59e700 1 --2- 172.21.15.77:0/3565877357 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe32c06ac20 0x7fe32c0b1670 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe31c009850 tx=0x7fe31c009b60 comp rx=0 tx=0).stop 2023-07-24T05:46:30.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7f87e77fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f87e80ae9a0 0x7f87e80adea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7f87e77fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f87e80ae9a0 0x7f87e80adea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:33922/0 (socket says 172.21.15.77:33922) 2023-07-24T05:46:30.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7f87e77fe700 1 -- 172.21.15.77:0/1246804133 learned_addr learned my addr 172.21.15.77:0/1246804133 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:30.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7f87edceb700 1 --2- 172.21.15.77:0/1246804133 >> v2:172.21.15.77:3300/0 conn(0x7f87e80b03e0 0x7f87e81606f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7f35d74bc700 1 -- start start 2023-07-24T05:46:30.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7f5feeffd700 1 --2- 172.21.15.77:0/884353682 >> v2:172.21.15.103:3300/0 conn(0x7f5ff00b0740 0x7f5ff006ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7fe32b59e700 1 -- 172.21.15.77:0/3565877357 shutdown_connections 2023-07-24T05:46:30.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7fe32b59e700 1 --2- 172.21.15.77:0/3565877357 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe32c0b2990 0x7fe32c0cdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7fe32b59e700 1 --2- 172.21.15.77:0/3565877357 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe32c06ac20 0x7fe32c0b1670 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7fe32b59e700 1 -- 172.21.15.77:0/3565877357 >> 172.21.15.77:0/3565877357 conn(0x7fe32c0cacc0 msgr2=0x7fe32c0cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:30.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7f87edceb700 1 -- 172.21.15.77:0/1246804133 --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e815d200 con 0x7f87e806a950 2023-07-24T05:46:30.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7f87e7fff700 1 --2- 172.21.15.77:0/1246804133 >> v2:172.21.15.77:3300/0 conn(0x7f87e80b03e0 0x7f87e81606f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7f87edceb700 1 -- 172.21.15.77:0/1246804133 --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e815d4e0 con 0x7f87e80b03e0 2023-07-24T05:46:30.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7f87edceb700 1 -- 172.21.15.77:0/1246804133 --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e815d7c0 con 0x7f87e80ae9a0 2023-07-24T05:46:30.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7f2cd77fe700 1 -- 172.21.15.77:0/711764197 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cdc011990 con 0x7f2ce01642d0 2023-07-24T05:46:30.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7f2cd77fe700 1 -- 172.21.15.77:0/711764197 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc011d40 con 0x7f2ce01642d0 2023-07-24T05:46:30.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7f2ce5bbc700 1 -- 172.21.15.77:0/711764197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ce01642d0 msgr2=0x7f2ce009bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7f2ce5bbc700 1 --2- 172.21.15.77:0/711764197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ce01642d0 0x7f2ce009bc30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc009910 tx=0x7f2cdc009c20 comp rx=0 tx=0).stop 2023-07-24T05:46:30.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7f87e77fe700 1 -- 172.21.15.77:0/1246804133 >> v2:172.21.15.77:3300/0 conn(0x7f87e80b03e0 msgr2=0x7f87e81606f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:30.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7f87e77fe700 1 --2- 172.21.15.77:0/1246804133 >> v2:172.21.15.77:3300/0 conn(0x7f87e80b03e0 0x7f87e81606f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7fe32b59e700 1 -- 172.21.15.77:0/3565877357 shutdown_connections 2023-07-24T05:46:30.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7f87e77fe700 1 -- 172.21.15.77:0/1246804133 >> v1:172.21.15.103:6789/0 conn(0x7f87e806a950 legacy=0x7f87e80afcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7f87e77fe700 1 -- 172.21.15.77:0/1246804133 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e815daa0 con 0x7f87e80ae9a0 2023-07-24T05:46:30.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7f87e7fff700 1 --2- 172.21.15.77:0/1246804133 >> v2:172.21.15.77:3300/0 conn(0x7f87e80b03e0 0x7f87e81606f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:46:30.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7f2ce5bbc700 1 -- 172.21.15.77:0/711764197 shutdown_connections 2023-07-24T05:46:30.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7f2ce5bbc700 1 --2- 172.21.15.77:0/711764197 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2ce00b0740 0x7f2ce006ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7f2ce5bbc700 1 --2- 172.21.15.77:0/711764197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ce01642d0 0x7f2ce009bc30 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7f2ce5bbc700 1 -- 172.21.15.77:0/711764197 >> 172.21.15.77:0/711764197 conn(0x7f2ce00cacc0 msgr2=0x7f2ce00cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:30.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7fcfbde27700 1 -- 172.21.15.77:0/1325660251 wait complete. 2023-07-24T05:46:30.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7fcfbde27700 1 Processor -- start 2023-07-24T05:46:30.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7fe32b59e700 1 -- 172.21.15.77:0/3565877357 wait complete. 2023-07-24T05:46:30.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7f5ff4e68700 1 -- 172.21.15.77:0/884353682 --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff00b0ba0 con 0x7f5ff006b390 2023-07-24T05:46:30.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7f5ff4e68700 1 -- 172.21.15.77:0/884353682 --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ff00ae290 con 0x7f5ff00b0740 2023-07-24T05:46:30.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7f5ff4e68700 1 -- 172.21.15.77:0/884353682 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff00af770 con 0x7f5ff01642d0 2023-07-24T05:46:30.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f5fee7fc700 1 -- 172.21.15.77:0/884353682 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3312564237 0 0) 0x7f5fe80014e0 con 0x7f5ff006b390 2023-07-24T05:46:30.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f5fee7fc700 1 -- 172.21.15.77:0/884353682 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fd80035d0 con 0x7f5ff006b390 2023-07-24T05:46:30.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f87e77fe700 1 --2- 172.21.15.77:0/1246804133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87e80ae9a0 0x7f87e80adea0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f87e80cbb70 tx=0x7f87dc009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a20c66152fd9923 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:30.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f87e67fc700 1 -- 172.21.15.77:0/1246804133 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87dc00b8a0 con 0x7f87e80ae9a0 2023-07-24T05:46:30.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f87e67fc700 1 -- 172.21.15.77:0/1246804133 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87dc00ba00 con 0x7f87e80ae9a0 2023-07-24T05:46:30.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f87e67fc700 1 -- 172.21.15.77:0/1246804133 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87dc00bd90 con 0x7f87e80ae9a0 2023-07-24T05:46:30.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f2ce5bbc700 1 -- 172.21.15.77:0/711764197 shutdown_connections 2023-07-24T05:46:30.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f2ce5bbc700 1 -- 172.21.15.77:0/711764197 wait complete. 2023-07-24T05:46:30.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7f35d74bc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f35d015b280 0x7f35d00ab5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f35d74bc700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35d00af730 con 0x7f35d0069b10 2023-07-24T05:46:30.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f35d74bc700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35d00abcc0 con 0x7f35d00c1150 2023-07-24T05:46:30.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f35d74bc700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35d015b660 con 0x7f35d015b280 2023-07-24T05:46:30.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f35d5a59700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f35d00c1150 0x7f35d00c1570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.77:39346/0 (socket says 172.21.15.77:39346) 2023-07-24T05:46:30.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f35d5a59700 1 -- 172.21.15.77:0/3560347462 learned_addr learned my addr 172.21.15.77:0/3560347462 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:30.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f35c7fff700 1 -- 172.21.15.77:0/3560347462 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 142588985 0 0) 0x7f35d00abcc0 con 0x7f35d00c1150 2023-07-24T05:46:30.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f35c7fff700 1 -- 172.21.15.77:0/3560347462 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35bc0035d0 con 0x7f35d00c1150 2023-07-24T05:46:30.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f35c7fff700 1 -- 172.21.15.77:0/3560347462 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1868327071 0 0) 0x7f35d00af730 con 0x7f35d0069b10 2023-07-24T05:46:30.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f35c7fff700 1 -- 172.21.15.77:0/3560347462 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35bc004950 con 0x7f35d0069b10 2023-07-24T05:46:30.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7fcfbde27700 1 -- start start 2023-07-24T05:46:30.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7fcfbde27700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcfb00e7990 0x7fcfb00db810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f5fee7fc700 1 -- 172.21.15.77:0/884353682 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 8204644 0 0) 0x7f5fd80035d0 con 0x7f5ff006b390 2023-07-24T05:46:30.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f5fee7fc700 1 -- 172.21.15.77:0/884353682 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5ff01642d0 msgr2=0x7f5ff009bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:30.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f5fee7fc700 1 --2- 172.21.15.77:0/884353682 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5ff01642d0 0x7f5ff009bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f5fee7fc700 1 -- 172.21.15.77:0/884353682 >> v2:172.21.15.103:3300/0 conn(0x7f5ff00b0740 msgr2=0x7f5ff006ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:30.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f5fee7fc700 1 --2- 172.21.15.77:0/884353682 >> v2:172.21.15.103:3300/0 conn(0x7f5ff00b0740 0x7f5ff006ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f5fee7fc700 1 -- 172.21.15.77:0/884353682 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff00ab9e0 con 0x7f5ff006b390 2023-07-24T05:46:30.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f5fee7fc700 1 -- 172.21.15.77:0/884353682 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4109865209 0 0) 0x7f5fe8001bd0 con 0x7f5ff006b390 2023-07-24T05:46:30.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f5fee7fc700 1 -- 172.21.15.77:0/884353682 >> v1:172.21.15.77:6789/0 conn(0x7f5ff006b390 legacy=0x7f5ff0164760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f5fee7fc700 1 --2- 172.21.15.77:0/884353682 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5fd8003a20 0x7f5fd8003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f5fee7fc700 1 --2- 172.21.15.77:0/884353682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fd8004870 0x7f5fd8004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f5fee7fc700 1 --2- 172.21.15.77:0/884353682 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5fd8005430 0x7f5fd800ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7fcfbde27700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcfb00eb3a0 0x7fcfb00e9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f5fee7fc700 1 -- 172.21.15.77:0/884353682 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff00ae290 con 0x7f5fd8004870 2023-07-24T05:46:30.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f5fee7fc700 1 -- 172.21.15.77:0/884353682 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff00af770 con 0x7f5fd8003a20 2023-07-24T05:46:30.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f5fee7fc700 1 -- 172.21.15.77:0/884353682 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd800c360 con 0x7f5fd8005430 2023-07-24T05:46:30.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f5feeffd700 1 --2- 172.21.15.77:0/884353682 >> v2:172.21.15.103:3300/0 conn(0x7f5ff00b0740 0x7f5ff006ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:46:30.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f5fef7fe700 1 --2- 172.21.15.77:0/884353682 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5ff01642d0 0x7f5ff009bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:46:30.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f35c7fff700 1 -- 172.21.15.77:0/3560347462 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2265506579 0 0) 0x7f35bc004950 con 0x7f35d0069b10 2023-07-24T05:46:30.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f35c7fff700 1 -- 172.21.15.77:0/3560347462 >> v2:172.21.15.103:3300/0 conn(0x7f35d015b280 msgr2=0x7f35d00ab5e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-24T05:46:30.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f35c7fff700 1 --2- 172.21.15.77:0/3560347462 >> v2:172.21.15.103:3300/0 conn(0x7f35d015b280 0x7f35d00ab5e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f35c7fff700 1 -- 172.21.15.77:0/3560347462 >> v1:172.21.15.103:6789/0 conn(0x7f35d00c1150 legacy=0x7f35d00c1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f35c7fff700 1 -- 172.21.15.77:0/3560347462 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d00abfa0 con 0x7f35d0069b10 2023-07-24T05:46:30.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.710+0000 7f3244ff9700 1 -- 172.21.15.77:0/2126216011 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f324000ac60 con 0x7f32480709f0 2023-07-24T05:46:30.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f3244ff9700 1 --2- 172.21.15.77:0/2126216011 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3234066320 0x7f32340687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f3244ff9700 1 -- 172.21.15.77:0/2126216011 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f32400849f0 con 0x7f32480709f0 2023-07-24T05:46:30.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f35c7fff700 1 -- 172.21.15.77:0/3560347462 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4109865209 0 0) 0x7f35c0001670 con 0x7f35d0069b10 2023-07-24T05:46:30.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f35c7fff700 1 -- 172.21.15.77:0/3560347462 >> v1:172.21.15.77:6789/0 conn(0x7f35d0069b10 legacy=0x7f35d0161b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f35c7fff700 1 --2- 172.21.15.77:0/3560347462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35bc004dc0 0x7f35bc0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f35c7fff700 1 --2- 172.21.15.77:0/3560347462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35bc003810 0x7f35bc003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f35c7fff700 1 --2- 172.21.15.77:0/3560347462 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f35bc009a20 0x7f35bc00be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f35c7fff700 1 -- 172.21.15.77:0/3560347462 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d015b660 con 0x7f35bc004dc0 2023-07-24T05:46:30.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f35c7fff700 1 -- 172.21.15.77:0/3560347462 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc00c430 con 0x7f35bc003810 2023-07-24T05:46:30.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f3244ff9700 1 --2- 172.21.15.77:0/2126216011 >> [v2:172.21.15.77:6810/825987196,v1:172.21.15.77:6812/825987196] conn(0x7f3234070000 0x7f3234072440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f3244ff9700 1 -- 172.21.15.77:0/2126216011 --> [v2:172.21.15.77:6810/825987196,v1:172.21.15.77:6812/825987196] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3234072b10 con 0x7f3234070000 2023-07-24T05:46:30.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f3244ff9700 1 -- 172.21.15.77:0/2126216011 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3240084da0 con 0x7f32480709f0 2023-07-24T05:46:30.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f35c7fff700 1 -- 172.21.15.77:0/3560347462 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35bc00c5f0 con 0x7f35bc009a20 2023-07-24T05:46:30.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f3247fff700 1 --2- 172.21.15.77:0/2126216011 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3234066320 0x7f32340687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f32477fe700 1 --2- 172.21.15.77:0/2126216011 >> [v2:172.21.15.77:6810/825987196,v1:172.21.15.77:6812/825987196] conn(0x7f3234070000 0x7f3234072440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f3247fff700 1 --2- 172.21.15.77:0/2126216011 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3234066320 0x7f32340687e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f324806dee0 tx=0x7f323c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:30.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7fcfbce25700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcfb00e7990 0x7fcfb00db810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7fcfbce25700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcfb00e7990 0x7fcfb00db810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.77:53776/0 (socket says 172.21.15.77:53776) 2023-07-24T05:46:30.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7fcfbce25700 1 -- 172.21.15.77:0/1742012229 learned_addr learned my addr 172.21.15.77:0/1742012229 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:30.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7fcfbde27700 1 --2- 172.21.15.77:0/1742012229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcfb00eb7e0 0x7fcfb00ea350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7fcfbde27700 1 -- 172.21.15.77:0/1742012229 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb00e95b0 con 0x7fcfb00eb3a0 2023-07-24T05:46:30.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7fcfbde27700 1 -- 172.21.15.77:0/1742012229 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb00489a0 con 0x7fcfb00eb7e0 2023-07-24T05:46:30.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7fcfbde27700 1 -- 172.21.15.77:0/1742012229 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb0048c80 con 0x7fcfb00e7990 2023-07-24T05:46:30.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7fcfb7fff700 1 --2- 172.21.15.77:0/1742012229 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcfb00eb3a0 0x7fcfb00e9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7fcfb7fff700 1 -- 172.21.15.77:0/1742012229 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcfb00e7990 msgr2=0x7fcfb00db810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7fcfb7fff700 1 --2- 172.21.15.77:0/1742012229 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fcfb00e7990 0x7fcfb00db810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7fcfb7fff700 1 -- 172.21.15.77:0/1742012229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcfb00eb7e0 msgr2=0x7fcfb00ea350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7fcfb7fff700 1 --2- 172.21.15.77:0/1742012229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcfb00eb7e0 0x7fcfb00ea350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7fcfb7fff700 1 -- 172.21.15.77:0/1742012229 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa4009570 con 0x7fcfb00eb3a0 2023-07-24T05:46:30.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7fe32b59e700 1 Processor -- start 2023-07-24T05:46:30.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7fe32b59e700 1 -- start start 2023-07-24T05:46:30.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f5fef7fe700 1 --2- 172.21.15.77:0/884353682 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5fd8003a20 0x7f5fd8003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f5feffff700 1 --2- 172.21.15.77:0/884353682 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5fd8005430 0x7f5fd800ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f5feeffd700 1 --2- 172.21.15.77:0/884353682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fd8004870 0x7f5fd8004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f87edceb700 1 -- 172.21.15.77:0/1246804133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87e80ae9a0 msgr2=0x7f87e80adea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f87edceb700 1 --2- 172.21.15.77:0/1246804133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87e80ae9a0 0x7f87e80adea0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f87e80cbb70 tx=0x7f87dc009bf0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f87edceb700 1 -- 172.21.15.77:0/1246804133 shutdown_connections 2023-07-24T05:46:30.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f87edceb700 1 --2- 172.21.15.77:0/1246804133 >> v2:172.21.15.77:3300/0 conn(0x7f87e80b03e0 0x7f87e81606f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f87edceb700 1 --2- 172.21.15.77:0/1246804133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87e80ae9a0 0x7f87e80adea0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f87edceb700 1 -- 172.21.15.77:0/1246804133 >> 172.21.15.77:0/1246804133 conn(0x7f87e80cacc0 msgr2=0x7f87e80cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:30.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f87edceb700 1 -- 172.21.15.77:0/1246804133 shutdown_connections 2023-07-24T05:46:30.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f87edceb700 1 -- 172.21.15.77:0/1246804133 wait complete. 2023-07-24T05:46:30.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f2ce5bbc700 1 Processor -- start 2023-07-24T05:46:30.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f2ce5bbc700 1 -- start start 2023-07-24T05:46:30.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.714+0000 7f35d5a59700 1 --2- 172.21.15.77:0/3560347462 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f35bc009a20 0x7f35bc00be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f35d4a57700 1 --2- 172.21.15.77:0/3560347462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35bc003810 0x7f35bc003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f35d5258700 1 --2- 172.21.15.77:0/3560347462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35bc004dc0 0x7f35bc0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f35d5a59700 1 -- 172.21.15.77:0/3560347462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35bc003810 msgr2=0x7f35bc003c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:30.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f35d5a59700 1 --2- 172.21.15.77:0/3560347462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35bc003810 0x7f35bc003c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f35d5a59700 1 -- 172.21.15.77:0/3560347462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35bc004dc0 msgr2=0x7f35bc0051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:30.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f35d5a59700 1 --2- 172.21.15.77:0/3560347462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35bc004dc0 0x7f35bc0051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f35d5a59700 1 -- 172.21.15.77:0/3560347462 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d00abfa0 con 0x7f35bc009a20 2023-07-24T05:46:30.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f35d5a59700 1 -- 172.21.15.77:0/3560347462 reap_dead start 2023-07-24T05:46:30.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f5fef7fe700 1 -- 172.21.15.77:0/884353682 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5fd8005430 msgr2=0x7f5fd800ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:30.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f5fef7fe700 1 --2- 172.21.15.77:0/884353682 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5fd8005430 0x7f5fd800ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f5fef7fe700 1 -- 172.21.15.77:0/884353682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fd8004870 msgr2=0x7f5fd8004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:30.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f5fef7fe700 1 --2- 172.21.15.77:0/884353682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fd8004870 0x7f5fd8004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f5fef7fe700 1 -- 172.21.15.77:0/884353682 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff00ab9e0 con 0x7f5fd8003a20 2023-07-24T05:46:30.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f2ce5bbc700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2ce006b390 0x7f2ce015d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f35d4a57700 1 --2- 172.21.15.77:0/3560347462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35bc003810 0x7f35bc003c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:46:30.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f35d5258700 1 --2- 172.21.15.77:0/3560347462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35bc004dc0 0x7f35bc0051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:46:30.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f32477fe700 1 --2- 172.21.15.77:0/2126216011 >> [v2:172.21.15.77:6810/825987196,v1:172.21.15.77:6812/825987196] conn(0x7f3234070000 0x7f3234072440 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:30.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7fcfb7fff700 1 --2- 172.21.15.77:0/1742012229 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcfb00eb3a0 0x7fcfb00e9e10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcfac00c400 tx=0x7fcfac00c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:30.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f5fef7fe700 1 --2- 172.21.15.77:0/884353682 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5fd8003a20 0x7f5fd8003e40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5ff00ab070 tx=0x7f5fd80058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db631cbba25df3df server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:30.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f2ce5bbc700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ce00b0740 0x7f2ce0160410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f2ce5bbc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ce01642d0 0x7f2ce01582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f2ce5bbc700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce015cd90 con 0x7f2ce01642d0 2023-07-24T05:46:30.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f2ce5bbc700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce015e790 con 0x7f2ce00b0740 2023-07-24T05:46:30.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f2ce5bbc700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce0162da0 con 0x7f2ce006b390 2023-07-24T05:46:30.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7fe32b59e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe32c06ac20 0x7fe32c159180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f2ce4bba700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2ce006b390 0x7f2ce015d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f2ce4bba700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2ce006b390 0x7f2ce015d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.77:53820/0 (socket says 172.21.15.77:53820) 2023-07-24T05:46:30.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f2ce4bba700 1 -- 172.21.15.77:0/2339502100 learned_addr learned my addr 172.21.15.77:0/2339502100 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:30.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7fe32b59e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe32c0ae5a0 0x7fe32c09b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f3244ff9700 1 -- 172.21.15.77:0/2126216011 <== osd.0 v2:172.21.15.77:6810/825987196 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f3234072b10 con 0x7f3234070000 2023-07-24T05:46:30.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7fcfb57fa700 1 -- 172.21.15.77:0/1742012229 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac0054e0 con 0x7fcfb00eb3a0 2023-07-24T05:46:30.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7fcfb57fa700 1 -- 172.21.15.77:0/1742012229 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfac0036a0 con 0x7fcfb00eb3a0 2023-07-24T05:46:30.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7fcfb57fa700 1 -- 172.21.15.77:0/1742012229 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac003a50 con 0x7fcfb00eb3a0 2023-07-24T05:46:30.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7fe32b59e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe32c0b2990 0x7fe32c1f9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7fe32a59c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe32c06ac20 0x7fe32c159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7fe32a59c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe32c06ac20 0x7fe32c159180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.77:53832/0 (socket says 172.21.15.77:53832) 2023-07-24T05:46:30.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7fe329d9b700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe32c0ae5a0 0x7fe32c09b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7fe329d9b700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe32c0ae5a0 0x7fe32c09b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:33972/0 (socket says 172.21.15.77:33972) 2023-07-24T05:46:30.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7fe329d9b700 1 -- 172.21.15.77:0/2575081885 learned_addr learned my addr 172.21.15.77:0/2575081885 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:30.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7fe32ad9d700 1 --2- 172.21.15.77:0/2575081885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe32c0b2990 0x7fe32c1f9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7fe32b59e700 1 -- 172.21.15.77:0/2575081885 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c09a360 con 0x7fe32c0b2990 2023-07-24T05:46:30.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7fe32b59e700 1 -- 172.21.15.77:0/2575081885 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c1596c0 con 0x7fe32c0ae5a0 2023-07-24T05:46:30.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7fe32b59e700 1 -- 172.21.15.77:0/2575081885 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c0997e0 con 0x7fe32c06ac20 2023-07-24T05:46:30.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f5fee7fc700 1 -- 172.21.15.77:0/884353682 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe0004220 con 0x7f5fd8003a20 2023-07-24T05:46:30.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f5fee7fc700 1 -- 172.21.15.77:0/884353682 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe0004380 con 0x7f5fd8003a20 2023-07-24T05:46:30.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f5fee7fc700 1 -- 172.21.15.77:0/884353682 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe00036c0 con 0x7f5fd8003a20 2023-07-24T05:46:30.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f2cd7fff700 1 --2- 172.21.15.77:0/2339502100 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ce00b0740 0x7f2ce0160410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f2ce53bb700 1 --2- 172.21.15.77:0/2339502100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ce01642d0 0x7f2ce01582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f2ce4bba700 1 -- 172.21.15.77:0/2339502100 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ce00b0740 msgr2=0x7f2ce0160410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f2ce4bba700 1 --2- 172.21.15.77:0/2339502100 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ce00b0740 0x7f2ce0160410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f2ce4bba700 1 -- 172.21.15.77:0/2339502100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ce01642d0 msgr2=0x7f2ce01582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f2ce4bba700 1 --2- 172.21.15.77:0/2339502100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ce01642d0 0x7f2ce01582e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f2ce4bba700 1 -- 172.21.15.77:0/2339502100 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cdc009570 con 0x7f2ce006b390 2023-07-24T05:46:30.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f35d5a59700 1 --2- 172.21.15.77:0/3560347462 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f35bc009a20 0x7f35bc00be10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f35c8002250 tx=0x7f35bc0058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b705a84eccc973e server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:30.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f5ff4e68700 1 -- 172.21.15.77:0/884353682 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5fd8003a20 msgr2=0x7f5fd8003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f5ff4e68700 1 --2- 172.21.15.77:0/884353682 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5fd8003a20 0x7f5fd8003e40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5ff00ab070 tx=0x7f5fd80058a0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f5feffff700 1 -- 172.21.15.77:0/884353682 reap_dead start 2023-07-24T05:46:30.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7fcfbde27700 1 -- 172.21.15.77:0/1742012229 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb0048f60 con 0x7fcfb00eb3a0 2023-07-24T05:46:30.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f2ce4bba700 1 --2- 172.21.15.77:0/2339502100 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2ce006b390 0x7f2ce015d1b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2ce00cb830 tx=0x7f2cdc004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:30.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7fe329d9b700 1 -- 172.21.15.77:0/2575081885 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe32c06ac20 msgr2=0x7fe32c159180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7fe329d9b700 1 --2- 172.21.15.77:0/2575081885 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe32c06ac20 0x7fe32c159180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7fe329d9b700 1 -- 172.21.15.77:0/2575081885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe32c0b2990 msgr2=0x7fe32c1f9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7fe329d9b700 1 --2- 172.21.15.77:0/2575081885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe32c0b2990 0x7fe32c1f9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7fe329d9b700 1 -- 172.21.15.77:0/2575081885 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe31c0094b0 con 0x7fe32c0ae5a0 2023-07-24T05:46:30.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7f2cd57fa700 1 -- 172.21.15.77:0/2339502100 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc004450 con 0x7f2ce006b390 2023-07-24T05:46:30.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7f2cd57fa700 1 -- 172.21.15.77:0/2339502100 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cdc01f070 con 0x7f2ce006b390 2023-07-24T05:46:30.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7f2cd57fa700 1 -- 172.21.15.77:0/2339502100 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc003900 con 0x7f2ce006b390 2023-07-24T05:46:30.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7f2ce5bbc700 1 -- 172.21.15.77:0/2339502100 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce0163080 con 0x7f2ce006b390 2023-07-24T05:46:30.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7ff8827cd700 1 Processor -- start 2023-07-24T05:46:30.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7f87edceb700 1 Processor -- start 2023-07-24T05:46:30.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7fcfbde27700 1 -- 172.21.15.77:0/1742012229 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb00dbf30 con 0x7fcfb00eb3a0 2023-07-24T05:46:30.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f35c7fff700 1 -- 172.21.15.77:0/3560347462 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c8001d10 con 0x7f35bc009a20 2023-07-24T05:46:30.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f35c7fff700 1 -- 172.21.15.77:0/3560347462 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c800dbe0 con 0x7f35bc009a20 2023-07-24T05:46:30.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.718+0000 7f35c7fff700 1 -- 172.21.15.77:0/3560347462 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c8011380 con 0x7f35bc009a20 2023-07-24T05:46:30.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7f35d74bc700 1 -- 172.21.15.77:0/3560347462 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f35bc009a20 msgr2=0x7f35bc00be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7f35d74bc700 1 --2- 172.21.15.77:0/3560347462 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f35bc009a20 0x7f35bc00be10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f35c8002250 tx=0x7f35bc0058a0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7f35d74bc700 1 -- 172.21.15.77:0/3560347462 shutdown_connections 2023-07-24T05:46:30.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7f35d74bc700 1 --2- 172.21.15.77:0/3560347462 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f35bc009a20 0x7f35bc00be10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7f35d74bc700 1 -- 172.21.15.77:0/3560347462 >> 172.21.15.77:0/3560347462 conn(0x7f35d00cac00 msgr2=0x7f35d00cb010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:30.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7f87edceb700 1 -- start start 2023-07-24T05:46:30.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7fe329d9b700 1 --2- 172.21.15.77:0/2575081885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe32c0ae5a0 0x7fe32c09b860 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe32000c520 tx=0x7fe32000c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:30.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7fe31affd700 1 -- 172.21.15.77:0/2575081885 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe320005d90 con 0x7fe32c0ae5a0 2023-07-24T05:46:30.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7fe31affd700 1 -- 172.21.15.77:0/2575081885 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3200070d0 con 0x7fe32c0ae5a0 2023-07-24T05:46:30.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7fe31affd700 1 -- 172.21.15.77:0/2575081885 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe320007440 con 0x7fe32c0ae5a0 2023-07-24T05:46:30.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7f35d74bc700 1 -- 172.21.15.77:0/3560347462 shutdown_connections 2023-07-24T05:46:30.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7ff8827cd700 1 -- start start 2023-07-24T05:46:30.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7fe32b59e700 1 -- 172.21.15.77:0/2575081885 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe32c099ac0 con 0x7fe32c0ae5a0 2023-07-24T05:46:30.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7f35d74bc700 1 -- 172.21.15.77:0/3560347462 wait complete. 2023-07-24T05:46:30.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7f2ce5bbc700 1 -- 172.21.15.77:0/2339502100 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce015c9b0 con 0x7f2ce006b390 2023-07-24T05:46:30.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7f5ff4e68700 1 -- 172.21.15.77:0/884353682 shutdown_connections 2023-07-24T05:46:30.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7f5ff4e68700 1 -- 172.21.15.77:0/884353682 >> 172.21.15.77:0/884353682 conn(0x7f5ff00cacc0 msgr2=0x7f5ff00cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:30.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7f5ff4e68700 1 -- 172.21.15.77:0/884353682 shutdown_connections 2023-07-24T05:46:30.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7fe32b59e700 1 -- 172.21.15.77:0/2575081885 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe32c09a080 con 0x7fe32c0ae5a0 2023-07-24T05:46:30.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7ff8827cd700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff874053d10 0x7ff87403eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7ff8827cd700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff874006c80 0x7ff8740540f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7f87edceb700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f87e806a950 0x7f87e8157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7f87edceb700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87e80ae9a0 0x7f87e815fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7f87edceb700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87e80b03e0 0x7f87e815e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7f87edceb700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e8158020 con 0x7f87e80b03e0 2023-07-24T05:46:30.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7f87edceb700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e8160360 con 0x7f87e80ae9a0 2023-07-24T05:46:30.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7f87edceb700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e815f990 con 0x7f87e806a950 2023-07-24T05:46:30.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7ff8827cd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff8740e6d30 0x7ff8740e71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7ff87bfff700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff874053d10 0x7ff87403eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7f87e6ffd700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87e80ae9a0 0x7f87e815fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7f87e6ffd700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87e80ae9a0 0x7f87e815fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:33974/0 (socket says 172.21.15.77:33974) 2023-07-24T05:46:30.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7f87e6ffd700 1 -- 172.21.15.77:0/2257197629 learned_addr learned my addr 172.21.15.77:0/2257197629 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:30.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7ff87bfff700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff874053d10 0x7ff87403eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.77:53848/0 (socket says 172.21.15.77:53848) 2023-07-24T05:46:30.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7ff87bfff700 1 -- 172.21.15.77:0/1074131122 learned_addr learned my addr 172.21.15.77:0/1074131122 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:30.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7ff8827cd700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff874007c70 con 0x7ff874006c80 2023-07-24T05:46:30.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7ff8827cd700 1 -- 172.21.15.77:0/1074131122 --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff874054630 con 0x7ff8740e6d30 2023-07-24T05:46:30.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7f87e77fe700 1 --2- 172.21.15.77:0/2257197629 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f87e806a950 0x7f87e8157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7ff880d6a700 1 --2- 172.21.15.77:0/1074131122 >> v2:172.21.15.103:3300/0 conn(0x7ff8740e6d30 0x7ff8740e71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7ff8827cd700 1 -- 172.21.15.77:0/1074131122 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8740073d0 con 0x7ff874053d10 2023-07-24T05:46:30.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7f87e77fe700 1 -- 172.21.15.77:0/2257197629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87e80ae9a0 msgr2=0x7f87e815fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7f87e77fe700 1 --2- 172.21.15.77:0/2257197629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87e80ae9a0 0x7f87e815fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7f87e77fe700 1 -- 172.21.15.77:0/2257197629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87e80b03e0 msgr2=0x7f87e815e3c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-24T05:46:30.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7f87e77fe700 1 --2- 172.21.15.77:0/2257197629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f87e80b03e0 0x7f87e815e3c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7f35d74bc700 1 Processor -- start 2023-07-24T05:46:30.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7f87e77fe700 1 -- 172.21.15.77:0/2257197629 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87dc009570 con 0x7f87e806a950 2023-07-24T05:46:30.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7f87e6ffd700 1 --2- 172.21.15.77:0/2257197629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87e80ae9a0 0x7f87e815fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:46:30.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.722+0000 7f5ff4e68700 1 -- 172.21.15.77:0/884353682 wait complete. 2023-07-24T05:46:30.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7ff87bfff700 1 -- 172.21.15.77:0/1074131122 >> v2:172.21.15.103:3300/0 conn(0x7ff8740e6d30 msgr2=0x7ff8740e71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:30.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7ff87bfff700 1 --2- 172.21.15.77:0/1074131122 >> v2:172.21.15.103:3300/0 conn(0x7ff8740e6d30 0x7ff8740e71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7ff87bfff700 1 -- 172.21.15.77:0/1074131122 >> v2:172.21.15.77:3300/0 conn(0x7ff874006c80 msgr2=0x7ff8740540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:30.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7ff87bfff700 1 --2- 172.21.15.77:0/1074131122 >> v2:172.21.15.77:3300/0 conn(0x7ff874006c80 0x7ff8740540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7ff87bfff700 1 -- 172.21.15.77:0/1074131122 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8740076b0 con 0x7ff874053d10 2023-07-24T05:46:30.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7f87e77fe700 1 --2- 172.21.15.77:0/2257197629 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f87e806a950 0x7f87e8157ae0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f87dc016000 tx=0x7f87dc004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:30.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7f5ff4e68700 1 Processor -- start 2023-07-24T05:46:30.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7f35d74bc700 1 -- start start 2023-07-24T05:46:30.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7ff87bfff700 1 --2- 172.21.15.77:0/1074131122 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff874053d10 0x7ff87403eba0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff8740537d0 tx=0x7ff870009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efbf1afb1810059c server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:30.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7f87cffff700 1 -- 172.21.15.77:0/2257197629 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87dc0038c0 con 0x7f87e806a950 2023-07-24T05:46:30.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7f87cffff700 1 -- 172.21.15.77:0/2257197629 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87dc003a40 con 0x7f87e806a950 2023-07-24T05:46:30.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7f87cffff700 1 -- 172.21.15.77:0/2257197629 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87dc003df0 con 0x7f87e806a950 2023-07-24T05:46:30.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7f87edceb700 1 -- 172.21.15.77:0/2257197629 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e815ed80 con 0x7f87e806a950 2023-07-24T05:46:30.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7f87edceb700 1 -- 172.21.15.77:0/2257197629 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e815f340 con 0x7f87e806a950 2023-07-24T05:46:30.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7f2ce5bbc700 1 -- 172.21.15.77:0/2339502100 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2ce00adfb0 con 0x7f2ce006b390 2023-07-24T05:46:30.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7fcfb57fa700 1 -- 172.21.15.77:0/1742012229 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcfac003bb0 con 0x7fcfb00eb3a0 2023-07-24T05:46:30.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7fcfb57fa700 1 --2- 172.21.15.77:0/1742012229 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fcf9c066340 0x7fcf9c068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7f5ff4e68700 1 -- start start 2023-07-24T05:46:30.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7f35d74bc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35bc009a20 0x7f35d00989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7fcfb57fa700 1 -- 172.21.15.77:0/1742012229 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcfac058240 con 0x7fcfb00eb3a0 2023-07-24T05:46:30.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7fcfbce25700 1 --2- 172.21.15.77:0/1742012229 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fcf9c066340 0x7fcf9c068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7f5ff4e68700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fd8003a20 0x7f5ff015f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7f5ff4e68700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5ff00c75a0 0x7f5ff00c7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7f35d5258700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35bc009a20 0x7f35d00989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7f35d5258700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35bc009a20 0x7f35d00989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58836/0 (socket says 172.21.15.77:58836) 2023-07-24T05:46:30.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7f87edceb700 1 -- 172.21.15.77:0/2257197629 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f87c8000fc0 con 0x7f87e806a950 2023-07-24T05:46:30.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7f2cd57fa700 1 -- 172.21.15.77:0/2339502100 <== mon.2 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2cdc003a60 con 0x7f2ce006b390 2023-07-24T05:46:30.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7fe31affd700 1 -- 172.21.15.77:0/2575081885 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe3200075a0 con 0x7fe32c0ae5a0 2023-07-24T05:46:30.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7f5ff4e68700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ff00c5380 0x7f5ff00c5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7f5fef7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fd8003a20 0x7f5ff015f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7f5ff4e68700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff015fe10 con 0x7f5fd8003a20 2023-07-24T05:46:30.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7f5ff4e68700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff00c7f60 con 0x7f5ff00c5380 2023-07-24T05:46:30.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7f5ff4e68700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff00c6d00 con 0x7f5ff00c75a0 2023-07-24T05:46:30.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7f35d74bc700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f35d01f5eb0 0x7f35d00c5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7f35d74bc700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35d00cc770 0x7f35d00ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7f35d74bc700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d01f6330 con 0x7f35bc009a20 2023-07-24T05:46:30.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7f5fef7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fd8003a20 0x7f5ff015f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58842/0 (socket says 172.21.15.77:58842) 2023-07-24T05:46:30.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7f5fef7fe700 1 -- 172.21.15.77:0/612655645 learned_addr learned my addr 172.21.15.77:0/612655645 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:30.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7f35d74bc700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d00b2960 con 0x7f35d00cc770 2023-07-24T05:46:30.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.726+0000 7f35d74bc700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d00cd130 con 0x7f35d01f5eb0 2023-07-24T05:46:30.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7f35d5258700 1 -- 172.21.15.77:0/1325312849 learned_addr learned my addr 172.21.15.77:0/1325312849 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:30.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7f35d4a57700 1 --2- 172.21.15.77:0/1325312849 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f35d01f5eb0 0x7f35d00c5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7f35d5a59700 1 --2- 172.21.15.77:0/1325312849 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35d00cc770 0x7f35d00ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7fe32b59e700 1 -- 172.21.15.77:0/2575081885 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe32c0b1090 con 0x7fe32c0ae5a0 2023-07-24T05:46:30.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7f5feffff700 1 --2- 172.21.15.77:0/612655645 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ff00c5380 0x7f5ff00c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7fe31affd700 1 --2- 172.21.15.77:0/2575081885 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe30c0662f0 0x7fe30c0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7f35d5258700 1 -- 172.21.15.77:0/1325312849 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f35d01f5eb0 msgr2=0x7f35d00c5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7f35d5258700 1 --2- 172.21.15.77:0/1325312849 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f35d01f5eb0 0x7f35d00c5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7f35d5258700 1 -- 172.21.15.77:0/1325312849 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35d00cc770 msgr2=0x7f35d00ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7f35d5258700 1 --2- 172.21.15.77:0/1325312849 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35d00cc770 0x7f35d00ccbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7f35d5258700 1 -- 172.21.15.77:0/1325312849 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d00c9ba0 con 0x7f35bc009a20 2023-07-24T05:46:30.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7f35d5a59700 1 --2- 172.21.15.77:0/1325312849 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35d00cc770 0x7f35d00ccbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:46:30.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7fe31affd700 1 -- 172.21.15.77:0/2575081885 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe3200832f0 con 0x7fe32c0ae5a0 2023-07-24T05:46:30.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7f5fef7fe700 1 -- 172.21.15.77:0/612655645 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5ff00c75a0 msgr2=0x7f5ff00c7a20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-24T05:46:30.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7f5fef7fe700 1 --2- 172.21.15.77:0/612655645 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5ff00c75a0 0x7f5ff00c7a20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7f5fef7fe700 1 -- 172.21.15.77:0/612655645 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ff00c5380 msgr2=0x7f5ff00c5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7f5fef7fe700 1 --2- 172.21.15.77:0/612655645 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ff00c5380 0x7f5ff00c5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7f5fef7fe700 1 -- 172.21.15.77:0/612655645 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff00c60f0 con 0x7f5fd8003a20 2023-07-24T05:46:30.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7fe31affd700 1 --2- 172.21.15.77:0/2575081885 >> [v2:172.21.15.77:6808/2394142159,v1:172.21.15.77:6811/2394142159] conn(0x7fe30c06ff50 0x7fe30c072390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7fe31affd700 1 -- 172.21.15.77:0/2575081885 --> [v2:172.21.15.77:6808/2394142159,v1:172.21.15.77:6811/2394142159] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe30c072a60 con 0x7fe30c06ff50 2023-07-24T05:46:30.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7fe32a59c700 1 --2- 172.21.15.77:0/2575081885 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe30c0662f0 0x7fe30c0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7fe31affd700 1 -- 172.21.15.77:0/2575081885 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe320001270 con 0x7fe32c0ae5a0 2023-07-24T05:46:30.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7f35d5258700 1 --2- 172.21.15.77:0/1325312849 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35bc009a20 0x7f35d00989f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f35cc00c540 tx=0x7f35cc00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:30.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7fe32ad9d700 1 --2- 172.21.15.77:0/2575081885 >> [v2:172.21.15.77:6808/2394142159,v1:172.21.15.77:6811/2394142159] conn(0x7fe30c06ff50 0x7fe30c072390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7f5fef7fe700 1 --2- 172.21.15.77:0/612655645 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fd8003a20 0x7f5ff015f8d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0008010 tx=0x7f5fe00047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:30.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7fcfa2ffd700 1 --2- 172.21.15.77:0/1742012229 >> [v2:172.21.15.77:6800/4133026815,v1:172.21.15.77:6801/4133026815] conn(0x7fcf900015e0 0x7fcf90003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7fcfa2ffd700 1 -- 172.21.15.77:0/1742012229 --> [v2:172.21.15.77:6800/4133026815,v1:172.21.15.77:6801/4133026815] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcf90006bf0 con 0x7fcf900015e0 2023-07-24T05:46:30.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7f2cd57fa700 1 --2- 172.21.15.77:0/2339502100 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2ccc0663c0 0x7f2ccc068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7f2cd57fa700 1 -- 172.21.15.77:0/2339502100 <== mon.2 v2:172.21.15.103:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2cdc021070 con 0x7f2ce006b390 2023-07-24T05:46:30.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7f2cd57fa700 1 --2- 172.21.15.77:0/2339502100 >> [v2:172.21.15.103:6811/2756677504,v1:172.21.15.103:6813/2756677504] conn(0x7f2ccc0700a0 0x7f2ccc0724e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7f2cd57fa700 1 -- 172.21.15.77:0/2339502100 --> [v2:172.21.15.103:6811/2756677504,v1:172.21.15.103:6813/2756677504] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2ccc072bb0 con 0x7f2ccc0700a0 2023-07-24T05:46:30.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7f2cd57fa700 1 -- 172.21.15.77:0/2339502100 <== mon.2 v2:172.21.15.103:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2cdc085dd0 con 0x7f2ce006b390 2023-07-24T05:46:30.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7ff87affd700 1 -- 172.21.15.77:0/1074131122 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff870011830 con 0x7ff874053d10 2023-07-24T05:46:30.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7ff87affd700 1 -- 172.21.15.77:0/1074131122 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff870011990 con 0x7ff874053d10 2023-07-24T05:46:30.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7ff87affd700 1 -- 172.21.15.77:0/1074131122 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff870011d20 con 0x7ff874053d10 2023-07-24T05:46:30.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7fe32ad9d700 1 --2- 172.21.15.77:0/2575081885 >> [v2:172.21.15.77:6808/2394142159,v1:172.21.15.77:6811/2394142159] conn(0x7fe30c06ff50 0x7fe30c072390 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:30.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7fcfbce25700 1 --2- 172.21.15.77:0/1742012229 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fcf9c066340 0x7fcf9c068800 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcfb802ca30 tx=0x7fcfb808af90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:30.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7fe32a59c700 1 --2- 172.21.15.77:0/2575081885 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe30c0662f0 0x7fe30c0687b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe31c000c00 tx=0x7fe31c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:30.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7f2ce53bb700 1 --2- 172.21.15.77:0/2339502100 >> [v2:172.21.15.103:6811/2756677504,v1:172.21.15.103:6813/2756677504] conn(0x7f2ccc0700a0 0x7f2ccc0724e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7f2cd7fff700 1 --2- 172.21.15.77:0/2339502100 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2ccc0663c0 0x7f2ccc068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7fcfbd626700 1 --2- 172.21.15.77:0/1742012229 >> [v2:172.21.15.77:6800/4133026815,v1:172.21.15.77:6801/4133026815] conn(0x7fcf900015e0 0x7fcf90003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.734+0000 7fcfbd626700 1 --2- 172.21.15.77:0/1742012229 >> [v2:172.21.15.77:6800/4133026815,v1:172.21.15.77:6801/4133026815] conn(0x7fcf900015e0 0x7fcf90003aa0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:30.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7f5fd7fff700 1 -- 172.21.15.77:0/612655645 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe001f070 con 0x7f5fd8003a20 2023-07-24T05:46:30.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7f5fd7fff700 1 -- 172.21.15.77:0/612655645 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe0023400 con 0x7f5fd8003a20 2023-07-24T05:46:30.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7f5fd7fff700 1 -- 172.21.15.77:0/612655645 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe0023770 con 0x7f5fd8003a20 2023-07-24T05:46:30.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.734+0000 7f5ff4e68700 1 -- 172.21.15.77:0/612655645 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff00c63d0 con 0x7f5fd8003a20 2023-07-24T05:46:30.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.734+0000 7f5ff4e68700 1 -- 172.21.15.77:0/612655645 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff00c6990 con 0x7f5fd8003a20 2023-07-24T05:46:30.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.734+0000 7f5ff4e68700 1 -- 172.21.15.77:0/612655645 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5ff00adfb0 con 0x7f5fd8003a20 2023-07-24T05:46:30.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7f87cffff700 1 -- 172.21.15.77:0/2257197629 <== mon.2 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f87dc011420 con 0x7f87e806a950 2023-07-24T05:46:30.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.734+0000 7f87cffff700 1 --2- 172.21.15.77:0/2257197629 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f87d40663c0 0x7f87d4068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.734+0000 7f87cffff700 1 -- 172.21.15.77:0/2257197629 <== mon.2 v2:172.21.15.103:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f87dc0858e0 con 0x7f87e806a950 2023-07-24T05:46:30.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.734+0000 7f87cffff700 1 --2- 172.21.15.77:0/2257197629 >> [v2:172.21.15.103:6824/1080481057,v1:172.21.15.103:6825/1080481057] conn(0x7f87d40700a0 0x7f87d40724e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.734+0000 7f87cffff700 1 -- 172.21.15.77:0/2257197629 --> [v2:172.21.15.103:6824/1080481057,v1:172.21.15.103:6825/1080481057] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f87d4072bb0 con 0x7f87d40700a0 2023-07-24T05:46:30.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.734+0000 7f87cffff700 1 -- 172.21.15.77:0/2257197629 <== mon.2 v2:172.21.15.103:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f87dc085c90 con 0x7f87e806a950 2023-07-24T05:46:30.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7f2cd7fff700 1 --2- 172.21.15.77:0/2339502100 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2ccc0663c0 0x7f2ccc068880 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0163a20 tx=0x7f2cd0009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:30.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7f35c5ffb700 1 -- 172.21.15.77:0/1325312849 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc011800 con 0x7f35bc009a20 2023-07-24T05:46:30.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7f35c5ffb700 1 -- 172.21.15.77:0/1325312849 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35cc011980 con 0x7f35bc009a20 2023-07-24T05:46:30.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7f35c5ffb700 1 -- 172.21.15.77:0/1325312849 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35cc011d30 con 0x7f35bc009a20 2023-07-24T05:46:30.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7f35d74bc700 1 -- 172.21.15.77:0/1325312849 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d00c9e80 con 0x7f35bc009a20 2023-07-24T05:46:30.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7ff8827cd700 1 -- 172.21.15.77:0/1074131122 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff874053d10 msgr2=0x7ff87403eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.730+0000 7ff8827cd700 1 --2- 172.21.15.77:0/1074131122 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff874053d10 0x7ff87403eba0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff8740537d0 tx=0x7ff870009bf0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.734+0000 7ff8827cd700 1 -- 172.21.15.77:0/1074131122 shutdown_connections 2023-07-24T05:46:30.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.734+0000 7ff8827cd700 1 --2- 172.21.15.77:0/1074131122 >> v2:172.21.15.103:3300/0 conn(0x7ff8740e6d30 0x7ff8740e71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.734+0000 7ff8827cd700 1 --2- 172.21.15.77:0/1074131122 >> v2:172.21.15.77:3300/0 conn(0x7ff874006c80 0x7ff8740540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.734+0000 7ff8827cd700 1 --2- 172.21.15.77:0/1074131122 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff874053d10 0x7ff87403eba0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.734+0000 7ff8827cd700 1 -- 172.21.15.77:0/1074131122 >> 172.21.15.77:0/1074131122 conn(0x7ff874055ae0 msgr2=0x7ff874055ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:30.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.734+0000 7ff8827cd700 1 -- 172.21.15.77:0/1074131122 shutdown_connections 2023-07-24T05:46:30.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.734+0000 7fcfb57fa700 1 -- 172.21.15.77:0/1742012229 <== osd.1 v2:172.21.15.77:6800/4133026815 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fcf90006bf0 con 0x7fcf900015e0 2023-07-24T05:46:30.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.734+0000 7f87e7fff700 1 --2- 172.21.15.77:0/2257197629 >> [v2:172.21.15.103:6824/1080481057,v1:172.21.15.103:6825/1080481057] conn(0x7f87d40700a0 0x7f87d40724e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.734+0000 7f87e6ffd700 1 --2- 172.21.15.77:0/2257197629 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f87d40663c0 0x7f87d4068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.734+0000 7f2ce53bb700 1 --2- 172.21.15.77:0/2339502100 >> [v2:172.21.15.103:6811/2756677504,v1:172.21.15.103:6813/2756677504] conn(0x7f2ccc0700a0 0x7f2ccc0724e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:30.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.734+0000 7fe31affd700 1 -- 172.21.15.77:0/2575081885 <== osd.2 v2:172.21.15.77:6808/2394142159 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe30c072a60 con 0x7fe30c06ff50 2023-07-24T05:46:30.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.734+0000 7f87e7fff700 1 --2- 172.21.15.77:0/2257197629 >> [v2:172.21.15.103:6824/1080481057,v1:172.21.15.103:6825/1080481057] conn(0x7f87d40700a0 0x7f87d40724e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:30.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.734+0000 7f87e6ffd700 1 --2- 172.21.15.77:0/2257197629 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f87d40663c0 0x7f87d4068880 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f87e80cee60 tx=0x7f87d8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:30.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.734+0000 7f35d74bc700 1 -- 172.21.15.77:0/1325312849 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d00ca440 con 0x7f35bc009a20 2023-07-24T05:46:30.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.734+0000 7ff8827cd700 1 -- 172.21.15.77:0/1074131122 wait complete. 2023-07-24T05:46:30.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.734+0000 7ff8827cd700 1 Processor -- start 2023-07-24T05:46:30.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.734+0000 7ff8827cd700 1 -- start start 2023-07-24T05:46:30.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.738+0000 7f87cffff700 1 -- 172.21.15.77:0/2257197629 <== osd.4 v2:172.21.15.103:6824/1080481057 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f87d4072bb0 con 0x7f87d40700a0 2023-07-24T05:46:30.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.738+0000 7f2cd57fa700 1 -- 172.21.15.77:0/2339502100 <== osd.5 v2:172.21.15.103:6811/2756677504 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f2ccc072bb0 con 0x7f2ccc0700a0 2023-07-24T05:46:30.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.738+0000 7ff8827cd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff874006c80 0x7ff874050ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.738+0000 7ff8827cd700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff874053d10 0x7ff8740d2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.738+0000 7ff8827cd700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff8740e6d30 0x7ff8740e14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.738+0000 7f35b37fe700 1 -- 172.21.15.77:0/1325312849 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f35ac000fc0 con 0x7f35bc009a20 2023-07-24T05:46:30.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.738+0000 7ff8827cd700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff874051400 con 0x7ff874006c80 2023-07-24T05:46:30.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.738+0000 7ff8827cd700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff874050140 con 0x7ff874053d10 2023-07-24T05:46:30.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.738+0000 7ff8827cd700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8740503e0 con 0x7ff8740e6d30 2023-07-24T05:46:30.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.738+0000 7ff87b7fe700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff874053d10 0x7ff8740d2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.738+0000 7ff87b7fe700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff874053d10 0x7ff8740d2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:33994/0 (socket says 172.21.15.77:33994) 2023-07-24T05:46:30.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.738+0000 7ff87b7fe700 1 -- 172.21.15.77:0/2688019415 learned_addr learned my addr 172.21.15.77:0/2688019415 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:30.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.738+0000 7ff880d6a700 1 --2- 172.21.15.77:0/2688019415 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff8740e6d30 0x7ff8740e14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.738+0000 7f5fd7fff700 1 -- 172.21.15.77:0/612655645 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5fe00238d0 con 0x7f5fd8003a20 2023-07-24T05:46:30.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.742+0000 7f5fd7fff700 1 --2- 172.21.15.77:0/612655645 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f5fdc066320 0x7f5fdc0687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.742+0000 7f5fd7fff700 1 -- 172.21.15.77:0/612655645 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5fe0000e40 con 0x7f5fd8003a20 2023-07-24T05:46:30.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.742+0000 7f5fd7fff700 1 --2- 172.21.15.77:0/612655645 >> [v2:172.21.15.77:6809/1492113982,v1:172.21.15.77:6813/1492113982] conn(0x7f5fdc06ff80 0x7f5fdc0723c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.742+0000 7f5fd7fff700 1 -- 172.21.15.77:0/612655645 --> [v2:172.21.15.77:6809/1492113982,v1:172.21.15.77:6813/1492113982] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5fdc072a90 con 0x7f5fdc06ff80 2023-07-24T05:46:30.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.742+0000 7f5fd7fff700 1 -- 172.21.15.77:0/612655645 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5fe0085820 con 0x7f5fd8003a20 2023-07-24T05:46:30.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.742+0000 7f5feeffd700 1 --2- 172.21.15.77:0/612655645 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f5fdc066320 0x7f5fdc0687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.742+0000 7f5feffff700 1 --2- 172.21.15.77:0/612655645 >> [v2:172.21.15.77:6809/1492113982,v1:172.21.15.77:6813/1492113982] conn(0x7f5fdc06ff80 0x7f5fdc0723c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.738+0000 7f35c5ffb700 1 -- 172.21.15.77:0/1325312849 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f35cc010350 con 0x7f35bc009a20 2023-07-24T05:46:30.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.742+0000 7f35c5ffb700 1 --2- 172.21.15.77:0/1325312849 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f35b4066370 0x7f35b4068830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.742+0000 7f35c5ffb700 1 -- 172.21.15.77:0/1325312849 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f35cc057fd0 con 0x7f35bc009a20 2023-07-24T05:46:30.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.742+0000 7f35c5ffb700 1 --2- 172.21.15.77:0/1325312849 >> [v2:172.21.15.103:6808/568977764,v1:172.21.15.103:6809/568977764] conn(0x7f35b4070050 0x7f35b4072490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.742+0000 7f35c5ffb700 1 -- 172.21.15.77:0/1325312849 --> [v2:172.21.15.103:6808/568977764,v1:172.21.15.103:6809/568977764] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f35b4072b60 con 0x7f35b4070050 2023-07-24T05:46:30.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.742+0000 7f35c5ffb700 1 -- 172.21.15.77:0/1325312849 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35cc00a370 con 0x7f35bc009a20 2023-07-24T05:46:30.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.738+0000 7ff87b7fe700 1 -- 172.21.15.77:0/2688019415 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff8740e6d30 msgr2=0x7ff8740e14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.738+0000 7ff87b7fe700 1 --2- 172.21.15.77:0/2688019415 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff8740e6d30 0x7ff8740e14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.738+0000 7ff87b7fe700 1 -- 172.21.15.77:0/2688019415 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff874006c80 msgr2=0x7ff874050ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.738+0000 7ff87b7fe700 1 --2- 172.21.15.77:0/2688019415 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff874006c80 0x7ff874050ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.738+0000 7ff87b7fe700 1 -- 172.21.15.77:0/2688019415 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff870009570 con 0x7ff874053d10 2023-07-24T05:46:30.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.738+0000 7ff87b7fe700 1 --2- 172.21.15.77:0/2688019415 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff874053d10 0x7ff8740d2340 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff86800b550 tx=0x7ff86800b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:30.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.738+0000 7ff878ff9700 1 -- 172.21.15.77:0/2688019415 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff868011830 con 0x7ff874053d10 2023-07-24T05:46:30.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.738+0000 7ff878ff9700 1 -- 172.21.15.77:0/2688019415 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8680119b0 con 0x7ff874053d10 2023-07-24T05:46:30.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.738+0000 7ff878ff9700 1 -- 172.21.15.77:0/2688019415 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff868011d60 con 0x7ff874053d10 2023-07-24T05:46:30.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.742+0000 7ff8827cd700 1 -- 172.21.15.77:0/2688019415 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8740506c0 con 0x7ff874053d10 2023-07-24T05:46:30.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.742+0000 7ff8827cd700 1 -- 172.21.15.77:0/2688019415 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff874052bd0 con 0x7ff874053d10 2023-07-24T05:46:30.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.742+0000 7f35d5a59700 1 --2- 172.21.15.77:0/1325312849 >> [v2:172.21.15.103:6808/568977764,v1:172.21.15.103:6809/568977764] conn(0x7f35b4070050 0x7f35b4072490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.742+0000 7f35d4a57700 1 --2- 172.21.15.77:0/1325312849 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f35b4066370 0x7f35b4068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.742+0000 7f5feffff700 1 --2- 172.21.15.77:0/612655645 >> [v2:172.21.15.77:6809/1492113982,v1:172.21.15.77:6813/1492113982] conn(0x7f5fdc06ff80 0x7f5fdc0723c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:30.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.742+0000 7f5feeffd700 1 --2- 172.21.15.77:0/612655645 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f5fdc066320 0x7f5fdc0687e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5ff00c8c70 tx=0x7f5fe4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:30.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.742+0000 7f35d4a57700 1 --2- 172.21.15.77:0/1325312849 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f35b4066370 0x7f35b4068830 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f35c0001eb0 tx=0x7f35c0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:30.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.742+0000 7f35d5a59700 1 --2- 172.21.15.77:0/1325312849 >> [v2:172.21.15.103:6808/568977764,v1:172.21.15.103:6809/568977764] conn(0x7f35b4070050 0x7f35b4072490 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:30.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.746+0000 7ff8827cd700 1 -- 172.21.15.77:0/2688019415 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff85c000fc0 con 0x7ff874053d10 2023-07-24T05:46:30.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.746+0000 7f5fd7fff700 1 -- 172.21.15.77:0/612655645 <== osd.3 v2:172.21.15.77:6809/1492113982 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f5fdc072a90 con 0x7f5fdc06ff80 2023-07-24T05:46:30.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.746+0000 7ff878ff9700 1 -- 172.21.15.77:0/2688019415 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff86801a400 con 0x7ff874053d10 2023-07-24T05:46:30.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.746+0000 7f35c5ffb700 1 -- 172.21.15.77:0/1325312849 <== osd.6 v2:172.21.15.103:6808/568977764 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f35b4072b60 con 0x7f35b4070050 2023-07-24T05:46:30.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.746+0000 7ff878ff9700 1 --2- 172.21.15.77:0/2688019415 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff860066340 0x7ff860068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.746+0000 7ff878ff9700 1 -- 172.21.15.77:0/2688019415 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff868083ee0 con 0x7ff874053d10 2023-07-24T05:46:30.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.746+0000 7ff878ff9700 1 --2- 172.21.15.77:0/2688019415 >> [v2:172.21.15.103:6800/1074557176,v1:172.21.15.103:6801/1074557176] conn(0x7ff86006ffa0 0x7ff8600723e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:30.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.746+0000 7ff878ff9700 1 -- 172.21.15.77:0/2688019415 --> [v2:172.21.15.103:6800/1074557176,v1:172.21.15.103:6801/1074557176] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff860072ab0 con 0x7ff86006ffa0 2023-07-24T05:46:30.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.746+0000 7ff878ff9700 1 -- 172.21.15.77:0/2688019415 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff868054be0 con 0x7ff874053d10 2023-07-24T05:46:30.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.746+0000 7ff87bfff700 1 --2- 172.21.15.77:0/2688019415 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff860066340 0x7ff860068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.750+0000 7ff880d6a700 1 --2- 172.21.15.77:0/2688019415 >> [v2:172.21.15.103:6800/1074557176,v1:172.21.15.103:6801/1074557176] conn(0x7ff86006ffa0 0x7ff8600723e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:30.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.750+0000 7ff87bfff700 1 --2- 172.21.15.77:0/2688019415 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff860066340 0x7ff860068800 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff870009c30 tx=0x7ff870010000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:30.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.750+0000 7ff880d6a700 1 --2- 172.21.15.77:0/2688019415 >> [v2:172.21.15.103:6800/1074557176,v1:172.21.15.103:6801/1074557176] conn(0x7ff86006ffa0 0x7ff8600723e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:30.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.754+0000 7f324e5ae700 1 -- 172.21.15.77:0/2126216011 --> [v2:172.21.15.77:6810/825987196,v1:172.21.15.77:6812/825987196] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3228002d60 con 0x7f3234070000 2023-07-24T05:46:30.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.754+0000 7f3244ff9700 1 -- 172.21.15.77:0/2126216011 <== osd.0 v2:172.21.15.77:6810/825987196 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3228002d60 con 0x7f3234070000 2023-07-24T05:46:30.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.754+0000 7ff878ff9700 1 -- 172.21.15.77:0/2688019415 <== osd.7 v2:172.21.15.103:6800/1074557176 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff860072ab0 con 0x7ff86006ffa0 2023-07-24T05:46:30.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.754+0000 7f324e5ae700 1 -- 172.21.15.77:0/2126216011 >> [v2:172.21.15.77:6810/825987196,v1:172.21.15.77:6812/825987196] conn(0x7f3234070000 msgr2=0x7f3234072440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.758+0000 7f324e5ae700 1 --2- 172.21.15.77:0/2126216011 >> [v2:172.21.15.77:6810/825987196,v1:172.21.15.77:6812/825987196] conn(0x7f3234070000 0x7f3234072440 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.758+0000 7f324e5ae700 1 -- 172.21.15.77:0/2126216011 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3234066320 msgr2=0x7f32340687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.758+0000 7f324e5ae700 1 --2- 172.21.15.77:0/2126216011 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3234066320 0x7f32340687e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f324806dee0 tx=0x7f323c008030 comp rx=0 tx=0).stop 2023-07-24T05:46:30.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.758+0000 7f324e5ae700 1 -- 172.21.15.77:0/2126216011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32480709f0 msgr2=0x7f32480c5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.758+0000 7f324e5ae700 1 --2- 172.21.15.77:0/2126216011 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32480709f0 0x7f32480c5310 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f324000cc50 tx=0x7f324000cf60 comp rx=0 tx=0).stop 2023-07-24T05:46:30.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.758+0000 7f324cb4b700 1 -- 172.21.15.77:0/2126216011 reap_dead start 2023-07-24T05:46:30.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.758+0000 7f324e5ae700 1 -- 172.21.15.77:0/2126216011 shutdown_connections 2023-07-24T05:46:30.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.758+0000 7f324e5ae700 1 -- 172.21.15.77:0/2126216011 >> 172.21.15.77:0/2126216011 conn(0x7f32480cacc0 msgr2=0x7f324806c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:30.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.758+0000 7f324e5ae700 1 -- 172.21.15.77:0/2126216011 shutdown_connections 2023-07-24T05:46:30.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.758+0000 7f324e5ae700 1 -- 172.21.15.77:0/2126216011 wait complete. 2023-07-24T05:46:30.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.762+0000 7f5ff4e68700 1 -- 172.21.15.77:0/612655645 --> [v2:172.21.15.77:6809/1492113982,v1:172.21.15.77:6813/1492113982] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5ff00adcd0 con 0x7f5fdc06ff80 2023-07-24T05:46:30.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.762+0000 7f5fd7fff700 1 -- 172.21.15.77:0/612655645 <== osd.3 v2:172.21.15.77:6809/1492113982 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5fe8001b50 con 0x7f5fdc06ff80 2023-07-24T05:46:30.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.762+0000 7f5ff4e68700 1 -- 172.21.15.77:0/612655645 >> [v2:172.21.15.77:6809/1492113982,v1:172.21.15.77:6813/1492113982] conn(0x7f5fdc06ff80 msgr2=0x7f5fdc0723c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.762+0000 7f5ff4e68700 1 --2- 172.21.15.77:0/612655645 >> [v2:172.21.15.77:6809/1492113982,v1:172.21.15.77:6813/1492113982] conn(0x7f5fdc06ff80 0x7f5fdc0723c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.766+0000 7f5ff4e68700 1 -- 172.21.15.77:0/612655645 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f5fdc066320 msgr2=0x7f5fdc0687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.766+0000 7f5ff4e68700 1 --2- 172.21.15.77:0/612655645 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f5fdc066320 0x7f5fdc0687e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5ff00c8c70 tx=0x7f5fe4008040 comp rx=0 tx=0).stop 2023-07-24T05:46:30.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.766+0000 7f5ff4e68700 1 -- 172.21.15.77:0/612655645 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fd8003a20 msgr2=0x7f5ff015f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.766+0000 7f5ff4e68700 1 --2- 172.21.15.77:0/612655645 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5fd8003a20 0x7f5ff015f8d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5fe0008010 tx=0x7f5fe00047e0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.766+0000 7f87edceb700 1 -- 172.21.15.77:0/2257197629 --> [v2:172.21.15.103:6824/1080481057,v1:172.21.15.103:6825/1080481057] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f87c8002d60 con 0x7f87d40700a0 2023-07-24T05:46:30.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.766+0000 7f5feffff700 1 -- 172.21.15.77:0/612655645 reap_dead start 2023-07-24T05:46:30.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.766+0000 7f5ff4e68700 1 -- 172.21.15.77:0/612655645 shutdown_connections 2023-07-24T05:46:30.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.766+0000 7f5ff4e68700 1 -- 172.21.15.77:0/612655645 >> 172.21.15.77:0/612655645 conn(0x7f5ff00cacc0 msgr2=0x7f5ff00c9800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:30.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.766+0000 7f87cffff700 1 -- 172.21.15.77:0/2257197629 <== osd.4 v2:172.21.15.103:6824/1080481057 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f87c8002d60 con 0x7f87d40700a0 2023-07-24T05:46:30.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.766+0000 7f5ff4e68700 1 -- 172.21.15.77:0/612655645 shutdown_connections 2023-07-24T05:46:30.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.766+0000 7f5ff4e68700 1 -- 172.21.15.77:0/612655645 wait complete. 2023-07-24T05:46:30.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.766+0000 7f2ce5bbc700 1 -- 172.21.15.77:0/2339502100 --> [v2:172.21.15.103:6811/2756677504,v1:172.21.15.103:6813/2756677504] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2ce00adcd0 con 0x7f2ccc0700a0 2023-07-24T05:46:30.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.770+0000 7f2cd57fa700 1 -- 172.21.15.77:0/2339502100 <== osd.5 v2:172.21.15.103:6811/2756677504 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2cd8001ce0 con 0x7f2ccc0700a0 2023-07-24T05:46:30.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.770+0000 7f2ce5bbc700 1 -- 172.21.15.77:0/2339502100 >> [v2:172.21.15.103:6811/2756677504,v1:172.21.15.103:6813/2756677504] conn(0x7f2ccc0700a0 msgr2=0x7f2ccc0724e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.770+0000 7f2ce5bbc700 1 --2- 172.21.15.77:0/2339502100 >> [v2:172.21.15.103:6811/2756677504,v1:172.21.15.103:6813/2756677504] conn(0x7f2ccc0700a0 0x7f2ccc0724e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.770+0000 7fcfa2ffd700 1 -- 172.21.15.77:0/1742012229 --> [v2:172.21.15.77:6800/4133026815,v1:172.21.15.77:6801/4133026815] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcf90005c70 con 0x7fcf900015e0 2023-07-24T05:46:30.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.770+0000 7fe32b59e700 1 -- 172.21.15.77:0/2575081885 --> [v2:172.21.15.77:6808/2394142159,v1:172.21.15.77:6811/2394142159] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe32c0cd6f0 con 0x7fe30c06ff50 2023-07-24T05:46:30.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.770+0000 7f2ce5bbc700 1 -- 172.21.15.77:0/2339502100 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2ccc0663c0 msgr2=0x7f2ccc068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.770+0000 7f2ce5bbc700 1 --2- 172.21.15.77:0/2339502100 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2ccc0663c0 0x7f2ccc068880 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0163a20 tx=0x7f2cd0009240 comp rx=0 tx=0).stop 2023-07-24T05:46:30.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.770+0000 7f2ce5bbc700 1 -- 172.21.15.77:0/2339502100 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2ce006b390 msgr2=0x7f2ce015d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.770+0000 7f2ce5bbc700 1 --2- 172.21.15.77:0/2339502100 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2ce006b390 0x7f2ce015d1b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2ce00cb830 tx=0x7f2cdc004770 comp rx=0 tx=0).stop 2023-07-24T05:46:30.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.770+0000 7f2ce53bb700 1 -- 172.21.15.77:0/2339502100 reap_dead start 2023-07-24T05:46:30.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.770+0000 7f2ce5bbc700 1 -- 172.21.15.77:0/2339502100 shutdown_connections 2023-07-24T05:46:30.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.770+0000 7f2ce5bbc700 1 -- 172.21.15.77:0/2339502100 >> 172.21.15.77:0/2339502100 conn(0x7f2ce00cacc0 msgr2=0x7f2ce006a180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:30.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.770+0000 7fe31affd700 1 -- 172.21.15.77:0/2575081885 <== osd.2 v2:172.21.15.77:6808/2394142159 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe324009cb0 con 0x7fe30c06ff50 2023-07-24T05:46:30.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.770+0000 7f87edceb700 1 -- 172.21.15.77:0/2257197629 >> [v2:172.21.15.103:6824/1080481057,v1:172.21.15.103:6825/1080481057] conn(0x7f87d40700a0 msgr2=0x7f87d40724e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.770+0000 7f87edceb700 1 --2- 172.21.15.77:0/2257197629 >> [v2:172.21.15.103:6824/1080481057,v1:172.21.15.103:6825/1080481057] conn(0x7f87d40700a0 0x7f87d40724e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.770+0000 7f2ce5bbc700 1 -- 172.21.15.77:0/2339502100 shutdown_connections 2023-07-24T05:46:30.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.770+0000 7f2ce5bbc700 1 -- 172.21.15.77:0/2339502100 wait complete. 2023-07-24T05:46:30.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.770+0000 7fe32b59e700 1 -- 172.21.15.77:0/2575081885 >> [v2:172.21.15.77:6808/2394142159,v1:172.21.15.77:6811/2394142159] conn(0x7fe30c06ff50 msgr2=0x7fe30c072390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.770+0000 7fe32b59e700 1 --2- 172.21.15.77:0/2575081885 >> [v2:172.21.15.77:6808/2394142159,v1:172.21.15.77:6811/2394142159] conn(0x7fe30c06ff50 0x7fe30c072390 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.770+0000 7f87edceb700 1 -- 172.21.15.77:0/2257197629 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f87d40663c0 msgr2=0x7f87d4068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.770+0000 7f87edceb700 1 --2- 172.21.15.77:0/2257197629 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f87d40663c0 0x7f87d4068880 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f87e80cee60 tx=0x7f87d8009040 comp rx=0 tx=0).stop 2023-07-24T05:46:30.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.770+0000 7f87edceb700 1 -- 172.21.15.77:0/2257197629 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f87e806a950 msgr2=0x7f87e8157ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.770+0000 7f87edceb700 1 --2- 172.21.15.77:0/2257197629 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f87e806a950 0x7f87e8157ae0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f87dc016000 tx=0x7f87dc004770 comp rx=0 tx=0).stop 2023-07-24T05:46:30.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.770+0000 7f87e7fff700 1 -- 172.21.15.77:0/2257197629 reap_dead start 2023-07-24T05:46:30.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.770+0000 7fcfb57fa700 1 -- 172.21.15.77:0/1742012229 <== osd.1 v2:172.21.15.77:6800/4133026815 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcf90005c70 con 0x7fcf900015e0 2023-07-24T05:46:30.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.774+0000 7fcfbde27700 1 -- 172.21.15.77:0/1742012229 >> [v2:172.21.15.77:6800/4133026815,v1:172.21.15.77:6801/4133026815] conn(0x7fcf900015e0 msgr2=0x7fcf90003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.774+0000 7fcfbde27700 1 --2- 172.21.15.77:0/1742012229 >> [v2:172.21.15.77:6800/4133026815,v1:172.21.15.77:6801/4133026815] conn(0x7fcf900015e0 0x7fcf90003aa0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.774+0000 7fe32b59e700 1 -- 172.21.15.77:0/2575081885 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe30c0662f0 msgr2=0x7fe30c0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.774+0000 7fe32b59e700 1 --2- 172.21.15.77:0/2575081885 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe30c0662f0 0x7fe30c0687b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe31c000c00 tx=0x7fe31c008030 comp rx=0 tx=0).stop 2023-07-24T05:46:30.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.774+0000 7fe32b59e700 1 -- 172.21.15.77:0/2575081885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe32c0ae5a0 msgr2=0x7fe32c09b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.774+0000 7fe32b59e700 1 --2- 172.21.15.77:0/2575081885 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe32c0ae5a0 0x7fe32c09b860 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe32000c520 tx=0x7fe32000c830 comp rx=0 tx=0).stop 2023-07-24T05:46:30.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.774+0000 7fe32ad9d700 1 -- 172.21.15.77:0/2575081885 reap_dead start 2023-07-24T05:46:30.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.774+0000 7fcfbde27700 1 -- 172.21.15.77:0/1742012229 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fcf9c066340 msgr2=0x7fcf9c068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.774+0000 7f87edceb700 1 -- 172.21.15.77:0/2257197629 shutdown_connections 2023-07-24T05:46:30.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.774+0000 7f87edceb700 1 -- 172.21.15.77:0/2257197629 >> 172.21.15.77:0/2257197629 conn(0x7f87e80cacc0 msgr2=0x7f87e80cb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:30.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.774+0000 7fcfbde27700 1 --2- 172.21.15.77:0/1742012229 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fcf9c066340 0x7fcf9c068800 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcfb802ca30 tx=0x7fcfb808af90 comp rx=0 tx=0).stop 2023-07-24T05:46:30.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.774+0000 7fcfbde27700 1 -- 172.21.15.77:0/1742012229 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcfb00eb3a0 msgr2=0x7fcfb00e9e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.774+0000 7fcfbde27700 1 --2- 172.21.15.77:0/1742012229 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcfb00eb3a0 0x7fcfb00e9e10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcfac00c400 tx=0x7fcfac00c710 comp rx=0 tx=0).stop 2023-07-24T05:46:30.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.774+0000 7fcfbd626700 1 -- 172.21.15.77:0/1742012229 reap_dead start 2023-07-24T05:46:30.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.774+0000 7fe32b59e700 1 -- 172.21.15.77:0/2575081885 shutdown_connections 2023-07-24T05:46:30.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.774+0000 7fe32b59e700 1 -- 172.21.15.77:0/2575081885 >> 172.21.15.77:0/2575081885 conn(0x7fe32c0cacc0 msgr2=0x7fe32c0c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:30.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.774+0000 7fcfbde27700 1 -- 172.21.15.77:0/1742012229 shutdown_connections 2023-07-24T05:46:30.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.774+0000 7fcfbde27700 1 -- 172.21.15.77:0/1742012229 >> 172.21.15.77:0/1742012229 conn(0x7fcfb0054cf0 msgr2=0x7fcfb00550d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:30.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.774+0000 7fe32b59e700 1 -- 172.21.15.77:0/2575081885 shutdown_connections 2023-07-24T05:46:30.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.774+0000 7fe32b59e700 1 -- 172.21.15.77:0/2575081885 wait complete. 2023-07-24T05:46:30.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.774+0000 7fcfbde27700 1 -- 172.21.15.77:0/1742012229 shutdown_connections 2023-07-24T05:46:30.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.774+0000 7fcfbde27700 1 -- 172.21.15.77:0/1742012229 wait complete. 2023-07-24T05:46:30.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.774+0000 7f87edceb700 1 -- 172.21.15.77:0/2257197629 shutdown_connections 2023-07-24T05:46:30.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.774+0000 7f87edceb700 1 -- 172.21.15.77:0/2257197629 wait complete. 2023-07-24T05:46:30.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.778+0000 7f35b37fe700 1 -- 172.21.15.77:0/1325312849 --> [v2:172.21.15.103:6808/568977764,v1:172.21.15.103:6809/568977764] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f35ac002d60 con 0x7f35b4070050 2023-07-24T05:46:30.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.778+0000 7f35c5ffb700 1 -- 172.21.15.77:0/1325312849 <== osd.6 v2:172.21.15.103:6808/568977764 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f35ac002d60 con 0x7f35b4070050 2023-07-24T05:46:30.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.778+0000 7f35b37fe700 1 -- 172.21.15.77:0/1325312849 >> [v2:172.21.15.103:6808/568977764,v1:172.21.15.103:6809/568977764] conn(0x7f35b4070050 msgr2=0x7f35b4072490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.778+0000 7f35b37fe700 1 --2- 172.21.15.77:0/1325312849 >> [v2:172.21.15.103:6808/568977764,v1:172.21.15.103:6809/568977764] conn(0x7f35b4070050 0x7f35b4072490 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.778+0000 7ff8827cd700 1 -- 172.21.15.77:0/2688019415 --> [v2:172.21.15.103:6800/1074557176,v1:172.21.15.103:6801/1074557176] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff85c002d60 con 0x7ff86006ffa0 2023-07-24T05:46:30.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.782+0000 7f35b37fe700 1 -- 172.21.15.77:0/1325312849 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f35b4066370 msgr2=0x7f35b4068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.782+0000 7f35b37fe700 1 --2- 172.21.15.77:0/1325312849 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f35b4066370 0x7f35b4068830 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f35c0001eb0 tx=0x7f35c0009040 comp rx=0 tx=0).stop 2023-07-24T05:46:30.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.782+0000 7f35b37fe700 1 -- 172.21.15.77:0/1325312849 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35bc009a20 msgr2=0x7f35d00989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.782+0000 7f35b37fe700 1 --2- 172.21.15.77:0/1325312849 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f35bc009a20 0x7f35d00989f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f35cc00c540 tx=0x7f35cc00c850 comp rx=0 tx=0).stop 2023-07-24T05:46:30.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.782+0000 7f35d5a59700 1 -- 172.21.15.77:0/1325312849 reap_dead start 2023-07-24T05:46:30.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.782+0000 7f35b37fe700 1 -- 172.21.15.77:0/1325312849 shutdown_connections 2023-07-24T05:46:30.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.782+0000 7f35b37fe700 1 -- 172.21.15.77:0/1325312849 >> 172.21.15.77:0/1325312849 conn(0x7f35d00cac00 msgr2=0x7f35d0164dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:30.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.782+0000 7f35b37fe700 1 -- 172.21.15.77:0/1325312849 shutdown_connections 2023-07-24T05:46:30.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.782+0000 7f35b37fe700 1 -- 172.21.15.77:0/1325312849 wait complete. 2023-07-24T05:46:30.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.782+0000 7ff878ff9700 1 -- 172.21.15.77:0/2688019415 <== osd.7 v2:172.21.15.103:6800/1074557176 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff85c002d60 con 0x7ff86006ffa0 2023-07-24T05:46:30.843 INFO:teuthology.orchestra.run.smithi077.stdout:60129542153 2023-07-24T05:46:30.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.782+0000 7ff8827cd700 1 -- 172.21.15.77:0/2688019415 >> [v2:172.21.15.103:6800/1074557176,v1:172.21.15.103:6801/1074557176] conn(0x7ff86006ffa0 msgr2=0x7ff8600723e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.782+0000 7ff8827cd700 1 --2- 172.21.15.77:0/2688019415 >> [v2:172.21.15.103:6800/1074557176,v1:172.21.15.103:6801/1074557176] conn(0x7ff86006ffa0 0x7ff8600723e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:30.844 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-24T05:46:30.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.782+0000 7ff8827cd700 1 -- 172.21.15.77:0/2688019415 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff860066340 msgr2=0x7ff860068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.782+0000 7ff8827cd700 1 --2- 172.21.15.77:0/2688019415 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff860066340 0x7ff860068800 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff870009c30 tx=0x7ff870010000 comp rx=0 tx=0).stop 2023-07-24T05:46:30.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.782+0000 7ff8827cd700 1 -- 172.21.15.77:0/2688019415 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff874053d10 msgr2=0x7ff8740d2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:30.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.782+0000 7ff8827cd700 1 --2- 172.21.15.77:0/2688019415 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff874053d10 0x7ff8740d2340 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff86800b550 tx=0x7ff86800b910 comp rx=0 tx=0).stop 2023-07-24T05:46:30.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.782+0000 7ff880d6a700 1 -- 172.21.15.77:0/2688019415 reap_dead start 2023-07-24T05:46:30.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.782+0000 7ff8827cd700 1 -- 172.21.15.77:0/2688019415 shutdown_connections 2023-07-24T05:46:30.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.782+0000 7ff8827cd700 1 -- 172.21.15.77:0/2688019415 >> 172.21.15.77:0/2688019415 conn(0x7ff874055ae0 msgr2=0x7ff874004be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:30.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.782+0000 7ff8827cd700 1 -- 172.21.15.77:0/2688019415 shutdown_connections 2023-07-24T05:46:30.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:30.782+0000 7ff8827cd700 1 -- 172.21.15.77:0/2688019415 wait complete. 2023-07-24T05:46:30.847 INFO:teuthology.orchestra.run.smithi077.stdout:60129542154 2023-07-24T05:46:30.847 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-24T05:46:30.848 INFO:teuthology.orchestra.run.smithi077.stdout:60129542153 2023-07-24T05:46:30.848 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-24T05:46:30.849 INFO:teuthology.orchestra.run.smithi077.stdout:60129542154 2023-07-24T05:46:30.849 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-24T05:46:30.850 INFO:teuthology.orchestra.run.smithi077.stdout:60129542154 2023-07-24T05:46:30.850 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-24T05:46:30.851 INFO:teuthology.orchestra.run.smithi077.stdout:60129542154 2023-07-24T05:46:30.851 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-24T05:46:30.852 INFO:teuthology.orchestra.run.smithi077.stdout:60129542153 2023-07-24T05:46:30.852 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-24T05:46:30.853 INFO:teuthology.orchestra.run.smithi077.stdout:60129542154 2023-07-24T05:46:30.854 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-24T05:46:31.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.102+0000 7fc8e6adf700 1 Processor -- start 2023-07-24T05:46:31.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.106+0000 7fc8e6adf700 1 -- start start 2023-07-24T05:46:31.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.106+0000 7fc8e6adf700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc8e0158b30 0x7fc8e00b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.106+0000 7fc8e6adf700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc8e00b0330 0x7fc8e00adca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.106+0000 7fc8e6adf700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8e00b20b0 con 0x7fc8e00aae70 2023-07-24T05:46:31.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.106+0000 7fc8e6adf700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8e0158f10 con 0x7fc8e00b0330 2023-07-24T05:46:31.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.106+0000 7fc8e6adf700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8e00b22e0 con 0x7fc8e0158b30 2023-07-24T05:46:31.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.106+0000 7fc8e507c700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc8e00b0330 0x7fc8e00adca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.106+0000 7fc8e487b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc8e0158b30 0x7fc8e00b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.106+0000 7fc8e487b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc8e0158b30 0x7fc8e00b1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:34010/0 (socket says 172.21.15.77:34010) 2023-07-24T05:46:31.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.106+0000 7fc8e487b700 1 -- 172.21.15.77:0/1269955608 learned_addr learned my addr 172.21.15.77:0/1269955608 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:31.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.106+0000 7fc8e487b700 1 -- 172.21.15.77:0/1269955608 >> v2:172.21.15.77:3300/0 conn(0x7fc8e00b0330 msgr2=0x7fc8e00adca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:31.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.106+0000 7fc8e487b700 1 --2- 172.21.15.77:0/1269955608 >> v2:172.21.15.77:3300/0 conn(0x7fc8e00b0330 0x7fc8e00adca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.106+0000 7fc8e487b700 1 -- 172.21.15.77:0/1269955608 >> v1:172.21.15.77:6789/0 conn(0x7fc8e00aae70 legacy=0x7fc8e00afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.106+0000 7fc8e487b700 1 -- 172.21.15.77:0/1269955608 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e00b25c0 con 0x7fc8e0158b30 2023-07-24T05:46:31.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.110+0000 7fc8e487b700 1 --2- 172.21.15.77:0/1269955608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8e0158b30 0x7fc8e00b1b70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc8e00cac90 tx=0x7fc8d000d330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d21ce7af8706927 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:31.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.110+0000 7fc8df7fe700 1 -- 172.21.15.77:0/1269955608 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d0010070 con 0x7fc8e0158b30 2023-07-24T05:46:31.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.110+0000 7fc8df7fe700 1 -- 172.21.15.77:0/1269955608 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d000d9d0 con 0x7fc8e0158b30 2023-07-24T05:46:31.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.110+0000 7fc8df7fe700 1 -- 172.21.15.77:0/1269955608 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d000dd40 con 0x7fc8e0158b30 2023-07-24T05:46:31.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.110+0000 7fc8e6adf700 1 -- 172.21.15.77:0/1269955608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8e0158b30 msgr2=0x7fc8e00b1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.110+0000 7fc8e6adf700 1 --2- 172.21.15.77:0/1269955608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8e0158b30 0x7fc8e00b1b70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc8e00cac90 tx=0x7fc8d000d330 comp rx=0 tx=0).stop 2023-07-24T05:46:31.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.110+0000 7fc8e6adf700 1 -- 172.21.15.77:0/1269955608 shutdown_connections 2023-07-24T05:46:31.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.110+0000 7fc8e6adf700 1 --2- 172.21.15.77:0/1269955608 >> v2:172.21.15.77:3300/0 conn(0x7fc8e00b0330 0x7fc8e00adca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.110+0000 7fc8e6adf700 1 --2- 172.21.15.77:0/1269955608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8e0158b30 0x7fc8e00b1b70 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.110+0000 7fc8e6adf700 1 -- 172.21.15.77:0/1269955608 >> 172.21.15.77:0/1269955608 conn(0x7fc8e00cacc0 msgr2=0x7fc8e00cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:31.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.110+0000 7f68ad065700 1 Processor -- start 2023-07-24T05:46:31.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.110+0000 7f68ad065700 1 -- start start 2023-07-24T05:46:31.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.114+0000 7fc8e6adf700 1 -- 172.21.15.77:0/1269955608 shutdown_connections 2023-07-24T05:46:31.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.114+0000 7fc8e6adf700 1 -- 172.21.15.77:0/1269955608 wait complete. 2023-07-24T05:46:31.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.114+0000 7fc8e6adf700 1 Processor -- start 2023-07-24T05:46:31.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.114+0000 7f68ad065700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f68a80d2480 0x7f68a80d2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.114+0000 7f68a6d9d700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f68a80b1a10 0x7f68a80ceee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57170/0 (socket says 172.21.15.77:57170) 2023-07-24T05:46:31.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.114+0000 7f68a6d9d700 1 -- 172.21.15.77:0/818109007 learned_addr learned my addr 172.21.15.77:0/818109007 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:31.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.114+0000 7f68a759e700 1 --2- 172.21.15.77:0/818109007 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f68a80d2480 0x7f68a80d2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.114+0000 7f68ad065700 1 -- 172.21.15.77:0/818109007 --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68a80c5de0 con 0x7f68a80b1a10 2023-07-24T05:46:31.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.114+0000 7fc8e6adf700 1 -- start start 2023-07-24T05:46:31.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.114+0000 7f68ad065700 1 -- 172.21.15.77:0/818109007 --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68a806d700 con 0x7f68a806bc80 2023-07-24T05:46:31.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.114+0000 7f68ad065700 1 -- 172.21.15.77:0/818109007 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a80d2e50 con 0x7f68a80d2480 2023-07-24T05:46:31.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.118+0000 7fc8e6adf700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8e00aae70 0x7fc8e01523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.114+0000 7f68a5d9b700 1 -- 172.21.15.77:0/818109007 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3024225065 0 0) 0x7f68a80c5de0 con 0x7f68a80b1a10 2023-07-24T05:46:31.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.118+0000 7fc8e6adf700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8e00b0330 0x7fc8e01dedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.118+0000 7fc8e487b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8e00aae70 0x7fc8e01523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.118+0000 7fc8e487b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8e00aae70 0x7fc8e01523f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58892/0 (socket says 172.21.15.77:58892) 2023-07-24T05:46:31.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.118+0000 7fc8e487b700 1 -- 172.21.15.77:0/1670215740 learned_addr learned my addr 172.21.15.77:0/1670215740 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:31.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.118+0000 7fc8e6adf700 1 --2- 172.21.15.77:0/1670215740 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8e0158b30 0x7fc8e0070990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.118+0000 7fc8e6adf700 1 -- 172.21.15.77:0/1670215740 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e01dfd30 con 0x7fc8e00aae70 2023-07-24T05:46:31.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.118+0000 7fc8dffff700 1 --2- 172.21.15.77:0/1670215740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8e00b0330 0x7fc8e01dedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.118+0000 7fc8e6adf700 1 -- 172.21.15.77:0/1670215740 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e01560a0 con 0x7fc8e00b0330 2023-07-24T05:46:31.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.118+0000 7fc8e6adf700 1 -- 172.21.15.77:0/1670215740 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e01df770 con 0x7fc8e0158b30 2023-07-24T05:46:31.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.118+0000 7fc8e507c700 1 --2- 172.21.15.77:0/1670215740 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8e0158b30 0x7fc8e0070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.114+0000 7f68a5d9b700 1 -- 172.21.15.77:0/818109007 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68900035d0 con 0x7f68a80b1a10 2023-07-24T05:46:31.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.114+0000 7f68a5d9b700 1 -- 172.21.15.77:0/818109007 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4000339536 0 0) 0x7f68a806d700 con 0x7f68a806bc80 2023-07-24T05:46:31.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.114+0000 7f68a5d9b700 1 -- 172.21.15.77:0/818109007 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68a80c5de0 con 0x7f68a806bc80 2023-07-24T05:46:31.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.114+0000 7f68a5d9b700 1 -- 172.21.15.77:0/818109007 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 589506283 0 0) 0x7f68900035d0 con 0x7f68a80b1a10 2023-07-24T05:46:31.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.114+0000 7f68a5d9b700 1 -- 172.21.15.77:0/818109007 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f68a80d2480 msgr2=0x7f68a80d2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:31.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.114+0000 7f68a5d9b700 1 --2- 172.21.15.77:0/818109007 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f68a80d2480 0x7f68a80d2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.114+0000 7f68a5d9b700 1 -- 172.21.15.77:0/818109007 >> v1:172.21.15.103:6789/0 conn(0x7f68a806bc80 legacy=0x7f68a80cfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.114+0000 7f68a5d9b700 1 -- 172.21.15.77:0/818109007 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a806d9e0 con 0x7f68a80b1a10 2023-07-24T05:46:31.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.114+0000 7f68a5d9b700 1 -- 172.21.15.77:0/818109007 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4109865209 0 0) 0x7f6898001670 con 0x7f68a80b1a10 2023-07-24T05:46:31.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.114+0000 7f68a5d9b700 1 -- 172.21.15.77:0/818109007 >> v1:172.21.15.77:6789/0 conn(0x7f68a80b1a10 legacy=0x7f68a80ceee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.114+0000 7f68a5d9b700 1 --2- 172.21.15.77:0/818109007 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f68a80d2480 0x7f6890003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.114+0000 7f68a5d9b700 1 --2- 172.21.15.77:0/818109007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6890004140 0x7f6890004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.114+0000 7f68a5d9b700 1 --2- 172.21.15.77:0/818109007 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6890004db0 0x7f6890005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.114+0000 7f68a5d9b700 1 -- 172.21.15.77:0/818109007 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a80d2e50 con 0x7f6890004140 2023-07-24T05:46:31.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.114+0000 7f68a5d9b700 1 -- 172.21.15.77:0/818109007 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689001cbd0 con 0x7f6890004db0 2023-07-24T05:46:31.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.114+0000 7f68a5d9b700 1 -- 172.21.15.77:0/818109007 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6890005a00 con 0x7f68a80d2480 2023-07-24T05:46:31.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.114+0000 7f68a659c700 1 --2- 172.21.15.77:0/818109007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6890004140 0x7f6890004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.118+0000 7f68a759e700 1 --2- 172.21.15.77:0/818109007 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6890004db0 0x7f6890005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.118+0000 7f68a659c700 1 -- 172.21.15.77:0/818109007 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f68a80d2480 msgr2=0x7f6890003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:31.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.118+0000 7f68a659c700 1 --2- 172.21.15.77:0/818109007 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f68a80d2480 0x7f6890003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.118+0000 7fc8dffff700 1 -- 172.21.15.77:0/1670215740 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8e0158b30 msgr2=0x7fc8e0070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.118+0000 7fc8dffff700 1 --2- 172.21.15.77:0/1670215740 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8e0158b30 0x7fc8e0070990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.118+0000 7fc8dffff700 1 -- 172.21.15.77:0/1670215740 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8e00aae70 msgr2=0x7fc8e01523f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.118+0000 7fc8dffff700 1 --2- 172.21.15.77:0/1670215740 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8e00aae70 0x7fc8e01523f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.118+0000 7fc8dffff700 1 -- 172.21.15.77:0/1670215740 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d00085f0 con 0x7fc8e00b0330 2023-07-24T05:46:31.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.118+0000 7fc8e487b700 1 --2- 172.21.15.77:0/1670215740 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8e00aae70 0x7fc8e01523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:46:31.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.118+0000 7f68a659c700 1 -- 172.21.15.77:0/818109007 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6890004db0 msgr2=0x7f6890005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:31.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.118+0000 7f68a659c700 1 --2- 172.21.15.77:0/818109007 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6890004db0 0x7f6890005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.118+0000 7fa8a0ddc700 1 Processor -- start 2023-07-24T05:46:31.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.118+0000 7f68a659c700 1 -- 172.21.15.77:0/818109007 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a806d9e0 con 0x7f6890004140 2023-07-24T05:46:31.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.118+0000 7fc8dffff700 1 --2- 172.21.15.77:0/1670215740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8e00b0330 0x7fc8e01dedd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc8d800cbe0 tx=0x7fc8d800cef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:31.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.118+0000 7f68a759e700 1 --2- 172.21.15.77:0/818109007 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6890004db0 0x7f6890005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:46:31.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.122+0000 7f0738a9e700 1 Processor -- start 2023-07-24T05:46:31.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.118+0000 7f68a659c700 1 --2- 172.21.15.77:0/818109007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6890004140 0x7f6890004870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f689c001960 tx=0x7f68900058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=854ca064be3c1ee server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:31.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.122+0000 7fc8dd7fa700 1 -- 172.21.15.77:0/1670215740 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d8003c20 con 0x7fc8e00b0330 2023-07-24T05:46:31.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.122+0000 7fc8dd7fa700 1 -- 172.21.15.77:0/1670215740 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d8003d80 con 0x7fc8e00b0330 2023-07-24T05:46:31.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.122+0000 7fc8dd7fa700 1 -- 172.21.15.77:0/1670215740 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d800aaa0 con 0x7fc8e00b0330 2023-07-24T05:46:31.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.122+0000 7fc8e6adf700 1 -- 172.21.15.77:0/1670215740 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8e01dfa50 con 0x7fc8e00b0330 2023-07-24T05:46:31.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.122+0000 7f0738a9e700 1 -- start start 2023-07-24T05:46:31.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.122+0000 7fc8e6adf700 1 -- 172.21.15.77:0/1670215740 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8e0152930 con 0x7fc8e00b0330 2023-07-24T05:46:31.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.118+0000 7f68a5d9b700 1 -- 172.21.15.77:0/818109007 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689c001450 con 0x7f6890004140 2023-07-24T05:46:31.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.118+0000 7f68a5d9b700 1 -- 172.21.15.77:0/818109007 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689c0052f0 con 0x7f6890004140 2023-07-24T05:46:31.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.118+0000 7f68a5d9b700 1 -- 172.21.15.77:0/818109007 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689c0036a0 con 0x7f6890004140 2023-07-24T05:46:31.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.118+0000 7f68ad065700 1 -- 172.21.15.77:0/818109007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6890004140 msgr2=0x7f6890004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.118+0000 7f68ad065700 1 --2- 172.21.15.77:0/818109007 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6890004140 0x7f6890004870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f689c001960 tx=0x7f68900058a0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.118+0000 7f68a759e700 1 -- 172.21.15.77:0/818109007 reap_dead start 2023-07-24T05:46:31.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.118+0000 7f68ad065700 1 -- 172.21.15.77:0/818109007 shutdown_connections 2023-07-24T05:46:31.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.118+0000 7f68ad065700 1 -- 172.21.15.77:0/818109007 >> 172.21.15.77:0/818109007 conn(0x7f68a80b7600 msgr2=0x7f68a80b79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:31.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.122+0000 7fc8e6adf700 1 -- 172.21.15.77:0/1670215740 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8e0155f00 con 0x7fc8e00b0330 2023-07-24T05:46:31.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.122+0000 7fa8a0ddc700 1 -- start start 2023-07-24T05:46:31.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.122+0000 7f0738a9e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f072c0e7940 0x7f072c0eb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.118+0000 7f68ad065700 1 -- 172.21.15.77:0/818109007 shutdown_connections 2023-07-24T05:46:31.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.118+0000 7f68ad065700 1 -- 172.21.15.77:0/818109007 wait complete. 2023-07-24T05:46:31.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.122+0000 7fa8a0ddc700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa8940e7620 0x7fa894009060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.122+0000 7f0731d9b700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f072c04a0a0 0x7f072c0eba00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57172/0 (socket says 172.21.15.77:57172) 2023-07-24T05:46:31.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.122+0000 7f0731d9b700 1 -- 172.21.15.77:0/2121646462 learned_addr learned my addr 172.21.15.77:0/2121646462 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:31.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.122+0000 7f073259c700 1 --2- 172.21.15.77:0/2121646462 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f072c0e7940 0x7f072c0eb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.122+0000 7f0738a9e700 1 --2- 172.21.15.77:0/2121646462 >> v2:172.21.15.77:3300/0 conn(0x7f072c049a30 0x7f072c0523b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.122+0000 7f0738a9e700 1 -- 172.21.15.77:0/2121646462 --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f072c054360 con 0x7f072c04a0a0 2023-07-24T05:46:31.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.122+0000 7f0738a9e700 1 -- 172.21.15.77:0/2121646462 --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f072c0545b0 con 0x7f072c049a30 2023-07-24T05:46:31.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.122+0000 7f0738a9e700 1 -- 172.21.15.77:0/2121646462 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f072c051bb0 con 0x7f072c0e7940 2023-07-24T05:46:31.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7fa89a59c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa8940e7620 0x7fa894009060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7fa89a59c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa8940e7620 0x7fa894009060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.77:53948/0 (socket says 172.21.15.77:53948) 2023-07-24T05:46:31.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7fa89a59c700 1 -- 172.21.15.77:0/4249851413 learned_addr learned my addr 172.21.15.77:0/4249851413 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:31.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7fa8a0ddc700 1 --2- 172.21.15.77:0/4249851413 >> v2:172.21.15.103:3300/0 conn(0x7fa8940072b0 0x7fa894054130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7fa8a0ddc700 1 -- 172.21.15.77:0/4249851413 --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa894053ca0 con 0x7fa894050d20 2023-07-24T05:46:31.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7fa8a0ddc700 1 -- 172.21.15.77:0/4249851413 --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa894051270 con 0x7fa8940072b0 2023-07-24T05:46:31.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7f68ad065700 1 Processor -- start 2023-07-24T05:46:31.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7fa8a0ddc700 1 -- 172.21.15.77:0/4249851413 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa894051550 con 0x7fa8940e7620 2023-07-24T05:46:31.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7fa89ad9d700 1 --2- 172.21.15.77:0/4249851413 >> v2:172.21.15.103:3300/0 conn(0x7fa8940072b0 0x7fa894054130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7fa89a59c700 1 -- 172.21.15.77:0/4249851413 >> v2:172.21.15.103:3300/0 conn(0x7fa8940072b0 msgr2=0x7fa894054130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:31.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7fa89a59c700 1 --2- 172.21.15.77:0/4249851413 >> v2:172.21.15.103:3300/0 conn(0x7fa8940072b0 0x7fa894054130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7f0732d9d700 1 --2- 172.21.15.77:0/2121646462 >> v2:172.21.15.77:3300/0 conn(0x7f072c049a30 0x7f072c0523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7f68ad065700 1 -- start start 2023-07-24T05:46:31.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7fa89a59c700 1 -- 172.21.15.77:0/4249851413 >> v1:172.21.15.77:6789/0 conn(0x7fa894050d20 legacy=0x7fa894006ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7fa89a59c700 1 -- 172.21.15.77:0/4249851413 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa894051830 con 0x7fa8940e7620 2023-07-24T05:46:31.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7f073159a700 1 -- 172.21.15.77:0/2121646462 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3547488244 0 0) 0x7f072c054360 con 0x7f072c04a0a0 2023-07-24T05:46:31.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7f073159a700 1 -- 172.21.15.77:0/2121646462 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f071c0035d0 con 0x7f072c04a0a0 2023-07-24T05:46:31.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7f073259c700 1 -- 172.21.15.77:0/2121646462 >> v2:172.21.15.77:3300/0 conn(0x7f072c049a30 msgr2=0x7f072c0523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:31.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7f073259c700 1 --2- 172.21.15.77:0/2121646462 >> v2:172.21.15.77:3300/0 conn(0x7f072c049a30 0x7f072c0523b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7f073259c700 1 -- 172.21.15.77:0/2121646462 >> v1:172.21.15.77:6789/0 conn(0x7f072c04a0a0 legacy=0x7f072c0eba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7f073259c700 1 -- 172.21.15.77:0/2121646462 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f072c051e90 con 0x7f072c0e7940 2023-07-24T05:46:31.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7fc8dd7fa700 1 -- 172.21.15.77:0/1670215740 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc8d800ac00 con 0x7fc8e00b0330 2023-07-24T05:46:31.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7fa89a59c700 1 --2- 172.21.15.77:0/4249851413 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa8940e7620 0x7fa894009060 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa88c009910 tx=0x7fa88c009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=110b7692cafdd2a1 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:31.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7f073259c700 1 --2- 172.21.15.77:0/2121646462 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f072c0e7940 0x7f072c0eb4c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f073402ca30 tx=0x7f07340676a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6c8ecd68748f1c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:31.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7f68ad065700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6890004140 0x7f68a806f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7f68ad065700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68a8163eb0 0x7f68a806de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7fa89959a700 1 -- 172.21.15.77:0/4249851413 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88c00ba60 con 0x7fa8940e7620 2023-07-24T05:46:31.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7fa89959a700 1 -- 172.21.15.77:0/4249851413 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88c00bbc0 con 0x7fa8940e7620 2023-07-24T05:46:31.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7fa89959a700 1 -- 172.21.15.77:0/4249851413 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88c009e60 con 0x7fa8940e7620 2023-07-24T05:46:31.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7f073159a700 1 -- 172.21.15.77:0/2121646462 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073406eea0 con 0x7f072c0e7940 2023-07-24T05:46:31.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7f073159a700 1 -- 172.21.15.77:0/2121646462 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0734066a80 con 0x7f072c0e7940 2023-07-24T05:46:31.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7f68ad065700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f68a806e3d0 0x7f68a80d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7f68a659c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68a8163eb0 0x7f68a806de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7f68a659c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68a8163eb0 0x7f68a806de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58914/0 (socket says 172.21.15.77:58914) 2023-07-24T05:46:31.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7f073159a700 1 -- 172.21.15.77:0/2121646462 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0734066e10 con 0x7f072c0e7940 2023-07-24T05:46:31.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7f68a659c700 1 -- 172.21.15.77:0/1102164094 learned_addr learned my addr 172.21.15.77:0/1102164094 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:31.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7f68ad065700 1 -- 172.21.15.77:0/1102164094 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a806f4f0 con 0x7f68a8163eb0 2023-07-24T05:46:31.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7f68a6d9d700 1 --2- 172.21.15.77:0/1102164094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6890004140 0x7f68a806f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7f68a759e700 1 --2- 172.21.15.77:0/1102164094 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f68a806e3d0 0x7f68a80d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7fa8a0ddc700 1 -- 172.21.15.77:0/4249851413 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa8940e7620 msgr2=0x7fa894009060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7fc8dd7fa700 1 --2- 172.21.15.77:0/1670215740 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc8cc0663f0 0x7fc8cc0688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7fa8a0ddc700 1 --2- 172.21.15.77:0/4249851413 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa8940e7620 0x7fa894009060 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa88c009910 tx=0x7fa88c009c20 comp rx=0 tx=0).stop 2023-07-24T05:46:31.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7fc8dd7fa700 1 -- 172.21.15.77:0/1670215740 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc8d8084910 con 0x7fc8e00b0330 2023-07-24T05:46:31.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7f68ad065700 1 -- 172.21.15.77:0/1102164094 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68a806e8e0 con 0x7f6890004140 2023-07-24T05:46:31.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.126+0000 7f68ad065700 1 -- 172.21.15.77:0/1102164094 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68a806ebc0 con 0x7f68a806e3d0 2023-07-24T05:46:31.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.130+0000 7fc8e487b700 1 --2- 172.21.15.77:0/1670215740 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc8cc0663f0 0x7fc8cc0688b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.130+0000 7fa8a0ddc700 1 -- 172.21.15.77:0/4249851413 shutdown_connections 2023-07-24T05:46:31.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.130+0000 7fa8a0ddc700 1 --2- 172.21.15.77:0/4249851413 >> v2:172.21.15.103:3300/0 conn(0x7fa8940072b0 0x7fa894054130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.130+0000 7fa8a0ddc700 1 --2- 172.21.15.77:0/4249851413 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa8940e7620 0x7fa894009060 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.130+0000 7fa8a0ddc700 1 -- 172.21.15.77:0/4249851413 >> 172.21.15.77:0/4249851413 conn(0x7fa894055cc0 msgr2=0x7fa8940560d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:31.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.130+0000 7fa8a0ddc700 1 -- 172.21.15.77:0/4249851413 shutdown_connections 2023-07-24T05:46:31.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.130+0000 7f0738a9e700 1 -- 172.21.15.77:0/2121646462 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f072c0e7940 msgr2=0x7f072c0eb4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.130+0000 7f0738a9e700 1 --2- 172.21.15.77:0/2121646462 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f072c0e7940 0x7f072c0eb4c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f073402ca30 tx=0x7f07340676a0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.130+0000 7f0738a9e700 1 -- 172.21.15.77:0/2121646462 shutdown_connections 2023-07-24T05:46:31.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.130+0000 7f0738a9e700 1 --2- 172.21.15.77:0/2121646462 >> v2:172.21.15.77:3300/0 conn(0x7f072c049a30 0x7f072c0523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.130+0000 7fa8a0ddc700 1 -- 172.21.15.77:0/4249851413 wait complete. 2023-07-24T05:46:31.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.130+0000 7f0738a9e700 1 --2- 172.21.15.77:0/2121646462 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f072c0e7940 0x7f072c0eb4c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.130+0000 7f0738a9e700 1 -- 172.21.15.77:0/2121646462 >> 172.21.15.77:0/2121646462 conn(0x7f072c053840 msgr2=0x7f072c053c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:31.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.130+0000 7f68a659c700 1 -- 172.21.15.77:0/1102164094 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f68a806e3d0 msgr2=0x7f68a80d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.130+0000 7f68a659c700 1 --2- 172.21.15.77:0/1102164094 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f68a806e3d0 0x7f68a80d01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.130+0000 7f68a659c700 1 -- 172.21.15.77:0/1102164094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6890004140 msgr2=0x7f68a806f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.130+0000 7f68a659c700 1 --2- 172.21.15.77:0/1102164094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6890004140 0x7f68a806f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.130+0000 7f68a659c700 1 -- 172.21.15.77:0/1102164094 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a806eea0 con 0x7f68a8163eb0 2023-07-24T05:46:31.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.130+0000 7f0738a9e700 1 -- 172.21.15.77:0/2121646462 shutdown_connections 2023-07-24T05:46:31.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.130+0000 7f0738a9e700 1 -- 172.21.15.77:0/2121646462 wait complete. 2023-07-24T05:46:31.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.130+0000 7fc8e487b700 1 --2- 172.21.15.77:0/1670215740 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc8cc0663f0 0x7fc8cc0688b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0000c00 tx=0x7fc8d0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:31.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.130+0000 7f68a659c700 1 --2- 172.21.15.77:0/1102164094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68a8163eb0 0x7f68a806de90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f689c00c3c0 tx=0x7f689c0012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:31.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.130+0000 7f688f7fe700 1 -- 172.21.15.77:0/1102164094 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689c006c90 con 0x7f68a8163eb0 2023-07-24T05:46:31.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.130+0000 7f68ad065700 1 -- 172.21.15.77:0/1102164094 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68a806f4f0 con 0x7f68a8163eb0 2023-07-24T05:46:31.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.130+0000 7f68ad065700 1 -- 172.21.15.77:0/1102164094 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68a8164310 con 0x7f68a8163eb0 2023-07-24T05:46:31.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.130+0000 7f68ad065700 1 -- 172.21.15.77:0/1102164094 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68a8072490 con 0x7f68a8163eb0 2023-07-24T05:46:31.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.134+0000 7f688f7fe700 1 -- 172.21.15.77:0/1102164094 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689c006df0 con 0x7f68a8163eb0 2023-07-24T05:46:31.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.134+0000 7f688f7fe700 1 -- 172.21.15.77:0/1102164094 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689c007280 con 0x7f68a8163eb0 2023-07-24T05:46:31.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.134+0000 7f771d2fb700 1 Processor -- start 2023-07-24T05:46:31.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.134+0000 7f771d2fb700 1 -- start start 2023-07-24T05:46:31.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.134+0000 7fa8a0ddc700 1 Processor -- start 2023-07-24T05:46:31.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.134+0000 7fa8a0ddc700 1 -- start start 2023-07-24T05:46:31.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.134+0000 7f771d2fb700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f771815c960 0x7f771806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.134+0000 7fc8dd7fa700 1 -- 172.21.15.77:0/1670215740 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc8d80519f0 con 0x7fc8e00b0330 2023-07-24T05:46:31.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.134+0000 7fa038d21700 1 Processor -- start 2023-07-24T05:46:31.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.134+0000 7fa038d21700 1 -- start start 2023-07-24T05:46:31.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.134+0000 7f771d2fb700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f77180d25f0 0x7f77180d2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.134+0000 7f771d2fb700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77180cfd40 con 0x7f77180b40e0 2023-07-24T05:46:31.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.134+0000 7f771d2fb700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77180ceee0 con 0x7f77180d25f0 2023-07-24T05:46:31.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.134+0000 7f771d2fb700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77180cf130 con 0x7f771815c960 2023-07-24T05:46:31.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.134+0000 7f77177fe700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f77180d25f0 0x7f77180d2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.134+0000 7f77177fe700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f77180d25f0 0x7f77180d2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58916/0 (socket says 172.21.15.77:58916) 2023-07-24T05:46:31.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.134+0000 7f77177fe700 1 -- 172.21.15.77:0/4286988382 learned_addr learned my addr 172.21.15.77:0/4286988382 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:31.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.134+0000 7f7717fff700 1 --2- 172.21.15.77:0/4286988382 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f771815c960 0x7f771806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.134+0000 7fa8a0ddc700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8940072b0 0x7fa894037790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.134+0000 7fa8a0ddc700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa894050d20 0x7fa8940e20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.134+0000 7f7658eb5700 1 Processor -- start 2023-07-24T05:46:31.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.134+0000 7fa89a59c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8940072b0 0x7fa894037790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7fa89a59c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8940072b0 0x7fa894037790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:34050/0 (socket says 172.21.15.77:34050) 2023-07-24T05:46:31.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7fa89a59c700 1 -- 172.21.15.77:0/4153375660 learned_addr learned my addr 172.21.15.77:0/4153375660 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:31.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.134+0000 7f77177fe700 1 -- 172.21.15.77:0/4286988382 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f771815c960 msgr2=0x7f771806d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:31.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.134+0000 7f77177fe700 1 --2- 172.21.15.77:0/4286988382 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f771815c960 0x7f771806d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.134+0000 7f77177fe700 1 -- 172.21.15.77:0/4286988382 >> v1:172.21.15.103:6789/0 conn(0x7f77180b40e0 legacy=0x7f77180b4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.134+0000 7f7716ffd700 1 -- 172.21.15.77:0/4286988382 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 306621466 0 0) 0x7f77180cfd40 con 0x7f77180b40e0 2023-07-24T05:46:31.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.134+0000 7f77177fe700 1 -- 172.21.15.77:0/4286988382 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77180d2f90 con 0x7f77180d25f0 2023-07-24T05:46:31.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7fa038d21700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa0340d2200 0x7fa0340b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7fa038d21700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0340d2640 con 0x7fa03415ca00 2023-07-24T05:46:31.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7fa038d21700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0340d0300 con 0x7fa0340b4630 2023-07-24T05:46:31.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7fa038d21700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0340b4ac0 con 0x7fa0340d2200 2023-07-24T05:46:31.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7fa8a0ddc700 1 --2- 172.21.15.77:0/4153375660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8940e7620 0x7fa89404ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7f7658eb5700 1 -- start start 2023-07-24T05:46:31.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.134+0000 7f0738a9e700 1 Processor -- start 2023-07-24T05:46:31.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.134+0000 7f0738a9e700 1 -- start start 2023-07-24T05:46:31.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7f3f0e59e700 1 Processor -- start 2023-07-24T05:46:31.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.134+0000 7f0738a9e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f072c049a30 0x7f072c189450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7f073259c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f072c049a30 0x7f072c189450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7f073259c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f072c049a30 0x7f072c189450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58932/0 (socket says 172.21.15.77:58932) 2023-07-24T05:46:31.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7fa899d9b700 1 --2- 172.21.15.77:0/4153375660 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa894050d20 0x7fa8940e20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7fa031d9b700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa0340d2200 0x7fa0340b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7fa03259c700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fa03415ca00 0x7fa03406d450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57190/0 (socket says 172.21.15.77:57190) 2023-07-24T05:46:31.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7fa03259c700 1 -- 172.21.15.77:0/2941756896 learned_addr learned my addr 172.21.15.77:0/2941756896 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:31.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.134+0000 7f688f7fe700 1 -- 172.21.15.77:0/1102164094 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f689c0073e0 con 0x7f68a8163eb0 2023-07-24T05:46:31.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.134+0000 7f688f7fe700 1 --2- 172.21.15.77:0/1102164094 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f68940663c0 0x7f6894068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7f688f7fe700 1 -- 172.21.15.77:0/1102164094 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f689c085180 con 0x7f68a8163eb0 2023-07-24T05:46:31.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7fa89ad9d700 1 --2- 172.21.15.77:0/4153375660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8940e7620 0x7fa89404ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7f0738a9e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f072c04a0a0 0x7f072c0553a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7f0738a9e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f072c0e7940 0x7f072c0558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7f77177fe700 1 --2- 172.21.15.77:0/4286988382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77180d25f0 0x7f77180d2a50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f770c009910 tx=0x7f770c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10e785bcdc5cb2a0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:31.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7fa8a0ddc700 1 -- 172.21.15.77:0/4153375660 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8940389e0 con 0x7fa8940e7620 2023-07-24T05:46:31.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7f0738a9e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072c189990 con 0x7f072c049a30 2023-07-24T05:46:31.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7f0738a9e700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072c185760 con 0x7f072c04a0a0 2023-07-24T05:46:31.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7f0738a9e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f072c185a40 con 0x7f072c0e7940 2023-07-24T05:46:31.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7fa031d9b700 1 -- 172.21.15.77:0/2941756896 >> v1:172.21.15.103:6789/0 conn(0x7fa0340b4630 legacy=0x7fa0340b11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:31.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7f3f0e59e700 1 -- start start 2023-07-24T05:46:31.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7fa031d9b700 1 -- 172.21.15.77:0/2941756896 >> v1:172.21.15.77:6789/0 conn(0x7fa03415ca00 legacy=0x7fa03406d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:31.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7fa031d9b700 1 -- 172.21.15.77:0/2941756896 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03415cde0 con 0x7fa0340d2200 2023-07-24T05:46:31.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7fa8a0ddc700 1 -- 172.21.15.77:0/4153375660 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8940e7a00 con 0x7fa8940072b0 2023-07-24T05:46:31.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7f073259c700 1 -- 172.21.15.77:0/2704773673 learned_addr learned my addr 172.21.15.77:0/2704773673 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:31.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7fa8a0ddc700 1 -- 172.21.15.77:0/4153375660 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa894038140 con 0x7fa894050d20 2023-07-24T05:46:31.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7f0732d9d700 1 --2- 172.21.15.77:0/2704773673 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f072c0e7940 0x7f072c0558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7f68a6d9d700 1 --2- 172.21.15.77:0/1102164094 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f68940663c0 0x7f6894068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7fa031d9b700 1 --2- 172.21.15.77:0/2941756896 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa0340d2200 0x7fa0340b40f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa028009880 tx=0x7fa028009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e2a3e48d616c34a server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:31.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7f0731d9b700 1 --2- 172.21.15.77:0/2704773673 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f072c04a0a0 0x7f072c0553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7f073259c700 1 -- 172.21.15.77:0/2704773673 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f072c0e7940 msgr2=0x7f072c0558e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7f073259c700 1 --2- 172.21.15.77:0/2704773673 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f072c0e7940 0x7f072c0558e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7f073259c700 1 -- 172.21.15.77:0/2704773673 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f072c04a0a0 msgr2=0x7f072c0553a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7f073259c700 1 --2- 172.21.15.77:0/2704773673 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f072c04a0a0 0x7f072c0553a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7f073259c700 1 -- 172.21.15.77:0/2704773673 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f072c185d20 con 0x7f072c049a30 2023-07-24T05:46:31.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7f073259c700 1 --2- 172.21.15.77:0/2704773673 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f072c049a30 0x7f072c189450 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0734061950 tx=0x7f0734069910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:31.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7fa03159a700 1 -- 172.21.15.77:0/2941756896 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa028004230 con 0x7fa0340d2200 2023-07-24T05:46:31.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7fa03159a700 1 -- 172.21.15.77:0/2941756896 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa028004390 con 0x7fa0340d2200 2023-07-24T05:46:31.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7fa899d9b700 1 -- 172.21.15.77:0/4153375660 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8940072b0 msgr2=0x7fa894037790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7fa899d9b700 1 --2- 172.21.15.77:0/4153375660 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8940072b0 0x7fa894037790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7fa899d9b700 1 -- 172.21.15.77:0/4153375660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8940e7620 msgr2=0x7fa89404ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7fa899d9b700 1 --2- 172.21.15.77:0/4153375660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8940e7620 0x7fa89404ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7fa899d9b700 1 -- 172.21.15.77:0/4153375660 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa88c009570 con 0x7fa894050d20 2023-07-24T05:46:31.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7f3f0e59e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3f0815a390 0x7f3f080702f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7f68a6d9d700 1 --2- 172.21.15.77:0/1102164094 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f68940663c0 0x7f6894068880 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f68980017a0 tx=0x7f6898001610 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:31.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7fa038d21700 1 -- 172.21.15.77:0/2941756896 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa0340d2200 msgr2=0x7fa0340b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7fa038d21700 1 --2- 172.21.15.77:0/2941756896 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa0340d2200 0x7fa0340b40f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa028009880 tx=0x7fa028009b90 comp rx=0 tx=0).stop 2023-07-24T05:46:31.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7f3f0e59e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3f080b0650 0x7f3f080b0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7f3f0e59e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f080b0fd0 con 0x7f3f080cdfd0 2023-07-24T05:46:31.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7f3f0e59e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f0815ce70 con 0x7f3f080b0650 2023-07-24T05:46:31.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.138+0000 7f3f0e59e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0815d130 con 0x7f3f0815a390 2023-07-24T05:46:31.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7fa899d9b700 1 --2- 172.21.15.77:0/4153375660 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa894050d20 0x7fa8940e20f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa89000c480 tx=0x7fa89000c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:31.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7fa038d21700 1 -- 172.21.15.77:0/2941756896 shutdown_connections 2023-07-24T05:46:31.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7fa038d21700 1 --2- 172.21.15.77:0/2941756896 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa0340d2200 0x7fa0340b40f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7fa038d21700 1 -- 172.21.15.77:0/2941756896 >> 172.21.15.77:0/2941756896 conn(0x7fa0340b7610 msgr2=0x7fa0340b7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:31.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7f3f0d59c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3f0815a390 0x7f3f080702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7fa038d21700 1 -- 172.21.15.77:0/2941756896 shutdown_connections 2023-07-24T05:46:31.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7f3f0d59c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3f0815a390 0x7f3f080702f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.77:54008/0 (socket says 172.21.15.77:54008) 2023-07-24T05:46:31.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7f3f0d59c700 1 -- 172.21.15.77:0/24199535 learned_addr learned my addr 172.21.15.77:0/24199535 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:31.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7f3f0dd9d700 1 --1- 172.21.15.77:0/24199535 >> v1:172.21.15.103:6789/0 conn(0x7f3f080cdfd0 0x7f3f08160740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.77:39390/0 (socket says 172.21.15.77:39390) 2023-07-24T05:46:31.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7f3f0cd9b700 1 --2- 172.21.15.77:0/24199535 >> v2:172.21.15.103:3300/0 conn(0x7f3f080b0650 0x7f3f080b0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7f3f0d59c700 1 -- 172.21.15.77:0/24199535 >> v2:172.21.15.103:3300/0 conn(0x7f3f080b0650 msgr2=0x7f3f080b0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:31.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7f3f0d59c700 1 --2- 172.21.15.77:0/24199535 >> v2:172.21.15.103:3300/0 conn(0x7f3f080b0650 0x7f3f080b0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7f3f0d59c700 1 -- 172.21.15.77:0/24199535 >> v1:172.21.15.103:6789/0 conn(0x7f3f080cdfd0 legacy=0x7f3f08160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:31.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7f3f0d59c700 1 -- 172.21.15.77:0/24199535 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0815d410 con 0x7f3f0815a390 2023-07-24T05:46:31.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7f3f0d59c700 1 --2- 172.21.15.77:0/24199535 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3f0815a390 0x7f3f080702f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3f04009910 tx=0x7f3f04009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8141e963177d6fbf server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:31.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7f7658eb5700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f764c0df5e0 0x7f764c007660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7f7658eb5700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f764c0060c0 0x7f764c054340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7f7658eb5700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f764c0065c0 con 0x7f764c04fd50 2023-07-24T05:46:31.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7f7658eb5700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f764c0df9c0 con 0x7f764c0060c0 2023-07-24T05:46:31.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7f765259c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f764c0df5e0 0x7f764c007660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7fa88affd700 1 -- 172.21.15.77:0/4153375660 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8900052d0 con 0x7fa894050d20 2023-07-24T05:46:31.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7fa88affd700 1 -- 172.21.15.77:0/4153375660 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa890005430 con 0x7fa894050d20 2023-07-24T05:46:31.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7fa88affd700 1 -- 172.21.15.77:0/4153375660 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8900055a0 con 0x7fa894050d20 2023-07-24T05:46:31.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7f765259c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f764c0df5e0 0x7f764c007660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:34070/0 (socket says 172.21.15.77:34070) 2023-07-24T05:46:31.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7f765259c700 1 -- 172.21.15.77:0/3571564992 learned_addr learned my addr 172.21.15.77:0/3571564992 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:31.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7f7651d9b700 1 --2- 172.21.15.77:0/3571564992 >> v2:172.21.15.77:3300/0 conn(0x7f764c0060c0 0x7f764c054340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7f7658eb5700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f764c0068a0 con 0x7f764c0df5e0 2023-07-24T05:46:31.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7fa038d21700 1 -- 172.21.15.77:0/2941756896 wait complete. 2023-07-24T05:46:31.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7f3efffff700 1 -- 172.21.15.77:0/24199535 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f04004230 con 0x7f3f0815a390 2023-07-24T05:46:31.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7f3efffff700 1 -- 172.21.15.77:0/24199535 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f04004390 con 0x7f3f0815a390 2023-07-24T05:46:31.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7f3efffff700 1 -- 172.21.15.77:0/24199535 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f04009e60 con 0x7f3f0815a390 2023-07-24T05:46:31.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7f3f0e59e700 1 -- 172.21.15.77:0/24199535 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3f0815a390 msgr2=0x7f3f080702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7f3f0e59e700 1 --2- 172.21.15.77:0/24199535 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3f0815a390 0x7f3f080702f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3f04009910 tx=0x7f3f04009c20 comp rx=0 tx=0).stop 2023-07-24T05:46:31.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7f3f0e59e700 1 -- 172.21.15.77:0/24199535 shutdown_connections 2023-07-24T05:46:31.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7f3f0e59e700 1 --2- 172.21.15.77:0/24199535 >> v2:172.21.15.103:3300/0 conn(0x7f3f080b0650 0x7f3f080b0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7f3f0e59e700 1 --2- 172.21.15.77:0/24199535 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3f0815a390 0x7f3f080702f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7f3f0e59e700 1 -- 172.21.15.77:0/24199535 >> 172.21.15.77:0/24199535 conn(0x7f3f080ced00 msgr2=0x7f3f080cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:31.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7f7651d9b700 1 -- 172.21.15.77:0/3571564992 >> v2:172.21.15.103:3300/0 conn(0x7f764c0df5e0 msgr2=0x7f764c007660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:31.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7f7651d9b700 1 --2- 172.21.15.77:0/3571564992 >> v2:172.21.15.103:3300/0 conn(0x7f764c0df5e0 0x7f764c007660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7f7651d9b700 1 -- 172.21.15.77:0/3571564992 >> v1:172.21.15.77:6789/0 conn(0x7f764c04fd50 legacy=0x7f764c050160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7f7651d9b700 1 -- 172.21.15.77:0/3571564992 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f764c006b80 con 0x7f764c0060c0 2023-07-24T05:46:31.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7fa8a0ddc700 1 -- 172.21.15.77:0/4153375660 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa894038420 con 0x7fa894050d20 2023-07-24T05:46:31.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7f3f0e59e700 1 -- 172.21.15.77:0/24199535 shutdown_connections 2023-07-24T05:46:31.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7f7651d9b700 1 --2- 172.21.15.77:0/3571564992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f764c0060c0 0x7f764c054340 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f764c04fc10 tx=0x7f7648009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1dba1e94d5a0da0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:31.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7fa8a0ddc700 1 -- 172.21.15.77:0/4153375660 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8940e7c50 con 0x7fa894050d20 2023-07-24T05:46:31.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.142+0000 7f3f0e59e700 1 -- 172.21.15.77:0/24199535 wait complete. 2023-07-24T05:46:31.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.146+0000 7fa038d21700 1 Processor -- start 2023-07-24T05:46:31.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.146+0000 7fa038d21700 1 -- start start 2023-07-24T05:46:31.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.146+0000 7fa8a0ddc700 1 -- 172.21.15.77:0/4153375660 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8940069b0 con 0x7fa894050d20 2023-07-24T05:46:31.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.146+0000 7f7716ffd700 1 -- 172.21.15.77:0/4286988382 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c011830 con 0x7f77180d25f0 2023-07-24T05:46:31.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.146+0000 7f0722ffd700 1 -- 172.21.15.77:0/2704773673 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0734097070 con 0x7f072c049a30 2023-07-24T05:46:31.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.146+0000 7f0738a9e700 1 -- 172.21.15.77:0/2704773673 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f072c186000 con 0x7f072c049a30 2023-07-24T05:46:31.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.146+0000 7f0738a9e700 1 -- 172.21.15.77:0/2704773673 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f072c185450 con 0x7f072c049a30 2023-07-24T05:46:31.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.146+0000 7f688f7fe700 1 -- 172.21.15.77:0/1102164094 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f689c055e10 con 0x7f68a8163eb0 2023-07-24T05:46:31.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.146+0000 7f3f0e59e700 1 Processor -- start 2023-07-24T05:46:31.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.146+0000 7fa038d21700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0340b4630 0x7fa03406de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.146+0000 7fa038d21700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0340d2200 0x7fa0341fe460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.146+0000 7fa038d21700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa0341fe9a0 0x7fa0340d1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.146+0000 7fa03259c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0340b4630 0x7fa03406de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.146+0000 7fa03259c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0340b4630 0x7fa03406de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:34078/0 (socket says 172.21.15.77:34078) 2023-07-24T05:46:31.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.146+0000 7f765159a700 1 -- 172.21.15.77:0/3571564992 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7648011830 con 0x7f764c0060c0 2023-07-24T05:46:31.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.146+0000 7fa031d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0340d2200 0x7fa0341fe460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.146+0000 7fa031d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0340d2200 0x7fa0341fe460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58950/0 (socket says 172.21.15.77:58950) 2023-07-24T05:46:31.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.146+0000 7fa03259c700 1 -- 172.21.15.77:0/283157969 learned_addr learned my addr 172.21.15.77:0/283157969 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:31.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.146+0000 7fa88affd700 1 -- 172.21.15.77:0/4153375660 <== mon.2 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa8900038e0 con 0x7fa894050d20 2023-07-24T05:46:31.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.146+0000 7f0738a9e700 1 -- 172.21.15.77:0/2704773673 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f072c005840 con 0x7f072c049a30 2023-07-24T05:46:31.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.150+0000 7fa038d21700 1 -- 172.21.15.77:0/283157969 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa034157d70 con 0x7fa0340d2200 2023-07-24T05:46:31.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.150+0000 7fa032d9d700 1 --2- 172.21.15.77:0/283157969 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa0341fe9a0 0x7fa0340d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.150+0000 7fa038d21700 1 -- 172.21.15.77:0/283157969 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0340713d0 con 0x7fa0340b4630 2023-07-24T05:46:31.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.150+0000 7fa038d21700 1 -- 172.21.15.77:0/283157969 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0340716b0 con 0x7fa0341fe9a0 2023-07-24T05:46:31.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.150+0000 7f0722ffd700 1 -- 172.21.15.77:0/2704773673 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f073406de90 con 0x7f072c049a30 2023-07-24T05:46:31.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.150+0000 7f0722ffd700 1 -- 172.21.15.77:0/2704773673 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07340731a0 con 0x7f072c049a30 2023-07-24T05:46:31.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.146+0000 7f3f0e59e700 1 -- start start 2023-07-24T05:46:31.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.150+0000 7f3f0e59e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3f080b0650 0x7f3f081f3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.150+0000 7f3f0e59e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f080cdfd0 0x7f3f081f7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.150+0000 7fa88affd700 1 --2- 172.21.15.77:0/4153375660 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa87c0662f0 0x7fa87c0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.150+0000 7fa88affd700 1 -- 172.21.15.77:0/4153375660 <== mon.2 v2:172.21.15.103:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa890083740 con 0x7fa894050d20 2023-07-24T05:46:31.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.150+0000 7f3f0e59e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f0815a390 0x7f3f080af470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.150+0000 7fa031d9b700 1 -- 172.21.15.77:0/283157969 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa0341fe9a0 msgr2=0x7fa0340d1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.150+0000 7fa031d9b700 1 --2- 172.21.15.77:0/283157969 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa0341fe9a0 0x7fa0340d1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.150+0000 7fa031d9b700 1 -- 172.21.15.77:0/283157969 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0340b4630 msgr2=0x7fa03406de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.150+0000 7fa031d9b700 1 --2- 172.21.15.77:0/283157969 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0340b4630 0x7fa03406de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.150+0000 7fa031d9b700 1 -- 172.21.15.77:0/283157969 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0280094b0 con 0x7fa0340d2200 2023-07-24T05:46:31.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.150+0000 7fa031d9b700 1 --2- 172.21.15.77:0/283157969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0340d2200 0x7fa0341fe460 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa028015000 tx=0x7fa0280047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:31.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.150+0000 7f3f0cd9b700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f080cdfd0 0x7f3f081f7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.150+0000 7f3f0d59c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3f080b0650 0x7f3f081f3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.150+0000 7f3f0cd9b700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f080cdfd0 0x7f3f081f7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:34084/0 (socket says 172.21.15.77:34084) 2023-07-24T05:46:31.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.150+0000 7f3f0cd9b700 1 -- 172.21.15.77:0/4095279356 learned_addr learned my addr 172.21.15.77:0/4095279356 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:31.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.146+0000 7f7716ffd700 1 -- 172.21.15.77:0/4286988382 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770c011990 con 0x7f77180d25f0 2023-07-24T05:46:31.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.146+0000 7f7716ffd700 1 -- 172.21.15.77:0/4286988382 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770c011d40 con 0x7f77180d25f0 2023-07-24T05:46:31.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.150+0000 7fa89a59c700 1 --2- 172.21.15.77:0/4153375660 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa87c0662f0 0x7fa87c0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.150+0000 7f3f0dd9d700 1 --2- 172.21.15.77:0/4095279356 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f0815a390 0x7f3f080af470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.150+0000 7f3f0e59e700 1 -- 172.21.15.77:0/4095279356 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0815eab0 con 0x7f3f0815a390 2023-07-24T05:46:31.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.150+0000 7f3f0e59e700 1 -- 172.21.15.77:0/4095279356 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f080afef0 con 0x7f3f080cdfd0 2023-07-24T05:46:31.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.150+0000 7f3f0e59e700 1 -- 172.21.15.77:0/4095279356 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0815e110 con 0x7f3f080b0650 2023-07-24T05:46:31.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.150+0000 7f771d2fb700 1 -- 172.21.15.77:0/4286988382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77180d25f0 msgr2=0x7f77180d2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.150+0000 7f771d2fb700 1 --2- 172.21.15.77:0/4286988382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77180d25f0 0x7f77180d2a50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f770c009910 tx=0x7f770c009c20 comp rx=0 tx=0).stop 2023-07-24T05:46:31.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.150+0000 7f3f0cd9b700 1 -- 172.21.15.77:0/4095279356 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3f080b0650 msgr2=0x7f3f081f3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.150+0000 7f3f0cd9b700 1 --2- 172.21.15.77:0/4095279356 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3f080b0650 0x7f3f081f3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.150+0000 7f3f0cd9b700 1 -- 172.21.15.77:0/4095279356 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f0815a390 msgr2=0x7f3f080af470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.150+0000 7f3f0cd9b700 1 --2- 172.21.15.77:0/4095279356 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f0815a390 0x7f3f080af470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.150+0000 7f3f0cd9b700 1 -- 172.21.15.77:0/4095279356 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f04009570 con 0x7f3f080cdfd0 2023-07-24T05:46:31.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.150+0000 7f3f0cd9b700 1 --2- 172.21.15.77:0/4095279356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f080cdfd0 0x7f3f081f7960 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3ef800d830 tx=0x7f3ef800db40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:31.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.154+0000 7f3efdffb700 1 -- 172.21.15.77:0/4095279356 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef80125f0 con 0x7f3f080cdfd0 2023-07-24T05:46:31.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.154+0000 7f3efdffb700 1 -- 172.21.15.77:0/4095279356 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef8012750 con 0x7f3f080cdfd0 2023-07-24T05:46:31.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.154+0000 7f3efdffb700 1 -- 172.21.15.77:0/4095279356 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef8012ae0 con 0x7f3f080cdfd0 2023-07-24T05:46:31.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.154+0000 7f3f0e59e700 1 -- 172.21.15.77:0/4095279356 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f0815e3f0 con 0x7f3f080cdfd0 2023-07-24T05:46:31.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.154+0000 7f3f0e59e700 1 -- 172.21.15.77:0/4095279356 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f080ae740 con 0x7f3f080cdfd0 2023-07-24T05:46:31.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.150+0000 7f771d2fb700 1 -- 172.21.15.77:0/4286988382 shutdown_connections 2023-07-24T05:46:31.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.150+0000 7f771d2fb700 1 --2- 172.21.15.77:0/4286988382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77180d25f0 0x7f77180d2a50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.150+0000 7f771d2fb700 1 --2- 172.21.15.77:0/4286988382 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f771815c960 0x7f771806d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.150+0000 7f771d2fb700 1 -- 172.21.15.77:0/4286988382 >> 172.21.15.77:0/4286988382 conn(0x7f77180b7600 msgr2=0x7f77180b79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:31.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.150+0000 7f771d2fb700 1 -- 172.21.15.77:0/4286988382 shutdown_connections 2023-07-24T05:46:31.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.150+0000 7f771d2fb700 1 -- 172.21.15.77:0/4286988382 wait complete. 2023-07-24T05:46:31.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.154+0000 7f771d2fb700 1 Processor -- start 2023-07-24T05:46:31.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.154+0000 7f765159a700 1 -- 172.21.15.77:0/3571564992 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7648011990 con 0x7f764c0060c0 2023-07-24T05:46:31.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.154+0000 7f7658eb5700 1 -- 172.21.15.77:0/3571564992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f764c0060c0 msgr2=0x7f764c054340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.154+0000 7f7658eb5700 1 --2- 172.21.15.77:0/3571564992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f764c0060c0 0x7f764c054340 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f764c04fc10 tx=0x7f7648009b30 comp rx=0 tx=0).stop 2023-07-24T05:46:31.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.154+0000 7f7658eb5700 1 -- 172.21.15.77:0/3571564992 shutdown_connections 2023-07-24T05:46:31.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.154+0000 7f7658eb5700 1 --2- 172.21.15.77:0/3571564992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f764c0060c0 0x7f764c054340 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.154+0000 7f7658eb5700 1 --2- 172.21.15.77:0/3571564992 >> v2:172.21.15.103:3300/0 conn(0x7f764c0df5e0 0x7f764c007660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.154+0000 7f7658eb5700 1 -- 172.21.15.77:0/3571564992 >> 172.21.15.77:0/3571564992 conn(0x7f764c054cf0 msgr2=0x7f764c055100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:31.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.154+0000 7f7658eb5700 1 -- 172.21.15.77:0/3571564992 shutdown_connections 2023-07-24T05:46:31.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.154+0000 7fa022ffd700 1 -- 172.21.15.77:0/283157969 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa028011a40 con 0x7fa0340d2200 2023-07-24T05:46:31.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.154+0000 7fa022ffd700 1 -- 172.21.15.77:0/283157969 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa028011ba0 con 0x7fa0340d2200 2023-07-24T05:46:31.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.154+0000 7fa022ffd700 1 -- 172.21.15.77:0/283157969 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02801b440 con 0x7fa0340d2200 2023-07-24T05:46:31.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.154+0000 7fa038d21700 1 -- 172.21.15.77:0/283157969 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa034071990 con 0x7fa0340d2200 2023-07-24T05:46:31.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.150+0000 7fa89a59c700 1 --2- 172.21.15.77:0/4153375660 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa87c0662f0 0x7fa87c0687b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa88c007fd0 tx=0x7fa88c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:31.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.154+0000 7fa88affd700 1 -- 172.21.15.77:0/4153375660 <== mon.2 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa890050940 con 0x7fa894050d20 2023-07-24T05:46:31.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.154+0000 7f0722ffd700 1 -- 172.21.15.77:0/2704773673 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0734073300 con 0x7f072c049a30 2023-07-24T05:46:31.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.154+0000 7f0722ffd700 1 --2- 172.21.15.77:0/2704773673 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f07140662f0 0x7f07140687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.154+0000 7f0722ffd700 1 -- 172.21.15.77:0/2704773673 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f07340fe440 con 0x7f072c049a30 2023-07-24T05:46:31.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.154+0000 7fa038d21700 1 -- 172.21.15.77:0/283157969 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa034071010 con 0x7fa0340d2200 2023-07-24T05:46:31.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.154+0000 7f771d2fb700 1 -- start start 2023-07-24T05:46:31.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.154+0000 7f7658eb5700 1 -- 172.21.15.77:0/3571564992 wait complete. 2023-07-24T05:46:31.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.158+0000 7fa038d21700 1 -- 172.21.15.77:0/283157969 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa034072490 con 0x7fa0340d2200 2023-07-24T05:46:31.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.158+0000 7f7658eb5700 1 Processor -- start 2023-07-24T05:46:31.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.158+0000 7f0731d9b700 1 --2- 172.21.15.77:0/2704773673 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f07140662f0 0x7f07140687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.158+0000 7f771d2fb700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f77180b40e0 0x7f7718158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.154+0000 7f3f0e59e700 1 -- 172.21.15.77:0/4095279356 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f080719c0 con 0x7f3f080cdfd0 2023-07-24T05:46:31.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.158+0000 7f3efdffb700 1 -- 172.21.15.77:0/4095279356 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3ef8012c40 con 0x7f3f080cdfd0 2023-07-24T05:46:31.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.158+0000 7f771d2fb700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77180d25f0 0x7f77181feb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.158+0000 7f771d2fb700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f771815c960 0x7f771815ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.158+0000 7f7717fff700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f77180b40e0 0x7f7718158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.158+0000 7f7717fff700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f77180b40e0 0x7f7718158680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.77:54034/0 (socket says 172.21.15.77:54034) 2023-07-24T05:46:31.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.158+0000 7f77177fe700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77180d25f0 0x7f77181feb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.158+0000 7f77177fe700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77180d25f0 0x7f77181feb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:34094/0 (socket says 172.21.15.77:34094) 2023-07-24T05:46:31.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.158+0000 7f0731d9b700 1 --2- 172.21.15.77:0/2704773673 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f07140662f0 0x7f07140687b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f072c050f90 tx=0x7f0728007d60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:31.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.158+0000 7f771cafa700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f771815c960 0x7f771815ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.158+0000 7f771cafa700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f771815c960 0x7f771815ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58970/0 (socket says 172.21.15.77:58970) 2023-07-24T05:46:31.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.158+0000 7f7717fff700 1 -- 172.21.15.77:0/2825692574 learned_addr learned my addr 172.21.15.77:0/2825692574 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:31.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.158+0000 7f771d2fb700 1 -- 172.21.15.77:0/2825692574 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77181ff1c0 con 0x7f771815c960 2023-07-24T05:46:31.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.158+0000 7f771d2fb700 1 -- 172.21.15.77:0/2825692574 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77181ff4a0 con 0x7f77180d25f0 2023-07-24T05:46:31.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.158+0000 7f771d2fb700 1 -- 172.21.15.77:0/2825692574 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77181ff780 con 0x7f77180b40e0 2023-07-24T05:46:31.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.158+0000 7f7658eb5700 1 -- start start 2023-07-24T05:46:31.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.158+0000 7f7658eb5700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f764c0060c0 0x7f764c0d9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.158+0000 7f7658eb5700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f764c04fd50 0x7f764c04e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.158+0000 7f3efdffb700 1 --2- 172.21.15.77:0/4095279356 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3eec0662f0 0x7f3eec0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.158+0000 7f7658eb5700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f764c0df5e0 0x7f764c1808d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.158+0000 7f3efdffb700 1 -- 172.21.15.77:0/4095279356 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3ef803a030 con 0x7f3f080cdfd0 2023-07-24T05:46:31.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.158+0000 7f7717fff700 1 -- 172.21.15.77:0/2825692574 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77180d25f0 msgr2=0x7f77181feb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.158+0000 7f7717fff700 1 --2- 172.21.15.77:0/2825692574 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77180d25f0 0x7f77181feb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.158+0000 7f7717fff700 1 -- 172.21.15.77:0/2825692574 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f771815c960 msgr2=0x7f771815ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.158+0000 7f7717fff700 1 --2- 172.21.15.77:0/2825692574 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f771815c960 0x7f771815ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.158+0000 7f7717fff700 1 -- 172.21.15.77:0/2825692574 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f770c009570 con 0x7f77180b40e0 2023-07-24T05:46:31.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.158+0000 7f77177fe700 1 --2- 172.21.15.77:0/2825692574 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77180d25f0 0x7f77181feb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:46:31.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.158+0000 7f765259c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f764c0060c0 0x7f764c0d9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.158+0000 7f3f0d59c700 1 --2- 172.21.15.77:0/4095279356 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3eec0662f0 0x7f3eec0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.158+0000 7f765259c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f764c0060c0 0x7f764c0d9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:34104/0 (socket says 172.21.15.77:34104) 2023-07-24T05:46:31.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.158+0000 7f765259c700 1 -- 172.21.15.77:0/3072997817 learned_addr learned my addr 172.21.15.77:0/3072997817 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:31.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.158+0000 7f7651d9b700 1 --2- 172.21.15.77:0/3072997817 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f764c04fd50 0x7f764c04e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.158+0000 7f7658eb5700 1 -- 172.21.15.77:0/3072997817 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764c04d730 con 0x7f764c0df5e0 2023-07-24T05:46:31.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.158+0000 7f7652d9d700 1 --2- 172.21.15.77:0/3072997817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f764c0df5e0 0x7f764c1808d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.158+0000 7f7658eb5700 1 -- 172.21.15.77:0/3072997817 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764c0da0a0 con 0x7f764c0060c0 2023-07-24T05:46:31.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.158+0000 7f7658eb5700 1 -- 172.21.15.77:0/3072997817 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764c04cb20 con 0x7f764c04fd50 2023-07-24T05:46:31.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.158+0000 7f7717fff700 1 --2- 172.21.15.77:0/2825692574 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f77180b40e0 0x7f7718158680 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f770800e9d0 tx=0x7f770800ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:31.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.162+0000 7f7714ff9700 1 -- 172.21.15.77:0/2825692574 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7708009720 con 0x7f77180b40e0 2023-07-24T05:46:31.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.162+0000 7f7714ff9700 1 -- 172.21.15.77:0/2825692574 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770800ee70 con 0x7f77180b40e0 2023-07-24T05:46:31.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.162+0000 7f7714ff9700 1 -- 172.21.15.77:0/2825692574 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770800ca50 con 0x7f77180b40e0 2023-07-24T05:46:31.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.162+0000 7f771d2fb700 1 -- 172.21.15.77:0/2825692574 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77181ffa60 con 0x7f77180b40e0 2023-07-24T05:46:31.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.162+0000 7f7652d9d700 1 -- 172.21.15.77:0/3072997817 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f764c04fd50 msgr2=0x7f764c04e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.162+0000 7f7652d9d700 1 --2- 172.21.15.77:0/3072997817 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f764c04fd50 0x7f764c04e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.162+0000 7f7652d9d700 1 -- 172.21.15.77:0/3072997817 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f764c0060c0 msgr2=0x7f764c0d9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.162+0000 7f7652d9d700 1 --2- 172.21.15.77:0/3072997817 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f764c0060c0 0x7f764c0d9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.162+0000 7f7652d9d700 1 -- 172.21.15.77:0/3072997817 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76480094b0 con 0x7f764c0df5e0 2023-07-24T05:46:31.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.162+0000 7f771d2fb700 1 -- 172.21.15.77:0/2825692574 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7718158e10 con 0x7f77180b40e0 2023-07-24T05:46:31.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.162+0000 7f7652d9d700 1 --2- 172.21.15.77:0/3072997817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f764c0df5e0 0x7f764c1808d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f765404f780 tx=0x7f7654066d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:31.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.162+0000 7f3f0d59c700 1 --2- 172.21.15.77:0/4095279356 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3eec0662f0 0x7f3eec0687b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3f04009910 tx=0x7f3f04008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:31.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.162+0000 7f0722ffd700 1 -- 172.21.15.77:0/2704773673 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f07340cb5f0 con 0x7f072c049a30 2023-07-24T05:46:31.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.162+0000 7f3efdffb700 1 -- 172.21.15.77:0/4095279356 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3ef8051d40 con 0x7f3f080cdfd0 2023-07-24T05:46:31.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.162+0000 7f771d2fb700 1 -- 172.21.15.77:0/2825692574 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f771806cd60 con 0x7f77180b40e0 2023-07-24T05:46:31.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.162+0000 7f7714ff9700 1 -- 172.21.15.77:0/2825692574 <== mon.2 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f770800cbb0 con 0x7f77180b40e0 2023-07-24T05:46:31.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.166+0000 7fa022ffd700 1 -- 172.21.15.77:0/283157969 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa02801b5a0 con 0x7fa0340d2200 2023-07-24T05:46:31.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.166+0000 7fa022ffd700 1 --2- 172.21.15.77:0/283157969 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa014066370 0x7fa014068830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.166+0000 7fa022ffd700 1 -- 172.21.15.77:0/283157969 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa028085b00 con 0x7fa0340d2200 2023-07-24T05:46:31.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.166+0000 7fa03259c700 1 --2- 172.21.15.77:0/283157969 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa014066370 0x7fa014068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.166+0000 7f7714ff9700 1 --2- 172.21.15.77:0/2825692574 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f77040662f0 0x7f77040687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.166+0000 7f7714ff9700 1 -- 172.21.15.77:0/2825692574 <== mon.2 v2:172.21.15.103:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7708084370 con 0x7f77180b40e0 2023-07-24T05:46:31.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.166+0000 7f77177fe700 1 --2- 172.21.15.77:0/2825692574 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f77040662f0 0x7f77040687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.166+0000 7f77177fe700 1 --2- 172.21.15.77:0/2825692574 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f77040662f0 0x7f77040687b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f77180c96e0 tx=0x7f770c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:31.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.170+0000 7fa03259c700 1 --2- 172.21.15.77:0/283157969 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa014066370 0x7fa014068830 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa024007d70 tx=0x7fa024007cc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:31.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.170+0000 7f7714ff9700 1 -- 172.21.15.77:0/2825692574 <== mon.2 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7708054f80 con 0x7f77180b40e0 2023-07-24T05:46:31.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.166+0000 7f7642ffd700 1 -- 172.21.15.77:0/3072997817 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765406eea0 con 0x7f764c0df5e0 2023-07-24T05:46:31.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.166+0000 7f7642ffd700 1 -- 172.21.15.77:0/3072997817 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7654072b90 con 0x7f764c0df5e0 2023-07-24T05:46:31.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.166+0000 7f7642ffd700 1 -- 172.21.15.77:0/3072997817 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76540731d0 con 0x7f764c0df5e0 2023-07-24T05:46:31.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.170+0000 7fa022ffd700 1 -- 172.21.15.77:0/283157969 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa028052f20 con 0x7fa0340d2200 2023-07-24T05:46:31.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.170+0000 7f7658eb5700 1 -- 172.21.15.77:0/3072997817 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f764c04ce00 con 0x7f764c0df5e0 2023-07-24T05:46:31.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.170+0000 7f7658eb5700 1 -- 172.21.15.77:0/3072997817 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f764c04d3c0 con 0x7f764c0df5e0 2023-07-24T05:46:31.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.174+0000 7f7658eb5700 1 -- 172.21.15.77:0/3072997817 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f764c050e50 con 0x7f764c0df5e0 2023-07-24T05:46:31.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.174+0000 7f7642ffd700 1 -- 172.21.15.77:0/3072997817 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7654073330 con 0x7f764c0df5e0 2023-07-24T05:46:31.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.174+0000 7f7642ffd700 1 --2- 172.21.15.77:0/3072997817 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f76340663c0 0x7f7634068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:31.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.178+0000 7f7642ffd700 1 -- 172.21.15.77:0/3072997817 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f76540fd080 con 0x7f764c0df5e0 2023-07-24T05:46:31.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.178+0000 7f765259c700 1 --2- 172.21.15.77:0/3072997817 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f76340663c0 0x7f7634068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:31.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.178+0000 7f765259c700 1 --2- 172.21.15.77:0/3072997817 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f76340663c0 0x7f7634068880 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f764c04e470 tx=0x7f764400c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:31.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.186+0000 7f7642ffd700 1 -- 172.21.15.77:0/3072997817 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f76540ca280 con 0x7f764c0df5e0 2023-07-24T05:46:31.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.470+0000 7fc8e6adf700 1 -- 172.21.15.77:0/1670215740 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc8e0155f00 con 0x7fc8e00b0330 2023-07-24T05:46:31.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.470+0000 7fc8dd7fa700 1 -- 172.21.15.77:0/1670215740 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc8e0155f00 con 0x7fc8e00b0330 2023-07-24T05:46:31.475 INFO:teuthology.orchestra.run.smithi077.stdout:60129542152 2023-07-24T05:46:31.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.470+0000 7f68ad065700 1 -- 172.21.15.77:0/1102164094 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f68a80d32d0 con 0x7f68a8163eb0 2023-07-24T05:46:31.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.470+0000 7f688f7fe700 1 -- 172.21.15.77:0/1102164094 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f689c0559a0 con 0x7f68a8163eb0 2023-07-24T05:46:31.476 INFO:teuthology.orchestra.run.smithi077.stdout:60129542153 2023-07-24T05:46:31.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.474+0000 7fc8e6adf700 1 -- 172.21.15.77:0/1670215740 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc8cc0663f0 msgr2=0x7fc8cc0688b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.474+0000 7fc8e6adf700 1 --2- 172.21.15.77:0/1670215740 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc8cc0663f0 0x7fc8cc0688b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0000c00 tx=0x7fc8d0008040 comp rx=0 tx=0).stop 2023-07-24T05:46:31.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.474+0000 7fc8e6adf700 1 -- 172.21.15.77:0/1670215740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8e00b0330 msgr2=0x7fc8e01dedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.474+0000 7fc8e6adf700 1 --2- 172.21.15.77:0/1670215740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8e00b0330 0x7fc8e01dedd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc8d800cbe0 tx=0x7fc8d800cef0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.474+0000 7fc8e6adf700 1 -- 172.21.15.77:0/1670215740 shutdown_connections 2023-07-24T05:46:31.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.474+0000 7fc8e6adf700 1 --2- 172.21.15.77:0/1670215740 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc8cc0663f0 0x7fc8cc0688b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.474+0000 7fc8e6adf700 1 --2- 172.21.15.77:0/1670215740 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc8e0158b30 0x7fc8e0070990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.474+0000 7fc8e6adf700 1 --2- 172.21.15.77:0/1670215740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8e00b0330 0x7fc8e01dedd0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.474+0000 7fc8e6adf700 1 --2- 172.21.15.77:0/1670215740 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc8e00aae70 0x7fc8e01523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.474+0000 7fc8e6adf700 1 -- 172.21.15.77:0/1670215740 >> 172.21.15.77:0/1670215740 conn(0x7fc8e00cacc0 msgr2=0x7fc8e00aef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:31.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.474+0000 7f68ad065700 1 -- 172.21.15.77:0/1102164094 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f68940663c0 msgr2=0x7f6894068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.474+0000 7f68ad065700 1 --2- 172.21.15.77:0/1102164094 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f68940663c0 0x7f6894068880 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f68980017a0 tx=0x7f6898001610 comp rx=0 tx=0).stop 2023-07-24T05:46:31.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.474+0000 7f68ad065700 1 -- 172.21.15.77:0/1102164094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68a8163eb0 msgr2=0x7f68a806de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.474+0000 7f68ad065700 1 --2- 172.21.15.77:0/1102164094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68a8163eb0 0x7f68a806de90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f689c00c3c0 tx=0x7f689c0012d0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.474+0000 7fc8e6adf700 1 -- 172.21.15.77:0/1670215740 shutdown_connections 2023-07-24T05:46:31.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.474+0000 7fc8e6adf700 1 -- 172.21.15.77:0/1670215740 wait complete. 2023-07-24T05:46:31.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.482+0000 7f68ad065700 1 -- 172.21.15.77:0/1102164094 shutdown_connections 2023-07-24T05:46:31.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.482+0000 7f68ad065700 1 --2- 172.21.15.77:0/1102164094 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f68940663c0 0x7f6894068880 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.482+0000 7f68ad065700 1 --2- 172.21.15.77:0/1102164094 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f68a806e3d0 0x7f68a80d01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.482+0000 7f68ad065700 1 --2- 172.21.15.77:0/1102164094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f68a8163eb0 0x7f68a806de90 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.482+0000 7f68ad065700 1 --2- 172.21.15.77:0/1102164094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6890004140 0x7f68a806f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.482+0000 7f68ad065700 1 -- 172.21.15.77:0/1102164094 >> 172.21.15.77:0/1102164094 conn(0x7f68a80b7600 msgr2=0x7f68a80b40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:31.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.482+0000 7f68ad065700 1 -- 172.21.15.77:0/1102164094 shutdown_connections 2023-07-24T05:46:31.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.482+0000 7fa8a0ddc700 1 -- 172.21.15.77:0/4153375660 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa8940e7e40 con 0x7fa894050d20 2023-07-24T05:46:31.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.482+0000 7f68ad065700 1 -- 172.21.15.77:0/1102164094 wait complete. 2023-07-24T05:46:31.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.482+0000 7fa88affd700 1 -- 172.21.15.77:0/4153375660 <== mon.2 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa890053f60 con 0x7fa894050d20 2023-07-24T05:46:31.487 INFO:teuthology.orchestra.run.smithi077.stdout:60129542153 2023-07-24T05:46:31.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.486+0000 7fa8a0ddc700 1 -- 172.21.15.77:0/4153375660 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa87c0662f0 msgr2=0x7fa87c0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.486+0000 7fa8a0ddc700 1 --2- 172.21.15.77:0/4153375660 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa87c0662f0 0x7fa87c0687b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa88c007fd0 tx=0x7fa88c008030 comp rx=0 tx=0).stop 2023-07-24T05:46:31.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.486+0000 7fa8a0ddc700 1 -- 172.21.15.77:0/4153375660 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa894050d20 msgr2=0x7fa8940e20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.486+0000 7fa8a0ddc700 1 --2- 172.21.15.77:0/4153375660 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa894050d20 0x7fa8940e20f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa89000c480 tx=0x7fa89000c790 comp rx=0 tx=0).stop 2023-07-24T05:46:31.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.486+0000 7fa8a0ddc700 1 -- 172.21.15.77:0/4153375660 shutdown_connections 2023-07-24T05:46:31.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.486+0000 7fa8a0ddc700 1 --2- 172.21.15.77:0/4153375660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8940e7620 0x7fa89404ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.486+0000 7fa8a0ddc700 1 --2- 172.21.15.77:0/4153375660 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa87c0662f0 0x7fa87c0687b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.486+0000 7fa8a0ddc700 1 --2- 172.21.15.77:0/4153375660 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa894050d20 0x7fa8940e20f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.486+0000 7fa8a0ddc700 1 --2- 172.21.15.77:0/4153375660 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8940072b0 0x7fa894037790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.486+0000 7fa8a0ddc700 1 -- 172.21.15.77:0/4153375660 >> 172.21.15.77:0/4153375660 conn(0x7fa894055cc0 msgr2=0x7fa8940e6930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:31.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.486+0000 7fa8a0ddc700 1 -- 172.21.15.77:0/4153375660 shutdown_connections 2023-07-24T05:46:31.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.486+0000 7fa8a0ddc700 1 -- 172.21.15.77:0/4153375660 wait complete. 2023-07-24T05:46:31.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.490+0000 7f3f0e59e700 1 -- 172.21.15.77:0/4095279356 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f3f08072490 con 0x7f3f080cdfd0 2023-07-24T05:46:31.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.490+0000 7f3efdffb700 1 -- 172.21.15.77:0/4095279356 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3ef8051d40 con 0x7f3f080cdfd0 2023-07-24T05:46:31.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.490+0000 7f771d2fb700 1 -- 172.21.15.77:0/2825692574 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f77181fff80 con 0x7f77180b40e0 2023-07-24T05:46:31.497 INFO:teuthology.orchestra.run.smithi077.stdout:60129542153 2023-07-24T05:46:31.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.494+0000 7f7714ff9700 1 -- 172.21.15.77:0/2825692574 <== mon.2 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f770800ce60 con 0x7f77180b40e0 2023-07-24T05:46:31.497 INFO:teuthology.orchestra.run.smithi077.stdout:60129542153 2023-07-24T05:46:31.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.494+0000 7f0738a9e700 1 -- 172.21.15.77:0/2704773673 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f072c0ec0c0 con 0x7f072c049a30 2023-07-24T05:46:31.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.494+0000 7f0722ffd700 1 -- 172.21.15.77:0/2704773673 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f07340735b0 con 0x7f072c049a30 2023-07-24T05:46:31.500 INFO:teuthology.orchestra.run.smithi077.stdout:60129542152 2023-07-24T05:46:31.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.494+0000 7fa038d21700 1 -- 172.21.15.77:0/283157969 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa034202410 con 0x7fa0340d2200 2023-07-24T05:46:31.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.494+0000 7f3f0e59e700 1 -- 172.21.15.77:0/4095279356 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3eec0662f0 msgr2=0x7f3eec0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.494+0000 7f3f0e59e700 1 --2- 172.21.15.77:0/4095279356 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3eec0662f0 0x7f3eec0687b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3f04009910 tx=0x7f3f04008030 comp rx=0 tx=0).stop 2023-07-24T05:46:31.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.494+0000 7f3f0e59e700 1 -- 172.21.15.77:0/4095279356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f080cdfd0 msgr2=0x7f3f081f7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.494+0000 7f3f0e59e700 1 --2- 172.21.15.77:0/4095279356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f080cdfd0 0x7f3f081f7960 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3ef800d830 tx=0x7f3ef800db40 comp rx=0 tx=0).stop 2023-07-24T05:46:31.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.498+0000 7f3f0e59e700 1 -- 172.21.15.77:0/4095279356 shutdown_connections 2023-07-24T05:46:31.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.498+0000 7f3f0e59e700 1 --2- 172.21.15.77:0/4095279356 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f0815a390 0x7f3f080af470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.498+0000 7f3f0e59e700 1 --2- 172.21.15.77:0/4095279356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f080cdfd0 0x7f3f081f7960 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.498+0000 7f3f0e59e700 1 --2- 172.21.15.77:0/4095279356 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3eec0662f0 0x7f3eec0687b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.498+0000 7f3f0e59e700 1 --2- 172.21.15.77:0/4095279356 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3f080b0650 0x7f3f081f3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.498+0000 7f3f0e59e700 1 -- 172.21.15.77:0/4095279356 >> 172.21.15.77:0/4095279356 conn(0x7f3f080ced00 msgr2=0x7f3f081567c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:31.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.498+0000 7f3f0e59e700 1 -- 172.21.15.77:0/4095279356 shutdown_connections 2023-07-24T05:46:31.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.498+0000 7f3f0e59e700 1 -- 172.21.15.77:0/4095279356 wait complete. 2023-07-24T05:46:31.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.498+0000 7f771d2fb700 1 -- 172.21.15.77:0/2825692574 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f77040662f0 msgr2=0x7f77040687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.498+0000 7f771d2fb700 1 --2- 172.21.15.77:0/2825692574 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f77040662f0 0x7f77040687b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f77180c96e0 tx=0x7f770c008030 comp rx=0 tx=0).stop 2023-07-24T05:46:31.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.498+0000 7f771d2fb700 1 -- 172.21.15.77:0/2825692574 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f77180b40e0 msgr2=0x7f7718158680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.498+0000 7f771d2fb700 1 --2- 172.21.15.77:0/2825692574 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f77180b40e0 0x7f7718158680 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f770800e9d0 tx=0x7f770800ece0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.498+0000 7fa022ffd700 1 -- 172.21.15.77:0/283157969 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa028056540 con 0x7fa0340d2200 2023-07-24T05:46:31.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.498+0000 7f771d2fb700 1 -- 172.21.15.77:0/2825692574 shutdown_connections 2023-07-24T05:46:31.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.498+0000 7f771d2fb700 1 --2- 172.21.15.77:0/2825692574 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f771815c960 0x7f771815ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.498+0000 7f771d2fb700 1 --2- 172.21.15.77:0/2825692574 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77180d25f0 0x7f77181feb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.498+0000 7f771d2fb700 1 --2- 172.21.15.77:0/2825692574 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f77040662f0 0x7f77040687b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.498+0000 7f771d2fb700 1 --2- 172.21.15.77:0/2825692574 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f77180b40e0 0x7f7718158680 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.498+0000 7f771d2fb700 1 -- 172.21.15.77:0/2825692574 >> 172.21.15.77:0/2825692574 conn(0x7f77180b7600 msgr2=0x7f77180d11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:31.505 INFO:teuthology.orchestra.run.smithi077.stdout:60129542153 2023-07-24T05:46:31.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.498+0000 7f771d2fb700 1 -- 172.21.15.77:0/2825692574 shutdown_connections 2023-07-24T05:46:31.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.498+0000 7f0738a9e700 1 -- 172.21.15.77:0/2704773673 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f07140662f0 msgr2=0x7f07140687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.498+0000 7f771d2fb700 1 -- 172.21.15.77:0/2825692574 wait complete. 2023-07-24T05:46:31.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.498+0000 7f0738a9e700 1 --2- 172.21.15.77:0/2704773673 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f07140662f0 0x7f07140687b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f072c050f90 tx=0x7f0728007d60 comp rx=0 tx=0).stop 2023-07-24T05:46:31.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.498+0000 7f0738a9e700 1 -- 172.21.15.77:0/2704773673 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f072c049a30 msgr2=0x7f072c189450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.498+0000 7f0738a9e700 1 --2- 172.21.15.77:0/2704773673 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f072c049a30 0x7f072c189450 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0734061950 tx=0x7f0734069910 comp rx=0 tx=0).stop 2023-07-24T05:46:31.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.498+0000 7f0738a9e700 1 -- 172.21.15.77:0/2704773673 shutdown_connections 2023-07-24T05:46:31.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.498+0000 7f0738a9e700 1 --2- 172.21.15.77:0/2704773673 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f07140662f0 0x7f07140687b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.498+0000 7f0738a9e700 1 --2- 172.21.15.77:0/2704773673 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f072c0e7940 0x7f072c0558e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.498+0000 7f0738a9e700 1 --2- 172.21.15.77:0/2704773673 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f072c04a0a0 0x7f072c0553a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.508 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.0 2023-07-24T05:46:31.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.502+0000 7f0738a9e700 1 --2- 172.21.15.77:0/2704773673 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f072c049a30 0x7f072c189450 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.502+0000 7f0738a9e700 1 -- 172.21.15.77:0/2704773673 >> 172.21.15.77:0/2704773673 conn(0x7f072c053840 msgr2=0x7f072c0d8160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:31.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.502+0000 7f7658eb5700 1 -- 172.21.15.77:0/3072997817 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f764c008c00 con 0x7f764c0df5e0 2023-07-24T05:46:31.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.502+0000 7f0738a9e700 1 -- 172.21.15.77:0/2704773673 shutdown_connections 2023-07-24T05:46:31.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.502+0000 7f0738a9e700 1 -- 172.21.15.77:0/2704773673 wait complete. 2023-07-24T05:46:31.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.502+0000 7f7642ffd700 1 -- 172.21.15.77:0/3072997817 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f76540cd8a0 con 0x7f764c0df5e0 2023-07-24T05:46:31.510 INFO:teuthology.orchestra.run.smithi077.stdout:60129542152 2023-07-24T05:46:31.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.502+0000 7fa038d21700 1 -- 172.21.15.77:0/283157969 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa014066370 msgr2=0x7fa014068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.502+0000 7fa038d21700 1 --2- 172.21.15.77:0/283157969 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa014066370 0x7fa014068830 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa024007d70 tx=0x7fa024007cc0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.502+0000 7fa038d21700 1 -- 172.21.15.77:0/283157969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0340d2200 msgr2=0x7fa0341fe460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.502+0000 7fa038d21700 1 --2- 172.21.15.77:0/283157969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0340d2200 0x7fa0341fe460 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa028015000 tx=0x7fa0280047e0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.502+0000 7fa038d21700 1 -- 172.21.15.77:0/283157969 shutdown_connections 2023-07-24T05:46:31.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.502+0000 7fa038d21700 1 --2- 172.21.15.77:0/283157969 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa014066370 0x7fa014068830 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.502+0000 7fa038d21700 1 --2- 172.21.15.77:0/283157969 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa0341fe9a0 0x7fa0340d1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.502+0000 7fa038d21700 1 --2- 172.21.15.77:0/283157969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0340d2200 0x7fa0341fe460 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.502+0000 7fa038d21700 1 --2- 172.21.15.77:0/283157969 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa0340b4630 0x7fa03406de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.502+0000 7fa038d21700 1 -- 172.21.15.77:0/283157969 >> 172.21.15.77:0/283157969 conn(0x7fa0340b7610 msgr2=0x7fa0340d0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:31.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.502+0000 7fa038d21700 1 -- 172.21.15.77:0/283157969 shutdown_connections 2023-07-24T05:46:31.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.506+0000 7fa038d21700 1 -- 172.21.15.77:0/283157969 wait complete. 2023-07-24T05:46:31.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.506+0000 7f7658eb5700 1 -- 172.21.15.77:0/3072997817 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f76340663c0 msgr2=0x7f7634068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.506+0000 7f7658eb5700 1 --2- 172.21.15.77:0/3072997817 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f76340663c0 0x7f7634068880 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f764c04e470 tx=0x7f764400c040 comp rx=0 tx=0).stop 2023-07-24T05:46:31.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.506+0000 7f7658eb5700 1 -- 172.21.15.77:0/3072997817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f764c0df5e0 msgr2=0x7f764c1808d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:31.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.506+0000 7f7658eb5700 1 --2- 172.21.15.77:0/3072997817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f764c0df5e0 0x7f764c1808d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f765404f780 tx=0x7f7654066d60 comp rx=0 tx=0).stop 2023-07-24T05:46:31.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.506+0000 7f7658eb5700 1 -- 172.21.15.77:0/3072997817 shutdown_connections 2023-07-24T05:46:31.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.506+0000 7f7658eb5700 1 --2- 172.21.15.77:0/3072997817 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f764c0df5e0 0x7f764c1808d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.506+0000 7f7658eb5700 1 --2- 172.21.15.77:0/3072997817 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f76340663c0 0x7f7634068880 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.506+0000 7f7658eb5700 1 --2- 172.21.15.77:0/3072997817 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f764c04fd50 0x7f764c04e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.506+0000 7f7658eb5700 1 --2- 172.21.15.77:0/3072997817 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f764c0060c0 0x7f764c0d9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:31.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.506+0000 7f7658eb5700 1 -- 172.21.15.77:0/3072997817 >> 172.21.15.77:0/3072997817 conn(0x7f764c054cf0 msgr2=0x7f764c004c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:31.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.506+0000 7f7658eb5700 1 -- 172.21.15.77:0/3072997817 shutdown_connections 2023-07-24T05:46:31.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:31.506+0000 7f7658eb5700 1 -- 172.21.15.77:0/3072997817 wait complete. 2023-07-24T05:46:31.516 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.5 2023-07-24T05:46:31.524 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.3 2023-07-24T05:46:31.526 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.7 2023-07-24T05:46:31.530 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.4 2023-07-24T05:46:31.534 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.2 2023-07-24T05:46:31.535 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.6 2023-07-24T05:46:31.538 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.1 2023-07-24T05:46:32.509 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-24T05:46:32.516 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-24T05:46:32.525 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-24T05:46:32.527 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-24T05:46:32.531 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-24T05:46:32.535 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-24T05:46:32.536 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-24T05:46:32.539 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-24T05:46:32.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.730+0000 7f38aab1a700 1 Processor -- start 2023-07-24T05:46:32.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.734+0000 7f38aab1a700 1 -- start start 2023-07-24T05:46:32.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.734+0000 7f38aab1a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f38a40b0330 0x7f38a40b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.734+0000 7f38aab1a700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f38a40aae70 0x7f38a40adca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.734+0000 7f38aab1a700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38a40b20b0 con 0x7f38a4158b30 2023-07-24T05:46:32.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.734+0000 7f38aab1a700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38a4158f10 con 0x7f38a40aae70 2023-07-24T05:46:32.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.734+0000 7f38aab1a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38a40b22e0 con 0x7f38a40b0330 2023-07-24T05:46:32.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.734+0000 7f38a88b6700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f38a4158b30 0x7f38a40afc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57202/0 (socket says 172.21.15.77:57202) 2023-07-24T05:46:32.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.734+0000 7f38a88b6700 1 -- 172.21.15.77:0/2460246886 learned_addr learned my addr 172.21.15.77:0/2460246886 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:32.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.734+0000 7f38a3fff700 1 --2- 172.21.15.77:0/2460246886 >> v2:172.21.15.103:3300/0 conn(0x7f38a40b0330 0x7f38a40b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:32.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.734+0000 7f38a90b7700 1 --2- 172.21.15.77:0/2460246886 >> v2:172.21.15.77:3300/0 conn(0x7f38a40aae70 0x7f38a40adca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:32.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.738+0000 7f38a3fff700 1 -- 172.21.15.77:0/2460246886 >> v2:172.21.15.77:3300/0 conn(0x7f38a40aae70 msgr2=0x7f38a40adca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:32.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.738+0000 7f38a3fff700 1 --2- 172.21.15.77:0/2460246886 >> v2:172.21.15.77:3300/0 conn(0x7f38a40aae70 0x7f38a40adca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:32.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.738+0000 7f38a3fff700 1 -- 172.21.15.77:0/2460246886 >> v1:172.21.15.77:6789/0 conn(0x7f38a4158b30 legacy=0x7f38a40afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:32.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.738+0000 7f38a3fff700 1 -- 172.21.15.77:0/2460246886 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a40b25c0 con 0x7f38a40b0330 2023-07-24T05:46:32.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.738+0000 7f38a90b7700 1 --2- 172.21.15.77:0/2460246886 >> v2:172.21.15.77:3300/0 conn(0x7f38a40aae70 0x7f38a40adca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:46:32.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.738+0000 7f38a3fff700 1 --2- 172.21.15.77:0/2460246886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38a40b0330 0x7f38a40b1b70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f38a406f8d0 tx=0x7f389400d330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33447c90dd8aeccd server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:32.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.738+0000 7f38a37fe700 1 -- 172.21.15.77:0/2460246886 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3894010070 con 0x7f38a40b0330 2023-07-24T05:46:32.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.738+0000 7f38a37fe700 1 -- 172.21.15.77:0/2460246886 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f389400d9c0 con 0x7f38a40b0330 2023-07-24T05:46:32.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.738+0000 7f38aab1a700 1 -- 172.21.15.77:0/2460246886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38a40b0330 msgr2=0x7f38a40b1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:32.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.738+0000 7f38aab1a700 1 --2- 172.21.15.77:0/2460246886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38a40b0330 0x7f38a40b1b70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f38a406f8d0 tx=0x7f389400d330 comp rx=0 tx=0).stop 2023-07-24T05:46:32.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.738+0000 7f38aab1a700 1 -- 172.21.15.77:0/2460246886 shutdown_connections 2023-07-24T05:46:32.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.742+0000 7f38aab1a700 1 --2- 172.21.15.77:0/2460246886 >> v2:172.21.15.77:3300/0 conn(0x7f38a40aae70 0x7f38a40adca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:32.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.742+0000 7f38aab1a700 1 --2- 172.21.15.77:0/2460246886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38a40b0330 0x7f38a40b1b70 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:32.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.742+0000 7f38aab1a700 1 -- 172.21.15.77:0/2460246886 >> 172.21.15.77:0/2460246886 conn(0x7f38a40cacc0 msgr2=0x7f38a40cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:32.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.742+0000 7f38aab1a700 1 -- 172.21.15.77:0/2460246886 shutdown_connections 2023-07-24T05:46:32.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.742+0000 7f38aab1a700 1 -- 172.21.15.77:0/2460246886 wait complete. 2023-07-24T05:46:32.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.742+0000 7f38aab1a700 1 Processor -- start 2023-07-24T05:46:32.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.742+0000 7f38aab1a700 1 -- start start 2023-07-24T05:46:32.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.746+0000 7f38aab1a700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38a40aae70 0x7f38a4202bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.746+0000 7f38aab1a700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f38a40b0330 0x7f38a40cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.746+0000 7f38aab1a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38a4158b30 0x7f38a41e5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.746+0000 7f38aab1a700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a406acd0 con 0x7f38a4158b30 2023-07-24T05:46:32.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.746+0000 7f38aab1a700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a40cdd20 con 0x7f38a40aae70 2023-07-24T05:46:32.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.746+0000 7f38aab1a700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a41530b0 con 0x7f38a40b0330 2023-07-24T05:46:32.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.746+0000 7f38a3fff700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f38a40b0330 0x7f38a40cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:32.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.746+0000 7f38a90b7700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38a4158b30 0x7f38a41e5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:32.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.746+0000 7f38a90b7700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38a4158b30 0x7f38a41e5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58982/0 (socket says 172.21.15.77:58982) 2023-07-24T05:46:32.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.746+0000 7f38a90b7700 1 -- 172.21.15.77:0/996747109 learned_addr learned my addr 172.21.15.77:0/996747109 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:32.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.750+0000 7f38a90b7700 1 -- 172.21.15.77:0/996747109 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f38a40b0330 msgr2=0x7f38a40cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:32.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.750+0000 7f38a90b7700 1 --2- 172.21.15.77:0/996747109 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f38a40b0330 0x7f38a40cd7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:32.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.750+0000 7f38a90b7700 1 -- 172.21.15.77:0/996747109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38a40aae70 msgr2=0x7f38a4202bd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-24T05:46:32.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.750+0000 7f38a90b7700 1 --2- 172.21.15.77:0/996747109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38a40aae70 0x7f38a4202bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:32.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.750+0000 7f38a90b7700 1 -- 172.21.15.77:0/996747109 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3894008530 con 0x7f38a4158b30 2023-07-24T05:46:32.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.750+0000 7f38a90b7700 1 --2- 172.21.15.77:0/996747109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38a4158b30 0x7f38a41e5470 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f389c007e10 tx=0x7f389c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:32.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.750+0000 7f38a17fa700 1 -- 172.21.15.77:0/996747109 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389c00de90 con 0x7f38a4158b30 2023-07-24T05:46:32.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.750+0000 7f38a17fa700 1 -- 172.21.15.77:0/996747109 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f389c00f040 con 0x7f38a4158b30 2023-07-24T05:46:32.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.750+0000 7f38aab1a700 1 -- 172.21.15.77:0/996747109 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38a4152dd0 con 0x7f38a4158b30 2023-07-24T05:46:32.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.750+0000 7f38a17fa700 1 -- 172.21.15.77:0/996747109 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389c003cb0 con 0x7f38a4158b30 2023-07-24T05:46:32.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.750+0000 7f38aab1a700 1 -- 172.21.15.77:0/996747109 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38a42023d0 con 0x7f38a4158b30 2023-07-24T05:46:32.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.754+0000 7f38aab1a700 1 -- 172.21.15.77:0/996747109 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38a40abb60 con 0x7f38a4158b30 2023-07-24T05:46:32.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.754+0000 7f38a17fa700 1 -- 172.21.15.77:0/996747109 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f389c004030 con 0x7f38a4158b30 2023-07-24T05:46:32.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.758+0000 7f38a17fa700 1 --2- 172.21.15.77:0/996747109 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f38900663f0 0x7f38900688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.758+0000 7f38a17fa700 1 -- 172.21.15.77:0/996747109 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f389c006e40 con 0x7f38a4158b30 2023-07-24T05:46:32.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.758+0000 7f38a88b6700 1 --2- 172.21.15.77:0/996747109 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f38900663f0 0x7f38900688b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:32.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.758+0000 7f38a88b6700 1 --2- 172.21.15.77:0/996747109 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f38900663f0 0x7f38900688b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f38a40adc30 tx=0x7f3898007af0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:32.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.766+0000 7f38a17fa700 1 -- 172.21.15.77:0/996747109 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f389c0512a0 con 0x7f38a4158b30 2023-07-24T05:46:32.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.782+0000 7f30dac51700 1 Processor -- start 2023-07-24T05:46:32.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.786+0000 7f30dac51700 1 -- start start 2023-07-24T05:46:32.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.786+0000 7f30dac51700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f30d40b0330 0x7f30d40b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.786+0000 7f30dac51700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f30d40aae70 0x7f30d40adca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.786+0000 7f30dac51700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30d40b20b0 con 0x7f30d4158b30 2023-07-24T05:46:32.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.786+0000 7f30dac51700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30d4158f10 con 0x7f30d40b0330 2023-07-24T05:46:32.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.786+0000 7f30dac51700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30d40b22e0 con 0x7f30d40aae70 2023-07-24T05:46:32.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.786+0000 7f30d89ed700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f30d4158b30 0x7f30d40afc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.77:39394/0 (socket says 172.21.15.77:39394) 2023-07-24T05:46:32.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.786+0000 7f30d3fff700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f30d40b0330 0x7f30d40b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:32.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.786+0000 7f30d91ee700 1 --2- 172.21.15.77:0/90551808 >> v2:172.21.15.103:3300/0 conn(0x7f30d40aae70 0x7f30d40adca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:32.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.786+0000 7f30d89ed700 1 -- 172.21.15.77:0/90551808 learned_addr learned my addr 172.21.15.77:0/90551808 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:32.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.786+0000 7f1a17d70700 1 Processor -- start 2023-07-24T05:46:32.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.786+0000 7f30d91ee700 1 -- 172.21.15.77:0/90551808 >> v2:172.21.15.77:3300/0 conn(0x7f30d40b0330 msgr2=0x7f30d40b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:32.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.786+0000 7f30d91ee700 1 --2- 172.21.15.77:0/90551808 >> v2:172.21.15.77:3300/0 conn(0x7f30d40b0330 0x7f30d40b1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:32.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.786+0000 7f30d91ee700 1 -- 172.21.15.77:0/90551808 >> v1:172.21.15.103:6789/0 conn(0x7f30d4158b30 legacy=0x7f30d40afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:32.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.786+0000 7f30d91ee700 1 -- 172.21.15.77:0/90551808 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d40b25c0 con 0x7f30d40aae70 2023-07-24T05:46:32.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.790+0000 7f30d91ee700 1 --2- 172.21.15.77:0/90551808 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30d40aae70 0x7f30d40adca0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f30d40b3240 tx=0x7f30c400bdc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f756fe31034d8b8 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:32.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.790+0000 7f30d37fe700 1 -- 172.21.15.77:0/90551808 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c4005c90 con 0x7f30d40aae70 2023-07-24T05:46:32.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.790+0000 7f30d37fe700 1 -- 172.21.15.77:0/90551808 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c4005df0 con 0x7f30d40aae70 2023-07-24T05:46:32.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.790+0000 7f30d37fe700 1 -- 172.21.15.77:0/90551808 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c400db80 con 0x7f30d40aae70 2023-07-24T05:46:32.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.790+0000 7f30dac51700 1 -- 172.21.15.77:0/90551808 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30d40aae70 msgr2=0x7f30d40adca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:32.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.790+0000 7f30dac51700 1 --2- 172.21.15.77:0/90551808 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30d40aae70 0x7f30d40adca0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f30d40b3240 tx=0x7f30c400bdc0 comp rx=0 tx=0).stop 2023-07-24T05:46:32.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.790+0000 7f30dac51700 1 -- 172.21.15.77:0/90551808 shutdown_connections 2023-07-24T05:46:32.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.790+0000 7f30dac51700 1 --2- 172.21.15.77:0/90551808 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30d40aae70 0x7f30d40adca0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:32.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.790+0000 7f30dac51700 1 --2- 172.21.15.77:0/90551808 >> v2:172.21.15.77:3300/0 conn(0x7f30d40b0330 0x7f30d40b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:32.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.790+0000 7f30dac51700 1 -- 172.21.15.77:0/90551808 >> 172.21.15.77:0/90551808 conn(0x7f30d40cacc0 msgr2=0x7f30d40cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:32.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.790+0000 7f30dac51700 1 -- 172.21.15.77:0/90551808 shutdown_connections 2023-07-24T05:46:32.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.790+0000 7f1a17d70700 1 -- start start 2023-07-24T05:46:32.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.790+0000 7f1a17d70700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1a10160d20 0x7f1a100adba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.790+0000 7f1a17d70700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1a100ae0e0 0x7f1a100b1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.790+0000 7f1a17d70700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a100af170 con 0x7f1a10161100 2023-07-24T05:46:32.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.790+0000 7f1a17d70700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a100ae5f0 con 0x7f1a100ae0e0 2023-07-24T05:46:32.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.790+0000 7f1a17d70700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a100ae8d0 con 0x7f1a10160d20 2023-07-24T05:46:32.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.790+0000 7f1a15b0c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1a10160d20 0x7f1a100adba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:32.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.790+0000 7f1a1530b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1a100ae0e0 0x7f1a100b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:32.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.790+0000 7f1a15b0c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1a10160d20 0x7f1a100adba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.77:54062/0 (socket says 172.21.15.77:54062) 2023-07-24T05:46:32.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.790+0000 7f1a15b0c700 1 -- 172.21.15.77:0/2011652059 learned_addr learned my addr 172.21.15.77:0/2011652059 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:32.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.790+0000 7f30dac51700 1 -- 172.21.15.77:0/90551808 wait complete. 2023-07-24T05:46:32.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.790+0000 7f6c58800700 1 Processor -- start 2023-07-24T05:46:32.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.790+0000 7f6c58800700 1 -- start start 2023-07-24T05:46:32.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.794+0000 7f1a1530b700 1 -- 172.21.15.77:0/2011652059 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1a10160d20 msgr2=0x7f1a100adba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:32.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.794+0000 7f1a1530b700 1 --2- 172.21.15.77:0/2011652059 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1a10160d20 0x7f1a100adba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:32.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.794+0000 7f1a1530b700 1 -- 172.21.15.77:0/2011652059 >> v1:172.21.15.103:6789/0 conn(0x7f1a10161100 legacy=0x7f1a10164b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:32.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.794+0000 7f1a1530b700 1 -- 172.21.15.77:0/2011652059 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a100aebb0 con 0x7f1a100ae0e0 2023-07-24T05:46:32.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.794+0000 7f1a1530b700 1 --2- 172.21.15.77:0/2011652059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a100ae0e0 0x7f1a100b1090 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1a00009850 tx=0x7f1a00009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=817822d3e68e9bfb server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:32.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.794+0000 7f1a14b0a700 1 -- 172.21.15.77:0/2011652059 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a00011830 con 0x7f1a100ae0e0 2023-07-24T05:46:32.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.794+0000 7f30dac51700 1 Processor -- start 2023-07-24T05:46:32.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.794+0000 7f6c58800700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6c500d2200 0x7f6c500b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.794+0000 7f6c58800700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c500d2640 con 0x7f6c5015ca00 2023-07-24T05:46:32.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.794+0000 7f6c58800700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c500d0300 con 0x7f6c500b4630 2023-07-24T05:46:32.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.794+0000 7f6c58800700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c500b4ac0 con 0x7f6c500d2200 2023-07-24T05:46:32.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.794+0000 7f1a14b0a700 1 -- 172.21.15.77:0/2011652059 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a00011990 con 0x7f1a100ae0e0 2023-07-24T05:46:32.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.794+0000 7f1a14b0a700 1 -- 172.21.15.77:0/2011652059 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a00011d40 con 0x7f1a100ae0e0 2023-07-24T05:46:32.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.794+0000 7f1a17d70700 1 -- 172.21.15.77:0/2011652059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a100ae0e0 msgr2=0x7f1a100b1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:32.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.794+0000 7f1a17d70700 1 --2- 172.21.15.77:0/2011652059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a100ae0e0 0x7f1a100b1090 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1a00009850 tx=0x7f1a00009b60 comp rx=0 tx=0).stop 2023-07-24T05:46:32.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.794+0000 7f6c5659c700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f6c5015ca00 0x7f6c5006d450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57212/0 (socket says 172.21.15.77:57212) 2023-07-24T05:46:32.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.794+0000 7f6c5659c700 1 -- 172.21.15.77:0/3862150088 learned_addr learned my addr 172.21.15.77:0/3862150088 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:32.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.794+0000 7f1a17d70700 1 -- 172.21.15.77:0/2011652059 shutdown_connections 2023-07-24T05:46:32.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.794+0000 7f1a17d70700 1 --2- 172.21.15.77:0/2011652059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a100ae0e0 0x7f1a100b1090 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:32.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.794+0000 7f1a17d70700 1 --2- 172.21.15.77:0/2011652059 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1a10160d20 0x7f1a100adba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:32.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.794+0000 7f1a17d70700 1 -- 172.21.15.77:0/2011652059 >> 172.21.15.77:0/2011652059 conn(0x7f1a100cacc0 msgr2=0x7f1a100cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:32.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.794+0000 7f6c55d9b700 1 --2- 172.21.15.77:0/3862150088 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6c500d2200 0x7f6c500b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:32.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.794+0000 7f1a17d70700 1 -- 172.21.15.77:0/2011652059 shutdown_connections 2023-07-24T05:46:32.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.794+0000 7f30dac51700 1 -- start start 2023-07-24T05:46:32.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.794+0000 7f30dac51700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f30d40aae70 0x7f30d4157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.794+0000 7f30dac51700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30d40b0330 0x7f30d4070b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.794+0000 7f6c5559a700 1 -- 172.21.15.77:0/3862150088 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3075928702 0 0) 0x7f6c500d2640 con 0x7f6c5015ca00 2023-07-24T05:46:32.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.794+0000 7f6c5559a700 1 -- 172.21.15.77:0/3862150088 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c3c0035d0 con 0x7f6c5015ca00 2023-07-24T05:46:32.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.794+0000 7f30dac51700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30d4158b30 0x7f30d4071070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.794+0000 7f6c55d9b700 1 -- 172.21.15.77:0/3862150088 >> v1:172.21.15.103:6789/0 conn(0x7f6c500b4630 legacy=0x7f6c500b11e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-24T05:46:32.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.794+0000 7f6c55d9b700 1 -- 172.21.15.77:0/3862150088 >> v1:172.21.15.77:6789/0 conn(0x7f6c5015ca00 legacy=0x7f6c5006d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:32.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.794+0000 7f6c55d9b700 1 -- 172.21.15.77:0/3862150088 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c5015cde0 con 0x7f6c500d2200 2023-07-24T05:46:32.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.794+0000 7f1a17d70700 1 -- 172.21.15.77:0/2011652059 wait complete. 2023-07-24T05:46:32.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.794+0000 7f30dac51700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d40c3800 con 0x7f30d4158b30 2023-07-24T05:46:32.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.794+0000 7f30dac51700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d40c33b0 con 0x7f30d40b0330 2023-07-24T05:46:32.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.794+0000 7f30dac51700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30d40c2b10 con 0x7f30d40aae70 2023-07-24T05:46:32.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.798+0000 7f30d89ed700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f30d40aae70 0x7f30d4157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:32.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.798+0000 7f30d89ed700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f30d40aae70 0x7f30d4157db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.77:54076/0 (socket says 172.21.15.77:54076) 2023-07-24T05:46:32.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.798+0000 7f30d89ed700 1 -- 172.21.15.77:0/3856734667 learned_addr learned my addr 172.21.15.77:0/3856734667 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:32.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.798+0000 7f30d3fff700 1 --2- 172.21.15.77:0/3856734667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30d40b0330 0x7f30d4070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:32.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.798+0000 7f30d91ee700 1 --2- 172.21.15.77:0/3856734667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30d4158b30 0x7f30d4071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:32.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.798+0000 7f6c55d9b700 1 --2- 172.21.15.77:0/3862150088 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6c500d2200 0x7f6c500b40f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6c44009880 tx=0x7f6c44009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc8d30e4e0d8b381 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:32.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.798+0000 7f30d3fff700 1 -- 172.21.15.77:0/3856734667 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f30d40aae70 msgr2=0x7f30d4157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:32.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.798+0000 7f30d3fff700 1 --2- 172.21.15.77:0/3856734667 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f30d40aae70 0x7f30d4157db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:32.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.798+0000 7f30d3fff700 1 -- 172.21.15.77:0/3856734667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30d4158b30 msgr2=0x7f30d4071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:32.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.798+0000 7f30d3fff700 1 --2- 172.21.15.77:0/3856734667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30d4158b30 0x7f30d4071070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:32.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.798+0000 7f30d3fff700 1 -- 172.21.15.77:0/3856734667 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c400b740 con 0x7f30d40b0330 2023-07-24T05:46:32.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.798+0000 7f6c5559a700 1 -- 172.21.15.77:0/3862150088 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c44004230 con 0x7f6c500d2200 2023-07-24T05:46:32.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.798+0000 7f6c5559a700 1 -- 172.21.15.77:0/3862150088 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c44004390 con 0x7f6c500d2200 2023-07-24T05:46:32.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.798+0000 7f6c5559a700 1 -- 172.21.15.77:0/3862150088 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c440036c0 con 0x7f6c500d2200 2023-07-24T05:46:32.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.798+0000 7f30d3fff700 1 --2- 172.21.15.77:0/3856734667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30d40b0330 0x7f30d4070b30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f30c800aa90 tx=0x7f30c800ada0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:32.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.798+0000 7f1a17d70700 1 Processor -- start 2023-07-24T05:46:32.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.798+0000 7f30d17fa700 1 -- 172.21.15.77:0/3856734667 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c8005e50 con 0x7f30d40b0330 2023-07-24T05:46:32.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.798+0000 7f30d17fa700 1 -- 172.21.15.77:0/3856734667 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c8010040 con 0x7f30d40b0330 2023-07-24T05:46:32.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.798+0000 7f30d17fa700 1 -- 172.21.15.77:0/3856734667 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c800f830 con 0x7f30d40b0330 2023-07-24T05:46:32.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.798+0000 7f30dac51700 1 -- 172.21.15.77:0/3856734667 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30d40c2df0 con 0x7f30d40b0330 2023-07-24T05:46:32.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.798+0000 7f30dac51700 1 -- 172.21.15.77:0/3856734667 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30d41582f0 con 0x7f30d40b0330 2023-07-24T05:46:32.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.798+0000 7f6c58800700 1 -- 172.21.15.77:0/3862150088 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6c500d2200 msgr2=0x7f6c500b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:32.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.798+0000 7f6c58800700 1 --2- 172.21.15.77:0/3862150088 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6c500d2200 0x7f6c500b40f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6c44009880 tx=0x7f6c44009b90 comp rx=0 tx=0).stop 2023-07-24T05:46:32.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.798+0000 7f6c58800700 1 -- 172.21.15.77:0/3862150088 shutdown_connections 2023-07-24T05:46:32.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.798+0000 7f6c58800700 1 --2- 172.21.15.77:0/3862150088 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6c500d2200 0x7f6c500b40f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:32.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.798+0000 7f6c58800700 1 -- 172.21.15.77:0/3862150088 >> 172.21.15.77:0/3862150088 conn(0x7f6c500b7610 msgr2=0x7f6c500b7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:32.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.798+0000 7f6c58800700 1 -- 172.21.15.77:0/3862150088 shutdown_connections 2023-07-24T05:46:32.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.798+0000 7f1a17d70700 1 -- start start 2023-07-24T05:46:32.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.798+0000 7f1a17d70700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a100ae0e0 0x7f1a10160020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.798+0000 7f1a17d70700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1a10160d20 0x7f1a10202b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.798+0000 7f1a17d70700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a10161100 0x7f1a102030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.798+0000 7f1a17d70700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a10099e80 con 0x7f1a100ae0e0 2023-07-24T05:46:32.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.798+0000 7f1a17d70700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1009acc0 con 0x7f1a10161100 2023-07-24T05:46:32.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.798+0000 7f1a1630d700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a10161100 0x7f1a102030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:32.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.798+0000 7f1a1630d700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a10161100 0x7f1a102030d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:34162/0 (socket says 172.21.15.77:34162) 2023-07-24T05:46:32.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.798+0000 7f1a1630d700 1 -- 172.21.15.77:0/2000599968 learned_addr learned my addr 172.21.15.77:0/2000599968 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:32.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.798+0000 7f1a17d70700 1 -- 172.21.15.77:0/2000599968 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1009a0b0 con 0x7f1a10160d20 2023-07-24T05:46:32.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.798+0000 7f1a15b0c700 1 --2- 172.21.15.77:0/2000599968 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a100ae0e0 0x7f1a10160020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:32.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.798+0000 7f30dac51700 1 -- 172.21.15.77:0/3856734667 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30b4005310 con 0x7f30d40b0330 2023-07-24T05:46:32.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.798+0000 7f1a1530b700 1 --2- 172.21.15.77:0/2000599968 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1a10160d20 0x7f1a10202b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:32.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.798+0000 7f6c58800700 1 -- 172.21.15.77:0/3862150088 wait complete. 2023-07-24T05:46:32.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7f996ddf9700 1 Processor -- start 2023-07-24T05:46:32.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7f996ddf9700 1 -- start start 2023-07-24T05:46:32.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7f1a1530b700 1 -- 172.21.15.77:0/2000599968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a10161100 msgr2=0x7f1a102030d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:32.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7f1a1530b700 1 --2- 172.21.15.77:0/2000599968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a10161100 0x7f1a102030d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:32.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7f1a1530b700 1 -- 172.21.15.77:0/2000599968 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a100ae0e0 msgr2=0x7f1a10160020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:32.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7f1a1530b700 1 --2- 172.21.15.77:0/2000599968 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a100ae0e0 0x7f1a10160020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:32.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7f1a1530b700 1 -- 172.21.15.77:0/2000599968 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a000094b0 con 0x7f1a10160d20 2023-07-24T05:46:32.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7f11f9ed8700 1 Processor -- start 2023-07-24T05:46:32.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7f11f9ed8700 1 -- start start 2023-07-24T05:46:32.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7f6c58800700 1 Processor -- start 2023-07-24T05:46:32.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7f6c58800700 1 -- start start 2023-07-24T05:46:32.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7f1a1530b700 1 --2- 172.21.15.77:0/2000599968 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1a10160d20 0x7f1a10202b90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1a00016000 tx=0x7f1a00004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:32.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7f11f9ed8700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f11f406bc80 0x7f11f40cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7f11f9ed8700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f11f40d2480 0x7f11f40d28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7f996ddf9700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f996815c960 0x7f996806d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7f996ddf9700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f99680d25f0 0x7f99680d2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7f996ddf9700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99680cfd40 con 0x7f99680b40e0 2023-07-24T05:46:32.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7f996ddf9700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99680ceee0 con 0x7f99680d25f0 2023-07-24T05:46:32.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7f996ddf9700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99680cf130 con 0x7f996815c960 2023-07-24T05:46:32.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7f11f9ed8700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11f40c5de0 con 0x7f11f40b1a10 2023-07-24T05:46:32.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7f11f9ed8700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11f40d2e30 con 0x7f11f406bc80 2023-07-24T05:46:32.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7f11f9ed8700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11f406d700 con 0x7f11f40d2480 2023-07-24T05:46:32.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7f30d17fa700 1 -- 172.21.15.77:0/3856734667 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f30c800f990 con 0x7f30d40b0330 2023-07-24T05:46:32.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7f30d17fa700 1 --2- 172.21.15.77:0/3856734667 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f30c00662f0 0x7f30c00687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7f30d17fa700 1 -- 172.21.15.77:0/3856734667 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f30c8084800 con 0x7f30d40b0330 2023-07-24T05:46:32.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7f99677fe700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f996815c960 0x7f996806d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:32.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7f99677fe700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f996815c960 0x7f996806d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.77:54100/0 (socket says 172.21.15.77:54100) 2023-07-24T05:46:32.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7f99677fe700 1 -- 172.21.15.77:0/1777576094 learned_addr learned my addr 172.21.15.77:0/1777576094 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:32.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7f1a067fc700 1 -- 172.21.15.77:0/2000599968 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a000036c0 con 0x7f1a10160d20 2023-07-24T05:46:32.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7f1a067fc700 1 -- 172.21.15.77:0/2000599968 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0001f070 con 0x7f1a10160d20 2023-07-24T05:46:32.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7f1a067fc700 1 -- 172.21.15.77:0/2000599968 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a00003a60 con 0x7f1a10160d20 2023-07-24T05:46:32.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7f1a17d70700 1 -- 172.21.15.77:0/2000599968 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a1009a390 con 0x7f1a10160d20 2023-07-24T05:46:32.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7ff9a55ca700 1 Processor -- start 2023-07-24T05:46:32.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7ff9a55ca700 1 -- start start 2023-07-24T05:46:32.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7f1a17d70700 1 -- 172.21.15.77:0/2000599968 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a1009a950 con 0x7f1a10160d20 2023-07-24T05:46:32.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7ff9a55ca700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff9a01642d0 0x7ff9a009bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7ff9a55ca700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff9a00b0740 0x7ff9a006ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7ff9a55ca700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a00b0ba0 con 0x7ff9a006b390 2023-07-24T05:46:32.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7ff9a55ca700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9a00ae290 con 0x7ff9a01642d0 2023-07-24T05:46:32.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7ff9a55ca700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9a00af770 con 0x7ff9a00b0740 2023-07-24T05:46:32.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7f11f8ed6700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f11f40b1a10 0x7f11f40ceee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.77:39404/0 (socket says 172.21.15.77:39404) 2023-07-24T05:46:32.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7f11f8ed6700 1 -- 172.21.15.77:0/2657570028 learned_addr learned my addr 172.21.15.77:0/2657570028 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:32.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7f6c58800700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c500b4630 0x7f6c50156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7f11f96d7700 1 --2- 172.21.15.77:0/2657570028 >> v2:172.21.15.103:3300/0 conn(0x7f11f40d2480 0x7f11f40d28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:32.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7f6c58800700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c500d2200 0x7f6c50160020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f11f3fff700 1 --2- 172.21.15.77:0/2657570028 >> v2:172.21.15.77:3300/0 conn(0x7f11f406bc80 0x7f11f40cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:32.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7ff9a4dc9700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ff9a006b390 0x7ff9a0164760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:57236/0 (socket says 172.21.15.77:57236) 2023-07-24T05:46:32.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7ff9a4dc9700 1 -- 172.21.15.77:0/3957606453 learned_addr learned my addr 172.21.15.77:0/3957606453 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:32.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7ff99ffff700 1 --2- 172.21.15.77:0/3957606453 >> v2:172.21.15.77:3300/0 conn(0x7ff9a01642d0 0x7ff9a009bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:32.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7f99677fe700 1 -- 172.21.15.77:0/1777576094 >> v2:172.21.15.77:3300/0 conn(0x7f99680d25f0 msgr2=0x7f99680d2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:32.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7f99677fe700 1 --2- 172.21.15.77:0/1777576094 >> v2:172.21.15.77:3300/0 conn(0x7f99680d25f0 0x7f99680d2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:32.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.802+0000 7f99677fe700 1 -- 172.21.15.77:0/1777576094 >> v1:172.21.15.77:6789/0 conn(0x7f99680b40e0 legacy=0x7f99680b4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:32.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f99677fe700 1 -- 172.21.15.77:0/1777576094 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99680d2f90 con 0x7f996815c960 2023-07-24T05:46:32.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f6c5659c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c500b4630 0x7f6c50156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:32.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f6c5659c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c500b4630 0x7f6c50156ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:34184/0 (socket says 172.21.15.77:34184) 2023-07-24T05:46:32.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f6c5659c700 1 -- 172.21.15.77:0/1162974219 learned_addr learned my addr 172.21.15.77:0/1162974219 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:32.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f6c58800700 1 --2- 172.21.15.77:0/1162974219 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6c5015ca00 0x7f6c5015f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f6c55d9b700 1 --2- 172.21.15.77:0/1162974219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c500d2200 0x7f6c50160020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:32.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f11f3fff700 1 -- 172.21.15.77:0/2657570028 >> v2:172.21.15.103:3300/0 conn(0x7f11f40d2480 msgr2=0x7f11f40d28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:32.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f11f3fff700 1 --2- 172.21.15.77:0/2657570028 >> v2:172.21.15.103:3300/0 conn(0x7f11f40d2480 0x7f11f40d28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:32.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f11f3fff700 1 -- 172.21.15.77:0/2657570028 >> v1:172.21.15.103:6789/0 conn(0x7f11f40b1a10 legacy=0x7f11f40ceee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:32.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f11f3fff700 1 -- 172.21.15.77:0/2657570028 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f406d9e0 con 0x7f11f406bc80 2023-07-24T05:46:32.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f6c58800700 1 -- 172.21.15.77:0/1162974219 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c50157430 con 0x7f6c500d2200 2023-07-24T05:46:32.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f99677fe700 1 --2- 172.21.15.77:0/1777576094 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f996815c960 0x7f996806d3b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9958009e50 tx=0x7f995800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbdf6bcc42c1ee94 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:32.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7ff99ffff700 1 -- 172.21.15.77:0/3957606453 >> v2:172.21.15.103:3300/0 conn(0x7ff9a00b0740 msgr2=0x7ff9a006ae50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-24T05:46:32.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7ff99ffff700 1 --2- 172.21.15.77:0/3957606453 >> v2:172.21.15.103:3300/0 conn(0x7ff9a00b0740 0x7ff9a006ae50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:32.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7ff99ffff700 1 -- 172.21.15.77:0/3957606453 >> v1:172.21.15.77:6789/0 conn(0x7ff9a006b390 legacy=0x7ff9a0164760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:32.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7ff99ffff700 1 -- 172.21.15.77:0/3957606453 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a00ab9e0 con 0x7ff9a01642d0 2023-07-24T05:46:32.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f6c58800700 1 -- 172.21.15.77:0/1162974219 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5009e3d0 con 0x7f6c500b4630 2023-07-24T05:46:32.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f6c58800700 1 -- 172.21.15.77:0/1162974219 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5009d7c0 con 0x7f6c5015ca00 2023-07-24T05:46:32.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7ff99ffff700 1 --2- 172.21.15.77:0/3957606453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9a01642d0 0x7ff9a009bc30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff9a00afd00 tx=0x7ff990009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9655bd36549dfb01 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:32.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f11f3fff700 1 --2- 172.21.15.77:0/2657570028 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11f406bc80 0x7f11f40cfa40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f11f40b5160 tx=0x7f11e0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=722751e29e46504f server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:32.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f1a17d70700 1 -- 172.21.15.77:0/2000599968 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19f8005310 con 0x7f1a10160d20 2023-07-24T05:46:32.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f30d89ed700 1 --2- 172.21.15.77:0/3856734667 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f30c00662f0 0x7f30c00687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:32.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7ff99effd700 1 -- 172.21.15.77:0/3957606453 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff990011830 con 0x7ff9a01642d0 2023-07-24T05:46:32.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7ff99effd700 1 -- 172.21.15.77:0/3957606453 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff990011990 con 0x7ff9a01642d0 2023-07-24T05:46:32.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7ff99effd700 1 -- 172.21.15.77:0/3957606453 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff990011d20 con 0x7ff9a01642d0 2023-07-24T05:46:32.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f11f37fe700 1 -- 172.21.15.77:0/2657570028 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e0011830 con 0x7f11f406bc80 2023-07-24T05:46:32.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f11f37fe700 1 -- 172.21.15.77:0/2657570028 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e0011990 con 0x7f11f406bc80 2023-07-24T05:46:32.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f6c56d9d700 1 --2- 172.21.15.77:0/1162974219 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6c5015ca00 0x7f6c5015f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:32.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f6c56d9d700 1 -- 172.21.15.77:0/1162974219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c500b4630 msgr2=0x7f6c50156ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:32.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f6c56d9d700 1 --2- 172.21.15.77:0/1162974219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c500b4630 0x7f6c50156ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:32.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f6c56d9d700 1 -- 172.21.15.77:0/1162974219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c500d2200 msgr2=0x7f6c50160020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:32.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f6c56d9d700 1 --2- 172.21.15.77:0/1162974219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c500d2200 0x7f6c50160020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:32.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f6c56d9d700 1 -- 172.21.15.77:0/1162974219 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c440094b0 con 0x7f6c5015ca00 2023-07-24T05:46:32.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f9966ffd700 1 -- 172.21.15.77:0/1777576094 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995800e070 con 0x7f996815c960 2023-07-24T05:46:32.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f9966ffd700 1 -- 172.21.15.77:0/1777576094 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9958003a40 con 0x7f996815c960 2023-07-24T05:46:32.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f9966ffd700 1 -- 172.21.15.77:0/1777576094 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9958003dd0 con 0x7f996815c960 2023-07-24T05:46:32.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f996ddf9700 1 -- 172.21.15.77:0/1777576094 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f996815c960 msgr2=0x7f996806d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:32.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f996ddf9700 1 --2- 172.21.15.77:0/1777576094 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f996815c960 0x7f996806d3b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9958009e50 tx=0x7f995800b330 comp rx=0 tx=0).stop 2023-07-24T05:46:32.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f996ddf9700 1 -- 172.21.15.77:0/1777576094 shutdown_connections 2023-07-24T05:46:32.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f996ddf9700 1 --2- 172.21.15.77:0/1777576094 >> v2:172.21.15.77:3300/0 conn(0x7f99680d25f0 0x7f99680d2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:32.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f996ddf9700 1 --2- 172.21.15.77:0/1777576094 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f996815c960 0x7f996806d3b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:32.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f996ddf9700 1 -- 172.21.15.77:0/1777576094 >> 172.21.15.77:0/1777576094 conn(0x7f99680b7600 msgr2=0x7f99680b79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:32.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f11f37fe700 1 -- 172.21.15.77:0/2657570028 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e0011d40 con 0x7f11f406bc80 2023-07-24T05:46:32.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7ff9a55ca700 1 -- 172.21.15.77:0/3957606453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9a01642d0 msgr2=0x7ff9a009bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:32.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7ff9a55ca700 1 --2- 172.21.15.77:0/3957606453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9a01642d0 0x7ff9a009bc30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff9a00afd00 tx=0x7ff990009b30 comp rx=0 tx=0).stop 2023-07-24T05:46:32.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7ff9a55ca700 1 -- 172.21.15.77:0/3957606453 shutdown_connections 2023-07-24T05:46:32.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7ff9a55ca700 1 --2- 172.21.15.77:0/3957606453 >> v2:172.21.15.103:3300/0 conn(0x7ff9a00b0740 0x7ff9a006ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:32.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7ff9a55ca700 1 --2- 172.21.15.77:0/3957606453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9a01642d0 0x7ff9a009bc30 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:32.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7ff9a55ca700 1 -- 172.21.15.77:0/3957606453 >> 172.21.15.77:0/3957606453 conn(0x7ff9a00cacc0 msgr2=0x7ff9a00cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:32.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f996ddf9700 1 -- 172.21.15.77:0/1777576094 shutdown_connections 2023-07-24T05:46:32.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f6c56d9d700 1 --2- 172.21.15.77:0/1162974219 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6c5015ca00 0x7f6c5015f340 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6c4800b3e0 tx=0x7f6c4800b6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:32.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f11f9ed8700 1 -- 172.21.15.77:0/2657570028 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11f406bc80 msgr2=0x7f11f40cfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:32.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f11f9ed8700 1 --2- 172.21.15.77:0/2657570028 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11f406bc80 0x7f11f40cfa40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f11f40b5160 tx=0x7f11e0009b30 comp rx=0 tx=0).stop 2023-07-24T05:46:32.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7fb41bdb1700 1 Processor -- start 2023-07-24T05:46:32.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f11f9ed8700 1 -- 172.21.15.77:0/2657570028 shutdown_connections 2023-07-24T05:46:32.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f11f9ed8700 1 --2- 172.21.15.77:0/2657570028 >> v2:172.21.15.103:3300/0 conn(0x7f11f40d2480 0x7f11f40d28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:32.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f11f9ed8700 1 --2- 172.21.15.77:0/2657570028 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11f406bc80 0x7f11f40cfa40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:32.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f11f9ed8700 1 -- 172.21.15.77:0/2657570028 >> 172.21.15.77:0/2657570028 conn(0x7f11f40b7600 msgr2=0x7f11f40b79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:32.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f11f9ed8700 1 -- 172.21.15.77:0/2657570028 shutdown_connections 2023-07-24T05:46:32.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f11f9ed8700 1 -- 172.21.15.77:0/2657570028 wait complete. 2023-07-24T05:46:32.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7fb41bdb1700 1 -- start start 2023-07-24T05:46:32.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7ff9a55ca700 1 -- 172.21.15.77:0/3957606453 shutdown_connections 2023-07-24T05:46:32.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.810+0000 7f1a067fc700 1 -- 172.21.15.77:0/2000599968 <== mon.2 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1a00003bc0 con 0x7f1a10160d20 2023-07-24T05:46:32.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7ff9a55ca700 1 -- 172.21.15.77:0/3957606453 wait complete. 2023-07-24T05:46:32.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.806+0000 7f996ddf9700 1 -- 172.21.15.77:0/1777576094 wait complete. 2023-07-24T05:46:32.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.810+0000 7fb41bdb1700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb40c0e32c0 0x7fb40c053990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.810+0000 7fb41bdb1700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb40c03a7d0 0x7fb40c04f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.810+0000 7fb41bdb1700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb40c050310 con 0x7fb40c04fec0 2023-07-24T05:46:32.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.810+0000 7fb41bdb1700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb40c0e36a0 con 0x7fb40c03a7d0 2023-07-24T05:46:32.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.810+0000 7fb41bdb1700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb40c0062b0 con 0x7fb40c0e32c0 2023-07-24T05:46:32.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.810+0000 7f996ddf9700 1 Processor -- start 2023-07-24T05:46:32.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.810+0000 7fb419b4d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb40c0e32c0 0x7fb40c053990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:32.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.810+0000 7fb419b4d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb40c0e32c0 0x7fb40c053990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:34186/0 (socket says 172.21.15.77:34186) 2023-07-24T05:46:32.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.810+0000 7fb419b4d700 1 -- 172.21.15.77:0/3953973531 learned_addr learned my addr 172.21.15.77:0/3953973531 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:32.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.810+0000 7fb41934c700 1 --2- 172.21.15.77:0/3953973531 >> v2:172.21.15.77:3300/0 conn(0x7fb40c03a7d0 0x7fb40c04f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:32.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.810+0000 7ff9a55ca700 1 Processor -- start 2023-07-24T05:46:32.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.810+0000 7f11f9ed8700 1 Processor -- start 2023-07-24T05:46:32.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.810+0000 7f1a067fc700 1 --2- 172.21.15.77:0/2000599968 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f19f40663c0 0x7f19f4068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.810+0000 7f1a067fc700 1 -- 172.21.15.77:0/2000599968 <== mon.2 v2:172.21.15.103:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1a00021070 con 0x7f1a10160d20 2023-07-24T05:46:32.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.810+0000 7ff9a55ca700 1 -- start start 2023-07-24T05:46:32.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.810+0000 7f30d89ed700 1 --2- 172.21.15.77:0/3856734667 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f30c00662f0 0x7f30c00687b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f30cc005cb0 tx=0x7f30cc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:32.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.810+0000 7f30d17fa700 1 -- 172.21.15.77:0/3856734667 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f30c8051a40 con 0x7f30d40b0330 2023-07-24T05:46:32.848 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.810+0000 7fb419b4d700 1 -- 172.21.15.77:0/3953973531 >> v2:172.21.15.77:3300/0 conn(0x7fb40c03a7d0 msgr2=0x7fb40c04f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:32.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.810+0000 7fb419b4d700 1 --2- 172.21.15.77:0/3953973531 >> v2:172.21.15.77:3300/0 conn(0x7fb40c03a7d0 0x7fb40c04f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:32.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.810+0000 7fb419b4d700 1 -- 172.21.15.77:0/3953973531 >> v1:172.21.15.77:6789/0 conn(0x7fb40c04fec0 legacy=0x7fb40c0e6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:32.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.810+0000 7fb419b4d700 1 -- 172.21.15.77:0/3953973531 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb40c005f80 con 0x7fb40c0e32c0 2023-07-24T05:46:32.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.810+0000 7fb419b4d700 1 --2- 172.21.15.77:0/3953973531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb40c0e32c0 0x7fb40c053990 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb40c00c320 tx=0x7fb410009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfaf831458d2c6f3 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:32.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.810+0000 7fb418b4b700 1 -- 172.21.15.77:0/3953973531 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41000b8a0 con 0x7fb40c0e32c0 2023-07-24T05:46:32.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.810+0000 7f996ddf9700 1 -- start start 2023-07-24T05:46:32.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.810+0000 7f996ddf9700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99680b40e0 0x7f99681fed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.854 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.810+0000 7f1a15b0c700 1 --2- 172.21.15.77:0/2000599968 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f19f40663c0 0x7f19f4068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:32.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.810+0000 7fb418b4b700 1 -- 172.21.15.77:0/3953973531 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb41000ba00 con 0x7fb40c0e32c0 2023-07-24T05:46:32.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.810+0000 7fb418b4b700 1 -- 172.21.15.77:0/3953973531 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41000bd90 con 0x7fb40c0e32c0 2023-07-24T05:46:32.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7ff9a55ca700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9a006b390 0x7ff9a01515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.810+0000 7f99677fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99680b40e0 0x7f99681fed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:32.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.810+0000 7f996ddf9700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99680d25f0 0x7f9968158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7f996ddf9700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f996815c960 0x7f9968158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7f99677fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99680b40e0 0x7f99681fed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59036/0 (socket says 172.21.15.77:59036) 2023-07-24T05:46:32.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7f996ddf9700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f996815dac0 con 0x7f99680b40e0 2023-07-24T05:46:32.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7f996ddf9700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99680c83d0 con 0x7f99680d25f0 2023-07-24T05:46:32.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7f996ddf9700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99680c86b0 con 0x7f996815c960 2023-07-24T05:46:32.857 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7ff9a55ca700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff9a00b0740 0x7ff9a014fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7f99677fe700 1 -- 172.21.15.77:0/2633799025 learned_addr learned my addr 172.21.15.77:0/2633799025 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:32.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7ff9a55ca700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9a01642d0 0x7ff9a01421d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7f995effd700 1 --2- 172.21.15.77:0/2633799025 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99680d25f0 0x7f9968158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:32.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7ff9a55ca700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a0151ae0 con 0x7ff9a01642d0 2023-07-24T05:46:32.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7f9967fff700 1 --2- 172.21.15.77:0/2633799025 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f996815c960 0x7f9968158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:32.859 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7ff9a55ca700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a0150120 con 0x7ff9a006b390 2023-07-24T05:46:32.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7f99677fe700 1 -- 172.21.15.77:0/2633799025 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f996815c960 msgr2=0x7f9968158140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:32.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7f99677fe700 1 --2- 172.21.15.77:0/2633799025 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f996815c960 0x7f9968158140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:32.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7f99677fe700 1 -- 172.21.15.77:0/2633799025 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99680d25f0 msgr2=0x7f9968158e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:32.860 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7f99677fe700 1 --2- 172.21.15.77:0/2633799025 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99680d25f0 0x7f9968158e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:32.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7ff99f7fe700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff9a00b0740 0x7ff9a014fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:32.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7ff9a55ca700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a0142710 con 0x7ff9a00b0740 2023-07-24T05:46:32.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7ff99f7fe700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff9a00b0740 0x7ff9a014fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.77:54140/0 (socket says 172.21.15.77:54140) 2023-07-24T05:46:32.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7ff99f7fe700 1 -- 172.21.15.77:0/440466363 learned_addr learned my addr 172.21.15.77:0/440466363 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:32.861 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7f99677fe700 1 -- 172.21.15.77:0/2633799025 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9958009b30 con 0x7f99680b40e0 2023-07-24T05:46:32.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7fb41bdb1700 1 -- 172.21.15.77:0/3953973531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb40c0e32c0 msgr2=0x7fb40c053990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:32.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7fb41bdb1700 1 --2- 172.21.15.77:0/3953973531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb40c0e32c0 0x7fb40c053990 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb40c00c320 tx=0x7fb410009bf0 comp rx=0 tx=0).stop 2023-07-24T05:46:32.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7f995effd700 1 --2- 172.21.15.77:0/2633799025 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99680d25f0 0x7f9968158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:46:32.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7ff9a4dc9700 1 --2- 172.21.15.77:0/440466363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9a01642d0 0x7ff9a01421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:32.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7ff99ffff700 1 --2- 172.21.15.77:0/440466363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9a006b390 0x7ff9a01515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:32.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7fb41bdb1700 1 -- 172.21.15.77:0/3953973531 shutdown_connections 2023-07-24T05:46:32.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7fb41bdb1700 1 --2- 172.21.15.77:0/3953973531 >> v2:172.21.15.77:3300/0 conn(0x7fb40c03a7d0 0x7fb40c04f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:32.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7fb41bdb1700 1 --2- 172.21.15.77:0/3953973531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb40c0e32c0 0x7fb40c053990 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:32.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7f1a15b0c700 1 --2- 172.21.15.77:0/2000599968 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f19f40663c0 0x7f19f4068880 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1a10098b10 tx=0x7f1a0800b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:32.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7fb41bdb1700 1 -- 172.21.15.77:0/3953973531 >> 172.21.15.77:0/3953973531 conn(0x7fb40c054bb0 msgr2=0x7fb40c054f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:32.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7f11f9ed8700 1 -- start start 2023-07-24T05:46:32.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7ff99f7fe700 1 -- 172.21.15.77:0/440466363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9a006b390 msgr2=0x7ff9a01515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:32.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7ff99f7fe700 1 --2- 172.21.15.77:0/440466363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9a006b390 0x7ff9a01515a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:32.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7ff99f7fe700 1 -- 172.21.15.77:0/440466363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9a01642d0 msgr2=0x7ff9a01421d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:32.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7ff99f7fe700 1 --2- 172.21.15.77:0/440466363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9a01642d0 0x7ff9a01421d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:32.865 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7ff99f7fe700 1 -- 172.21.15.77:0/440466363 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9900094b0 con 0x7ff9a00b0740 2023-07-24T05:46:32.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7ff9a4dc9700 1 --2- 172.21.15.77:0/440466363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9a01642d0 0x7ff9a01421d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:46:32.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7f1a067fc700 1 -- 172.21.15.77:0/2000599968 <== mon.2 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1a000528e0 con 0x7f1a10160d20 2023-07-24T05:46:32.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7f6c42ffd700 1 -- 172.21.15.77:0/1162974219 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4800bea0 con 0x7f6c5015ca00 2023-07-24T05:46:32.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7f6c42ffd700 1 -- 172.21.15.77:0/1162974219 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c48011850 con 0x7f6c5015ca00 2023-07-24T05:46:32.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7f6c42ffd700 1 -- 172.21.15.77:0/1162974219 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c48011c00 con 0x7f6c5015ca00 2023-07-24T05:46:32.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7f6c58800700 1 -- 172.21.15.77:0/1162974219 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c5009daa0 con 0x7f6c5015ca00 2023-07-24T05:46:32.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7f6c58800700 1 -- 172.21.15.77:0/1162974219 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c50160560 con 0x7f6c5015ca00 2023-07-24T05:46:32.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7f6c58800700 1 -- 172.21.15.77:0/1162974219 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c5009dec0 con 0x7f6c5015ca00 2023-07-24T05:46:32.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7ff99f7fe700 1 --2- 172.21.15.77:0/440466363 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff9a00b0740 0x7ff9a014fbe0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff99400b4a0 tx=0x7ff99400b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:32.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7ff99cff9700 1 -- 172.21.15.77:0/440466363 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff994011830 con 0x7ff9a00b0740 2023-07-24T05:46:32.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7ff99cff9700 1 -- 172.21.15.77:0/440466363 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9940119b0 con 0x7ff9a00b0740 2023-07-24T05:46:32.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7ff99cff9700 1 -- 172.21.15.77:0/440466363 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff994011d60 con 0x7ff9a00b0740 2023-07-24T05:46:32.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7f99677fe700 1 --2- 172.21.15.77:0/2633799025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99680b40e0 0x7f99681fed10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f99680b5180 tx=0x7f9958004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:32.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7f9964ff9700 1 -- 172.21.15.77:0/2633799025 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9958004440 con 0x7f99680b40e0 2023-07-24T05:46:32.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7f9964ff9700 1 -- 172.21.15.77:0/2633799025 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99580045a0 con 0x7f99680b40e0 2023-07-24T05:46:32.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7f9964ff9700 1 -- 172.21.15.77:0/2633799025 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9958004930 con 0x7f99680b40e0 2023-07-24T05:46:32.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7fb41bdb1700 1 -- 172.21.15.77:0/3953973531 shutdown_connections 2023-07-24T05:46:32.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7ff9a55ca700 1 -- 172.21.15.77:0/440466363 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a0151d30 con 0x7ff9a00b0740 2023-07-24T05:46:32.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7ff9a55ca700 1 -- 172.21.15.77:0/440466363 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a014b950 con 0x7ff9a00b0740 2023-07-24T05:46:32.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.818+0000 7ff9a55ca700 1 -- 172.21.15.77:0/440466363 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff980005310 con 0x7ff9a00b0740 2023-07-24T05:46:32.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.818+0000 7f11f9ed8700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11f40b1a10 0x7f11f40b20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.814+0000 7fb41bdb1700 1 -- 172.21.15.77:0/3953973531 wait complete. 2023-07-24T05:46:32.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.818+0000 7fb41bdb1700 1 Processor -- start 2023-07-24T05:46:32.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.818+0000 7f11f9ed8700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11f40d2480 0x7f11f414db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.818+0000 7fb41bdb1700 1 -- start start 2023-07-24T05:46:32.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.818+0000 7f11f8ed6700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11f40b1a10 0x7f11f40b20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:32.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.818+0000 7f11f8ed6700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11f40b1a10 0x7f11f40b20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:34218/0 (socket says 172.21.15.77:34218) 2023-07-24T05:46:32.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.818+0000 7f11f8ed6700 1 -- 172.21.15.77:0/3617068913 learned_addr learned my addr 172.21.15.77:0/3617068913 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:32.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.818+0000 7f11f3fff700 1 --2- 172.21.15.77:0/3617068913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11f40d2480 0x7f11f414db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:32.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.818+0000 7f996ddf9700 1 -- 172.21.15.77:0/2633799025 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f996815d750 con 0x7f99680b40e0 2023-07-24T05:46:32.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.818+0000 7f11f9ed8700 1 --2- 172.21.15.77:0/3617068913 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f11f41627c0 0x7f11f4162c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.818+0000 7f11f9ed8700 1 -- 172.21.15.77:0/3617068913 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f40b2600 con 0x7f11f40d2480 2023-07-24T05:46:32.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.818+0000 7f11f9ed8700 1 -- 172.21.15.77:0/3617068913 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f4163190 con 0x7f11f40b1a10 2023-07-24T05:46:32.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.818+0000 7f11f9ed8700 1 -- 172.21.15.77:0/3617068913 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11f40c78d0 con 0x7f11f41627c0 2023-07-24T05:46:32.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.818+0000 7f11f96d7700 1 --2- 172.21.15.77:0/3617068913 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f11f41627c0 0x7f11f4162c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:32.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.818+0000 7fb41bdb1700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb40c03a7d0 0x7fb40c185910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.818+0000 7fb41bdb1700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb40c04fec0 0x7fb40c188770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.818+0000 7fb41bdb1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb40c0e32c0 0x7fb40c168530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.818+0000 7fb419b4d700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb40c03a7d0 0x7fb40c185910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:32.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.818+0000 7f996ddf9700 1 -- 172.21.15.77:0/2633799025 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99681589f0 con 0x7f99680b40e0 2023-07-24T05:46:32.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.818+0000 7fb419b4d700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb40c03a7d0 0x7fb40c185910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:34230/0 (socket says 172.21.15.77:34230) 2023-07-24T05:46:32.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.818+0000 7f6c42ffd700 1 -- 172.21.15.77:0/1162974219 <== mon.2 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6c4801a400 con 0x7f6c5015ca00 2023-07-24T05:46:32.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.822+0000 7f6c42ffd700 1 --2- 172.21.15.77:0/1162974219 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6c340663c0 0x7f6c34068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.822+0000 7fb41934c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb40c04fec0 0x7fb40c188770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:32.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.822+0000 7fb41934c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb40c04fec0 0x7fb40c188770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.77:54154/0 (socket says 172.21.15.77:54154) 2023-07-24T05:46:32.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.822+0000 7f11f8ed6700 1 -- 172.21.15.77:0/3617068913 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f11f41627c0 msgr2=0x7f11f4162c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:32.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.822+0000 7f11f8ed6700 1 --2- 172.21.15.77:0/3617068913 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f11f41627c0 0x7f11f4162c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:32.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.822+0000 7f11f8ed6700 1 -- 172.21.15.77:0/3617068913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11f40d2480 msgr2=0x7f11f414db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:32.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.822+0000 7f11f8ed6700 1 --2- 172.21.15.77:0/3617068913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11f40d2480 0x7f11f414db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:32.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.822+0000 7f11f8ed6700 1 -- 172.21.15.77:0/3617068913 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e00094b0 con 0x7f11f40b1a10 2023-07-24T05:46:32.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.822+0000 7f6c42ffd700 1 -- 172.21.15.77:0/1162974219 <== mon.2 v2:172.21.15.103:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6c480842f0 con 0x7f6c5015ca00 2023-07-24T05:46:32.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.822+0000 7f11f96d7700 1 --2- 172.21.15.77:0/3617068913 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f11f41627c0 0x7f11f4162c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:46:32.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.822+0000 7f6c5659c700 1 --2- 172.21.15.77:0/1162974219 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6c340663c0 0x7f6c34068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:32.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.822+0000 7f6c42ffd700 1 -- 172.21.15.77:0/1162974219 <== mon.2 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6c480514f0 con 0x7f6c5015ca00 2023-07-24T05:46:32.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.822+0000 7f6c5659c700 1 --2- 172.21.15.77:0/1162974219 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6c340663c0 0x7f6c34068880 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c001380 tx=0x7f6c4c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:32.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.826+0000 7ff99cff9700 1 -- 172.21.15.77:0/440466363 <== mon.2 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff99401a400 con 0x7ff9a00b0740 2023-07-24T05:46:32.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.826+0000 7ff99cff9700 1 --2- 172.21.15.77:0/440466363 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff98c0663c0 0x7ff98c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.826+0000 7ff99cff9700 1 -- 172.21.15.77:0/440466363 <== mon.2 v2:172.21.15.103:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff994084640 con 0x7ff9a00b0740 2023-07-24T05:46:32.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.830+0000 7ff99ffff700 1 --2- 172.21.15.77:0/440466363 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff98c0663c0 0x7ff98c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:32.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.822+0000 7f996ddf9700 1 -- 172.21.15.77:0/2633799025 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f996815d8e0 con 0x7f99680b40e0 2023-07-24T05:46:32.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.822+0000 7f9964ff9700 1 -- 172.21.15.77:0/2633799025 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9958012430 con 0x7f99680b40e0 2023-07-24T05:46:32.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.822+0000 7f9964ff9700 1 --2- 172.21.15.77:0/2633799025 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f9948066340 0x7f9948068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.826+0000 7f995effd700 1 --2- 172.21.15.77:0/2633799025 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f9948066340 0x7f9948068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:32.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.830+0000 7f995effd700 1 --2- 172.21.15.77:0/2633799025 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f9948066340 0x7f9948068800 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f99681ff250 tx=0x7f9950008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:32.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.822+0000 7f11f8ed6700 1 --2- 172.21.15.77:0/3617068913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11f40b1a10 0x7f11f40b20c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f11e800c700 tx=0x7f11e800ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:32.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.826+0000 7f11f17fa700 1 -- 172.21.15.77:0/3617068913 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e8005d90 con 0x7f11f40b1a10 2023-07-24T05:46:32.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.826+0000 7f11f17fa700 1 -- 172.21.15.77:0/3617068913 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e80070d0 con 0x7f11f40b1a10 2023-07-24T05:46:32.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.826+0000 7f11f9ed8700 1 -- 172.21.15.77:0/3617068913 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11f40c70a0 con 0x7f11f40b1a10 2023-07-24T05:46:32.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.826+0000 7f11f17fa700 1 -- 172.21.15.77:0/3617068913 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e8007440 con 0x7f11f40b1a10 2023-07-24T05:46:32.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.826+0000 7f11f9ed8700 1 -- 172.21.15.77:0/3617068913 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11f40c7e50 con 0x7f11f40b1a10 2023-07-24T05:46:32.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.830+0000 7f11f9ed8700 1 -- 172.21.15.77:0/3617068913 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11f40c8040 con 0x7f11f40b1a10 2023-07-24T05:46:32.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.822+0000 7fb41a34e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb40c0e32c0 0x7fb40c168530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:32.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.822+0000 7fb41a34e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb40c0e32c0 0x7fb40c168530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59050/0 (socket says 172.21.15.77:59050) 2023-07-24T05:46:32.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.822+0000 7fb41bdb1700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb40c188cb0 con 0x7fb40c0e32c0 2023-07-24T05:46:32.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.822+0000 7fb41bdb1700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb40c0d3830 con 0x7fb40c03a7d0 2023-07-24T05:46:32.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.822+0000 7fb41bdb1700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb40c0d3b10 con 0x7fb40c04fec0 2023-07-24T05:46:32.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.822+0000 7fb419b4d700 1 -- 172.21.15.77:0/3334292528 learned_addr learned my addr 172.21.15.77:0/3334292528 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:32.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.822+0000 7fb419b4d700 1 -- 172.21.15.77:0/3334292528 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb40c04fec0 msgr2=0x7fb40c188770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:32.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.822+0000 7fb419b4d700 1 --2- 172.21.15.77:0/3334292528 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb40c04fec0 0x7fb40c188770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:32.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.822+0000 7fb419b4d700 1 -- 172.21.15.77:0/3334292528 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb40c0e32c0 msgr2=0x7fb40c168530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:32.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.822+0000 7fb419b4d700 1 --2- 172.21.15.77:0/3334292528 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb40c0e32c0 0x7fb40c168530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:32.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.822+0000 7fb419b4d700 1 -- 172.21.15.77:0/3334292528 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb410009570 con 0x7fb40c03a7d0 2023-07-24T05:46:32.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.822+0000 7fb419b4d700 1 --2- 172.21.15.77:0/3334292528 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb40c03a7d0 0x7fb40c185910 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb410000c00 tx=0x7fb410004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:32.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.822+0000 7fb40a7fc700 1 -- 172.21.15.77:0/3334292528 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4100038c0 con 0x7fb40c03a7d0 2023-07-24T05:46:32.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.822+0000 7fb40a7fc700 1 -- 172.21.15.77:0/3334292528 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb41001f070 con 0x7fb40c03a7d0 2023-07-24T05:46:32.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.822+0000 7fb40a7fc700 1 -- 172.21.15.77:0/3334292528 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb410003c80 con 0x7fb40c03a7d0 2023-07-24T05:46:32.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.822+0000 7fb41bdb1700 1 -- 172.21.15.77:0/3334292528 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb40c0d3df0 con 0x7fb40c03a7d0 2023-07-24T05:46:32.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.822+0000 7fb41bdb1700 1 -- 172.21.15.77:0/3334292528 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb40c0d43b0 con 0x7fb40c03a7d0 2023-07-24T05:46:32.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.826+0000 7fb41bdb1700 1 -- 172.21.15.77:0/3334292528 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb40c0053f0 con 0x7fb40c03a7d0 2023-07-24T05:46:32.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.826+0000 7fb40a7fc700 1 -- 172.21.15.77:0/3334292528 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb41001a430 con 0x7fb40c03a7d0 2023-07-24T05:46:32.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.830+0000 7fb40a7fc700 1 --2- 172.21.15.77:0/3334292528 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb3f80662f0 0x7fb3f80687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.830+0000 7fb40a7fc700 1 -- 172.21.15.77:0/3334292528 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb410021070 con 0x7fb40c03a7d0 2023-07-24T05:46:32.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.830+0000 7f9964ff9700 1 -- 172.21.15.77:0/2633799025 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9958059a40 con 0x7f99680b40e0 2023-07-24T05:46:32.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.830+0000 7fb41934c700 1 --2- 172.21.15.77:0/3334292528 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb3f80662f0 0x7fb3f80687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:32.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.830+0000 7ff99cff9700 1 -- 172.21.15.77:0/440466363 <== mon.2 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff994051860 con 0x7ff9a00b0740 2023-07-24T05:46:32.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.830+0000 7fb41934c700 1 --2- 172.21.15.77:0/3334292528 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb3f80662f0 0x7fb3f80687b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb40c048a30 tx=0x7fb404008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:32.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.830+0000 7ff99ffff700 1 --2- 172.21.15.77:0/440466363 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff98c0663c0 0x7ff98c068880 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff9900090b0 tx=0x7ff99001c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:32.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.834+0000 7f9964ff9700 1 -- 172.21.15.77:0/2633799025 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9958055850 con 0x7f99680b40e0 2023-07-24T05:46:32.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.834+0000 7fb40a7fc700 1 -- 172.21.15.77:0/3334292528 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb410052be0 con 0x7fb40c03a7d0 2023-07-24T05:46:32.886 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.838+0000 7f11f17fa700 1 -- 172.21.15.77:0/3617068913 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f11e80075a0 con 0x7f11f40b1a10 2023-07-24T05:46:32.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.838+0000 7f11f17fa700 1 --2- 172.21.15.77:0/3617068913 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f11d80663c0 0x7f11d8068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:32.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.838+0000 7f11f17fa700 1 -- 172.21.15.77:0/3617068913 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f11e8083890 con 0x7f11f40b1a10 2023-07-24T05:46:32.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.838+0000 7f11f3fff700 1 --2- 172.21.15.77:0/3617068913 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f11d80663c0 0x7f11d8068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:32.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.842+0000 7f11f17fa700 1 -- 172.21.15.77:0/3617068913 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f11e8050ab0 con 0x7f11f40b1a10 2023-07-24T05:46:32.887 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:32.842+0000 7f11f3fff700 1 --2- 172.21.15.77:0/3617068913 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f11d80663c0 0x7f11d8068880 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f11e00090b0 tx=0x7f11e001c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:33.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.086+0000 7f38aab1a700 1 -- 172.21.15.77:0/996747109 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f38a4072490 con 0x7f38a4158b30 2023-07-24T05:46:33.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.086+0000 7f38a17fa700 1 -- 172.21.15.77:0/996747109 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f389c01a020 con 0x7f38a4158b30 2023-07-24T05:46:33.091 INFO:teuthology.orchestra.run.smithi077.stdout:60129542152 2023-07-24T05:46:33.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.098+0000 7f388affd700 1 -- 172.21.15.77:0/996747109 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f38900663f0 msgr2=0x7f38900688b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:33.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.098+0000 7f388affd700 1 --2- 172.21.15.77:0/996747109 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f38900663f0 0x7f38900688b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f38a40adc30 tx=0x7f3898007af0 comp rx=0 tx=0).stop 2023-07-24T05:46:33.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.098+0000 7f388affd700 1 -- 172.21.15.77:0/996747109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38a4158b30 msgr2=0x7f38a41e5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:33.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.098+0000 7f388affd700 1 --2- 172.21.15.77:0/996747109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38a4158b30 0x7f38a41e5470 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f389c007e10 tx=0x7f389c00d3b0 comp rx=0 tx=0).stop 2023-07-24T05:46:33.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.098+0000 7f388affd700 1 -- 172.21.15.77:0/996747109 shutdown_connections 2023-07-24T05:46:33.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.098+0000 7f388affd700 1 --2- 172.21.15.77:0/996747109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38a4158b30 0x7f38a41e5470 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:33.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.098+0000 7f388affd700 1 --2- 172.21.15.77:0/996747109 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f38900663f0 0x7f38900688b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:33.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.098+0000 7f388affd700 1 --2- 172.21.15.77:0/996747109 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f38a40b0330 0x7f38a40cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:33.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.098+0000 7f388affd700 1 --2- 172.21.15.77:0/996747109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38a40aae70 0x7f38a4202bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:33.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.098+0000 7f388affd700 1 -- 172.21.15.77:0/996747109 >> 172.21.15.77:0/996747109 conn(0x7f38a40cacc0 msgr2=0x7f38a406c040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:33.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.098+0000 7f388affd700 1 -- 172.21.15.77:0/996747109 shutdown_connections 2023-07-24T05:46:33.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.098+0000 7f388affd700 1 -- 172.21.15.77:0/996747109 wait complete. 2023-07-24T05:46:33.126 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.0 2023-07-24T05:46:33.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.130+0000 7f30dac51700 1 -- 172.21.15.77:0/3856734667 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f30b40055c0 con 0x7f30d40b0330 2023-07-24T05:46:33.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.134+0000 7f30d17fa700 1 -- 172.21.15.77:0/3856734667 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f30c8055060 con 0x7f30d40b0330 2023-07-24T05:46:33.137 INFO:teuthology.orchestra.run.smithi077.stdout:60129542153 2023-07-24T05:46:33.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.134+0000 7f6c58800700 1 -- 172.21.15.77:0/1162974219 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f6c5009dec0 con 0x7f6c5015ca00 2023-07-24T05:46:33.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.134+0000 7f1a17d70700 1 -- 172.21.15.77:0/2000599968 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f19f8005890 con 0x7f1a10160d20 2023-07-24T05:46:33.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.134+0000 7f6c42ffd700 1 -- 172.21.15.77:0/1162974219 <== mon.2 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6c5009dec0 con 0x7f6c5015ca00 2023-07-24T05:46:33.140 INFO:teuthology.orchestra.run.smithi077.stdout:60129542153 2023-07-24T05:46:33.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.134+0000 7f1a067fc700 1 -- 172.21.15.77:0/2000599968 <== mon.2 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1a00055f00 con 0x7f1a10160d20 2023-07-24T05:46:33.141 INFO:teuthology.orchestra.run.smithi077.stdout:60129542153 2023-07-24T05:46:33.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.138+0000 7f30dac51700 1 -- 172.21.15.77:0/3856734667 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f30c00662f0 msgr2=0x7f30c00687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:33.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.138+0000 7f30dac51700 1 --2- 172.21.15.77:0/3856734667 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f30c00662f0 0x7f30c00687b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f30cc005cb0 tx=0x7f30cc009040 comp rx=0 tx=0).stop 2023-07-24T05:46:33.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.138+0000 7f30dac51700 1 -- 172.21.15.77:0/3856734667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30d40b0330 msgr2=0x7f30d4070b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:33.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.138+0000 7f30dac51700 1 --2- 172.21.15.77:0/3856734667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30d40b0330 0x7f30d4070b30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f30c800aa90 tx=0x7f30c800ada0 comp rx=0 tx=0).stop 2023-07-24T05:46:33.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.138+0000 7f6c58800700 1 -- 172.21.15.77:0/1162974219 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6c340663c0 msgr2=0x7f6c34068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:33.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.138+0000 7f6c58800700 1 --2- 172.21.15.77:0/1162974219 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6c340663c0 0x7f6c34068880 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c001380 tx=0x7f6c4c009040 comp rx=0 tx=0).stop 2023-07-24T05:46:33.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.138+0000 7f6c58800700 1 -- 172.21.15.77:0/1162974219 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6c5015ca00 msgr2=0x7f6c5015f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:33.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.138+0000 7f6c58800700 1 --2- 172.21.15.77:0/1162974219 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6c5015ca00 0x7f6c5015f340 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6c4800b3e0 tx=0x7f6c4800b6f0 comp rx=0 tx=0).stop 2023-07-24T05:46:33.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.138+0000 7f30dac51700 1 -- 172.21.15.77:0/3856734667 shutdown_connections 2023-07-24T05:46:33.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.138+0000 7f30dac51700 1 --2- 172.21.15.77:0/3856734667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30d4158b30 0x7f30d4071070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:33.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.138+0000 7f30dac51700 1 --2- 172.21.15.77:0/3856734667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30d40b0330 0x7f30d4070b30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:33.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.138+0000 7f30dac51700 1 --2- 172.21.15.77:0/3856734667 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f30c00662f0 0x7f30c00687b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:33.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.138+0000 7f30dac51700 1 --2- 172.21.15.77:0/3856734667 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f30d40aae70 0x7f30d4157db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:33.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.138+0000 7f30dac51700 1 -- 172.21.15.77:0/3856734667 >> 172.21.15.77:0/3856734667 conn(0x7f30d40cacc0 msgr2=0x7f30d406cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:33.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.138+0000 7f6c58800700 1 -- 172.21.15.77:0/1162974219 shutdown_connections 2023-07-24T05:46:33.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.138+0000 7f6c58800700 1 --2- 172.21.15.77:0/1162974219 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6c340663c0 0x7f6c34068880 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:33.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.138+0000 7f6c58800700 1 --2- 172.21.15.77:0/1162974219 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6c5015ca00 0x7f6c5015f340 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:33.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.138+0000 7f6c58800700 1 --2- 172.21.15.77:0/1162974219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c500d2200 0x7f6c50160020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:33.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.138+0000 7f6c58800700 1 --2- 172.21.15.77:0/1162974219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c500b4630 0x7f6c50156ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:33.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.138+0000 7f6c58800700 1 -- 172.21.15.77:0/1162974219 >> 172.21.15.77:0/1162974219 conn(0x7f6c500b7610 msgr2=0x7f6c500cf5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:33.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.138+0000 7f1a17d70700 1 -- 172.21.15.77:0/2000599968 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f19f40663c0 msgr2=0x7f19f4068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:33.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.138+0000 7f6c58800700 1 -- 172.21.15.77:0/1162974219 shutdown_connections 2023-07-24T05:46:33.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.138+0000 7f1a17d70700 1 --2- 172.21.15.77:0/2000599968 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f19f40663c0 0x7f19f4068880 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1a10098b10 tx=0x7f1a0800b040 comp rx=0 tx=0).stop 2023-07-24T05:46:33.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.138+0000 7f6c58800700 1 -- 172.21.15.77:0/1162974219 wait complete. 2023-07-24T05:46:33.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.138+0000 7f1a17d70700 1 -- 172.21.15.77:0/2000599968 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1a10160d20 msgr2=0x7f1a10202b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:33.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.138+0000 7f1a17d70700 1 --2- 172.21.15.77:0/2000599968 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1a10160d20 0x7f1a10202b90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1a00016000 tx=0x7f1a00004770 comp rx=0 tx=0).stop 2023-07-24T05:46:33.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.138+0000 7f30dac51700 1 -- 172.21.15.77:0/3856734667 shutdown_connections 2023-07-24T05:46:33.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.138+0000 7f30dac51700 1 -- 172.21.15.77:0/3856734667 wait complete. 2023-07-24T05:46:33.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.138+0000 7f1a17d70700 1 -- 172.21.15.77:0/2000599968 shutdown_connections 2023-07-24T05:46:33.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.138+0000 7f1a17d70700 1 --2- 172.21.15.77:0/2000599968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a10161100 0x7f1a102030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:33.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.138+0000 7f1a17d70700 1 --2- 172.21.15.77:0/2000599968 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f19f40663c0 0x7f19f4068880 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:33.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.138+0000 7f1a17d70700 1 --2- 172.21.15.77:0/2000599968 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1a10160d20 0x7f1a10202b90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:33.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.138+0000 7f1a17d70700 1 --2- 172.21.15.77:0/2000599968 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a100ae0e0 0x7f1a10160020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:33.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.138+0000 7f1a17d70700 1 -- 172.21.15.77:0/2000599968 >> 172.21.15.77:0/2000599968 conn(0x7f1a100cacc0 msgr2=0x7f1a1006ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:33.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.138+0000 7f1a17d70700 1 -- 172.21.15.77:0/2000599968 shutdown_connections 2023-07-24T05:46:33.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.138+0000 7f1a17d70700 1 -- 172.21.15.77:0/2000599968 wait complete. 2023-07-24T05:46:33.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.150+0000 7f996ddf9700 1 -- 172.21.15.77:0/2633799025 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9968072490 con 0x7f99680b40e0 2023-07-24T05:46:33.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.154+0000 7f9964ff9700 1 -- 172.21.15.77:0/2633799025 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f99580553e0 con 0x7f99680b40e0 2023-07-24T05:46:33.157 INFO:teuthology.orchestra.run.smithi077.stdout:60129542152 2023-07-24T05:46:33.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.154+0000 7ff9a55ca700 1 -- 172.21.15.77:0/440466363 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7ff980005890 con 0x7ff9a00b0740 2023-07-24T05:46:33.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.154+0000 7f996ddf9700 1 -- 172.21.15.77:0/2633799025 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f9948066340 msgr2=0x7f9948068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:33.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.154+0000 7f996ddf9700 1 --2- 172.21.15.77:0/2633799025 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f9948066340 0x7f9948068800 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f99681ff250 tx=0x7f9950008040 comp rx=0 tx=0).stop 2023-07-24T05:46:33.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.154+0000 7f996ddf9700 1 -- 172.21.15.77:0/2633799025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99680b40e0 msgr2=0x7f99681fed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:33.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.154+0000 7f996ddf9700 1 --2- 172.21.15.77:0/2633799025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99680b40e0 0x7f99681fed10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f99680b5180 tx=0x7f9958004af0 comp rx=0 tx=0).stop 2023-07-24T05:46:33.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.154+0000 7ff99cff9700 1 -- 172.21.15.77:0/440466363 <== mon.2 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff994054e80 con 0x7ff9a00b0740 2023-07-24T05:46:33.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.154+0000 7f996ddf9700 1 -- 172.21.15.77:0/2633799025 shutdown_connections 2023-07-24T05:46:33.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.154+0000 7f996ddf9700 1 --2- 172.21.15.77:0/2633799025 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f9948066340 0x7f9948068800 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:33.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.154+0000 7f996ddf9700 1 --2- 172.21.15.77:0/2633799025 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f996815c960 0x7f9968158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:33.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.154+0000 7f996ddf9700 1 --2- 172.21.15.77:0/2633799025 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99680d25f0 0x7f9968158e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:33.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.154+0000 7f996ddf9700 1 --2- 172.21.15.77:0/2633799025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99680b40e0 0x7f99681fed10 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:33.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.154+0000 7f996ddf9700 1 -- 172.21.15.77:0/2633799025 >> 172.21.15.77:0/2633799025 conn(0x7f99680b7600 msgr2=0x7f99680b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:33.162 INFO:teuthology.orchestra.run.smithi077.stdout:60129542152 2023-07-24T05:46:33.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.158+0000 7f996ddf9700 1 -- 172.21.15.77:0/2633799025 shutdown_connections 2023-07-24T05:46:33.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.158+0000 7f996ddf9700 1 -- 172.21.15.77:0/2633799025 wait complete. 2023-07-24T05:46:33.164 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.7 2023-07-24T05:46:33.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.158+0000 7ff9a55ca700 1 -- 172.21.15.77:0/440466363 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff98c0663c0 msgr2=0x7ff98c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:33.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.158+0000 7ff9a55ca700 1 --2- 172.21.15.77:0/440466363 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff98c0663c0 0x7ff98c068880 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff9900090b0 tx=0x7ff99001c040 comp rx=0 tx=0).stop 2023-07-24T05:46:33.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.158+0000 7ff9a55ca700 1 -- 172.21.15.77:0/440466363 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff9a00b0740 msgr2=0x7ff9a014fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:33.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.158+0000 7ff9a55ca700 1 --2- 172.21.15.77:0/440466363 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff9a00b0740 0x7ff9a014fbe0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff99400b4a0 tx=0x7ff99400b860 comp rx=0 tx=0).stop 2023-07-24T05:46:33.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.158+0000 7ff9a55ca700 1 -- 172.21.15.77:0/440466363 shutdown_connections 2023-07-24T05:46:33.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.158+0000 7ff9a55ca700 1 --2- 172.21.15.77:0/440466363 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff9a01642d0 0x7ff9a01421d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:33.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.158+0000 7ff9a55ca700 1 --2- 172.21.15.77:0/440466363 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff98c0663c0 0x7ff98c068880 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:33.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.158+0000 7ff9a55ca700 1 --2- 172.21.15.77:0/440466363 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff9a00b0740 0x7ff9a014fbe0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:33.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.158+0000 7ff9a55ca700 1 --2- 172.21.15.77:0/440466363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9a006b390 0x7ff9a01515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:33.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.158+0000 7ff9a55ca700 1 -- 172.21.15.77:0/440466363 >> 172.21.15.77:0/440466363 conn(0x7ff9a00cacc0 msgr2=0x7ff9a00c49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:33.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.158+0000 7ff9a55ca700 1 -- 172.21.15.77:0/440466363 shutdown_connections 2023-07-24T05:46:33.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.158+0000 7ff9a55ca700 1 -- 172.21.15.77:0/440466363 wait complete. 2023-07-24T05:46:33.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.162+0000 7fb41bdb1700 1 -- 172.21.15.77:0/3334292528 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb40c052850 con 0x7fb40c03a7d0 2023-07-24T05:46:33.167 INFO:teuthology.orchestra.run.smithi077.stdout:60129542153 2023-07-24T05:46:33.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.162+0000 7fb40a7fc700 1 -- 172.21.15.77:0/3334292528 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb410056200 con 0x7fb40c03a7d0 2023-07-24T05:46:33.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.162+0000 7fb41bdb1700 1 -- 172.21.15.77:0/3334292528 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb3f80662f0 msgr2=0x7fb3f80687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:33.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.162+0000 7fb41bdb1700 1 --2- 172.21.15.77:0/3334292528 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb3f80662f0 0x7fb3f80687b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb40c048a30 tx=0x7fb404008040 comp rx=0 tx=0).stop 2023-07-24T05:46:33.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.162+0000 7fb41bdb1700 1 -- 172.21.15.77:0/3334292528 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb40c03a7d0 msgr2=0x7fb40c185910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:33.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.162+0000 7fb41bdb1700 1 --2- 172.21.15.77:0/3334292528 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb40c03a7d0 0x7fb40c185910 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb410000c00 tx=0x7fb410004770 comp rx=0 tx=0).stop 2023-07-24T05:46:33.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.166+0000 7fb41bdb1700 1 -- 172.21.15.77:0/3334292528 shutdown_connections 2023-07-24T05:46:33.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.166+0000 7fb41bdb1700 1 --2- 172.21.15.77:0/3334292528 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb40c0e32c0 0x7fb40c168530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:33.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.166+0000 7fb41bdb1700 1 --2- 172.21.15.77:0/3334292528 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb3f80662f0 0x7fb3f80687b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:33.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.166+0000 7fb41bdb1700 1 --2- 172.21.15.77:0/3334292528 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb40c04fec0 0x7fb40c188770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:33.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.166+0000 7fb41bdb1700 1 --2- 172.21.15.77:0/3334292528 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb40c03a7d0 0x7fb40c185910 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:33.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.166+0000 7fb41bdb1700 1 -- 172.21.15.77:0/3334292528 >> 172.21.15.77:0/3334292528 conn(0x7fb40c054bb0 msgr2=0x7fb40c004a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:33.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.166+0000 7fb41bdb1700 1 -- 172.21.15.77:0/3334292528 shutdown_connections 2023-07-24T05:46:33.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.166+0000 7fb41bdb1700 1 -- 172.21.15.77:0/3334292528 wait complete. 2023-07-24T05:46:33.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.166+0000 7f11f9ed8700 1 -- 172.21.15.77:0/3617068913 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f11f4072490 con 0x7f11f40b1a10 2023-07-24T05:46:33.172 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.3 2023-07-24T05:46:33.173 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.5 2023-07-24T05:46:33.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.166+0000 7f11f17fa700 1 -- 172.21.15.77:0/3617068913 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f11e80540d0 con 0x7f11f40b1a10 2023-07-24T05:46:33.174 INFO:teuthology.orchestra.run.smithi077.stdout:60129542153 2023-07-24T05:46:33.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.166+0000 7f11f9ed8700 1 -- 172.21.15.77:0/3617068913 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f11d80663c0 msgr2=0x7f11d8068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:33.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.166+0000 7f11f9ed8700 1 --2- 172.21.15.77:0/3617068913 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f11d80663c0 0x7f11d8068880 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f11e00090b0 tx=0x7f11e001c040 comp rx=0 tx=0).stop 2023-07-24T05:46:33.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.166+0000 7f11f9ed8700 1 -- 172.21.15.77:0/3617068913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11f40b1a10 msgr2=0x7f11f40b20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:33.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.166+0000 7f11f9ed8700 1 --2- 172.21.15.77:0/3617068913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11f40b1a10 0x7f11f40b20c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f11e800c700 tx=0x7f11e800ca10 comp rx=0 tx=0).stop 2023-07-24T05:46:33.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.170+0000 7f11f9ed8700 1 -- 172.21.15.77:0/3617068913 shutdown_connections 2023-07-24T05:46:33.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.170+0000 7f11f9ed8700 1 --2- 172.21.15.77:0/3617068913 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f11d80663c0 0x7f11d8068880 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:33.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.170+0000 7f11f9ed8700 1 --2- 172.21.15.77:0/3617068913 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f11f41627c0 0x7f11f4162c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:33.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.170+0000 7f11f9ed8700 1 --2- 172.21.15.77:0/3617068913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f11f40d2480 0x7f11f414db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:33.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.170+0000 7f11f9ed8700 1 --2- 172.21.15.77:0/3617068913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11f40b1a10 0x7f11f40b20c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:33.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.170+0000 7f11f9ed8700 1 -- 172.21.15.77:0/3617068913 >> 172.21.15.77:0/3617068913 conn(0x7f11f40b7600 msgr2=0x7f11f40ceee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:33.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.170+0000 7f11f9ed8700 1 -- 172.21.15.77:0/3617068913 shutdown_connections 2023-07-24T05:46:33.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:33.170+0000 7f11f9ed8700 1 -- 172.21.15.77:0/3617068913 wait complete. 2023-07-24T05:46:33.182 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.2 2023-07-24T05:46:33.186 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.4 2023-07-24T05:46:33.189 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.1 2023-07-24T05:46:33.193 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.6 2023-07-24T05:46:34.128 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-24T05:46:34.165 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-24T05:46:34.173 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-24T05:46:34.174 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-24T05:46:34.182 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-24T05:46:34.186 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-24T05:46:34.190 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-24T05:46:34.194 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-24T05:46:34.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.318+0000 7f4e764fc700 1 Processor -- start 2023-07-24T05:46:34.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.318+0000 7f4e764fc700 1 -- start start 2023-07-24T05:46:34.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.322+0000 7f4e764fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4e70158b30 0x7f4e700b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.322+0000 7f4e764fc700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4e700aae70 0x7f4e700afc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.322+0000 7f4e764fc700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e700b20b0 con 0x7f4e700b0160 2023-07-24T05:46:34.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.322+0000 7f4e764fc700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e70158f10 con 0x7f4e700aae70 2023-07-24T05:46:34.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.322+0000 7f4e764fc700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e700b05d0 con 0x7f4e70158b30 2023-07-24T05:46:34.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.322+0000 7f4e6f7fe700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4e700aae70 0x7f4e700afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.322+0000 7f4e6f7fe700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4e700aae70 0x7f4e700afc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42360/0 (socket says 172.21.15.77:42360) 2023-07-24T05:46:34.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.322+0000 7f4e6f7fe700 1 -- 172.21.15.77:0/1028576214 learned_addr learned my addr 172.21.15.77:0/1028576214 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:34.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.322+0000 7f4e6f7fe700 1 -- 172.21.15.77:0/1028576214 >> v2:172.21.15.103:3300/0 conn(0x7f4e70158b30 msgr2=0x7f4e700b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:34.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.322+0000 7f4e6f7fe700 1 --2- 172.21.15.77:0/1028576214 >> v2:172.21.15.103:3300/0 conn(0x7f4e70158b30 0x7f4e700b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.322+0000 7f4e6f7fe700 1 -- 172.21.15.77:0/1028576214 >> v1:172.21.15.103:6789/0 conn(0x7f4e700b0160 legacy=0x7f4e70069fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:34.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.322+0000 7f4e6f7fe700 1 -- 172.21.15.77:0/1028576214 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e700b22e0 con 0x7f4e700aae70 2023-07-24T05:46:34.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.322+0000 7f4e6f7fe700 1 --2- 172.21.15.77:0/1028576214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e700aae70 0x7f4e700afc20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4e700cac90 tx=0x7f4e6800d650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fa5189d81530e52 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:34.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.322+0000 7f4e6effd700 1 -- 172.21.15.77:0/1028576214 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e68010070 con 0x7f4e700aae70 2023-07-24T05:46:34.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.326+0000 7f4e6effd700 1 -- 172.21.15.77:0/1028576214 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e6800dca0 con 0x7f4e700aae70 2023-07-24T05:46:34.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.326+0000 7f4e764fc700 1 -- 172.21.15.77:0/1028576214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e700aae70 msgr2=0x7f4e700afc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.326+0000 7f4e764fc700 1 --2- 172.21.15.77:0/1028576214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e700aae70 0x7f4e700afc20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4e700cac90 tx=0x7f4e6800d650 comp rx=0 tx=0).stop 2023-07-24T05:46:34.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.326+0000 7f4e764fc700 1 -- 172.21.15.77:0/1028576214 shutdown_connections 2023-07-24T05:46:34.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.326+0000 7f4e764fc700 1 --2- 172.21.15.77:0/1028576214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e700aae70 0x7f4e700afc20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.326+0000 7f4e764fc700 1 --2- 172.21.15.77:0/1028576214 >> v2:172.21.15.103:3300/0 conn(0x7f4e70158b30 0x7f4e700b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.326+0000 7f4e764fc700 1 -- 172.21.15.77:0/1028576214 >> 172.21.15.77:0/1028576214 conn(0x7f4e700cacc0 msgr2=0x7f4e700cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:34.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.326+0000 7f4e764fc700 1 -- 172.21.15.77:0/1028576214 shutdown_connections 2023-07-24T05:46:34.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.326+0000 7f4e764fc700 1 -- 172.21.15.77:0/1028576214 wait complete. 2023-07-24T05:46:34.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.330+0000 7f4e764fc700 1 Processor -- start 2023-07-24T05:46:34.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.330+0000 7f4e764fc700 1 -- start start 2023-07-24T05:46:34.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.330+0000 7f4e764fc700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4e700aae70 0x7f4e70201ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.330+0000 7f4e764fc700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e700b0160 0x7f4e700c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.330+0000 7f4e764fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e70158b30 0x7f4e700c9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.334+0000 7f4e764fc700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7006fe80 con 0x7f4e70158b30 2023-07-24T05:46:34.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.334+0000 7f4e6f7fe700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e700b0160 0x7f4e700c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.334+0000 7f4e6f7fe700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e700b0160 0x7f4e700c98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:42000/0 (socket says 172.21.15.77:42000) 2023-07-24T05:46:34.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.334+0000 7f4e6f7fe700 1 -- 172.21.15.77:0/3592688175 learned_addr learned my addr 172.21.15.77:0/3592688175 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:34.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.334+0000 7f4e74a99700 1 --2- 172.21.15.77:0/3592688175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e70158b30 0x7f4e700c9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.334+0000 7f4e6ffff700 1 --2- 172.21.15.77:0/3592688175 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4e700aae70 0x7f4e70201ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.334+0000 7f4e764fc700 1 -- 172.21.15.77:0/3592688175 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e700719a0 con 0x7f4e700b0160 2023-07-24T05:46:34.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.334+0000 7f4e764fc700 1 -- 172.21.15.77:0/3592688175 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7006fae0 con 0x7f4e700aae70 2023-07-24T05:46:34.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.334+0000 7f4e74a99700 1 -- 172.21.15.77:0/3592688175 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4e700aae70 msgr2=0x7f4e70201ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.334+0000 7f4e74a99700 1 --2- 172.21.15.77:0/3592688175 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4e700aae70 0x7f4e70201ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.334+0000 7f4e74a99700 1 -- 172.21.15.77:0/3592688175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e700b0160 msgr2=0x7f4e700c98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.334+0000 7f4e74a99700 1 --2- 172.21.15.77:0/3592688175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e700b0160 0x7f4e700c98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.334+0000 7f4e74a99700 1 -- 172.21.15.77:0/3592688175 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e6800d050 con 0x7f4e70158b30 2023-07-24T05:46:34.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.334+0000 7f4e74a99700 1 --2- 172.21.15.77:0/3592688175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e70158b30 0x7f4e700c9e00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4e6400c390 tx=0x7f4e6400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:34.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.334+0000 7f4e6cff9700 1 -- 172.21.15.77:0/3592688175 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e64011790 con 0x7f4e70158b30 2023-07-24T05:46:34.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.334+0000 7f4e764fc700 1 -- 172.21.15.77:0/3592688175 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e700c29f0 con 0x7f4e70158b30 2023-07-24T05:46:34.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.334+0000 7f4e764fc700 1 -- 172.21.15.77:0/3592688175 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e700c2fb0 con 0x7f4e70158b30 2023-07-24T05:46:34.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.338+0000 7f4e764fc700 1 -- 172.21.15.77:0/3592688175 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e7006ffc0 con 0x7f4e70158b30 2023-07-24T05:46:34.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.346+0000 7f4e6cff9700 1 -- 172.21.15.77:0/3592688175 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e640118f0 con 0x7f4e70158b30 2023-07-24T05:46:34.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.350+0000 7f4e6cff9700 1 -- 172.21.15.77:0/3592688175 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e64011c80 con 0x7f4e70158b30 2023-07-24T05:46:34.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.350+0000 7f4e6cff9700 1 -- 172.21.15.77:0/3592688175 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4e6401c460 con 0x7f4e70158b30 2023-07-24T05:46:34.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.350+0000 7f4e6cff9700 1 --2- 172.21.15.77:0/3592688175 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f4e580665e0 0x7f4e58068aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.350+0000 7f4e6cff9700 1 -- 172.21.15.77:0/3592688175 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4e64083c90 con 0x7f4e70158b30 2023-07-24T05:46:34.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.350+0000 7f4e6cff9700 1 -- 172.21.15.77:0/3592688175 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4e7006ffc0 con 0x7f4e70158b30 2023-07-24T05:46:34.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.350+0000 7f4e6ffff700 1 --2- 172.21.15.77:0/3592688175 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f4e580665e0 0x7f4e58068aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.354+0000 7f4e6ffff700 1 --2- 172.21.15.77:0/3592688175 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f4e580665e0 0x7f4e58068aa0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4e60006fd0 tx=0x7f4e60008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:34.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.374+0000 7f00f79ed700 1 Processor -- start 2023-07-24T05:46:34.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.374+0000 7f00f79ed700 1 -- start start 2023-07-24T05:46:34.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.374+0000 7f00f79ed700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00f006ceb0 0x7f00f00c1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.374+0000 7f00f79ed700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00f00c1db0 con 0x7f00f00c13e0 2023-07-24T05:46:34.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.374+0000 7f00f79ed700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00f0161510 con 0x7f00f0161130 2023-07-24T05:46:34.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.374+0000 7f00f79ed700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f00cf240 con 0x7f00f006ceb0 2023-07-24T05:46:34.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.378+0000 7f00f4f88700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f00f00c13e0 0x7f00f00cd0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:53628/0 (socket says 172.21.15.77:53628) 2023-07-24T05:46:34.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.378+0000 7f00f4f88700 1 -- 172.21.15.77:0/674932144 learned_addr learned my addr 172.21.15.77:0/674932144 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:34.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.378+0000 7f00f5f8a700 1 --2- 172.21.15.77:0/674932144 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00f006ceb0 0x7f00f00c1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.378+0000 7f08e247d700 1 Processor -- start 2023-07-24T05:46:34.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.378+0000 7f00e7fff700 1 -- 172.21.15.77:0/674932144 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1710120154 0 0) 0x7f00f00c1db0 con 0x7f00f00c13e0 2023-07-24T05:46:34.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.378+0000 7f00e7fff700 1 -- 172.21.15.77:0/674932144 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00dc0035d0 con 0x7f00f00c13e0 2023-07-24T05:46:34.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.378+0000 7f00f5f8a700 1 -- 172.21.15.77:0/674932144 >> v1:172.21.15.103:6789/0 conn(0x7f00f0161130 legacy=0x7f00f00ceb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.378+0000 7f00f5f8a700 1 -- 172.21.15.77:0/674932144 >> v1:172.21.15.77:6789/0 conn(0x7f00f00c13e0 legacy=0x7f00f00cd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.378+0000 7f00f5f8a700 1 -- 172.21.15.77:0/674932144 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f0071370 con 0x7f00f006ceb0 2023-07-24T05:46:34.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.378+0000 7f08e247d700 1 -- start start 2023-07-24T05:46:34.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.378+0000 7f00f5f8a700 1 --2- 172.21.15.77:0/674932144 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00f006ceb0 0x7f00f00c1870 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f00e8009dc0 tx=0x7f00e800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=334e520ce8a116af server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:34.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.378+0000 7f00e7fff700 1 -- 172.21.15.77:0/674932144 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e800e070 con 0x7f00f006ceb0 2023-07-24T05:46:34.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.378+0000 7f00e7fff700 1 -- 172.21.15.77:0/674932144 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e8003a40 con 0x7f00f006ceb0 2023-07-24T05:46:34.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.378+0000 7f00e7fff700 1 -- 172.21.15.77:0/674932144 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e8003db0 con 0x7f00f006ceb0 2023-07-24T05:46:34.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.378+0000 7f00f79ed700 1 -- 172.21.15.77:0/674932144 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00f006ceb0 msgr2=0x7f00f00c1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.378+0000 7f00f79ed700 1 --2- 172.21.15.77:0/674932144 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00f006ceb0 0x7f00f00c1870 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f00e8009dc0 tx=0x7f00e800b330 comp rx=0 tx=0).stop 2023-07-24T05:46:34.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.378+0000 7f08e247d700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f08dc0cb7e0 0x7f08dc0b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.378+0000 7f08e247d700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f08dc0aae70 0x7f08dc1588c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.378+0000 7f08e247d700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08dc0b20b0 con 0x7f08dc0afc20 2023-07-24T05:46:34.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.378+0000 7f08e247d700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08dc15f5a0 con 0x7f08dc0aae70 2023-07-24T05:46:34.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.378+0000 7f08e247d700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08dc0b25c0 con 0x7f08dc0cb7e0 2023-07-24T05:46:34.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.378+0000 7f00f79ed700 1 -- 172.21.15.77:0/674932144 shutdown_connections 2023-07-24T05:46:34.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.378+0000 7f00f79ed700 1 --2- 172.21.15.77:0/674932144 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00f006ceb0 0x7f00f00c1870 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.378+0000 7f00f79ed700 1 -- 172.21.15.77:0/674932144 >> 172.21.15.77:0/674932144 conn(0x7f00f00b1360 msgr2=0x7f00f00b1770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:34.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.382+0000 7f00f79ed700 1 -- 172.21.15.77:0/674932144 shutdown_connections 2023-07-24T05:46:34.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.382+0000 7f08e0c7a700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f08dc0aae70 0x7f08dc1588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.382+0000 7f08e0c7a700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f08dc0aae70 0x7f08dc1588c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42384/0 (socket says 172.21.15.77:42384) 2023-07-24T05:46:34.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.382+0000 7f08e0c7a700 1 -- 172.21.15.77:0/3948672629 learned_addr learned my addr 172.21.15.77:0/3948672629 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:34.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.382+0000 7f08e147b700 1 --2- 172.21.15.77:0/3948672629 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f08dc0cb7e0 0x7f08dc0b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.382+0000 7f08e0c7a700 1 -- 172.21.15.77:0/3948672629 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f08dc0cb7e0 msgr2=0x7f08dc0b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:34.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.382+0000 7f08e0c7a700 1 --2- 172.21.15.77:0/3948672629 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f08dc0cb7e0 0x7f08dc0b1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.382+0000 7f08e0c7a700 1 -- 172.21.15.77:0/3948672629 >> v1:172.21.15.103:6789/0 conn(0x7f08dc0afc20 legacy=0x7f08dc0b00b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-24T05:46:34.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.382+0000 7f08e0c7a700 1 -- 172.21.15.77:0/3948672629 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08dc0b28a0 con 0x7f08dc0aae70 2023-07-24T05:46:34.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.382+0000 7f08e147b700 1 --2- 172.21.15.77:0/3948672629 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f08dc0cb7e0 0x7f08dc0b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:46:34.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.382+0000 7f08e0c7a700 1 --2- 172.21.15.77:0/3948672629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08dc0aae70 0x7f08dc1588c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f08cc009910 tx=0x7f08cc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=164419334897092 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:34.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.382+0000 7f08d3fff700 1 -- 172.21.15.77:0/3948672629 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc004230 con 0x7f08dc0aae70 2023-07-24T05:46:34.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.382+0000 7f08d3fff700 1 -- 172.21.15.77:0/3948672629 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08cc004390 con 0x7f08dc0aae70 2023-07-24T05:46:34.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.382+0000 7f08d3fff700 1 -- 172.21.15.77:0/3948672629 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc0036c0 con 0x7f08dc0aae70 2023-07-24T05:46:34.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.382+0000 7f00f79ed700 1 -- 172.21.15.77:0/674932144 wait complete. 2023-07-24T05:46:34.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.382+0000 7f00f79ed700 1 Processor -- start 2023-07-24T05:46:34.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.382+0000 7f08e247d700 1 -- 172.21.15.77:0/3948672629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08dc0aae70 msgr2=0x7f08dc1588c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.382+0000 7f08e247d700 1 --2- 172.21.15.77:0/3948672629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08dc0aae70 0x7f08dc1588c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f08cc009910 tx=0x7f08cc009c20 comp rx=0 tx=0).stop 2023-07-24T05:46:34.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.382+0000 7f00f79ed700 1 -- start start 2023-07-24T05:46:34.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.386+0000 7f08e247d700 1 -- 172.21.15.77:0/3948672629 shutdown_connections 2023-07-24T05:46:34.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.386+0000 7f08e247d700 1 --2- 172.21.15.77:0/3948672629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08dc0aae70 0x7f08dc1588c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.386+0000 7f08e247d700 1 --2- 172.21.15.77:0/3948672629 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f08dc0cb7e0 0x7f08dc0b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.386+0000 7f08e247d700 1 -- 172.21.15.77:0/3948672629 >> 172.21.15.77:0/3948672629 conn(0x7f08dc0cacc0 msgr2=0x7f08dc0cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:34.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.386+0000 7f08e247d700 1 -- 172.21.15.77:0/3948672629 shutdown_connections 2023-07-24T05:46:34.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.386+0000 7f00f79ed700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00f006ceb0 0x7f00f0201cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.386+0000 7f00f79ed700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00f00c13e0 0x7f00f00b0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.386+0000 7f00f79ed700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00f0161130 0x7f00f00b0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.386+0000 7f00f79ed700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f0203450 con 0x7f00f00c13e0 2023-07-24T05:46:34.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.386+0000 7f00f79ed700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f0098300 con 0x7f00f0161130 2023-07-24T05:46:34.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.386+0000 7f00f79ed700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f01fee40 con 0x7f00f006ceb0 2023-07-24T05:46:34.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.386+0000 7f00f4f88700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00f00c13e0 0x7f00f00b0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.386+0000 7f00f4f88700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00f00c13e0 0x7f00f00b0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42396/0 (socket says 172.21.15.77:42396) 2023-07-24T05:46:34.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.386+0000 7f00f4f88700 1 -- 172.21.15.77:0/1225893920 learned_addr learned my addr 172.21.15.77:0/1225893920 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:34.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.386+0000 7f00f5f8a700 1 --2- 172.21.15.77:0/1225893920 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00f0161130 0x7f00f00b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.386+0000 7f00f4f88700 1 -- 172.21.15.77:0/1225893920 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00f006ceb0 msgr2=0x7f00f0201cc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-24T05:46:34.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.386+0000 7f00f4f88700 1 --2- 172.21.15.77:0/1225893920 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00f006ceb0 0x7f00f0201cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.386+0000 7f00f4f88700 1 -- 172.21.15.77:0/1225893920 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00f0161130 msgr2=0x7f00f00b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.386+0000 7f00f4f88700 1 --2- 172.21.15.77:0/1225893920 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00f0161130 0x7f00f00b0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.386+0000 7f00f4f88700 1 -- 172.21.15.77:0/1225893920 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e8009a70 con 0x7f00f00c13e0 2023-07-24T05:46:34.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.386+0000 7f08e247d700 1 -- 172.21.15.77:0/3948672629 wait complete. 2023-07-24T05:46:34.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.386+0000 7f08e247d700 1 Processor -- start 2023-07-24T05:46:34.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.386+0000 7f08e247d700 1 -- start start 2023-07-24T05:46:34.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.386+0000 7fe312c65700 1 Processor -- start 2023-07-24T05:46:34.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.386+0000 7f00f4f88700 1 --2- 172.21.15.77:0/1225893920 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00f00c13e0 0x7f00f00b0130 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f00e000c730 tx=0x7f00e000ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:34.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.386+0000 7fe312c65700 1 -- start start 2023-07-24T05:46:34.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.390+0000 7f00e5ffb700 1 -- 172.21.15.77:0/1225893920 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e0005d90 con 0x7f00f00c13e0 2023-07-24T05:46:34.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.390+0000 7f00e5ffb700 1 -- 172.21.15.77:0/1225893920 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e00070d0 con 0x7f00f00c13e0 2023-07-24T05:46:34.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.390+0000 7f08e247d700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f08dc0aae70 0x7f08dc1fec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.390+0000 7f08e247d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08dc0afc20 0x7f08dc0c27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.390+0000 7f08e247d700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08dc0cb7e0 0x7f08dc0c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.390+0000 7f00e5ffb700 1 -- 172.21.15.77:0/1225893920 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e0007480 con 0x7f00f00c13e0 2023-07-24T05:46:34.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.390+0000 7f08e247d700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08dc0c7650 con 0x7f08dc0afc20 2023-07-24T05:46:34.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.390+0000 7f08e247d700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08dc0c69d0 con 0x7f08dc0cb7e0 2023-07-24T05:46:34.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.390+0000 7f08e247d700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08dc0c6cb0 con 0x7f08dc0aae70 2023-07-24T05:46:34.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.390+0000 7f08e147b700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f08dc0aae70 0x7f08dc1fec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.390+0000 7f08e147b700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f08dc0aae70 0x7f08dc1fec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.77:51706/0 (socket says 172.21.15.77:51706) 2023-07-24T05:46:34.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.390+0000 7f08e147b700 1 -- 172.21.15.77:0/4270418876 learned_addr learned my addr 172.21.15.77:0/4270418876 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:34.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.390+0000 7fe312c65700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe30c158580 0x7fe30c0afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.390+0000 7fe312c65700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe30c0cb720 0x7fe30c0affd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.390+0000 7fe312c65700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe30c0ab1c0 con 0x7fe30c158960 2023-07-24T05:46:34.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.390+0000 7fe312c65700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe30c0b2fa0 con 0x7fe30c0cb720 2023-07-24T05:46:34.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.390+0000 7fe312c65700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe30c0af0b0 con 0x7fe30c158580 2023-07-24T05:46:34.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.390+0000 7f08e1c7c700 1 --2- 172.21.15.77:0/4270418876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08dc0cb7e0 0x7f08dc0c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.390+0000 7f00f79ed700 1 -- 172.21.15.77:0/1225893920 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f01ffe40 con 0x7f00f00c13e0 2023-07-24T05:46:34.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.390+0000 7f00f79ed700 1 -- 172.21.15.77:0/1225893920 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f01ff080 con 0x7f00f00c13e0 2023-07-24T05:46:34.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.390+0000 7f08e147b700 1 -- 172.21.15.77:0/4270418876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08dc0cb7e0 msgr2=0x7f08dc0c2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.390+0000 7f08e147b700 1 --2- 172.21.15.77:0/4270418876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08dc0cb7e0 0x7f08dc0c2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.390+0000 7f08e147b700 1 -- 172.21.15.77:0/4270418876 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08dc0afc20 msgr2=0x7f08dc0c27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.390+0000 7f08e147b700 1 --2- 172.21.15.77:0/4270418876 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08dc0afc20 0x7f08dc0c27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.390+0000 7f08e147b700 1 -- 172.21.15.77:0/4270418876 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d80094b0 con 0x7f08dc0aae70 2023-07-24T05:46:34.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.390+0000 7fe30bfff700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe30c0cb720 0x7fe30c0affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.390+0000 7fe311202700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe30c158960 0x7fe30c0b1a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.77:57450/0 (socket says 172.21.15.77:57450) 2023-07-24T05:46:34.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.390+0000 7fe311202700 1 -- 172.21.15.77:0/4263816659 learned_addr learned my addr 172.21.15.77:0/4263816659 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:34.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.390+0000 7fe310a01700 1 --2- 172.21.15.77:0/4263816659 >> v2:172.21.15.103:3300/0 conn(0x7fe30c158580 0x7fe30c0afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.390+0000 7f08e147b700 1 --2- 172.21.15.77:0/4270418876 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f08dc0aae70 0x7f08dc1fec70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f08d800ebe0 tx=0x7f08d800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:34.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.390+0000 7f08d1ffb700 1 -- 172.21.15.77:0/4270418876 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d800c850 con 0x7f08dc0aae70 2023-07-24T05:46:34.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.390+0000 7f08d1ffb700 1 -- 172.21.15.77:0/4270418876 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d800c9b0 con 0x7f08dc0aae70 2023-07-24T05:46:34.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.390+0000 7f08d1ffb700 1 -- 172.21.15.77:0/4270418876 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d800cd20 con 0x7f08dc0aae70 2023-07-24T05:46:34.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.390+0000 7fe30bfff700 1 -- 172.21.15.77:0/4263816659 >> v2:172.21.15.103:3300/0 conn(0x7fe30c158580 msgr2=0x7fe30c0afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:34.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.390+0000 7fe30bfff700 1 --2- 172.21.15.77:0/4263816659 >> v2:172.21.15.103:3300/0 conn(0x7fe30c158580 0x7fe30c0afa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.390+0000 7fe30bfff700 1 -- 172.21.15.77:0/4263816659 >> v1:172.21.15.103:6789/0 conn(0x7fe30c158960 legacy=0x7fe30c0b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.390+0000 7fe30bfff700 1 -- 172.21.15.77:0/4263816659 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe30c0b0510 con 0x7fe30c0cb720 2023-07-24T05:46:34.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.390+0000 7fe30bfff700 1 --2- 172.21.15.77:0/4263816659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe30c0cb720 0x7fe30c0affd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe30c073260 tx=0x7fe2f8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8b420df70e79ff0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:34.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.394+0000 7f08e247d700 1 -- 172.21.15.77:0/4270418876 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08cc009570 con 0x7f08dc0aae70 2023-07-24T05:46:34.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.394+0000 7f00f79ed700 1 -- 172.21.15.77:0/1225893920 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00f004df10 con 0x7f00f00c13e0 2023-07-24T05:46:34.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.394+0000 7f08e247d700 1 -- 172.21.15.77:0/4270418876 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08dc0c7270 con 0x7f08dc0aae70 2023-07-24T05:46:34.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.394+0000 7fe30b7fe700 1 -- 172.21.15.77:0/4263816659 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f8011830 con 0x7fe30c0cb720 2023-07-24T05:46:34.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.394+0000 7fe30b7fe700 1 -- 172.21.15.77:0/4263816659 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f8011990 con 0x7fe30c0cb720 2023-07-24T05:46:34.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.394+0000 7fe30b7fe700 1 -- 172.21.15.77:0/4263816659 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f8011d40 con 0x7fe30c0cb720 2023-07-24T05:46:34.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.394+0000 7f08bf7fe700 1 -- 172.21.15.77:0/4270418876 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08dc0b1b70 con 0x7f08dc0aae70 2023-07-24T05:46:34.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.394+0000 7fe312c65700 1 -- 172.21.15.77:0/4263816659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe30c0cb720 msgr2=0x7fe30c0affd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.394+0000 7fe312c65700 1 --2- 172.21.15.77:0/4263816659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe30c0cb720 0x7fe30c0affd0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe30c073260 tx=0x7fe2f8009b30 comp rx=0 tx=0).stop 2023-07-24T05:46:34.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.394+0000 7fe312c65700 1 -- 172.21.15.77:0/4263816659 shutdown_connections 2023-07-24T05:46:34.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.394+0000 7fe312c65700 1 --2- 172.21.15.77:0/4263816659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe30c0cb720 0x7fe30c0affd0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.394+0000 7fe312c65700 1 --2- 172.21.15.77:0/4263816659 >> v2:172.21.15.103:3300/0 conn(0x7fe30c158580 0x7fe30c0afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.394+0000 7fe312c65700 1 -- 172.21.15.77:0/4263816659 >> 172.21.15.77:0/4263816659 conn(0x7fe30c0cac00 msgr2=0x7fe30c0cb010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:34.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.394+0000 7fe312c65700 1 -- 172.21.15.77:0/4263816659 shutdown_connections 2023-07-24T05:46:34.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.398+0000 7f08d1ffb700 1 -- 172.21.15.77:0/4270418876 <== mon.2 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f08d8013470 con 0x7f08dc0aae70 2023-07-24T05:46:34.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.394+0000 7fe312c65700 1 -- 172.21.15.77:0/4263816659 wait complete. 2023-07-24T05:46:34.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.398+0000 7f08d1ffb700 1 --2- 172.21.15.77:0/4270418876 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f08c00663c0 0x7f08c0068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.398+0000 7f08d1ffb700 1 -- 172.21.15.77:0/4270418876 <== mon.2 v2:172.21.15.103:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f08d8084070 con 0x7f08dc0aae70 2023-07-24T05:46:34.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.398+0000 7f00e5ffb700 1 -- 172.21.15.77:0/1225893920 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f00e00075e0 con 0x7f00f00c13e0 2023-07-24T05:46:34.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.398+0000 7f00e5ffb700 1 --2- 172.21.15.77:0/1225893920 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f00d40663c0 0x7f00d4068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.398+0000 7f00e5ffb700 1 -- 172.21.15.77:0/1225893920 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f00e00835f0 con 0x7f00f00c13e0 2023-07-24T05:46:34.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.398+0000 7f08e0c7a700 1 --2- 172.21.15.77:0/4270418876 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f08c00663c0 0x7f08c0068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.398+0000 7f00f5789700 1 --2- 172.21.15.77:0/1225893920 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f00d40663c0 0x7f00d4068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.398+0000 7fe312c65700 1 Processor -- start 2023-07-24T05:46:34.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.398+0000 7fe312c65700 1 -- start start 2023-07-24T05:46:34.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.398+0000 7f08e0c7a700 1 --2- 172.21.15.77:0/4270418876 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f08c00663c0 0x7f08c0068880 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f08cc009910 tx=0x7f08cc010000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:34.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.402+0000 7f00f5789700 1 --2- 172.21.15.77:0/1225893920 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f00d40663c0 0x7f00d4068880 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f00ec001790 tx=0x7f00ec007a50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:34.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.402+0000 7fe312c65700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe30c0cb720 0x7fe30c153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.402+0000 7fe312c65700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe30c158580 0x7fe30c09a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.402+0000 7fe312c65700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe30c158960 0x7fe30c0c2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.402+0000 7fe310a01700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe30c0cb720 0x7fe30c153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.402+0000 7fe30bfff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe30c158580 0x7fe30c09a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.402+0000 7fe30bfff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe30c158580 0x7fe30c09a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:42052/0 (socket says 172.21.15.77:42052) 2023-07-24T05:46:34.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.402+0000 7fe310a01700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe30c0cb720 0x7fe30c153db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.77:51716/0 (socket says 172.21.15.77:51716) 2023-07-24T05:46:34.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.402+0000 7f00e5ffb700 1 -- 172.21.15.77:0/1225893920 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f00e00506d0 con 0x7f00f00c13e0 2023-07-24T05:46:34.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.402+0000 7fe30bfff700 1 -- 172.21.15.77:0/771811087 learned_addr learned my addr 172.21.15.77:0/771811087 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:34.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.402+0000 7fe312c65700 1 -- 172.21.15.77:0/771811087 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c0c3b00 con 0x7fe30c158960 2023-07-24T05:46:34.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.402+0000 7fe312c65700 1 -- 172.21.15.77:0/771811087 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c1542f0 con 0x7fe30c158580 2023-07-24T05:46:34.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.402+0000 7fe312c65700 1 -- 172.21.15.77:0/771811087 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c0c16a0 con 0x7fe30c0cb720 2023-07-24T05:46:34.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.402+0000 7fe311202700 1 --2- 172.21.15.77:0/771811087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe30c158960 0x7fe30c0c2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.402+0000 7fe30bfff700 1 -- 172.21.15.77:0/771811087 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe30c0cb720 msgr2=0x7fe30c153db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.402+0000 7fe30bfff700 1 --2- 172.21.15.77:0/771811087 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe30c0cb720 0x7fe30c153db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.402+0000 7fe30bfff700 1 -- 172.21.15.77:0/771811087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe30c158960 msgr2=0x7fe30c0c2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.402+0000 7fe30bfff700 1 --2- 172.21.15.77:0/771811087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe30c158960 0x7fe30c0c2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.402+0000 7fe30bfff700 1 -- 172.21.15.77:0/771811087 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f80094b0 con 0x7fe30c158580 2023-07-24T05:46:34.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.406+0000 7fe30bfff700 1 --2- 172.21.15.77:0/771811087 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe30c158580 0x7fe30c09a480 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8000c00 tx=0x7fe2f8004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:34.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.406+0000 7fe3097fa700 1 -- 172.21.15.77:0/771811087 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f8004590 con 0x7fe30c158580 2023-07-24T05:46:34.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.406+0000 7fe3097fa700 1 -- 172.21.15.77:0/771811087 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f80036c0 con 0x7fe30c158580 2023-07-24T05:46:34.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.406+0000 7fe3097fa700 1 -- 172.21.15.77:0/771811087 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f8003a50 con 0x7fe30c158580 2023-07-24T05:46:34.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.406+0000 7fe312c65700 1 -- 172.21.15.77:0/771811087 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe30c0c1980 con 0x7fe30c158580 2023-07-24T05:46:34.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.406+0000 7fe312c65700 1 -- 172.21.15.77:0/771811087 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe30c0c1f40 con 0x7fe30c158580 2023-07-24T05:46:34.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.406+0000 7fe2f6ffd700 1 -- 172.21.15.77:0/771811087 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe30c0c2160 con 0x7fe30c158580 2023-07-24T05:46:34.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.406+0000 7f08d1ffb700 1 -- 172.21.15.77:0/4270418876 <== mon.2 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f08d8051270 con 0x7f08dc0aae70 2023-07-24T05:46:34.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.410+0000 7fe3097fa700 1 -- 172.21.15.77:0/771811087 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe2f8003bb0 con 0x7fe30c158580 2023-07-24T05:46:34.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.414+0000 7fe3097fa700 1 --2- 172.21.15.77:0/771811087 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe2f0066320 0x7fe2f00687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.414+0000 7fe3097fa700 1 -- 172.21.15.77:0/771811087 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe2f8006ce0 con 0x7fe30c158580 2023-07-24T05:46:34.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.414+0000 7fe310a01700 1 --2- 172.21.15.77:0/771811087 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe2f0066320 0x7fe2f00687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.414+0000 7fe310a01700 1 --2- 172.21.15.77:0/771811087 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe2f0066320 0x7fe2f00687e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe30000a9b0 tx=0x7fe300008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:34.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.418+0000 7fe3097fa700 1 -- 172.21.15.77:0/771811087 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe2f80537b0 con 0x7fe30c158580 2023-07-24T05:46:34.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.450+0000 7effa82fc700 1 Processor -- start 2023-07-24T05:46:34.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.450+0000 7effa82fc700 1 -- start start 2023-07-24T05:46:34.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.450+0000 7effa82fc700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7effa0158b30 0x7effa00b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.456 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.450+0000 7effa82fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7effa00b0330 0x7effa00adca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.450+0000 7effa82fc700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effa00b20b0 con 0x7effa00aae70 2023-07-24T05:46:34.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.450+0000 7effa82fc700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effa0158f10 con 0x7effa00b0330 2023-07-24T05:46:34.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.450+0000 7effa82fc700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa00b22e0 con 0x7effa0158b30 2023-07-24T05:46:34.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.450+0000 7effa5897700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7effa00aae70 0x7effa00afc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:53642/0 (socket says 172.21.15.77:53642) 2023-07-24T05:46:34.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.450+0000 7effa5897700 1 -- 172.21.15.77:0/3644749744 learned_addr learned my addr 172.21.15.77:0/3644749744 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:34.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.454+0000 7effa6098700 1 --2- 172.21.15.77:0/3644749744 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7effa0158b30 0x7effa00b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.454+0000 7effa6899700 1 --2- 172.21.15.77:0/3644749744 >> v2:172.21.15.103:3300/0 conn(0x7effa00b0330 0x7effa00adca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.454+0000 7effa6098700 1 -- 172.21.15.77:0/3644749744 >> v2:172.21.15.103:3300/0 conn(0x7effa00b0330 msgr2=0x7effa00adca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:34.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.454+0000 7effa6098700 1 --2- 172.21.15.77:0/3644749744 >> v2:172.21.15.103:3300/0 conn(0x7effa00b0330 0x7effa00adca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.454+0000 7effa6098700 1 -- 172.21.15.77:0/3644749744 >> v1:172.21.15.77:6789/0 conn(0x7effa00aae70 legacy=0x7effa00afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.454+0000 7effa6098700 1 -- 172.21.15.77:0/3644749744 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa00b25c0 con 0x7effa0158b30 2023-07-24T05:46:34.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.454+0000 7effa6098700 1 --2- 172.21.15.77:0/3644749744 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7effa0158b30 0x7effa00b1b70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7eff90009850 tx=0x7eff90009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=677aafb0b15fcce8 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:34.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.454+0000 7effa5096700 1 -- 172.21.15.77:0/3644749744 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff90004230 con 0x7effa0158b30 2023-07-24T05:46:34.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.454+0000 7effa5096700 1 -- 172.21.15.77:0/3644749744 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff90004390 con 0x7effa0158b30 2023-07-24T05:46:34.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.454+0000 7effa82fc700 1 -- 172.21.15.77:0/3644749744 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7effa0158b30 msgr2=0x7effa00b1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.454+0000 7effa82fc700 1 --2- 172.21.15.77:0/3644749744 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7effa0158b30 0x7effa00b1b70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7eff90009850 tx=0x7eff90009b60 comp rx=0 tx=0).stop 2023-07-24T05:46:34.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.454+0000 7effa82fc700 1 -- 172.21.15.77:0/3644749744 shutdown_connections 2023-07-24T05:46:34.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.454+0000 7effa82fc700 1 --2- 172.21.15.77:0/3644749744 >> v2:172.21.15.103:3300/0 conn(0x7effa00b0330 0x7effa00adca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.454+0000 7effa82fc700 1 --2- 172.21.15.77:0/3644749744 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7effa0158b30 0x7effa00b1b70 secure :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7eff90009850 tx=0x7eff90009b60 comp rx=0 tx=0).stop 2023-07-24T05:46:34.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.454+0000 7effa82fc700 1 -- 172.21.15.77:0/3644749744 >> 172.21.15.77:0/3644749744 conn(0x7effa00cacc0 msgr2=0x7effa00cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:34.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.458+0000 7effa82fc700 1 -- 172.21.15.77:0/3644749744 shutdown_connections 2023-07-24T05:46:34.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.458+0000 7effa82fc700 1 -- 172.21.15.77:0/3644749744 wait complete. 2023-07-24T05:46:34.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.458+0000 7effa82fc700 1 Processor -- start 2023-07-24T05:46:34.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.458+0000 7effa82fc700 1 -- start start 2023-07-24T05:46:34.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.462+0000 7effa82fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effa00aae70 0x7effa014f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.462+0000 7effa82fc700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effa00b0330 0x7effa00712e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.458+0000 7fa744211700 1 Processor -- start 2023-07-24T05:46:34.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.458+0000 7fa744211700 1 -- start start 2023-07-24T05:46:34.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.462+0000 7fa744211700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa73c09bc30 0x7fa73c0b0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.462+0000 7fa744211700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa73c164760 0x7fa73c164bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.462+0000 7fa744211700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa73c0af770 con 0x7fa73c1642d0 2023-07-24T05:46:34.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.462+0000 7fa744211700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73c0ae290 con 0x7fa73c164760 2023-07-24T05:46:34.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.462+0000 7fa744211700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa73c09c090 con 0x7fa73c09bc30 2023-07-24T05:46:34.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.462+0000 7effa82fc700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7effa00c98c0 0x7effa00c9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.462+0000 7fa7417ac700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa73c09bc30 0x7fa73c0b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.462+0000 7effa82fc700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa00ca2b0 con 0x7effa00aae70 2023-07-24T05:46:34.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.462+0000 7effa82fc700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa014fad0 con 0x7effa00b0330 2023-07-24T05:46:34.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.462+0000 7effa6098700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effa00aae70 0x7effa014f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.462+0000 7effa6098700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effa00aae70 0x7effa014f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42444/0 (socket says 172.21.15.77:42444) 2023-07-24T05:46:34.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.462+0000 7effa5897700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effa00b0330 0x7effa00712e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.462+0000 7effa6098700 1 -- 172.21.15.77:0/791495701 learned_addr learned my addr 172.21.15.77:0/791495701 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:34.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.462+0000 7effa82fc700 1 -- 172.21.15.77:0/791495701 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa0156e00 con 0x7effa00c98c0 2023-07-24T05:46:34.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.462+0000 7effa6899700 1 --2- 172.21.15.77:0/791495701 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7effa00c98c0 0x7effa00c9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.462+0000 7fa7417ac700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa73c09bc30 0x7fa73c0b0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:42068/0 (socket says 172.21.15.77:42068) 2023-07-24T05:46:34.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.462+0000 7fa7427ae700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa73c164760 0x7fa73c164bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.462+0000 7fa7427ae700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa73c164760 0x7fa73c164bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42458/0 (socket says 172.21.15.77:42458) 2023-07-24T05:46:34.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.462+0000 7fa7427ae700 1 -- 172.21.15.77:0/1978669245 learned_addr learned my addr 172.21.15.77:0/1978669245 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:34.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.462+0000 7fa7427ae700 1 -- 172.21.15.77:0/1978669245 >> v2:172.21.15.103:3300/0 conn(0x7fa73c09bc30 msgr2=0x7fa73c0b0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:34.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.462+0000 7fa7427ae700 1 --2- 172.21.15.77:0/1978669245 >> v2:172.21.15.103:3300/0 conn(0x7fa73c09bc30 0x7fa73c0b0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.462+0000 7fa7427ae700 1 -- 172.21.15.77:0/1978669245 >> v1:172.21.15.77:6789/0 conn(0x7fa73c1642d0 legacy=0x7fa73c06ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.462+0000 7fa7427ae700 1 -- 172.21.15.77:0/1978669245 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c0ab9e0 con 0x7fa73c164760 2023-07-24T05:46:34.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.462+0000 7effa6098700 1 -- 172.21.15.77:0/791495701 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7effa00c98c0 msgr2=0x7effa00c9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.462+0000 7effa6098700 1 --2- 172.21.15.77:0/791495701 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7effa00c98c0 0x7effa00c9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.462+0000 7effa6098700 1 -- 172.21.15.77:0/791495701 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effa00b0330 msgr2=0x7effa00712e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.462+0000 7effa6098700 1 --2- 172.21.15.77:0/791495701 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effa00b0330 0x7effa00712e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.462+0000 7effa6098700 1 -- 172.21.15.77:0/791495701 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff900094b0 con 0x7effa00aae70 2023-07-24T05:46:34.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.462+0000 7fa740fab700 1 -- 172.21.15.77:0/1978669245 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3206783243 0 0) 0x7fa73c0af770 con 0x7fa73c1642d0 2023-07-24T05:46:34.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.462+0000 7fa7417ac700 1 --2- 172.21.15.77:0/1978669245 >> v2:172.21.15.103:3300/0 conn(0x7fa73c09bc30 0x7fa73c0b0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2023-07-24T05:46:34.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.462+0000 7fa7427ae700 1 --2- 172.21.15.77:0/1978669245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa73c164760 0x7fa73c164bf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0afd00 tx=0x7fa738009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72012b998da7e40e server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:34.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.462+0000 7fa740fab700 1 -- 172.21.15.77:0/1978669245 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa738005ea0 con 0x7fa73c164760 2023-07-24T05:46:34.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.462+0000 7effa6098700 1 --2- 172.21.15.77:0/791495701 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effa00aae70 0x7effa014f070 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7eff90004000 tx=0x7eff90004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:34.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.466+0000 7fa740fab700 1 -- 172.21.15.77:0/1978669245 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa738006030 con 0x7fa73c164760 2023-07-24T05:46:34.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.466+0000 7fa740fab700 1 -- 172.21.15.77:0/1978669245 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7380063a0 con 0x7fa73c164760 2023-07-24T05:46:34.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.466+0000 7eff96ffd700 1 -- 172.21.15.77:0/791495701 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9001e070 con 0x7effa00aae70 2023-07-24T05:46:34.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.466+0000 7f3cdd011700 1 Processor -- start 2023-07-24T05:46:34.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.466+0000 7fa744211700 1 -- 172.21.15.77:0/1978669245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa73c164760 msgr2=0x7fa73c164bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.466+0000 7fa744211700 1 --2- 172.21.15.77:0/1978669245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa73c164760 0x7fa73c164bf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0afd00 tx=0x7fa738009bf0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.466+0000 7f3cdd011700 1 -- start start 2023-07-24T05:46:34.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.466+0000 7fa744211700 1 -- 172.21.15.77:0/1978669245 shutdown_connections 2023-07-24T05:46:34.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.466+0000 7fa744211700 1 --2- 172.21.15.77:0/1978669245 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa73c164760 0x7fa73c164bf0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.466+0000 7fa744211700 1 --2- 172.21.15.77:0/1978669245 >> v2:172.21.15.103:3300/0 conn(0x7fa73c09bc30 0x7fa73c0b0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.466+0000 7fa744211700 1 -- 172.21.15.77:0/1978669245 >> 172.21.15.77:0/1978669245 conn(0x7fa73c0cacc0 msgr2=0x7fa73c0cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:34.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.466+0000 7fa744211700 1 -- 172.21.15.77:0/1978669245 shutdown_connections 2023-07-24T05:46:34.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.466+0000 7effa82fc700 1 -- 172.21.15.77:0/791495701 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effa014f5b0 con 0x7effa00aae70 2023-07-24T05:46:34.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.466+0000 7effa82fc700 1 -- 172.21.15.77:0/791495701 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effa00c38e0 con 0x7effa00aae70 2023-07-24T05:46:34.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.466+0000 7eff96ffd700 1 -- 172.21.15.77:0/791495701 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff90003e70 con 0x7effa00aae70 2023-07-24T05:46:34.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.466+0000 7fa744211700 1 -- 172.21.15.77:0/1978669245 wait complete. 2023-07-24T05:46:34.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.466+0000 7f3cdd011700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3cd0050320 0x7f3cd0005f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.466+0000 7f3cdd011700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cd00535a0 con 0x7f3cd00556d0 2023-07-24T05:46:34.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.466+0000 7f3cdd011700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cd0006840 con 0x7f3cd0007600 2023-07-24T05:46:34.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.466+0000 7f3cdd011700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd00e6210 con 0x7f3cd0050320 2023-07-24T05:46:34.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.466+0000 7f3cd6d9d700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f3cd0007600 0x7f3cd00df230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.77:57462/0 (socket says 172.21.15.77:57462) 2023-07-24T05:46:34.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.470+0000 7f3cd6d9d700 1 -- 172.21.15.77:0/84068019 learned_addr learned my addr 172.21.15.77:0/84068019 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:34.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.466+0000 7eff96ffd700 1 -- 172.21.15.77:0/791495701 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff90010a10 con 0x7effa00aae70 2023-07-24T05:46:34.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.470+0000 7f3cd759e700 1 --2- 172.21.15.77:0/84068019 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3cd0050320 0x7f3cd0005f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.470+0000 7f3cd5d9b700 1 -- 172.21.15.77:0/84068019 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1022942103 0 0) 0x7f3cd0006840 con 0x7f3cd0007600 2023-07-24T05:46:34.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.470+0000 7f3cd5d9b700 1 -- 172.21.15.77:0/84068019 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cc00035d0 con 0x7f3cd0007600 2023-07-24T05:46:34.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.470+0000 7f3cd5d9b700 1 -- 172.21.15.77:0/84068019 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3636350255 0 0) 0x7f3cd00535a0 con 0x7f3cd00556d0 2023-07-24T05:46:34.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.470+0000 7fa744211700 1 Processor -- start 2023-07-24T05:46:34.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.470+0000 7f3cd5d9b700 1 -- 172.21.15.77:0/84068019 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cd0006840 con 0x7f3cd00556d0 2023-07-24T05:46:34.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.470+0000 7fa744211700 1 -- start start 2023-07-24T05:46:34.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.470+0000 7f3cd5d9b700 1 -- 172.21.15.77:0/84068019 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 293488437 0 0) 0x7f3cd0006840 con 0x7f3cd00556d0 2023-07-24T05:46:34.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.470+0000 7f3cd5d9b700 1 -- 172.21.15.77:0/84068019 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3cd0050320 msgr2=0x7f3cd0005f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:34.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.470+0000 7f3cd5d9b700 1 --2- 172.21.15.77:0/84068019 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3cd0050320 0x7f3cd0005f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.470+0000 7f3cd5d9b700 1 -- 172.21.15.77:0/84068019 >> v1:172.21.15.103:6789/0 conn(0x7f3cd0007600 legacy=0x7f3cd00df230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.470+0000 7f3cd5d9b700 1 -- 172.21.15.77:0/84068019 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd0006b20 con 0x7f3cd00556d0 2023-07-24T05:46:34.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.470+0000 7f3cd5d9b700 1 -- 172.21.15.77:0/84068019 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4109865209 0 0) 0x7f3cc80015f0 con 0x7f3cd00556d0 2023-07-24T05:46:34.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.470+0000 7f3cd5d9b700 1 -- 172.21.15.77:0/84068019 >> v1:172.21.15.77:6789/0 conn(0x7f3cd00556d0 legacy=0x7f3cd004fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.470+0000 7eff96ffd700 1 -- 172.21.15.77:0/791495701 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7eff90010bf0 con 0x7effa00aae70 2023-07-24T05:46:34.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.470+0000 7eff96ffd700 1 --2- 172.21.15.77:0/791495701 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7eff840663c0 0x7eff84068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.470+0000 7eff96ffd700 1 -- 172.21.15.77:0/791495701 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7eff90084d60 con 0x7effa00aae70 2023-07-24T05:46:34.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.470+0000 7f3cd5d9b700 1 --2- 172.21.15.77:0/84068019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cc0004c70 0x7f3cc0005050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.470+0000 7f3cd5d9b700 1 --2- 172.21.15.77:0/84068019 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cc0003810 0x7f3cc0003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.470+0000 7f3cd5d9b700 1 --2- 172.21.15.77:0/84068019 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3cd0050320 0x7f3cc00041d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.470+0000 7fa744211700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa73c09bc30 0x7fa73c0ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.470+0000 7f3cd5d9b700 1 -- 172.21.15.77:0/84068019 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd8061770 con 0x7f3cc0004c70 2023-07-24T05:46:34.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.470+0000 7f3cd5d9b700 1 -- 172.21.15.77:0/84068019 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd00e6210 con 0x7f3cc0003810 2023-07-24T05:46:34.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.470+0000 7f3cd5d9b700 1 -- 172.21.15.77:0/84068019 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc000bb00 con 0x7f3cd0050320 2023-07-24T05:46:34.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.470+0000 7f3cd6d9d700 1 --2- 172.21.15.77:0/84068019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cc0004c70 0x7f3cc0005050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.470+0000 7f3cd659c700 1 --2- 172.21.15.77:0/84068019 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cc0003810 0x7f3cc0003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.470+0000 7f3cd759e700 1 --2- 172.21.15.77:0/84068019 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3cd0050320 0x7f3cc00041d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.470+0000 7fa744211700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa73c1642d0 0x7fa73c070700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.470+0000 7fa744211700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa73c164760 0x7fa73c070c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.470+0000 7effa5897700 1 --2- 172.21.15.77:0/791495701 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7eff840663c0 0x7eff84068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.474+0000 7fa741fad700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa73c09bc30 0x7fa73c0ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.474+0000 7fa7417ac700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa73c1642d0 0x7fa73c070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.474+0000 7fa741fad700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa73c09bc30 0x7fa73c0ccbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.77:51766/0 (socket says 172.21.15.77:51766) 2023-07-24T05:46:34.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.474+0000 7fa7417ac700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa73c1642d0 0x7fa73c070700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42478/0 (socket says 172.21.15.77:42478) 2023-07-24T05:46:34.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.474+0000 7f3cd659c700 1 -- 172.21.15.77:0/84068019 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3cd0050320 msgr2=0x7f3cc00041d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:34.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.474+0000 7fa741fad700 1 -- 172.21.15.77:0/3880832870 learned_addr learned my addr 172.21.15.77:0/3880832870 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:34.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.474+0000 7fa744211700 1 -- 172.21.15.77:0/3880832870 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c0c66d0 con 0x7fa73c1642d0 2023-07-24T05:46:34.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.474+0000 7fa744211700 1 -- 172.21.15.77:0/3880832870 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c0c69b0 con 0x7fa73c164760 2023-07-24T05:46:34.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.474+0000 7fa744211700 1 -- 172.21.15.77:0/3880832870 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c0c6c90 con 0x7fa73c09bc30 2023-07-24T05:46:34.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.474+0000 7f3cd659c700 1 --2- 172.21.15.77:0/84068019 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3cd0050320 0x7f3cc00041d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.474+0000 7f3cd659c700 1 -- 172.21.15.77:0/84068019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cc0004c70 msgr2=0x7f3cc0005050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:34.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.474+0000 7f3cd659c700 1 --2- 172.21.15.77:0/84068019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cc0004c70 0x7f3cc0005050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.474+0000 7f3cd659c700 1 -- 172.21.15.77:0/84068019 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd0006840 con 0x7f3cc0003810 2023-07-24T05:46:34.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.474+0000 7f3cd6d9d700 1 --2- 172.21.15.77:0/84068019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cc0004c70 0x7f3cc0005050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:46:34.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.474+0000 7fa7427ae700 1 --2- 172.21.15.77:0/3880832870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa73c164760 0x7fa73c070c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.474+0000 7fa7417ac700 1 -- 172.21.15.77:0/3880832870 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa73c09bc30 msgr2=0x7fa73c0ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.474+0000 7fa7417ac700 1 --2- 172.21.15.77:0/3880832870 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa73c09bc30 0x7fa73c0ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.474+0000 7fa7417ac700 1 -- 172.21.15.77:0/3880832870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa73c164760 msgr2=0x7fa73c070c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.474+0000 7fa7417ac700 1 --2- 172.21.15.77:0/3880832870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa73c164760 0x7fa73c070c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.474+0000 7fa7417ac700 1 -- 172.21.15.77:0/3880832870 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa738009570 con 0x7fa73c1642d0 2023-07-24T05:46:34.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.474+0000 7f3cd659c700 1 --2- 172.21.15.77:0/84068019 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cc0003810 0x7f3cc0003c90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3cc800d520 tx=0x7f3cc00058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90c1d76e0947efd3 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:34.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.474+0000 7effa82fc700 1 -- 172.21.15.77:0/791495701 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff88005310 con 0x7effa00aae70 2023-07-24T05:46:34.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.474+0000 7effa5897700 1 --2- 172.21.15.77:0/791495701 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7eff840663c0 0x7eff84068880 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7eff98002230 tx=0x7eff98001d10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:34.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.474+0000 7fa7417ac700 1 --2- 172.21.15.77:0/3880832870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa73c1642d0 0x7fa73c070700 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa72c00c7f0 tx=0x7fa72c00cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:34.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.474+0000 7f3cd5d9b700 1 -- 172.21.15.77:0/84068019 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc8006310 con 0x7f3cc0003810 2023-07-24T05:46:34.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.474+0000 7f3cd5d9b700 1 -- 172.21.15.77:0/84068019 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc8006470 con 0x7f3cc0003810 2023-07-24T05:46:34.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.474+0000 7f3cd5d9b700 1 -- 172.21.15.77:0/84068019 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc8004930 con 0x7f3cc0003810 2023-07-24T05:46:34.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.474+0000 7f3cdd011700 1 -- 172.21.15.77:0/84068019 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cc0003810 msgr2=0x7f3cc0003c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.474+0000 7f3cdd011700 1 --2- 172.21.15.77:0/84068019 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cc0003810 0x7f3cc0003c90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3cc800d520 tx=0x7f3cc00058a0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.474+0000 7f3cd759e700 1 -- 172.21.15.77:0/84068019 reap_dead start 2023-07-24T05:46:34.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.474+0000 7f3cdd011700 1 -- 172.21.15.77:0/84068019 shutdown_connections 2023-07-24T05:46:34.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.474+0000 7f3cdd011700 1 -- 172.21.15.77:0/84068019 >> 172.21.15.77:0/84068019 conn(0x7f3cd0054bb0 msgr2=0x7f3cd0054fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:34.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.474+0000 7f3cdd011700 1 -- 172.21.15.77:0/84068019 shutdown_connections 2023-07-24T05:46:34.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.478+0000 7f3cdd011700 1 -- 172.21.15.77:0/84068019 wait complete. 2023-07-24T05:46:34.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.478+0000 7fa7327fc700 1 -- 172.21.15.77:0/3880832870 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c011800 con 0x7fa73c1642d0 2023-07-24T05:46:34.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.478+0000 7fa744211700 1 -- 172.21.15.77:0/3880832870 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa73c0c6f70 con 0x7fa73c1642d0 2023-07-24T05:46:34.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.478+0000 7fa744211700 1 -- 172.21.15.77:0/3880832870 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa73c0cd100 con 0x7fa73c1642d0 2023-07-24T05:46:34.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.478+0000 7f3cdd011700 1 Processor -- start 2023-07-24T05:46:34.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.482+0000 7eff96ffd700 1 -- 172.21.15.77:0/791495701 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7eff90051f60 con 0x7effa00aae70 2023-07-24T05:46:34.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.482+0000 7fa7327fc700 1 -- 172.21.15.77:0/3880832870 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa72c011960 con 0x7fa73c1642d0 2023-07-24T05:46:34.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.482+0000 7fa7327fc700 1 -- 172.21.15.77:0/3880832870 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa72c011cd0 con 0x7fa73c1642d0 2023-07-24T05:46:34.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.478+0000 7f3cdd011700 1 -- start start 2023-07-24T05:46:34.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.482+0000 7f3cdd011700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cc0003810 0x7f3cd004a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.482+0000 7f3cdd011700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cd00d70a0 0x7f3cd004d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.482+0000 7f3cdd011700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3cd004dc20 0x7f3cd00e1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.482+0000 7f3cdd011700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd004e660 con 0x7f3cc0003810 2023-07-24T05:46:34.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.482+0000 7f3cdd011700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd00dfa70 con 0x7f3cd00d70a0 2023-07-24T05:46:34.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.482+0000 7f3cd6d9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cc0003810 0x7f3cd004a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.482+0000 7f3cd659c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cd00d70a0 0x7f3cd004d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.482+0000 7f3cd6d9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cc0003810 0x7f3cd004a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42492/0 (socket says 172.21.15.77:42492) 2023-07-24T05:46:34.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.482+0000 7f3cd6d9d700 1 -- 172.21.15.77:0/3827557340 learned_addr learned my addr 172.21.15.77:0/3827557340 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:34.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.482+0000 7f3cdd011700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd004e0a0 con 0x7f3cd004dc20 2023-07-24T05:46:34.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.482+0000 7f3cd759e700 1 --2- 172.21.15.77:0/3827557340 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3cd004dc20 0x7f3cd00e1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.482+0000 7f3cd6d9d700 1 -- 172.21.15.77:0/3827557340 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3cd004dc20 msgr2=0x7f3cd00e1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.482+0000 7f3cd6d9d700 1 --2- 172.21.15.77:0/3827557340 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3cd004dc20 0x7f3cd00e1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.482+0000 7f3cd6d9d700 1 -- 172.21.15.77:0/3827557340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cd00d70a0 msgr2=0x7f3cd004d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.482+0000 7f3cd6d9d700 1 --2- 172.21.15.77:0/3827557340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cd00d70a0 0x7f3cd004d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.482+0000 7f3cd6d9d700 1 -- 172.21.15.77:0/3827557340 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd004e380 con 0x7f3cc0003810 2023-07-24T05:46:34.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.482+0000 7f3cd6d9d700 1 --2- 172.21.15.77:0/3827557340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cc0003810 0x7f3cd004a8c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3cd804f150 tx=0x7f3cd8072a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:34.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.486+0000 7fa7327fc700 1 -- 172.21.15.77:0/3880832870 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa72c01a450 con 0x7fa73c1642d0 2023-07-24T05:46:34.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.486+0000 7f3cc77fe700 1 -- 172.21.15.77:0/3827557340 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd806eea0 con 0x7f3cc0003810 2023-07-24T05:46:34.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.486+0000 7f3cdd011700 1 -- 172.21.15.77:0/3827557340 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cd00df700 con 0x7f3cc0003810 2023-07-24T05:46:34.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.486+0000 7f3cdd011700 1 -- 172.21.15.77:0/3827557340 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cd00e21e0 con 0x7f3cc0003810 2023-07-24T05:46:34.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.486+0000 7f3cc77fe700 1 -- 172.21.15.77:0/3827557340 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd80731a0 con 0x7f3cc0003810 2023-07-24T05:46:34.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.486+0000 7f3cc77fe700 1 -- 172.21.15.77:0/3827557340 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd8073510 con 0x7f3cc0003810 2023-07-24T05:46:34.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.486+0000 7fa7327fc700 1 --2- 172.21.15.77:0/3880832870 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa7200662f0 0x7fa7200687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.486+0000 7fa7327fc700 1 -- 172.21.15.77:0/3880832870 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa72c083fc0 con 0x7fa73c1642d0 2023-07-24T05:46:34.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.486+0000 7fa741fad700 1 --2- 172.21.15.77:0/3880832870 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa7200662f0 0x7fa7200687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.486+0000 7fa744211700 1 -- 172.21.15.77:0/3880832870 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa724005310 con 0x7fa73c1642d0 2023-07-24T05:46:34.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.490+0000 7f3cdd011700 1 -- 172.21.15.77:0/3827557340 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cb4005310 con 0x7f3cc0003810 2023-07-24T05:46:34.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.490+0000 7fa741fad700 1 --2- 172.21.15.77:0/3880832870 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa7200662f0 0x7fa7200687b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa7340012e0 tx=0x7fa734009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:34.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.494+0000 7f3cc77fe700 1 -- 172.21.15.77:0/3827557340 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3cd8092790 con 0x7f3cc0003810 2023-07-24T05:46:34.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.494+0000 7f3cc77fe700 1 --2- 172.21.15.77:0/3827557340 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3cc0067760 0x7f3cc0069c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.498+0000 7f3cc77fe700 1 -- 172.21.15.77:0/3827557340 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3cd8106190 con 0x7f3cc0003810 2023-07-24T05:46:34.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.498+0000 7f3cd659c700 1 --2- 172.21.15.77:0/3827557340 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3cc0067760 0x7f3cc0069c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.498+0000 7f3cd659c700 1 --2- 172.21.15.77:0/3827557340 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3cc0067760 0x7f3cc0069c20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3cd00da5e0 tx=0x7f3cc8006000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:34.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.502+0000 7fa7327fc700 1 -- 172.21.15.77:0/3880832870 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa72c051050 con 0x7fa73c1642d0 2023-07-24T05:46:34.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.510+0000 7f3cc77fe700 1 -- 172.21.15.77:0/3827557340 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3cd80d3310 con 0x7f3cc0003810 2023-07-24T05:46:34.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.522+0000 7f8a4614c700 1 Processor -- start 2023-07-24T05:46:34.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.522+0000 7f8a4614c700 1 -- start start 2023-07-24T05:46:34.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.526+0000 7f8a4614c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8a40158b30 0x7f8a400b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.526+0000 7f8a4614c700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a400b20b0 con 0x7f8a400b0330 2023-07-24T05:46:34.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.526+0000 7f8a4614c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a400b22e0 con 0x7f8a400aae70 2023-07-24T05:46:34.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.526+0000 7f8a4614c700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a40158f10 con 0x7f8a40158b30 2023-07-24T05:46:34.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.526+0000 7f8a4514a700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8a40158b30 0x7f8a400b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.526+0000 7f8a4594b700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f8a400b0330 0x7f8a400adca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:53662/0 (socket says 172.21.15.77:53662) 2023-07-24T05:46:34.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.526+0000 7f8a4594b700 1 -- 172.21.15.77:0/3322560577 learned_addr learned my addr 172.21.15.77:0/3322560577 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:34.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.526+0000 7f8a4514a700 1 -- 172.21.15.77:0/3322560577 >> v1:172.21.15.103:6789/0 conn(0x7f8a400aae70 legacy=0x7f8a400afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:34.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.526+0000 7f8a4514a700 1 -- 172.21.15.77:0/3322560577 >> v1:172.21.15.77:6789/0 conn(0x7f8a400b0330 legacy=0x7f8a400adca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.526+0000 7f8a4514a700 1 -- 172.21.15.77:0/3322560577 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a400b25c0 con 0x7f8a40158b30 2023-07-24T05:46:34.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.526+0000 7f8a37fff700 1 -- 172.21.15.77:0/3322560577 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1960057830 0 0) 0x7f8a400b20b0 con 0x7f8a400b0330 2023-07-24T05:46:34.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.526+0000 7f8a4514a700 1 --2- 172.21.15.77:0/3322560577 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8a40158b30 0x7f8a400b1b70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8a3800ca30 tx=0x7f8a3800cd40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb48b4ff57a6e43f server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:34.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.526+0000 7f8a37fff700 1 -- 172.21.15.77:0/3322560577 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a38007dd0 con 0x7f8a40158b30 2023-07-24T05:46:34.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.526+0000 7f8a37fff700 1 -- 172.21.15.77:0/3322560577 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a38003a40 con 0x7f8a40158b30 2023-07-24T05:46:34.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.530+0000 7f8a4614c700 1 -- 172.21.15.77:0/3322560577 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8a40158b30 msgr2=0x7f8a400b1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.530+0000 7f8a4614c700 1 --2- 172.21.15.77:0/3322560577 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8a40158b30 0x7f8a400b1b70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8a3800ca30 tx=0x7f8a3800cd40 comp rx=0 tx=0).stop 2023-07-24T05:46:34.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.530+0000 7f8a4614c700 1 -- 172.21.15.77:0/3322560577 shutdown_connections 2023-07-24T05:46:34.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.530+0000 7f8a4614c700 1 --2- 172.21.15.77:0/3322560577 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8a40158b30 0x7f8a400b1b70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.530+0000 7f8a4614c700 1 -- 172.21.15.77:0/3322560577 >> 172.21.15.77:0/3322560577 conn(0x7f8a400cacc0 msgr2=0x7f8a400cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:34.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.530+0000 7f8a4614c700 1 -- 172.21.15.77:0/3322560577 shutdown_connections 2023-07-24T05:46:34.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.530+0000 7f8a4614c700 1 -- 172.21.15.77:0/3322560577 wait complete. 2023-07-24T05:46:34.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.534+0000 7f8a4614c700 1 Processor -- start 2023-07-24T05:46:34.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.534+0000 7f8a4614c700 1 -- start start 2023-07-24T05:46:34.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.534+0000 7f8a4614c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8a400aae70 0x7f8a4014f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.534+0000 7f8a4614c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a400b0330 0x7f8a40159110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.534+0000 7f8a4614c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a40158b30 0x7f8a4006c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.538+0000 7f8a4514a700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8a400aae70 0x7f8a4014f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.538+0000 7f8a4514a700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8a400aae70 0x7f8a4014f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.77:51784/0 (socket says 172.21.15.77:51784) 2023-07-24T05:46:34.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.538+0000 7f8a44949700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a400b0330 0x7f8a40159110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.538+0000 7f8a44949700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a400b0330 0x7f8a40159110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:42112/0 (socket says 172.21.15.77:42112) 2023-07-24T05:46:34.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.538+0000 7f8a4594b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a40158b30 0x7f8a4006c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.538+0000 7f8a4594b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a40158b30 0x7f8a4006c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42500/0 (socket says 172.21.15.77:42500) 2023-07-24T05:46:34.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.538+0000 7f8a4514a700 1 -- 172.21.15.77:0/2115146762 learned_addr learned my addr 172.21.15.77:0/2115146762 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:34.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.538+0000 7f8a4614c700 1 -- 172.21.15.77:0/2115146762 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4014e990 con 0x7f8a40158b30 2023-07-24T05:46:34.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.538+0000 7f8a4614c700 1 -- 172.21.15.77:0/2115146762 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4015bce0 con 0x7f8a400b0330 2023-07-24T05:46:34.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.538+0000 7f8a4614c700 1 -- 172.21.15.77:0/2115146762 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4014ebe0 con 0x7f8a400aae70 2023-07-24T05:46:34.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.538+0000 7f8a4514a700 1 -- 172.21.15.77:0/2115146762 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a400b0330 msgr2=0x7f8a40159110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.538+0000 7f8a4514a700 1 --2- 172.21.15.77:0/2115146762 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a400b0330 0x7f8a40159110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.538+0000 7f8a4514a700 1 -- 172.21.15.77:0/2115146762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a40158b30 msgr2=0x7f8a4006c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.538+0000 7f8a4514a700 1 --2- 172.21.15.77:0/2115146762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a40158b30 0x7f8a4006c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.538+0000 7f8a4514a700 1 -- 172.21.15.77:0/2115146762 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a3800c660 con 0x7f8a400aae70 2023-07-24T05:46:34.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.538+0000 7f8a4594b700 1 --2- 172.21.15.77:0/2115146762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a40158b30 0x7f8a4006c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:46:34.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.538+0000 7f8a4514a700 1 --2- 172.21.15.77:0/2115146762 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8a400aae70 0x7f8a4014f6c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8a38016040 tx=0x7f8a38004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:34.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.538+0000 7f8a35ffb700 1 -- 172.21.15.77:0/2115146762 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a38004400 con 0x7f8a400aae70 2023-07-24T05:46:34.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.538+0000 7f8a35ffb700 1 -- 172.21.15.77:0/2115146762 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a380045a0 con 0x7f8a400aae70 2023-07-24T05:46:34.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.538+0000 7f8a35ffb700 1 -- 172.21.15.77:0/2115146762 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a38004950 con 0x7f8a400aae70 2023-07-24T05:46:34.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.538+0000 7f8a4614c700 1 -- 172.21.15.77:0/2115146762 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a4014eec0 con 0x7f8a400aae70 2023-07-24T05:46:34.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.538+0000 7f8a4614c700 1 -- 172.21.15.77:0/2115146762 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a4014fc00 con 0x7f8a400aae70 2023-07-24T05:46:34.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.542+0000 7f8a35ffb700 1 -- 172.21.15.77:0/2115146762 <== mon.2 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8a3800b8a0 con 0x7f8a400aae70 2023-07-24T05:46:34.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.546+0000 7f8a35ffb700 1 --2- 172.21.15.77:0/2115146762 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f8a24066320 0x7f8a240687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:34.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.546+0000 7f8a35ffb700 1 -- 172.21.15.77:0/2115146762 <== mon.2 v2:172.21.15.103:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8a380854a0 con 0x7f8a400aae70 2023-07-24T05:46:34.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.546+0000 7f8a44949700 1 --2- 172.21.15.77:0/2115146762 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f8a24066320 0x7f8a240687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:34.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.546+0000 7f8a44949700 1 --2- 172.21.15.77:0/2115146762 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f8a24066320 0x7f8a240687e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8a400c9670 tx=0x7f8a30009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:34.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.550+0000 7f8a4614c700 1 -- 172.21.15.77:0/2115146762 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a40072490 con 0x7f8a400aae70 2023-07-24T05:46:34.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.558+0000 7f8a35ffb700 1 -- 172.21.15.77:0/2115146762 <== mon.2 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8a38052620 con 0x7f8a400aae70 2023-07-24T05:46:34.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.698+0000 7f4e764fc700 1 -- 172.21.15.77:0/3592688175 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4e7006ffc0 con 0x7f4e70158b30 2023-07-24T05:46:34.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.698+0000 7f4e6cff9700 1 -- 172.21.15.77:0/3592688175 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4e7006ffc0 con 0x7f4e70158b30 2023-07-24T05:46:34.705 INFO:teuthology.orchestra.run.smithi077.stdout:60129542153 2023-07-24T05:46:34.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.702+0000 7f4e5e7fc700 1 -- 172.21.15.77:0/3592688175 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f4e580665e0 msgr2=0x7f4e58068aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.702+0000 7f4e5e7fc700 1 --2- 172.21.15.77:0/3592688175 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f4e580665e0 0x7f4e58068aa0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4e60006fd0 tx=0x7f4e60008040 comp rx=0 tx=0).stop 2023-07-24T05:46:34.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.702+0000 7f4e5e7fc700 1 -- 172.21.15.77:0/3592688175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e70158b30 msgr2=0x7f4e700c9e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.702+0000 7f4e5e7fc700 1 --2- 172.21.15.77:0/3592688175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e70158b30 0x7f4e700c9e00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4e6400c390 tx=0x7f4e6400c6a0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.702+0000 7f4e5e7fc700 1 -- 172.21.15.77:0/3592688175 shutdown_connections 2023-07-24T05:46:34.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.702+0000 7f4e5e7fc700 1 --2- 172.21.15.77:0/3592688175 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4e70158b30 0x7f4e700c9e00 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.702+0000 7f4e5e7fc700 1 --2- 172.21.15.77:0/3592688175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e700b0160 0x7f4e700c98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.702+0000 7f4e5e7fc700 1 --2- 172.21.15.77:0/3592688175 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f4e580665e0 0x7f4e58068aa0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.702+0000 7f4e5e7fc700 1 --2- 172.21.15.77:0/3592688175 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4e700aae70 0x7f4e70201ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.702+0000 7f4e5e7fc700 1 -- 172.21.15.77:0/3592688175 >> 172.21.15.77:0/3592688175 conn(0x7f4e700cacc0 msgr2=0x7f4e70157db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:34.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.702+0000 7f4e5e7fc700 1 -- 172.21.15.77:0/3592688175 shutdown_connections 2023-07-24T05:46:34.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.702+0000 7f4e5e7fc700 1 -- 172.21.15.77:0/3592688175 wait complete. 2023-07-24T05:46:34.732 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.0 2023-07-24T05:46:34.733 DEBUG:teuthology.parallel:result is None 2023-07-24T05:46:34.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.730+0000 7f08bf7fe700 1 -- 172.21.15.77:0/4270418876 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f08dc0c6df0 con 0x7f08dc0aae70 2023-07-24T05:46:34.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.730+0000 7f08d1ffb700 1 -- 172.21.15.77:0/4270418876 <== mon.2 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f08dc0c6df0 con 0x7f08dc0aae70 2023-07-24T05:46:34.736 INFO:teuthology.orchestra.run.smithi077.stdout:60129542154 2023-07-24T05:46:34.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.734+0000 7f08bf7fe700 1 -- 172.21.15.77:0/4270418876 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f08c00663c0 msgr2=0x7f08c0068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.734+0000 7f08bf7fe700 1 --2- 172.21.15.77:0/4270418876 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f08c00663c0 0x7f08c0068880 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f08cc009910 tx=0x7f08cc010000 comp rx=0 tx=0).stop 2023-07-24T05:46:34.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.734+0000 7f08bf7fe700 1 -- 172.21.15.77:0/4270418876 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f08dc0aae70 msgr2=0x7f08dc1fec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.734+0000 7f08bf7fe700 1 --2- 172.21.15.77:0/4270418876 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f08dc0aae70 0x7f08dc1fec70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f08d800ebe0 tx=0x7f08d800eef0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.734+0000 7f08bf7fe700 1 -- 172.21.15.77:0/4270418876 shutdown_connections 2023-07-24T05:46:34.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.734+0000 7f08bf7fe700 1 --2- 172.21.15.77:0/4270418876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f08dc0cb7e0 0x7f08dc0c2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.734+0000 7f08bf7fe700 1 --2- 172.21.15.77:0/4270418876 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f08dc0afc20 0x7f08dc0c27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.734+0000 7f08bf7fe700 1 --2- 172.21.15.77:0/4270418876 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f08c00663c0 0x7f08c0068880 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.734+0000 7f08bf7fe700 1 --2- 172.21.15.77:0/4270418876 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f08dc0aae70 0x7f08dc1fec70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.734+0000 7f08bf7fe700 1 -- 172.21.15.77:0/4270418876 >> 172.21.15.77:0/4270418876 conn(0x7f08dc0cacc0 msgr2=0x7f08dc06c080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:34.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.734+0000 7f08bf7fe700 1 -- 172.21.15.77:0/4270418876 shutdown_connections 2023-07-24T05:46:34.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.738+0000 7f08bf7fe700 1 -- 172.21.15.77:0/4270418876 wait complete. 2023-07-24T05:46:34.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.738+0000 7f00f79ed700 1 -- 172.21.15.77:0/1225893920 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f00f00b89b0 con 0x7f00f00c13e0 2023-07-24T05:46:34.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.742+0000 7f00e5ffb700 1 -- 172.21.15.77:0/1225893920 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f00e0053cf0 con 0x7f00f00c13e0 2023-07-24T05:46:34.745 INFO:teuthology.orchestra.run.smithi077.stdout:60129542154 2023-07-24T05:46:34.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.742+0000 7f00f79ed700 1 -- 172.21.15.77:0/1225893920 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f00d40663c0 msgr2=0x7f00d4068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.742+0000 7f00f79ed700 1 --2- 172.21.15.77:0/1225893920 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f00d40663c0 0x7f00d4068880 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f00ec001790 tx=0x7f00ec007a50 comp rx=0 tx=0).stop 2023-07-24T05:46:34.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.742+0000 7f00f79ed700 1 -- 172.21.15.77:0/1225893920 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00f00c13e0 msgr2=0x7f00f00b0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.742+0000 7f00f79ed700 1 --2- 172.21.15.77:0/1225893920 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00f00c13e0 0x7f00f00b0130 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f00e000c730 tx=0x7f00e000ca40 comp rx=0 tx=0).stop 2023-07-24T05:46:34.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.746+0000 7f00f79ed700 1 -- 172.21.15.77:0/1225893920 shutdown_connections 2023-07-24T05:46:34.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.746+0000 7f00f79ed700 1 --2- 172.21.15.77:0/1225893920 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00f0161130 0x7f00f00b0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.746+0000 7f00f79ed700 1 --2- 172.21.15.77:0/1225893920 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00f00c13e0 0x7f00f00b0130 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.746+0000 7f00f79ed700 1 --2- 172.21.15.77:0/1225893920 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f00d40663c0 0x7f00d4068880 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.746+0000 7f00f79ed700 1 --2- 172.21.15.77:0/1225893920 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00f006ceb0 0x7f00f0201cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.746+0000 7f00f79ed700 1 -- 172.21.15.77:0/1225893920 >> 172.21.15.77:0/1225893920 conn(0x7f00f00b1360 msgr2=0x7f00f00ade70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:34.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.746+0000 7f00f79ed700 1 -- 172.21.15.77:0/1225893920 shutdown_connections 2023-07-24T05:46:34.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.746+0000 7f00f79ed700 1 -- 172.21.15.77:0/1225893920 wait complete. 2023-07-24T05:46:34.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.746+0000 7fe2f6ffd700 1 -- 172.21.15.77:0/771811087 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe30c04e760 con 0x7fe30c158580 2023-07-24T05:46:34.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.750+0000 7fe3097fa700 1 -- 172.21.15.77:0/771811087 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe2f8015020 con 0x7fe30c158580 2023-07-24T05:46:34.753 INFO:teuthology.orchestra.run.smithi077.stdout:60129542154 2023-07-24T05:46:34.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.754+0000 7fe2f6ffd700 1 -- 172.21.15.77:0/771811087 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe2f0066320 msgr2=0x7fe2f00687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.754+0000 7fe2f6ffd700 1 --2- 172.21.15.77:0/771811087 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe2f0066320 0x7fe2f00687e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe30000a9b0 tx=0x7fe300008040 comp rx=0 tx=0).stop 2023-07-24T05:46:34.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.754+0000 7fe2f6ffd700 1 -- 172.21.15.77:0/771811087 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe30c158580 msgr2=0x7fe30c09a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.754+0000 7fe2f6ffd700 1 --2- 172.21.15.77:0/771811087 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe30c158580 0x7fe30c09a480 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe2f8000c00 tx=0x7fe2f8004770 comp rx=0 tx=0).stop 2023-07-24T05:46:34.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.754+0000 7fe2f6ffd700 1 -- 172.21.15.77:0/771811087 shutdown_connections 2023-07-24T05:46:34.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.754+0000 7fe2f6ffd700 1 --2- 172.21.15.77:0/771811087 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe30c158960 0x7fe30c0c2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.754+0000 7fe2f6ffd700 1 --2- 172.21.15.77:0/771811087 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe30c158580 0x7fe30c09a480 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.754+0000 7fe2f6ffd700 1 --2- 172.21.15.77:0/771811087 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe2f0066320 0x7fe2f00687e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.754+0000 7fe2f6ffd700 1 --2- 172.21.15.77:0/771811087 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe30c0cb720 0x7fe30c153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.754+0000 7fe2f6ffd700 1 -- 172.21.15.77:0/771811087 >> 172.21.15.77:0/771811087 conn(0x7fe30c0cac00 msgr2=0x7fe30c071b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:34.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.754+0000 7fe2f6ffd700 1 -- 172.21.15.77:0/771811087 shutdown_connections 2023-07-24T05:46:34.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.754+0000 7fe2f6ffd700 1 -- 172.21.15.77:0/771811087 wait complete. 2023-07-24T05:46:34.768 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.7 2023-07-24T05:46:34.768 DEBUG:teuthology.parallel:result is None 2023-07-24T05:46:34.776 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.5 2023-07-24T05:46:34.776 DEBUG:teuthology.parallel:result is None 2023-07-24T05:46:34.777 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.3 2023-07-24T05:46:34.777 DEBUG:teuthology.parallel:result is None 2023-07-24T05:46:34.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.778+0000 7fa744211700 1 -- 172.21.15.77:0/3880832870 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fa7240055c0 con 0x7fa73c1642d0 2023-07-24T05:46:34.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.778+0000 7fa7327fc700 1 -- 172.21.15.77:0/3880832870 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa72c01f090 con 0x7fa73c1642d0 2023-07-24T05:46:34.784 INFO:teuthology.orchestra.run.smithi077.stdout:60129542153 2023-07-24T05:46:34.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.782+0000 7fa744211700 1 -- 172.21.15.77:0/3880832870 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa7200662f0 msgr2=0x7fa7200687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.782+0000 7fa744211700 1 --2- 172.21.15.77:0/3880832870 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa7200662f0 0x7fa7200687b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa7340012e0 tx=0x7fa734009040 comp rx=0 tx=0).stop 2023-07-24T05:46:34.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.782+0000 7fa744211700 1 -- 172.21.15.77:0/3880832870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa73c1642d0 msgr2=0x7fa73c070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.782+0000 7fa744211700 1 --2- 172.21.15.77:0/3880832870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa73c1642d0 0x7fa73c070700 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa72c00c7f0 tx=0x7fa72c00cb00 comp rx=0 tx=0).stop 2023-07-24T05:46:34.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.782+0000 7fa744211700 1 -- 172.21.15.77:0/3880832870 shutdown_connections 2023-07-24T05:46:34.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.782+0000 7fa744211700 1 --2- 172.21.15.77:0/3880832870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa73c164760 0x7fa73c070c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.782+0000 7fa744211700 1 --2- 172.21.15.77:0/3880832870 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa73c1642d0 0x7fa73c070700 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.782+0000 7fa744211700 1 --2- 172.21.15.77:0/3880832870 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa7200662f0 0x7fa7200687b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.782+0000 7fa744211700 1 --2- 172.21.15.77:0/3880832870 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa73c09bc30 0x7fa73c0ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.782+0000 7fa744211700 1 -- 172.21.15.77:0/3880832870 >> 172.21.15.77:0/3880832870 conn(0x7fa73c0cacc0 msgr2=0x7fa73c0abeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:34.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.782+0000 7fa744211700 1 -- 172.21.15.77:0/3880832870 shutdown_connections 2023-07-24T05:46:34.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.782+0000 7fa744211700 1 -- 172.21.15.77:0/3880832870 wait complete. 2023-07-24T05:46:34.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.786+0000 7effa82fc700 1 -- 172.21.15.77:0/791495701 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7eff880055c0 con 0x7effa00aae70 2023-07-24T05:46:34.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.786+0000 7eff96ffd700 1 -- 172.21.15.77:0/791495701 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7eff90027020 con 0x7effa00aae70 2023-07-24T05:46:34.790 INFO:teuthology.orchestra.run.smithi077.stdout:60129542153 2023-07-24T05:46:34.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.790+0000 7effa82fc700 1 -- 172.21.15.77:0/791495701 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7eff840663c0 msgr2=0x7eff84068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.790+0000 7effa82fc700 1 --2- 172.21.15.77:0/791495701 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7eff840663c0 0x7eff84068880 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7eff98002230 tx=0x7eff98001d10 comp rx=0 tx=0).stop 2023-07-24T05:46:34.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.790+0000 7effa82fc700 1 -- 172.21.15.77:0/791495701 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effa00aae70 msgr2=0x7effa014f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.790+0000 7effa82fc700 1 --2- 172.21.15.77:0/791495701 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effa00aae70 0x7effa014f070 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7eff90004000 tx=0x7eff90004770 comp rx=0 tx=0).stop 2023-07-24T05:46:34.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.790+0000 7effa82fc700 1 -- 172.21.15.77:0/791495701 shutdown_connections 2023-07-24T05:46:34.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.790+0000 7effa82fc700 1 --2- 172.21.15.77:0/791495701 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7eff840663c0 0x7eff84068880 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.790+0000 7effa82fc700 1 --2- 172.21.15.77:0/791495701 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7effa00c98c0 0x7effa00c9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.790+0000 7effa82fc700 1 --2- 172.21.15.77:0/791495701 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effa00b0330 0x7effa00712e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.790+0000 7effa82fc700 1 --2- 172.21.15.77:0/791495701 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effa00aae70 0x7effa014f070 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.790+0000 7effa82fc700 1 -- 172.21.15.77:0/791495701 >> 172.21.15.77:0/791495701 conn(0x7effa00cacc0 msgr2=0x7effa01572e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:34.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.790+0000 7effa82fc700 1 -- 172.21.15.77:0/791495701 shutdown_connections 2023-07-24T05:46:34.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.790+0000 7effa82fc700 1 -- 172.21.15.77:0/791495701 wait complete. 2023-07-24T05:46:34.810 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.4 2023-07-24T05:46:34.810 DEBUG:teuthology.parallel:result is None 2023-07-24T05:46:34.813 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.2 2023-07-24T05:46:34.814 DEBUG:teuthology.parallel:result is None 2023-07-24T05:46:34.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.822+0000 7f3cdd011700 1 -- 172.21.15.77:0/3827557340 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3cb4005890 con 0x7f3cc0003810 2023-07-24T05:46:34.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.822+0000 7f3cc77fe700 1 -- 172.21.15.77:0/3827557340 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3cd80d6930 con 0x7f3cc0003810 2023-07-24T05:46:34.829 INFO:teuthology.orchestra.run.smithi077.stdout:60129542154 2023-07-24T05:46:34.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.826+0000 7f3cdd011700 1 -- 172.21.15.77:0/3827557340 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3cc0067760 msgr2=0x7f3cc0069c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.826+0000 7f3cdd011700 1 --2- 172.21.15.77:0/3827557340 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3cc0067760 0x7f3cc0069c20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3cd00da5e0 tx=0x7f3cc8006000 comp rx=0 tx=0).stop 2023-07-24T05:46:34.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.826+0000 7f3cdd011700 1 -- 172.21.15.77:0/3827557340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cc0003810 msgr2=0x7f3cd004a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.826+0000 7f3cdd011700 1 --2- 172.21.15.77:0/3827557340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cc0003810 0x7f3cd004a8c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3cd804f150 tx=0x7f3cd8072a40 comp rx=0 tx=0).stop 2023-07-24T05:46:34.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.826+0000 7f3cdd011700 1 -- 172.21.15.77:0/3827557340 shutdown_connections 2023-07-24T05:46:34.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.826+0000 7f3cdd011700 1 --2- 172.21.15.77:0/3827557340 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3cc0067760 0x7f3cc0069c20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.826+0000 7f3cdd011700 1 --2- 172.21.15.77:0/3827557340 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3cd004dc20 0x7f3cd00e1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.826+0000 7f3cdd011700 1 --2- 172.21.15.77:0/3827557340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cd00d70a0 0x7f3cd004d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.826+0000 7f3cdd011700 1 --2- 172.21.15.77:0/3827557340 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cc0003810 0x7f3cd004a8c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.826+0000 7f3cdd011700 1 -- 172.21.15.77:0/3827557340 >> 172.21.15.77:0/3827557340 conn(0x7f3cd0054bb0 msgr2=0x7f3cd0038130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:34.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.826+0000 7f3cdd011700 1 -- 172.21.15.77:0/3827557340 shutdown_connections 2023-07-24T05:46:34.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.826+0000 7f3cdd011700 1 -- 172.21.15.77:0/3827557340 wait complete. 2023-07-24T05:46:34.850 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.846+0000 7f8a4614c700 1 -- 172.21.15.77:0/2115146762 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f8a4006bdb0 con 0x7f8a400aae70 2023-07-24T05:46:34.851 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.846+0000 7f8a35ffb700 1 -- 172.21.15.77:0/2115146762 <== mon.2 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8a38023030 con 0x7f8a400aae70 2023-07-24T05:46:34.851 INFO:teuthology.orchestra.run.smithi077.stdout:60129542154 2023-07-24T05:46:34.854 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.1 2023-07-24T05:46:34.854 DEBUG:teuthology.parallel:result is None 2023-07-24T05:46:34.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.850+0000 7f8a4614c700 1 -- 172.21.15.77:0/2115146762 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f8a24066320 msgr2=0x7f8a240687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.850+0000 7f8a4614c700 1 --2- 172.21.15.77:0/2115146762 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f8a24066320 0x7f8a240687e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8a400c9670 tx=0x7f8a30009040 comp rx=0 tx=0).stop 2023-07-24T05:46:34.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.850+0000 7f8a4614c700 1 -- 172.21.15.77:0/2115146762 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8a400aae70 msgr2=0x7f8a4014f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:34.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.850+0000 7f8a4614c700 1 --2- 172.21.15.77:0/2115146762 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8a400aae70 0x7f8a4014f6c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8a38016040 tx=0x7f8a38004af0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.850+0000 7f8a4614c700 1 -- 172.21.15.77:0/2115146762 shutdown_connections 2023-07-24T05:46:34.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.850+0000 7f8a4614c700 1 --2- 172.21.15.77:0/2115146762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a40158b30 0x7f8a4006c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.850+0000 7f8a4614c700 1 --2- 172.21.15.77:0/2115146762 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a400b0330 0x7f8a40159110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.850+0000 7f8a4614c700 1 --2- 172.21.15.77:0/2115146762 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f8a24066320 0x7f8a240687e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.850+0000 7f8a4614c700 1 --2- 172.21.15.77:0/2115146762 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8a400aae70 0x7f8a4014f6c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:34.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.850+0000 7f8a4614c700 1 -- 172.21.15.77:0/2115146762 >> 172.21.15.77:0/2115146762 conn(0x7f8a400cacc0 msgr2=0x7f8a400adba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:34.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.850+0000 7f8a4614c700 1 -- 172.21.15.77:0/2115146762 shutdown_connections 2023-07-24T05:46:34.856 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:34.850+0000 7f8a4614c700 1 -- 172.21.15.77:0/2115146762 wait complete. 2023-07-24T05:46:34.874 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.6 2023-07-24T05:46:34.874 DEBUG:teuthology.parallel:result is None 2023-07-24T05:46:34.875 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-24T05:46:34.875 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-24T05:46:35.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.074+0000 7f6bfb59e700 1 Processor -- start 2023-07-24T05:46:35.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.074+0000 7f6bfb59e700 1 -- start start 2023-07-24T05:46:35.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.074+0000 7f6bfb59e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6bfc160d20 0x7f6bfc0adba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:35.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.078+0000 7f6bfb59e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6bfc0ae0e0 0x7f6bfc0b1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:35.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.078+0000 7f6bfb59e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bfc0af170 con 0x7f6bfc161100 2023-07-24T05:46:35.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.078+0000 7f6bfb59e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bfc0ae5f0 con 0x7f6bfc0ae0e0 2023-07-24T05:46:35.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.078+0000 7f6bfb59e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bfc0ae8d0 con 0x7f6bfc160d20 2023-07-24T05:46:35.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.078+0000 7f6bf3fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6bfc0ae0e0 0x7f6bfc0b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:35.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.078+0000 7f6bfa59c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6bfc160d20 0x7f6bfc0adba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:35.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.078+0000 7f6bf3fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6bfc0ae0e0 0x7f6bfc0b1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:42122/0 (socket says 172.21.15.77:42122) 2023-07-24T05:46:35.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.078+0000 7f6bf3fff700 1 -- 172.21.15.77:0/2314197467 learned_addr learned my addr 172.21.15.77:0/2314197467 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:35.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.078+0000 7f6bf3fff700 1 -- 172.21.15.77:0/2314197467 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6bfc160d20 msgr2=0x7f6bfc0adba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:35.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.078+0000 7f6bf3fff700 1 --2- 172.21.15.77:0/2314197467 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6bfc160d20 0x7f6bfc0adba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:35.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.078+0000 7f6bf3fff700 1 -- 172.21.15.77:0/2314197467 >> v1:172.21.15.103:6789/0 conn(0x7f6bfc161100 legacy=0x7f6bfc164b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:35.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.078+0000 7f6bf3fff700 1 -- 172.21.15.77:0/2314197467 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bfc0aebb0 con 0x7f6bfc0ae0e0 2023-07-24T05:46:35.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.078+0000 7f6bf3fff700 1 --2- 172.21.15.77:0/2314197467 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bfc0ae0e0 0x7f6bfc0b1090 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6be4009910 tx=0x7f6be4009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24aae5e80d0cd5f9 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:35.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.078+0000 7f6bf9d9b700 1 -- 172.21.15.77:0/2314197467 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be4011830 con 0x7f6bfc0ae0e0 2023-07-24T05:46:35.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.078+0000 7f6bf9d9b700 1 -- 172.21.15.77:0/2314197467 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be4011990 con 0x7f6bfc0ae0e0 2023-07-24T05:46:35.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.078+0000 7f6bf9d9b700 1 -- 172.21.15.77:0/2314197467 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be4011d40 con 0x7f6bfc0ae0e0 2023-07-24T05:46:35.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.078+0000 7f6bfb59e700 1 -- 172.21.15.77:0/2314197467 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bfc0ae0e0 msgr2=0x7f6bfc0b1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:35.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.078+0000 7f6bfb59e700 1 --2- 172.21.15.77:0/2314197467 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bfc0ae0e0 0x7f6bfc0b1090 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6be4009910 tx=0x7f6be4009c20 comp rx=0 tx=0).stop 2023-07-24T05:46:35.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.078+0000 7f6bfb59e700 1 -- 172.21.15.77:0/2314197467 shutdown_connections 2023-07-24T05:46:35.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.078+0000 7f6bfb59e700 1 --2- 172.21.15.77:0/2314197467 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bfc0ae0e0 0x7f6bfc0b1090 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:35.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.078+0000 7f6bfb59e700 1 --2- 172.21.15.77:0/2314197467 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6bfc160d20 0x7f6bfc0adba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:35.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.078+0000 7f6bfb59e700 1 -- 172.21.15.77:0/2314197467 >> 172.21.15.77:0/2314197467 conn(0x7f6bfc0cacc0 msgr2=0x7f6bfc0cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:35.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.078+0000 7f6bfb59e700 1 -- 172.21.15.77:0/2314197467 shutdown_connections 2023-07-24T05:46:35.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.082+0000 7f6bfb59e700 1 -- 172.21.15.77:0/2314197467 wait complete. 2023-07-24T05:46:35.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.082+0000 7f6bfb59e700 1 Processor -- start 2023-07-24T05:46:35.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.082+0000 7f6bfb59e700 1 -- start start 2023-07-24T05:46:35.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.086+0000 7f6bfb59e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6bfc0ae0e0 0x7f6bfc158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:35.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.086+0000 7f6bfb59e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6bfc160d20 0x7f6bfc1632c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:35.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.086+0000 7f6bfb59e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bfc161100 0x7f6bfc163800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:35.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.086+0000 7f6bfb59e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bfc0c4a50 con 0x7f6bfc0ae0e0 2023-07-24T05:46:35.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.086+0000 7f6bfb59e700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bfc0c3e40 con 0x7f6bfc161100 2023-07-24T05:46:35.090 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.086+0000 7f6bfb59e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bfc0c4120 con 0x7f6bfc160d20 2023-07-24T05:46:35.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.086+0000 7f6bfa59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6bfc0ae0e0 0x7f6bfc158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:35.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.086+0000 7f6bfa59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6bfc0ae0e0 0x7f6bfc158ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42502/0 (socket says 172.21.15.77:42502) 2023-07-24T05:46:35.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.086+0000 7f6bfa59c700 1 -- 172.21.15.77:0/2693578382 learned_addr learned my addr 172.21.15.77:0/2693578382 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:35.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.086+0000 7f6bfad9d700 1 --2- 172.21.15.77:0/2693578382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bfc161100 0x7f6bfc163800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:35.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.086+0000 7f6bf3fff700 1 --2- 172.21.15.77:0/2693578382 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6bfc160d20 0x7f6bfc1632c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:35.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.086+0000 7f6bfa59c700 1 -- 172.21.15.77:0/2693578382 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6bfc160d20 msgr2=0x7f6bfc1632c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:35.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.086+0000 7f6bfa59c700 1 --2- 172.21.15.77:0/2693578382 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6bfc160d20 0x7f6bfc1632c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:35.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.086+0000 7f6bfa59c700 1 -- 172.21.15.77:0/2693578382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bfc161100 msgr2=0x7f6bfc163800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:35.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.086+0000 7f6bfa59c700 1 --2- 172.21.15.77:0/2693578382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bfc161100 0x7f6bfc163800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:35.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.086+0000 7f6bfa59c700 1 -- 172.21.15.77:0/2693578382 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be4009570 con 0x7f6bfc0ae0e0 2023-07-24T05:46:35.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.086+0000 7f6bf3fff700 1 --2- 172.21.15.77:0/2693578382 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6bfc160d20 0x7f6bfc1632c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:46:35.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.086+0000 7f6bfa59c700 1 --2- 172.21.15.77:0/2693578382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6bfc0ae0e0 0x7f6bfc158ee0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6bec00e9d0 tx=0x7f6bec00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:35.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.086+0000 7f6bf2ffd700 1 -- 172.21.15.77:0/2693578382 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bec009720 con 0x7f6bfc0ae0e0 2023-07-24T05:46:35.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.086+0000 7f6bf2ffd700 1 -- 172.21.15.77:0/2693578382 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bec00c850 con 0x7f6bfc0ae0e0 2023-07-24T05:46:35.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.086+0000 7f6bfb59e700 1 -- 172.21.15.77:0/2693578382 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bfc0c4400 con 0x7f6bfc0ae0e0 2023-07-24T05:46:35.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.086+0000 7f6bf2ffd700 1 -- 172.21.15.77:0/2693578382 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bec00cbc0 con 0x7f6bfc0ae0e0 2023-07-24T05:46:35.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.086+0000 7f6bfb59e700 1 -- 172.21.15.77:0/2693578382 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bfc159420 con 0x7f6bfc0ae0e0 2023-07-24T05:46:35.094 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.090+0000 7f6bfb59e700 1 -- 172.21.15.77:0/2693578382 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bfc072490 con 0x7f6bfc0ae0e0 2023-07-24T05:46:35.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.090+0000 7f6bf2ffd700 1 -- 172.21.15.77:0/2693578382 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6bec00cd20 con 0x7f6bfc0ae0e0 2023-07-24T05:46:35.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.094+0000 7f6bf2ffd700 1 --2- 172.21.15.77:0/2693578382 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6be00662f0 0x7f6be00687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:35.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.094+0000 7f6bf2ffd700 1 -- 172.21.15.77:0/2693578382 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6bec084130 con 0x7f6bfc0ae0e0 2023-07-24T05:46:35.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.094+0000 7f6bf3fff700 1 --2- 172.21.15.77:0/2693578382 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6be00662f0 0x7f6be00687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:35.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.094+0000 7f6bf3fff700 1 --2- 172.21.15.77:0/2693578382 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6be00662f0 0x7f6be00687b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc0ae520 tx=0x7f6be4008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:35.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.098+0000 7f6bf2ffd700 1 -- 172.21.15.77:0/2693578382 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6bec051220 con 0x7f6bfc0ae0e0 2023-07-24T05:46:35.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.254+0000 7f6bfb59e700 1 -- 172.21.15.77:0/2693578382 --> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6bfc0aee90 con 0x7f6be00662f0 2023-07-24T05:46:35.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.270+0000 7f6bf2ffd700 1 -- 172.21.15.77:0/2693578382 <== mgr.4108 v2:172.21.15.103:6832/1305366540 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367151 (secure 0 0 0) 0x7f6be4011c00 con 0x7f6be00662f0 2023-07-24T05:46:35.279 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:46:35.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.282+0000 7f6bfb59e700 1 -- 172.21.15.77:0/2693578382 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6be00662f0 msgr2=0x7f6be00687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:35.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.282+0000 7f6bfb59e700 1 --2- 172.21.15.77:0/2693578382 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6be00662f0 0x7f6be00687b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc0ae520 tx=0x7f6be4008030 comp rx=0 tx=0).stop 2023-07-24T05:46:35.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.282+0000 7f6bfb59e700 1 -- 172.21.15.77:0/2693578382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6bfc0ae0e0 msgr2=0x7f6bfc158ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:35.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.282+0000 7f6bfb59e700 1 --2- 172.21.15.77:0/2693578382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6bfc0ae0e0 0x7f6bfc158ee0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6bec00e9d0 tx=0x7f6bec00ece0 comp rx=0 tx=0).stop 2023-07-24T05:46:35.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.282+0000 7f6bfb59e700 1 -- 172.21.15.77:0/2693578382 shutdown_connections 2023-07-24T05:46:35.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.282+0000 7f6bfb59e700 1 --2- 172.21.15.77:0/2693578382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bfc161100 0x7f6bfc163800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:35.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.282+0000 7f6bfb59e700 1 --2- 172.21.15.77:0/2693578382 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6be00662f0 0x7f6be00687b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:35.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.282+0000 7f6bfb59e700 1 --2- 172.21.15.77:0/2693578382 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6bfc160d20 0x7f6bfc1632c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:35.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.282+0000 7f6bfb59e700 1 --2- 172.21.15.77:0/2693578382 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6bfc0ae0e0 0x7f6bfc158ee0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:35.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.282+0000 7f6bfb59e700 1 -- 172.21.15.77:0/2693578382 >> 172.21.15.77:0/2693578382 conn(0x7f6bfc0cacc0 msgr2=0x7f6bfc0cb830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:35.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.282+0000 7f6bfb59e700 1 -- 172.21.15.77:0/2693578382 shutdown_connections 2023-07-24T05:46:35.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.282+0000 7f6bfb59e700 1 -- 172.21.15.77:0/2693578382 wait complete. 2023-07-24T05:46:35.289 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-07-24T05:46:35.306 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2023-07-24T05:46:34.538334+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594959,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219412,"kb_used_data":3260,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755308,"statfs":{"total":773094113280,"available":772869435392,"internally_reserved":0,"allocated":3338240,"data_stored":2049379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005387"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.485697+0000","last_change":"2023-07-24T05:46:05.018571+0000","last_active":"2023-07-24T05:46:07.485697+0000","last_peered":"2023-07-24T05:46:07.485697+0000","last_clean":"2023-07-24T05:46:07.485697+0000","last_became_active":"2023-07-24T05:46:05.017995+0000","last_became_peered":"2023-07-24T05:46:05.017995+0000","last_unstale":"2023-07-24T05:46:07.485697+0000","last_undegraded":"2023-07-24T05:46:07.485697+0000","last_fullsized":"2023-07-24T05:46:07.485697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:09:07.896789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.720068+0000","last_change":"2023-07-24T05:45:59.909905+0000","last_active":"2023-07-24T05:46:06.720068+0000","last_peered":"2023-07-24T05:46:06.720068+0000","last_clean":"2023-07-24T05:46:06.720068+0000","last_became_active":"2023-07-24T05:45:59.909674+0000","last_became_peered":"2023-07-24T05:45:59.909674+0000","last_unstale":"2023-07-24T05:46:06.720068+0000","last_undegraded":"2023-07-24T05:46:06.720068+0000","last_fullsized":"2023-07-24T05:46:06.720068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:52:15.728826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.020712+0000","last_change":"2023-07-24T05:46:00.933508+0000","last_active":"2023-07-24T05:46:06.020712+0000","last_peered":"2023-07-24T05:46:06.020712+0000","last_clean":"2023-07-24T05:46:06.020712+0000","last_became_active":"2023-07-24T05:46:00.933149+0000","last_became_peered":"2023-07-24T05:46:00.933149+0000","last_unstale":"2023-07-24T05:46:06.020712+0000","last_undegraded":"2023-07-24T05:46:06.020712+0000","last_fullsized":"2023-07-24T05:46:06.020712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:48:28.674504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.020411+0000","last_change":"2023-07-24T05:46:05.015347+0000","last_active":"2023-07-24T05:46:06.020411+0000","last_peered":"2023-07-24T05:46:06.020411+0000","last_clean":"2023-07-24T05:46:06.020411+0000","last_became_active":"2023-07-24T05:46:05.014821+0000","last_became_peered":"2023-07-24T05:46:05.014821+0000","last_unstale":"2023-07-24T05:46:06.020411+0000","last_undegraded":"2023-07-24T05:46:06.020411+0000","last_fullsized":"2023-07-24T05:46:06.020411+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:18:33.791257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.484589+0000","last_change":"2023-07-24T05:45:59.894586+0000","last_active":"2023-07-24T05:46:07.484589+0000","last_peered":"2023-07-24T05:46:07.484589+0000","last_clean":"2023-07-24T05:46:07.484589+0000","last_became_active":"2023-07-24T05:45:59.894286+0000","last_became_peered":"2023-07-24T05:45:59.894286+0000","last_unstale":"2023-07-24T05:46:07.484589+0000","last_undegraded":"2023-07-24T05:46:07.484589+0000","last_fullsized":"2023-07-24T05:46:07.484589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:35:04.605981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.484398+0000","last_change":"2023-07-24T05:46:00.933761+0000","last_active":"2023-07-24T05:46:07.484398+0000","last_peered":"2023-07-24T05:46:07.484398+0000","last_clean":"2023-07-24T05:46:07.484398+0000","last_became_active":"2023-07-24T05:46:00.933321+0000","last_became_peered":"2023-07-24T05:46:00.933321+0000","last_unstale":"2023-07-24T05:46:07.484398+0000","last_undegraded":"2023-07-24T05:46:07.484398+0000","last_fullsized":"2023-07-24T05:46:07.484398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:28:13.314710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486274+0000","last_change":"2023-07-24T05:46:05.020875+0000","last_active":"2023-07-24T05:46:07.486274+0000","last_peered":"2023-07-24T05:46:07.486274+0000","last_clean":"2023-07-24T05:46:07.486274+0000","last_became_active":"2023-07-24T05:46:05.020425+0000","last_became_peered":"2023-07-24T05:46:05.020425+0000","last_unstale":"2023-07-24T05:46:07.486274+0000","last_undegraded":"2023-07-24T05:46:07.486274+0000","last_fullsized":"2023-07-24T05:46:07.486274+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T16:13:44.814663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486774+0000","last_change":"2023-07-24T05:45:59.917608+0000","last_active":"2023-07-24T05:46:07.486774+0000","last_peered":"2023-07-24T05:46:07.486774+0000","last_clean":"2023-07-24T05:46:07.486774+0000","last_became_active":"2023-07-24T05:45:59.917276+0000","last_became_peered":"2023-07-24T05:45:59.917276+0000","last_unstale":"2023-07-24T05:46:07.486774+0000","last_undegraded":"2023-07-24T05:46:07.486774+0000","last_fullsized":"2023-07-24T05:46:07.486774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:26:41.573346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.021965+0000","last_change":"2023-07-24T05:46:00.937906+0000","last_active":"2023-07-24T05:46:06.021965+0000","last_peered":"2023-07-24T05:46:06.021965+0000","last_clean":"2023-07-24T05:46:06.021965+0000","last_became_active":"2023-07-24T05:46:00.937395+0000","last_became_peered":"2023-07-24T05:46:00.937395+0000","last_unstale":"2023-07-24T05:46:06.021965+0000","last_undegraded":"2023-07-24T05:46:06.021965+0000","last_fullsized":"2023-07-24T05:46:06.021965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T16:29:11.391157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.481461+0000","last_change":"2023-07-24T05:46:05.025366+0000","last_active":"2023-07-24T05:46:06.481461+0000","last_peered":"2023-07-24T05:46:06.481461+0000","last_clean":"2023-07-24T05:46:06.481461+0000","last_became_active":"2023-07-24T05:46:05.024220+0000","last_became_peered":"2023-07-24T05:46:05.024220+0000","last_unstale":"2023-07-24T05:46:06.481461+0000","last_undegraded":"2023-07-24T05:46:06.481461+0000","last_fullsized":"2023-07-24T05:46:06.481461+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:56:32.485103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486003+0000","last_change":"2023-07-24T05:45:59.917558+0000","last_active":"2023-07-24T05:46:07.486003+0000","last_peered":"2023-07-24T05:46:07.486003+0000","last_clean":"2023-07-24T05:46:07.486003+0000","last_became_active":"2023-07-24T05:45:59.917247+0000","last_became_peered":"2023-07-24T05:45:59.917247+0000","last_unstale":"2023-07-24T05:46:07.486003+0000","last_undegraded":"2023-07-24T05:46:07.486003+0000","last_fullsized":"2023-07-24T05:46:07.486003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:07:11.420006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.022778+0000","last_change":"2023-07-24T05:46:00.937863+0000","last_active":"2023-07-24T05:46:06.022778+0000","last_peered":"2023-07-24T05:46:06.022778+0000","last_clean":"2023-07-24T05:46:06.022778+0000","last_became_active":"2023-07-24T05:46:00.937533+0000","last_became_peered":"2023-07-24T05:46:00.937533+0000","last_unstale":"2023-07-24T05:46:06.022778+0000","last_undegraded":"2023-07-24T05:46:06.022778+0000","last_fullsized":"2023-07-24T05:46:06.022778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:22:28.252629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486901+0000","last_change":"2023-07-24T05:46:05.021105+0000","last_active":"2023-07-24T05:46:07.486901+0000","last_peered":"2023-07-24T05:46:07.486901+0000","last_clean":"2023-07-24T05:46:07.486901+0000","last_became_active":"2023-07-24T05:46:05.020568+0000","last_became_peered":"2023-07-24T05:46:05.020568+0000","last_unstale":"2023-07-24T05:46:07.486901+0000","last_undegraded":"2023-07-24T05:46:07.486901+0000","last_fullsized":"2023-07-24T05:46:07.486901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:37:20.869353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.720347+0000","last_change":"2023-07-24T05:45:59.904446+0000","last_active":"2023-07-24T05:46:06.720347+0000","last_peered":"2023-07-24T05:46:06.720347+0000","last_clean":"2023-07-24T05:46:06.720347+0000","last_became_active":"2023-07-24T05:45:59.900231+0000","last_became_peered":"2023-07-24T05:45:59.900231+0000","last_unstale":"2023-07-24T05:46:06.720347+0000","last_undegraded":"2023-07-24T05:46:06.720347+0000","last_fullsized":"2023-07-24T05:46:06.720347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:44:12.555935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.018863+0000","last_change":"2023-07-24T05:46:00.951996+0000","last_active":"2023-07-24T05:46:06.018863+0000","last_peered":"2023-07-24T05:46:06.018863+0000","last_clean":"2023-07-24T05:46:06.018863+0000","last_became_active":"2023-07-24T05:46:00.951595+0000","last_became_peered":"2023-07-24T05:46:00.951595+0000","last_unstale":"2023-07-24T05:46:06.018863+0000","last_undegraded":"2023-07-24T05:46:06.018863+0000","last_fullsized":"2023-07-24T05:46:06.018863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:12:50.748120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023300+0000","last_change":"2023-07-24T05:46:05.017525+0000","last_active":"2023-07-24T05:46:06.023300+0000","last_peered":"2023-07-24T05:46:06.023300+0000","last_clean":"2023-07-24T05:46:06.023300+0000","last_became_active":"2023-07-24T05:46:05.015341+0000","last_became_peered":"2023-07-24T05:46:05.015341+0000","last_unstale":"2023-07-24T05:46:06.023300+0000","last_undegraded":"2023-07-24T05:46:06.023300+0000","last_fullsized":"2023-07-24T05:46:06.023300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:21:43.930293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.022219+0000","last_change":"2023-07-24T05:45:59.908228+0000","last_active":"2023-07-24T05:46:06.022219+0000","last_peered":"2023-07-24T05:46:06.022219+0000","last_clean":"2023-07-24T05:46:06.022219+0000","last_became_active":"2023-07-24T05:45:59.907944+0000","last_became_peered":"2023-07-24T05:45:59.907944+0000","last_unstale":"2023-07-24T05:46:06.022219+0000","last_undegraded":"2023-07-24T05:46:06.022219+0000","last_fullsized":"2023-07-24T05:46:06.022219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:52:47.698647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.484788+0000","last_change":"2023-07-24T05:46:00.952847+0000","last_active":"2023-07-24T05:46:07.484788+0000","last_peered":"2023-07-24T05:46:07.484788+0000","last_clean":"2023-07-24T05:46:07.484788+0000","last_became_active":"2023-07-24T05:46:00.952573+0000","last_became_peered":"2023-07-24T05:46:00.952573+0000","last_unstale":"2023-07-24T05:46:07.484788+0000","last_undegraded":"2023-07-24T05:46:07.484788+0000","last_fullsized":"2023-07-24T05:46:07.484788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:41:28.929137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.022213+0000","last_change":"2023-07-24T05:46:05.014357+0000","last_active":"2023-07-24T05:46:06.022213+0000","last_peered":"2023-07-24T05:46:06.022213+0000","last_clean":"2023-07-24T05:46:06.022213+0000","last_became_active":"2023-07-24T05:46:05.013964+0000","last_became_peered":"2023-07-24T05:46:05.013964+0000","last_unstale":"2023-07-24T05:46:06.022213+0000","last_undegraded":"2023-07-24T05:46:06.022213+0000","last_fullsized":"2023-07-24T05:46:06.022213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:56:47.701279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486215+0000","last_change":"2023-07-24T05:45:59.907153+0000","last_active":"2023-07-24T05:46:07.486215+0000","last_peered":"2023-07-24T05:46:07.486215+0000","last_clean":"2023-07-24T05:46:07.486215+0000","last_became_active":"2023-07-24T05:45:59.906816+0000","last_became_peered":"2023-07-24T05:45:59.906816+0000","last_unstale":"2023-07-24T05:46:07.486215+0000","last_undegraded":"2023-07-24T05:46:07.486215+0000","last_fullsized":"2023-07-24T05:46:07.486215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T05:59:19.607892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.719904+0000","last_change":"2023-07-24T05:46:00.931260+0000","last_active":"2023-07-24T05:46:06.719904+0000","last_peered":"2023-07-24T05:46:06.719904+0000","last_clean":"2023-07-24T05:46:06.719904+0000","last_became_active":"2023-07-24T05:46:00.930959+0000","last_became_peered":"2023-07-24T05:46:00.930959+0000","last_unstale":"2023-07-24T05:46:06.719904+0000","last_undegraded":"2023-07-24T05:46:06.719904+0000","last_fullsized":"2023-07-24T05:46:06.719904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:56:23.036353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.719736+0000","last_change":"2023-07-24T05:46:05.017693+0000","last_active":"2023-07-24T05:46:06.719736+0000","last_peered":"2023-07-24T05:46:06.719736+0000","last_clean":"2023-07-24T05:46:06.719736+0000","last_became_active":"2023-07-24T05:46:05.015057+0000","last_became_peered":"2023-07-24T05:46:05.015057+0000","last_unstale":"2023-07-24T05:46:06.719736+0000","last_undegraded":"2023-07-24T05:46:06.719736+0000","last_fullsized":"2023-07-24T05:46:06.719736+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:21:43.441226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.483452+0000","last_change":"2023-07-24T05:45:59.908355+0000","last_active":"2023-07-24T05:46:07.483452+0000","last_peered":"2023-07-24T05:46:07.483452+0000","last_clean":"2023-07-24T05:46:07.483452+0000","last_became_active":"2023-07-24T05:45:59.907240+0000","last_became_peered":"2023-07-24T05:45:59.907240+0000","last_unstale":"2023-07-24T05:46:07.483452+0000","last_undegraded":"2023-07-24T05:46:07.483452+0000","last_fullsized":"2023-07-24T05:46:07.483452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:15:19.009984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.022429+0000","last_change":"2023-07-24T05:46:00.933306+0000","last_active":"2023-07-24T05:46:06.022429+0000","last_peered":"2023-07-24T05:46:06.022429+0000","last_clean":"2023-07-24T05:46:06.022429+0000","last_became_active":"2023-07-24T05:46:00.932306+0000","last_became_peered":"2023-07-24T05:46:00.932306+0000","last_unstale":"2023-07-24T05:46:06.022429+0000","last_undegraded":"2023-07-24T05:46:06.022429+0000","last_fullsized":"2023-07-24T05:46:06.022429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:06:46.941549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.483132+0000","last_change":"2023-07-24T05:46:00.941623+0000","last_active":"2023-07-24T05:46:07.483132+0000","last_peered":"2023-07-24T05:46:07.483132+0000","last_clean":"2023-07-24T05:46:07.483132+0000","last_became_active":"2023-07-24T05:46:00.941341+0000","last_became_peered":"2023-07-24T05:46:00.941341+0000","last_unstale":"2023-07-24T05:46:07.483132+0000","last_undegraded":"2023-07-24T05:46:07.483132+0000","last_fullsized":"2023-07-24T05:46:07.483132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:08:22.272136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.720265+0000","last_change":"2023-07-24T05:45:59.909261+0000","last_active":"2023-07-24T05:46:06.720265+0000","last_peered":"2023-07-24T05:46:06.720265+0000","last_clean":"2023-07-24T05:46:06.720265+0000","last_became_active":"2023-07-24T05:45:59.908962+0000","last_became_peered":"2023-07-24T05:45:59.908962+0000","last_unstale":"2023-07-24T05:46:06.720265+0000","last_undegraded":"2023-07-24T05:46:06.720265+0000","last_fullsized":"2023-07-24T05:46:06.720265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:56:19.698866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.021043+0000","last_change":"2023-07-24T05:46:05.012927+0000","last_active":"2023-07-24T05:46:06.021043+0000","last_peered":"2023-07-24T05:46:06.021043+0000","last_clean":"2023-07-24T05:46:06.021043+0000","last_became_active":"2023-07-24T05:46:05.012506+0000","last_became_peered":"2023-07-24T05:46:05.012506+0000","last_unstale":"2023-07-24T05:46:06.021043+0000","last_undegraded":"2023-07-24T05:46:06.021043+0000","last_fullsized":"2023-07-24T05:46:06.021043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:48:07.287011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.483976+0000","last_change":"2023-07-24T05:46:00.931782+0000","last_active":"2023-07-24T05:46:07.483976+0000","last_peered":"2023-07-24T05:46:07.483976+0000","last_clean":"2023-07-24T05:46:07.483976+0000","last_became_active":"2023-07-24T05:46:00.931488+0000","last_became_peered":"2023-07-24T05:46:00.931488+0000","last_unstale":"2023-07-24T05:46:07.483976+0000","last_undegraded":"2023-07-24T05:46:07.483976+0000","last_fullsized":"2023-07-24T05:46:07.483976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:34:32.612133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486848+0000","last_change":"2023-07-24T05:45:59.909882+0000","last_active":"2023-07-24T05:46:07.486848+0000","last_peered":"2023-07-24T05:46:07.486848+0000","last_clean":"2023-07-24T05:46:07.486848+0000","last_became_active":"2023-07-24T05:45:59.909623+0000","last_became_peered":"2023-07-24T05:45:59.909623+0000","last_unstale":"2023-07-24T05:46:07.486848+0000","last_undegraded":"2023-07-24T05:46:07.486848+0000","last_fullsized":"2023-07-24T05:46:07.486848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:39:16.199623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.480977+0000","last_change":"2023-07-24T05:46:05.025942+0000","last_active":"2023-07-24T05:46:06.480977+0000","last_peered":"2023-07-24T05:46:06.480977+0000","last_clean":"2023-07-24T05:46:06.480977+0000","last_became_active":"2023-07-24T05:46:05.025150+0000","last_became_peered":"2023-07-24T05:46:05.025150+0000","last_unstale":"2023-07-24T05:46:06.480977+0000","last_undegraded":"2023-07-24T05:46:06.480977+0000","last_fullsized":"2023-07-24T05:46:06.480977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:18:59.759729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.482301+0000","last_change":"2023-07-24T05:45:59.916471+0000","last_active":"2023-07-24T05:46:06.482301+0000","last_peered":"2023-07-24T05:46:06.482301+0000","last_clean":"2023-07-24T05:46:06.482301+0000","last_became_active":"2023-07-24T05:45:59.914483+0000","last_became_peered":"2023-07-24T05:45:59.914483+0000","last_unstale":"2023-07-24T05:46:06.482301+0000","last_undegraded":"2023-07-24T05:46:06.482301+0000","last_fullsized":"2023-07-24T05:46:06.482301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:14:26.354550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486144+0000","last_change":"2023-07-24T05:46:00.946206+0000","last_active":"2023-07-24T05:46:07.486144+0000","last_peered":"2023-07-24T05:46:07.486144+0000","last_clean":"2023-07-24T05:46:07.486144+0000","last_became_active":"2023-07-24T05:46:00.941357+0000","last_became_peered":"2023-07-24T05:46:00.941357+0000","last_unstale":"2023-07-24T05:46:07.486144+0000","last_undegraded":"2023-07-24T05:46:07.486144+0000","last_fullsized":"2023-07-24T05:46:07.486144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:57:39.660342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.483625+0000","last_change":"2023-07-24T05:46:05.011477+0000","last_active":"2023-07-24T05:46:07.483625+0000","last_peered":"2023-07-24T05:46:07.483625+0000","last_clean":"2023-07-24T05:46:07.483625+0000","last_became_active":"2023-07-24T05:46:05.011080+0000","last_became_peered":"2023-07-24T05:46:05.011080+0000","last_unstale":"2023-07-24T05:46:07.483625+0000","last_undegraded":"2023-07-24T05:46:07.483625+0000","last_fullsized":"2023-07-24T05:46:07.483625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:20:27.076589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"25'10","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:18.816659+0000","last_change":"2023-07-24T05:45:59.909189+0000","last_active":"2023-07-24T05:46:18.816659+0000","last_peered":"2023-07-24T05:46:18.816659+0000","last_clean":"2023-07-24T05:46:18.816659+0000","last_became_active":"2023-07-24T05:45:59.908248+0000","last_became_peered":"2023-07-24T05:45:59.908248+0000","last_unstale":"2023-07-24T05:46:18.816659+0000","last_undegraded":"2023-07-24T05:46:18.816659+0000","last_fullsized":"2023-07-24T05:46:18.816659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:04:41.772179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3793,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023001+0000","last_change":"2023-07-24T05:46:00.930080+0000","last_active":"2023-07-24T05:46:06.023001+0000","last_peered":"2023-07-24T05:46:06.023001+0000","last_clean":"2023-07-24T05:46:06.023001+0000","last_became_active":"2023-07-24T05:46:00.929737+0000","last_became_peered":"2023-07-24T05:46:00.929737+0000","last_unstale":"2023-07-24T05:46:06.023001+0000","last_undegraded":"2023-07-24T05:46:06.023001+0000","last_fullsized":"2023-07-24T05:46:06.023001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:13:45.155446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.485916+0000","last_change":"2023-07-24T05:46:05.017936+0000","last_active":"2023-07-24T05:46:07.485916+0000","last_peered":"2023-07-24T05:46:07.485916+0000","last_clean":"2023-07-24T05:46:07.485916+0000","last_became_active":"2023-07-24T05:46:05.017553+0000","last_became_peered":"2023-07-24T05:46:05.017553+0000","last_unstale":"2023-07-24T05:46:07.485916+0000","last_undegraded":"2023-07-24T05:46:07.485916+0000","last_fullsized":"2023-07-24T05:46:07.485916+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:18:15.042584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.022842+0000","last_change":"2023-07-24T05:46:00.933560+0000","last_active":"2023-07-24T05:46:06.022842+0000","last_peered":"2023-07-24T05:46:06.022842+0000","last_clean":"2023-07-24T05:46:06.022842+0000","last_became_active":"2023-07-24T05:46:00.933176+0000","last_became_peered":"2023-07-24T05:46:00.933176+0000","last_unstale":"2023-07-24T05:46:06.022842+0000","last_undegraded":"2023-07-24T05:46:06.022842+0000","last_fullsized":"2023-07-24T05:46:06.022842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:22:28.734087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.022569+0000","last_change":"2023-07-24T05:45:54.350738+0000","last_active":"2023-07-24T05:46:06.022569+0000","last_peered":"2023-07-24T05:46:06.022569+0000","last_clean":"2023-07-24T05:46:06.022569+0000","last_became_active":"2023-07-24T05:45:54.350347+0000","last_became_peered":"2023-07-24T05:45:54.350347+0000","last_unstale":"2023-07-24T05:46:06.022569+0000","last_undegraded":"2023-07-24T05:46:06.022569+0000","last_fullsized":"2023-07-24T05:46:06.022569+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:15:33.932270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.720381+0000","last_change":"2023-07-24T05:45:59.904262+0000","last_active":"2023-07-24T05:46:06.720381+0000","last_peered":"2023-07-24T05:46:06.720381+0000","last_clean":"2023-07-24T05:46:06.720381+0000","last_became_active":"2023-07-24T05:45:59.901334+0000","last_became_peered":"2023-07-24T05:45:59.901334+0000","last_unstale":"2023-07-24T05:46:06.720381+0000","last_undegraded":"2023-07-24T05:46:06.720381+0000","last_fullsized":"2023-07-24T05:46:06.720381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:58:01.493567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.483100+0000","last_change":"2023-07-24T05:46:05.016239+0000","last_active":"2023-07-24T05:46:07.483100+0000","last_peered":"2023-07-24T05:46:07.483100+0000","last_clean":"2023-07-24T05:46:07.483100+0000","last_became_active":"2023-07-24T05:46:05.015792+0000","last_became_peered":"2023-07-24T05:46:05.015792+0000","last_unstale":"2023-07-24T05:46:07.483100+0000","last_undegraded":"2023-07-24T05:46:07.483100+0000","last_fullsized":"2023-07-24T05:46:07.483100+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:52:03.648761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.483288+0000","last_change":"2023-07-24T05:46:00.933134+0000","last_active":"2023-07-24T05:46:07.483288+0000","last_peered":"2023-07-24T05:46:07.483288+0000","last_clean":"2023-07-24T05:46:07.483288+0000","last_became_active":"2023-07-24T05:46:00.932531+0000","last_became_peered":"2023-07-24T05:46:00.932531+0000","last_unstale":"2023-07-24T05:46:07.483288+0000","last_undegraded":"2023-07-24T05:46:07.483288+0000","last_fullsized":"2023-07-24T05:46:07.483288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:21:40.350408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.487206+0000","last_change":"2023-07-24T05:45:54.346766+0000","last_active":"2023-07-24T05:46:07.487206+0000","last_peered":"2023-07-24T05:46:07.487206+0000","last_clean":"2023-07-24T05:46:07.487206+0000","last_became_active":"2023-07-24T05:45:54.346404+0000","last_became_peered":"2023-07-24T05:45:54.346404+0000","last_unstale":"2023-07-24T05:46:07.487206+0000","last_undegraded":"2023-07-24T05:46:07.487206+0000","last_fullsized":"2023-07-24T05:46:07.487206+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:41:48.652814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.484987+0000","last_change":"2023-07-24T05:45:59.909030+0000","last_active":"2023-07-24T05:46:07.484987+0000","last_peered":"2023-07-24T05:46:07.484987+0000","last_clean":"2023-07-24T05:46:07.484987+0000","last_became_active":"2023-07-24T05:45:59.908731+0000","last_became_peered":"2023-07-24T05:45:59.908731+0000","last_unstale":"2023-07-24T05:46:07.484987+0000","last_undegraded":"2023-07-24T05:46:07.484987+0000","last_fullsized":"2023-07-24T05:46:07.484987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:47:28.208042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.020418+0000","last_change":"2023-07-24T05:46:05.014582+0000","last_active":"2023-07-24T05:46:06.020418+0000","last_peered":"2023-07-24T05:46:06.020418+0000","last_clean":"2023-07-24T05:46:06.020418+0000","last_became_active":"2023-07-24T05:46:05.014202+0000","last_became_peered":"2023-07-24T05:46:05.014202+0000","last_unstale":"2023-07-24T05:46:06.020418+0000","last_undegraded":"2023-07-24T05:46:06.020418+0000","last_fullsized":"2023-07-24T05:46:06.020418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:08:46.149814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.719886+0000","last_change":"2023-07-24T05:46:00.935075+0000","last_active":"2023-07-24T05:46:06.719886+0000","last_peered":"2023-07-24T05:46:06.719886+0000","last_clean":"2023-07-24T05:46:06.719886+0000","last_became_active":"2023-07-24T05:46:00.934789+0000","last_became_peered":"2023-07-24T05:46:00.934789+0000","last_unstale":"2023-07-24T05:46:06.719886+0000","last_undegraded":"2023-07-24T05:46:06.719886+0000","last_fullsized":"2023-07-24T05:46:06.719886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:35:30.780605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.482573+0000","last_change":"2023-07-24T05:45:54.355858+0000","last_active":"2023-07-24T05:46:06.482573+0000","last_peered":"2023-07-24T05:46:06.482573+0000","last_clean":"2023-07-24T05:46:06.482573+0000","last_became_active":"2023-07-24T05:45:54.355598+0000","last_became_peered":"2023-07-24T05:45:54.355598+0000","last_unstale":"2023-07-24T05:46:06.482573+0000","last_undegraded":"2023-07-24T05:46:06.482573+0000","last_fullsized":"2023-07-24T05:46:06.482573+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:04:55.110927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486464+0000","last_change":"2023-07-24T05:45:59.902462+0000","last_active":"2023-07-24T05:46:07.486464+0000","last_peered":"2023-07-24T05:46:07.486464+0000","last_clean":"2023-07-24T05:46:07.486464+0000","last_became_active":"2023-07-24T05:45:59.902137+0000","last_became_peered":"2023-07-24T05:45:59.902137+0000","last_unstale":"2023-07-24T05:46:07.486464+0000","last_undegraded":"2023-07-24T05:46:07.486464+0000","last_fullsized":"2023-07-24T05:46:07.486464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:29:00.215998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.021410+0000","last_change":"2023-07-24T05:46:05.020732+0000","last_active":"2023-07-24T05:46:06.021410+0000","last_peered":"2023-07-24T05:46:06.021410+0000","last_clean":"2023-07-24T05:46:06.021410+0000","last_became_active":"2023-07-24T05:46:05.020404+0000","last_became_peered":"2023-07-24T05:46:05.020404+0000","last_unstale":"2023-07-24T05:46:06.021410+0000","last_undegraded":"2023-07-24T05:46:06.021410+0000","last_fullsized":"2023-07-24T05:46:06.021410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:19:13.139942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486329+0000","last_change":"2023-07-24T05:46:00.932855+0000","last_active":"2023-07-24T05:46:07.486329+0000","last_peered":"2023-07-24T05:46:07.486329+0000","last_clean":"2023-07-24T05:46:07.486329+0000","last_became_active":"2023-07-24T05:46:00.932529+0000","last_became_peered":"2023-07-24T05:46:00.932529+0000","last_unstale":"2023-07-24T05:46:07.486329+0000","last_undegraded":"2023-07-24T05:46:07.486329+0000","last_fullsized":"2023-07-24T05:46:07.486329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:26:42.584506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486661+0000","last_change":"2023-07-24T05:45:54.354128+0000","last_active":"2023-07-24T05:46:07.486661+0000","last_peered":"2023-07-24T05:46:07.486661+0000","last_clean":"2023-07-24T05:46:07.486661+0000","last_became_active":"2023-07-24T05:45:54.353816+0000","last_became_peered":"2023-07-24T05:45:54.353816+0000","last_unstale":"2023-07-24T05:46:07.486661+0000","last_undegraded":"2023-07-24T05:46:07.486661+0000","last_fullsized":"2023-07-24T05:46:07.486661+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:18:49.117398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486818+0000","last_change":"2023-07-24T05:45:59.910016+0000","last_active":"2023-07-24T05:46:07.486818+0000","last_peered":"2023-07-24T05:46:07.486818+0000","last_clean":"2023-07-24T05:46:07.486818+0000","last_became_active":"2023-07-24T05:45:59.909740+0000","last_became_peered":"2023-07-24T05:45:59.909740+0000","last_unstale":"2023-07-24T05:46:07.486818+0000","last_undegraded":"2023-07-24T05:46:07.486818+0000","last_fullsized":"2023-07-24T05:46:07.486818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:29:00.215998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.719697+0000","last_change":"2023-07-24T05:46:05.024839+0000","last_active":"2023-07-24T05:46:06.719697+0000","last_peered":"2023-07-24T05:46:06.719697+0000","last_clean":"2023-07-24T05:46:06.719697+0000","last_became_active":"2023-07-24T05:46:05.024447+0000","last_became_peered":"2023-07-24T05:46:05.024447+0000","last_unstale":"2023-07-24T05:46:06.719697+0000","last_undegraded":"2023-07-24T05:46:06.719697+0000","last_fullsized":"2023-07-24T05:46:06.719697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:39:44.669092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486397+0000","last_change":"2023-07-24T05:46:00.938782+0000","last_active":"2023-07-24T05:46:07.486397+0000","last_peered":"2023-07-24T05:46:07.486397+0000","last_clean":"2023-07-24T05:46:07.486397+0000","last_became_active":"2023-07-24T05:46:00.938402+0000","last_became_peered":"2023-07-24T05:46:00.938402+0000","last_unstale":"2023-07-24T05:46:07.486397+0000","last_undegraded":"2023-07-24T05:46:07.486397+0000","last_fullsized":"2023-07-24T05:46:07.486397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:18:26.734018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023120+0000","last_change":"2023-07-24T05:45:59.909892+0000","last_active":"2023-07-24T05:46:06.023120+0000","last_peered":"2023-07-24T05:46:06.023120+0000","last_clean":"2023-07-24T05:46:06.023120+0000","last_became_active":"2023-07-24T05:45:59.909552+0000","last_became_peered":"2023-07-24T05:45:59.909552+0000","last_unstale":"2023-07-24T05:46:06.023120+0000","last_undegraded":"2023-07-24T05:46:06.023120+0000","last_fullsized":"2023-07-24T05:46:06.023120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:32:56.241515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486150+0000","last_change":"2023-07-24T05:45:54.353232+0000","last_active":"2023-07-24T05:46:07.486150+0000","last_peered":"2023-07-24T05:46:07.486150+0000","last_clean":"2023-07-24T05:46:07.486150+0000","last_became_active":"2023-07-24T05:45:54.352983+0000","last_became_peered":"2023-07-24T05:45:54.352983+0000","last_unstale":"2023-07-24T05:46:07.486150+0000","last_undegraded":"2023-07-24T05:46:07.486150+0000","last_fullsized":"2023-07-24T05:46:07.486150+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:13:51.706275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.720334+0000","last_change":"2023-07-24T05:46:05.026068+0000","last_active":"2023-07-24T05:46:06.720334+0000","last_peered":"2023-07-24T05:46:06.720334+0000","last_clean":"2023-07-24T05:46:06.720334+0000","last_became_active":"2023-07-24T05:46:05.025042+0000","last_became_peered":"2023-07-24T05:46:05.025042+0000","last_unstale":"2023-07-24T05:46:06.720334+0000","last_undegraded":"2023-07-24T05:46:06.720334+0000","last_fullsized":"2023-07-24T05:46:06.720334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:35:03.922426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.487482+0000","last_change":"2023-07-24T05:46:00.937728+0000","last_active":"2023-07-24T05:46:07.487482+0000","last_peered":"2023-07-24T05:46:07.487482+0000","last_clean":"2023-07-24T05:46:07.487482+0000","last_became_active":"2023-07-24T05:46:00.937334+0000","last_became_peered":"2023-07-24T05:46:00.937334+0000","last_unstale":"2023-07-24T05:46:07.487482+0000","last_undegraded":"2023-07-24T05:46:07.487482+0000","last_fullsized":"2023-07-24T05:46:07.487482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:44:23.859944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.485666+0000","last_change":"2023-07-24T05:45:59.902663+0000","last_active":"2023-07-24T05:46:07.485666+0000","last_peered":"2023-07-24T05:46:07.485666+0000","last_clean":"2023-07-24T05:46:07.485666+0000","last_became_active":"2023-07-24T05:45:59.902383+0000","last_became_peered":"2023-07-24T05:45:59.902383+0000","last_unstale":"2023-07-24T05:46:07.485666+0000","last_undegraded":"2023-07-24T05:46:07.485666+0000","last_fullsized":"2023-07-24T05:46:07.485666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T05:47:06.412190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.017303+0000","last_change":"2023-07-24T05:45:54.349000+0000","last_active":"2023-07-24T05:46:06.017303+0000","last_peered":"2023-07-24T05:46:06.017303+0000","last_clean":"2023-07-24T05:46:06.017303+0000","last_became_active":"2023-07-24T05:45:54.348646+0000","last_became_peered":"2023-07-24T05:45:54.348646+0000","last_unstale":"2023-07-24T05:46:06.017303+0000","last_undegraded":"2023-07-24T05:46:06.017303+0000","last_fullsized":"2023-07-24T05:46:06.017303+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:25:22.452188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.018595+0000","last_change":"2023-07-24T05:46:05.015931+0000","last_active":"2023-07-24T05:46:06.018595+0000","last_peered":"2023-07-24T05:46:06.018595+0000","last_clean":"2023-07-24T05:46:06.018595+0000","last_became_active":"2023-07-24T05:46:05.013649+0000","last_became_peered":"2023-07-24T05:46:05.013649+0000","last_unstale":"2023-07-24T05:46:06.018595+0000","last_undegraded":"2023-07-24T05:46:06.018595+0000","last_fullsized":"2023-07-24T05:46:06.018595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:02:14.273821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.720047+0000","last_change":"2023-07-24T05:46:00.942679+0000","last_active":"2023-07-24T05:46:06.720047+0000","last_peered":"2023-07-24T05:46:06.720047+0000","last_clean":"2023-07-24T05:46:06.720047+0000","last_became_active":"2023-07-24T05:46:00.941904+0000","last_became_peered":"2023-07-24T05:46:00.941904+0000","last_unstale":"2023-07-24T05:46:06.720047+0000","last_undegraded":"2023-07-24T05:46:06.720047+0000","last_fullsized":"2023-07-24T05:46:06.720047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:37:25.195905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.718941+0000","last_change":"2023-07-24T05:45:59.905040+0000","last_active":"2023-07-24T05:46:06.718941+0000","last_peered":"2023-07-24T05:46:06.718941+0000","last_clean":"2023-07-24T05:46:06.718941+0000","last_became_active":"2023-07-24T05:45:59.904704+0000","last_became_peered":"2023-07-24T05:45:59.904704+0000","last_unstale":"2023-07-24T05:46:06.718941+0000","last_undegraded":"2023-07-24T05:46:06.718941+0000","last_fullsized":"2023-07-24T05:46:06.718941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:14:26.074102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.481364+0000","last_change":"2023-07-24T05:45:54.350803+0000","last_active":"2023-07-24T05:46:06.481364+0000","last_peered":"2023-07-24T05:46:06.481364+0000","last_clean":"2023-07-24T05:46:06.481364+0000","last_became_active":"2023-07-24T05:45:54.350427+0000","last_became_peered":"2023-07-24T05:45:54.350427+0000","last_unstale":"2023-07-24T05:46:06.481364+0000","last_undegraded":"2023-07-24T05:46:06.481364+0000","last_fullsized":"2023-07-24T05:46:06.481364+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:41:48.652814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486965+0000","last_change":"2023-07-24T05:46:05.021436+0000","last_active":"2023-07-24T05:46:07.486965+0000","last_peered":"2023-07-24T05:46:07.486965+0000","last_clean":"2023-07-24T05:46:07.486965+0000","last_became_active":"2023-07-24T05:46:05.020835+0000","last_became_peered":"2023-07-24T05:46:05.020835+0000","last_unstale":"2023-07-24T05:46:07.486965+0000","last_undegraded":"2023-07-24T05:46:07.486965+0000","last_fullsized":"2023-07-24T05:46:07.486965+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:37:20.869353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.021744+0000","last_change":"2023-07-24T05:46:00.936580+0000","last_active":"2023-07-24T05:46:06.021744+0000","last_peered":"2023-07-24T05:46:06.021744+0000","last_clean":"2023-07-24T05:46:06.021744+0000","last_became_active":"2023-07-24T05:46:00.936229+0000","last_became_peered":"2023-07-24T05:46:00.936229+0000","last_unstale":"2023-07-24T05:46:06.021744+0000","last_undegraded":"2023-07-24T05:46:06.021744+0000","last_fullsized":"2023-07-24T05:46:06.021744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:56:32.104824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.483869+0000","last_change":"2023-07-24T05:45:59.909952+0000","last_active":"2023-07-24T05:46:07.483869+0000","last_peered":"2023-07-24T05:46:07.483869+0000","last_clean":"2023-07-24T05:46:07.483869+0000","last_became_active":"2023-07-24T05:45:59.909649+0000","last_became_peered":"2023-07-24T05:45:59.909649+0000","last_unstale":"2023-07-24T05:46:07.483869+0000","last_undegraded":"2023-07-24T05:46:07.483869+0000","last_fullsized":"2023-07-24T05:46:07.483869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T16:11:54.051701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486355+0000","last_change":"2023-07-24T05:45:54.351103+0000","last_active":"2023-07-24T05:46:07.486355+0000","last_peered":"2023-07-24T05:46:07.486355+0000","last_clean":"2023-07-24T05:46:07.486355+0000","last_became_active":"2023-07-24T05:45:54.350628+0000","last_became_peered":"2023-07-24T05:45:54.350628+0000","last_unstale":"2023-07-24T05:46:07.486355+0000","last_undegraded":"2023-07-24T05:46:07.486355+0000","last_fullsized":"2023-07-24T05:46:07.486355+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T05:47:00.879682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":177,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.481430+0000","last_change":"2023-07-24T05:45:54.356765+0000","last_active":"2023-07-24T05:46:06.481430+0000","last_peered":"2023-07-24T05:46:06.481430+0000","last_clean":"2023-07-24T05:46:06.481430+0000","last_became_active":"2023-07-24T05:45:54.355687+0000","last_became_peered":"2023-07-24T05:45:54.355687+0000","last_unstale":"2023-07-24T05:46:06.481430+0000","last_undegraded":"2023-07-24T05:46:06.481430+0000","last_fullsized":"2023-07-24T05:46:06.481430+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:54:08.245065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.481843+0000","last_change":"2023-07-24T05:46:05.031446+0000","last_active":"2023-07-24T05:46:06.481843+0000","last_peered":"2023-07-24T05:46:06.481843+0000","last_clean":"2023-07-24T05:46:06.481843+0000","last_became_active":"2023-07-24T05:46:05.024845+0000","last_became_peered":"2023-07-24T05:46:05.024845+0000","last_unstale":"2023-07-24T05:46:06.481843+0000","last_undegraded":"2023-07-24T05:46:06.481843+0000","last_fullsized":"2023-07-24T05:46:06.481843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:21:24.557827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.487407+0000","last_change":"2023-07-24T05:46:00.951820+0000","last_active":"2023-07-24T05:46:07.487407+0000","last_peered":"2023-07-24T05:46:07.487407+0000","last_clean":"2023-07-24T05:46:07.487407+0000","last_became_active":"2023-07-24T05:46:00.951559+0000","last_became_peered":"2023-07-24T05:46:00.951559+0000","last_unstale":"2023-07-24T05:46:07.487407+0000","last_undegraded":"2023-07-24T05:46:07.487407+0000","last_fullsized":"2023-07-24T05:46:07.487407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:54:14.788733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.483532+0000","last_change":"2023-07-24T05:45:59.900996+0000","last_active":"2023-07-24T05:46:07.483532+0000","last_peered":"2023-07-24T05:46:07.483532+0000","last_clean":"2023-07-24T05:46:07.483532+0000","last_became_active":"2023-07-24T05:45:59.900724+0000","last_became_peered":"2023-07-24T05:45:59.900724+0000","last_unstale":"2023-07-24T05:46:07.483532+0000","last_undegraded":"2023-07-24T05:46:07.483532+0000","last_fullsized":"2023-07-24T05:46:07.483532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T05:50:54.789729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023915+0000","last_change":"2023-07-24T05:46:05.016680+0000","last_active":"2023-07-24T05:46:06.023915+0000","last_peered":"2023-07-24T05:46:06.023915+0000","last_clean":"2023-07-24T05:46:06.023915+0000","last_became_active":"2023-07-24T05:46:05.016328+0000","last_became_peered":"2023-07-24T05:46:05.016328+0000","last_unstale":"2023-07-24T05:46:06.023915+0000","last_undegraded":"2023-07-24T05:46:06.023915+0000","last_fullsized":"2023-07-24T05:46:06.023915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:23:56.011534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023923+0000","last_change":"2023-07-24T05:46:00.929728+0000","last_active":"2023-07-24T05:46:06.023923+0000","last_peered":"2023-07-24T05:46:06.023923+0000","last_clean":"2023-07-24T05:46:06.023923+0000","last_became_active":"2023-07-24T05:46:00.929370+0000","last_became_peered":"2023-07-24T05:46:00.929370+0000","last_unstale":"2023-07-24T05:46:06.023923+0000","last_undegraded":"2023-07-24T05:46:06.023923+0000","last_fullsized":"2023-07-24T05:46:06.023923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:21:03.638024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.022985+0000","last_change":"2023-07-24T05:45:59.898271+0000","last_active":"2023-07-24T05:46:06.022985+0000","last_peered":"2023-07-24T05:46:06.022985+0000","last_clean":"2023-07-24T05:46:06.022985+0000","last_became_active":"2023-07-24T05:45:59.897886+0000","last_became_peered":"2023-07-24T05:45:59.897886+0000","last_unstale":"2023-07-24T05:46:06.022985+0000","last_undegraded":"2023-07-24T05:46:06.022985+0000","last_fullsized":"2023-07-24T05:46:06.022985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:25:43.491840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486953+0000","last_change":"2023-07-24T05:46:05.028021+0000","last_active":"2023-07-24T05:46:07.486953+0000","last_peered":"2023-07-24T05:46:07.486953+0000","last_clean":"2023-07-24T05:46:07.486953+0000","last_became_active":"2023-07-24T05:46:05.027497+0000","last_became_peered":"2023-07-24T05:46:05.027497+0000","last_unstale":"2023-07-24T05:46:07.486953+0000","last_undegraded":"2023-07-24T05:46:07.486953+0000","last_fullsized":"2023-07-24T05:46:07.486953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:18:59.759729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023787+0000","last_change":"2023-07-24T05:46:00.934906+0000","last_active":"2023-07-24T05:46:06.023787+0000","last_peered":"2023-07-24T05:46:06.023787+0000","last_clean":"2023-07-24T05:46:06.023787+0000","last_became_active":"2023-07-24T05:46:00.934638+0000","last_became_peered":"2023-07-24T05:46:00.934638+0000","last_unstale":"2023-07-24T05:46:06.023787+0000","last_undegraded":"2023-07-24T05:46:06.023787+0000","last_fullsized":"2023-07-24T05:46:06.023787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:41:49.497015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.021959+0000","last_change":"2023-07-24T05:45:59.905289+0000","last_active":"2023-07-24T05:46:06.021959+0000","last_peered":"2023-07-24T05:46:06.021959+0000","last_clean":"2023-07-24T05:46:06.021959+0000","last_became_active":"2023-07-24T05:45:59.904879+0000","last_became_peered":"2023-07-24T05:45:59.904879+0000","last_unstale":"2023-07-24T05:46:06.021959+0000","last_undegraded":"2023-07-24T05:46:06.021959+0000","last_fullsized":"2023-07-24T05:46:06.021959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:27:08.531843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486029+0000","last_change":"2023-07-24T05:46:05.027486+0000","last_active":"2023-07-24T05:46:07.486029+0000","last_peered":"2023-07-24T05:46:07.486029+0000","last_clean":"2023-07-24T05:46:07.486029+0000","last_became_active":"2023-07-24T05:46:05.027085+0000","last_became_peered":"2023-07-24T05:46:05.027085+0000","last_unstale":"2023-07-24T05:46:07.486029+0000","last_undegraded":"2023-07-24T05:46:07.486029+0000","last_fullsized":"2023-07-24T05:46:07.486029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:16:02.948425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023538+0000","last_change":"2023-07-24T05:46:00.934235+0000","last_active":"2023-07-24T05:46:06.023538+0000","last_peered":"2023-07-24T05:46:06.023538+0000","last_clean":"2023-07-24T05:46:06.023538+0000","last_became_active":"2023-07-24T05:46:00.933521+0000","last_became_peered":"2023-07-24T05:46:00.933521+0000","last_unstale":"2023-07-24T05:46:06.023538+0000","last_undegraded":"2023-07-24T05:46:06.023538+0000","last_fullsized":"2023-07-24T05:46:06.023538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:20:03.823702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.484224+0000","last_change":"2023-07-24T05:45:59.908218+0000","last_active":"2023-07-24T05:46:07.484224+0000","last_peered":"2023-07-24T05:46:07.484224+0000","last_clean":"2023-07-24T05:46:07.484224+0000","last_became_active":"2023-07-24T05:45:59.905094+0000","last_became_peered":"2023-07-24T05:45:59.905094+0000","last_unstale":"2023-07-24T05:46:07.484224+0000","last_undegraded":"2023-07-24T05:46:07.484224+0000","last_fullsized":"2023-07-24T05:46:07.484224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:59:25.131271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.018333+0000","last_change":"2023-07-24T05:46:05.014000+0000","last_active":"2023-07-24T05:46:06.018333+0000","last_peered":"2023-07-24T05:46:06.018333+0000","last_clean":"2023-07-24T05:46:06.018333+0000","last_became_active":"2023-07-24T05:46:05.013545+0000","last_became_peered":"2023-07-24T05:46:05.013545+0000","last_unstale":"2023-07-24T05:46:06.018333+0000","last_undegraded":"2023-07-24T05:46:06.018333+0000","last_fullsized":"2023-07-24T05:46:06.018333+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:30:34.177072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.719968+0000","last_change":"2023-07-24T05:46:00.942615+0000","last_active":"2023-07-24T05:46:06.719968+0000","last_peered":"2023-07-24T05:46:06.719968+0000","last_clean":"2023-07-24T05:46:06.719968+0000","last_became_active":"2023-07-24T05:46:00.942343+0000","last_became_peered":"2023-07-24T05:46:00.942343+0000","last_unstale":"2023-07-24T05:46:06.719968+0000","last_undegraded":"2023-07-24T05:46:06.719968+0000","last_fullsized":"2023-07-24T05:46:06.719968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:16:15.816474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486385+0000","last_change":"2023-07-24T05:45:59.904112+0000","last_active":"2023-07-24T05:46:07.486385+0000","last_peered":"2023-07-24T05:46:07.486385+0000","last_clean":"2023-07-24T05:46:07.486385+0000","last_became_active":"2023-07-24T05:45:59.903760+0000","last_became_peered":"2023-07-24T05:45:59.903760+0000","last_unstale":"2023-07-24T05:46:07.486385+0000","last_undegraded":"2023-07-24T05:46:07.486385+0000","last_fullsized":"2023-07-24T05:46:07.486385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:18:09.932761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.017429+0000","last_change":"2023-07-24T05:46:05.014076+0000","last_active":"2023-07-24T05:46:06.017429+0000","last_peered":"2023-07-24T05:46:06.017429+0000","last_clean":"2023-07-24T05:46:06.017429+0000","last_became_active":"2023-07-24T05:46:05.013619+0000","last_became_peered":"2023-07-24T05:46:05.013619+0000","last_unstale":"2023-07-24T05:46:06.017429+0000","last_undegraded":"2023-07-24T05:46:06.017429+0000","last_fullsized":"2023-07-24T05:46:06.017429+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:43:11.918523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.021542+0000","last_change":"2023-07-24T05:46:00.940659+0000","last_active":"2023-07-24T05:46:06.021542+0000","last_peered":"2023-07-24T05:46:06.021542+0000","last_clean":"2023-07-24T05:46:06.021542+0000","last_became_active":"2023-07-24T05:46:00.940369+0000","last_became_peered":"2023-07-24T05:46:00.940369+0000","last_unstale":"2023-07-24T05:46:06.021542+0000","last_undegraded":"2023-07-24T05:46:06.021542+0000","last_fullsized":"2023-07-24T05:46:06.021542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:52:54.919489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.482583+0000","last_change":"2023-07-24T05:45:59.912501+0000","last_active":"2023-07-24T05:46:06.482583+0000","last_peered":"2023-07-24T05:46:06.482583+0000","last_clean":"2023-07-24T05:46:06.482583+0000","last_became_active":"2023-07-24T05:45:59.912147+0000","last_became_peered":"2023-07-24T05:45:59.912147+0000","last_unstale":"2023-07-24T05:46:06.482583+0000","last_undegraded":"2023-07-24T05:46:06.482583+0000","last_fullsized":"2023-07-24T05:46:06.482583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:21:00.823778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.018222+0000","last_change":"2023-07-24T05:46:05.015069+0000","last_active":"2023-07-24T05:46:06.018222+0000","last_peered":"2023-07-24T05:46:06.018222+0000","last_clean":"2023-07-24T05:46:06.018222+0000","last_became_active":"2023-07-24T05:46:05.014697+0000","last_became_peered":"2023-07-24T05:46:05.014697+0000","last_unstale":"2023-07-24T05:46:06.018222+0000","last_undegraded":"2023-07-24T05:46:06.018222+0000","last_fullsized":"2023-07-24T05:46:06.018222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:20:31.902334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.020882+0000","last_change":"2023-07-24T05:46:00.943156+0000","last_active":"2023-07-24T05:46:06.020882+0000","last_peered":"2023-07-24T05:46:06.020882+0000","last_clean":"2023-07-24T05:46:06.020882+0000","last_became_active":"2023-07-24T05:46:00.942833+0000","last_became_peered":"2023-07-24T05:46:00.942833+0000","last_unstale":"2023-07-24T05:46:06.020882+0000","last_undegraded":"2023-07-24T05:46:06.020882+0000","last_fullsized":"2023-07-24T05:46:06.020882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:20:21.843640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.482833+0000","last_change":"2023-07-24T05:45:59.915627+0000","last_active":"2023-07-24T05:46:06.482833+0000","last_peered":"2023-07-24T05:46:06.482833+0000","last_clean":"2023-07-24T05:46:06.482833+0000","last_became_active":"2023-07-24T05:45:59.914637+0000","last_became_peered":"2023-07-24T05:45:59.914637+0000","last_unstale":"2023-07-24T05:46:06.482833+0000","last_undegraded":"2023-07-24T05:46:06.482833+0000","last_fullsized":"2023-07-24T05:46:06.482833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:39:35.102402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.017196+0000","last_change":"2023-07-24T05:46:05.011172+0000","last_active":"2023-07-24T05:46:06.017196+0000","last_peered":"2023-07-24T05:46:06.017196+0000","last_clean":"2023-07-24T05:46:06.017196+0000","last_became_active":"2023-07-24T05:46:05.010777+0000","last_became_peered":"2023-07-24T05:46:05.010777+0000","last_unstale":"2023-07-24T05:46:06.017196+0000","last_undegraded":"2023-07-24T05:46:06.017196+0000","last_fullsized":"2023-07-24T05:46:06.017196+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:26:39.193132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.485649+0000","last_change":"2023-07-24T05:46:00.934405+0000","last_active":"2023-07-24T05:46:07.485649+0000","last_peered":"2023-07-24T05:46:07.485649+0000","last_clean":"2023-07-24T05:46:07.485649+0000","last_became_active":"2023-07-24T05:46:00.934126+0000","last_became_peered":"2023-07-24T05:46:00.934126+0000","last_unstale":"2023-07-24T05:46:07.485649+0000","last_undegraded":"2023-07-24T05:46:07.485649+0000","last_fullsized":"2023-07-24T05:46:07.485649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:05:57.654666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.482743+0000","last_change":"2023-07-24T05:45:59.917679+0000","last_active":"2023-07-24T05:46:06.482743+0000","last_peered":"2023-07-24T05:46:06.482743+0000","last_clean":"2023-07-24T05:46:06.482743+0000","last_became_active":"2023-07-24T05:45:59.917405+0000","last_became_peered":"2023-07-24T05:45:59.917405+0000","last_unstale":"2023-07-24T05:46:06.482743+0000","last_undegraded":"2023-07-24T05:46:06.482743+0000","last_fullsized":"2023-07-24T05:46:06.482743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:34:24.141383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.481505+0000","last_change":"2023-07-24T05:46:05.024741+0000","last_active":"2023-07-24T05:46:06.481505+0000","last_peered":"2023-07-24T05:46:06.481505+0000","last_clean":"2023-07-24T05:46:06.481505+0000","last_became_active":"2023-07-24T05:46:05.024355+0000","last_became_peered":"2023-07-24T05:46:05.024355+0000","last_unstale":"2023-07-24T05:46:06.481505+0000","last_undegraded":"2023-07-24T05:46:06.481505+0000","last_fullsized":"2023-07-24T05:46:06.481505+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:01:06.159423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486150+0000","last_change":"2023-07-24T05:46:05.025607+0000","last_active":"2023-07-24T05:46:07.486150+0000","last_peered":"2023-07-24T05:46:07.486150+0000","last_clean":"2023-07-24T05:46:07.486150+0000","last_became_active":"2023-07-24T05:46:05.025184+0000","last_became_peered":"2023-07-24T05:46:05.025184+0000","last_unstale":"2023-07-24T05:46:07.486150+0000","last_undegraded":"2023-07-24T05:46:07.486150+0000","last_fullsized":"2023-07-24T05:46:07.486150+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:07:04.576293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.020902+0000","last_change":"2023-07-24T05:45:59.893932+0000","last_active":"2023-07-24T05:46:06.020902+0000","last_peered":"2023-07-24T05:46:06.020902+0000","last_clean":"2023-07-24T05:46:06.020902+0000","last_became_active":"2023-07-24T05:45:59.893642+0000","last_became_peered":"2023-07-24T05:45:59.893642+0000","last_unstale":"2023-07-24T05:46:06.020902+0000","last_undegraded":"2023-07-24T05:46:06.020902+0000","last_fullsized":"2023-07-24T05:46:06.020902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:52:27.141526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.484842+0000","last_change":"2023-07-24T05:46:00.945824+0000","last_active":"2023-07-24T05:46:07.484842+0000","last_peered":"2023-07-24T05:46:07.484842+0000","last_clean":"2023-07-24T05:46:07.484842+0000","last_became_active":"2023-07-24T05:46:00.945507+0000","last_became_peered":"2023-07-24T05:46:00.945507+0000","last_unstale":"2023-07-24T05:46:07.484842+0000","last_undegraded":"2023-07-24T05:46:07.484842+0000","last_fullsized":"2023-07-24T05:46:07.484842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:45:28.785621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.484595+0000","last_change":"2023-07-24T05:46:05.012722+0000","last_active":"2023-07-24T05:46:07.484595+0000","last_peered":"2023-07-24T05:46:07.484595+0000","last_clean":"2023-07-24T05:46:07.484595+0000","last_became_active":"2023-07-24T05:46:05.012277+0000","last_became_peered":"2023-07-24T05:46:05.012277+0000","last_unstale":"2023-07-24T05:46:07.484595+0000","last_undegraded":"2023-07-24T05:46:07.484595+0000","last_fullsized":"2023-07-24T05:46:07.484595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:52:02.115068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.481785+0000","last_change":"2023-07-24T05:45:59.917206+0000","last_active":"2023-07-24T05:46:06.481785+0000","last_peered":"2023-07-24T05:46:06.481785+0000","last_clean":"2023-07-24T05:46:06.481785+0000","last_became_active":"2023-07-24T05:45:59.916943+0000","last_became_peered":"2023-07-24T05:45:59.916943+0000","last_unstale":"2023-07-24T05:46:06.481785+0000","last_undegraded":"2023-07-24T05:46:06.481785+0000","last_fullsized":"2023-07-24T05:46:06.481785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:27:17.744313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.720189+0000","last_change":"2023-07-24T05:46:00.936641+0000","last_active":"2023-07-24T05:46:06.720189+0000","last_peered":"2023-07-24T05:46:06.720189+0000","last_clean":"2023-07-24T05:46:06.720189+0000","last_became_active":"2023-07-24T05:46:00.936319+0000","last_became_peered":"2023-07-24T05:46:00.936319+0000","last_unstale":"2023-07-24T05:46:06.720189+0000","last_undegraded":"2023-07-24T05:46:06.720189+0000","last_fullsized":"2023-07-24T05:46:06.720189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:10:55.303833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.719149+0000","last_change":"2023-07-24T05:45:59.900013+0000","last_active":"2023-07-24T05:46:06.719149+0000","last_peered":"2023-07-24T05:46:06.719149+0000","last_clean":"2023-07-24T05:46:06.719149+0000","last_became_active":"2023-07-24T05:45:59.899700+0000","last_became_peered":"2023-07-24T05:45:59.899700+0000","last_unstale":"2023-07-24T05:46:06.719149+0000","last_undegraded":"2023-07-24T05:46:06.719149+0000","last_fullsized":"2023-07-24T05:46:06.719149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:33:29.936263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486499+0000","last_change":"2023-07-24T05:46:00.940858+0000","last_active":"2023-07-24T05:46:07.486499+0000","last_peered":"2023-07-24T05:46:07.486499+0000","last_clean":"2023-07-24T05:46:07.486499+0000","last_became_active":"2023-07-24T05:46:00.940529+0000","last_became_peered":"2023-07-24T05:46:00.940529+0000","last_unstale":"2023-07-24T05:46:07.486499+0000","last_undegraded":"2023-07-24T05:46:07.486499+0000","last_fullsized":"2023-07-24T05:46:07.486499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:15:58.849762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.483911+0000","last_change":"2023-07-24T05:46:05.014910+0000","last_active":"2023-07-24T05:46:07.483911+0000","last_peered":"2023-07-24T05:46:07.483911+0000","last_clean":"2023-07-24T05:46:07.483911+0000","last_became_active":"2023-07-24T05:46:05.014511+0000","last_became_peered":"2023-07-24T05:46:05.014511+0000","last_unstale":"2023-07-24T05:46:07.483911+0000","last_undegraded":"2023-07-24T05:46:07.483911+0000","last_fullsized":"2023-07-24T05:46:07.483911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:34:15.032724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.481980+0000","last_change":"2023-07-24T05:45:59.916266+0000","last_active":"2023-07-24T05:46:06.481980+0000","last_peered":"2023-07-24T05:46:06.481980+0000","last_clean":"2023-07-24T05:46:06.481980+0000","last_became_active":"2023-07-24T05:45:59.914544+0000","last_became_peered":"2023-07-24T05:45:59.914544+0000","last_unstale":"2023-07-24T05:46:06.481980+0000","last_undegraded":"2023-07-24T05:46:06.481980+0000","last_fullsized":"2023-07-24T05:46:06.481980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:33:27.607916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.484475+0000","last_change":"2023-07-24T05:46:00.953089+0000","last_active":"2023-07-24T05:46:07.484475+0000","last_peered":"2023-07-24T05:46:07.484475+0000","last_clean":"2023-07-24T05:46:07.484475+0000","last_became_active":"2023-07-24T05:46:00.952556+0000","last_became_peered":"2023-07-24T05:46:00.952556+0000","last_unstale":"2023-07-24T05:46:07.484475+0000","last_undegraded":"2023-07-24T05:46:07.484475+0000","last_fullsized":"2023-07-24T05:46:07.484475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:17:13.270600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486360+0000","last_change":"2023-07-24T05:46:05.019474+0000","last_active":"2023-07-24T05:46:07.486360+0000","last_peered":"2023-07-24T05:46:07.486360+0000","last_clean":"2023-07-24T05:46:07.486360+0000","last_became_active":"2023-07-24T05:46:05.019086+0000","last_became_peered":"2023-07-24T05:46:05.019086+0000","last_unstale":"2023-07-24T05:46:07.486360+0000","last_undegraded":"2023-07-24T05:46:07.486360+0000","last_fullsized":"2023-07-24T05:46:07.486360+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:09:07.896789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.020739+0000","last_change":"2023-07-24T05:46:00.936747+0000","last_active":"2023-07-24T05:46:06.020739+0000","last_peered":"2023-07-24T05:46:06.020739+0000","last_clean":"2023-07-24T05:46:06.020739+0000","last_became_active":"2023-07-24T05:46:00.936461+0000","last_became_peered":"2023-07-24T05:46:00.936461+0000","last_unstale":"2023-07-24T05:46:06.020739+0000","last_undegraded":"2023-07-24T05:46:06.020739+0000","last_fullsized":"2023-07-24T05:46:06.020739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:55:23.971299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.483640+0000","last_change":"2023-07-24T05:46:00.943313+0000","last_active":"2023-07-24T05:46:07.483640+0000","last_peered":"2023-07-24T05:46:07.483640+0000","last_clean":"2023-07-24T05:46:07.483640+0000","last_became_active":"2023-07-24T05:46:00.943036+0000","last_became_peered":"2023-07-24T05:46:00.943036+0000","last_unstale":"2023-07-24T05:46:07.483640+0000","last_undegraded":"2023-07-24T05:46:07.483640+0000","last_fullsized":"2023-07-24T05:46:07.483640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:00:32.924792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023237+0000","last_change":"2023-07-24T05:46:00.930795+0000","last_active":"2023-07-24T05:46:06.023237+0000","last_peered":"2023-07-24T05:46:06.023237+0000","last_clean":"2023-07-24T05:46:06.023237+0000","last_became_active":"2023-07-24T05:46:00.930447+0000","last_became_peered":"2023-07-24T05:46:00.930447+0000","last_unstale":"2023-07-24T05:46:06.023237+0000","last_undegraded":"2023-07-24T05:46:06.023237+0000","last_fullsized":"2023-07-24T05:46:06.023237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:28:47.348353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.484078+0000","last_change":"2023-07-24T05:46:00.945856+0000","last_active":"2023-07-24T05:46:07.484078+0000","last_peered":"2023-07-24T05:46:07.484078+0000","last_clean":"2023-07-24T05:46:07.484078+0000","last_became_active":"2023-07-24T05:46:00.945620+0000","last_became_peered":"2023-07-24T05:46:00.945620+0000","last_unstale":"2023-07-24T05:46:07.484078+0000","last_undegraded":"2023-07-24T05:46:07.484078+0000","last_fullsized":"2023-07-24T05:46:07.484078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:02:38.151470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486593+0000","last_change":"2023-07-24T05:46:00.946115+0000","last_active":"2023-07-24T05:46:07.486593+0000","last_peered":"2023-07-24T05:46:07.486593+0000","last_clean":"2023-07-24T05:46:07.486593+0000","last_became_active":"2023-07-24T05:46:00.945731+0000","last_became_peered":"2023-07-24T05:46:00.945731+0000","last_unstale":"2023-07-24T05:46:07.486593+0000","last_undegraded":"2023-07-24T05:46:07.486593+0000","last_fullsized":"2023-07-24T05:46:07.486593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:39:17.210783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486565+0000","last_change":"2023-07-24T05:46:00.935106+0000","last_active":"2023-07-24T05:46:07.486565+0000","last_peered":"2023-07-24T05:46:07.486565+0000","last_clean":"2023-07-24T05:46:07.486565+0000","last_became_active":"2023-07-24T05:46:00.934759+0000","last_became_peered":"2023-07-24T05:46:00.934759+0000","last_unstale":"2023-07-24T05:46:07.486565+0000","last_undegraded":"2023-07-24T05:46:07.486565+0000","last_fullsized":"2023-07-24T05:46:07.486565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T05:59:20.619052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.487093+0000","last_change":"2023-07-24T05:46:00.937903+0000","last_active":"2023-07-24T05:46:07.487093+0000","last_peered":"2023-07-24T05:46:07.487093+0000","last_clean":"2023-07-24T05:46:07.487093+0000","last_became_active":"2023-07-24T05:46:00.937520+0000","last_became_peered":"2023-07-24T05:46:00.937520+0000","last_unstale":"2023-07-24T05:46:07.487093+0000","last_undegraded":"2023-07-24T05:46:07.487093+0000","last_fullsized":"2023-07-24T05:46:07.487093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:56:28.386440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.487373+0000","last_change":"2023-07-24T05:46:00.950064+0000","last_active":"2023-07-24T05:46:07.487373+0000","last_peered":"2023-07-24T05:46:07.487373+0000","last_clean":"2023-07-24T05:46:07.487373+0000","last_became_active":"2023-07-24T05:46:00.949415+0000","last_became_peered":"2023-07-24T05:46:00.949415+0000","last_unstale":"2023-07-24T05:46:07.487373+0000","last_undegraded":"2023-07-24T05:46:07.487373+0000","last_fullsized":"2023-07-24T05:46:07.487373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:01:02.060760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.481115+0000","last_change":"2023-07-24T05:46:00.945119+0000","last_active":"2023-07-24T05:46:06.481115+0000","last_peered":"2023-07-24T05:46:06.481115+0000","last_clean":"2023-07-24T05:46:06.481115+0000","last_became_active":"2023-07-24T05:46:00.944813+0000","last_became_peered":"2023-07-24T05:46:00.944813+0000","last_unstale":"2023-07-24T05:46:06.481115+0000","last_undegraded":"2023-07-24T05:46:06.481115+0000","last_fullsized":"2023-07-24T05:46:06.481115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:37:16.770689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.483093+0000","last_change":"2023-07-24T05:46:00.935631+0000","last_active":"2023-07-24T05:46:07.483093+0000","last_peered":"2023-07-24T05:46:07.483093+0000","last_clean":"2023-07-24T05:46:07.483093+0000","last_became_active":"2023-07-24T05:46:00.935367+0000","last_became_peered":"2023-07-24T05:46:00.935367+0000","last_unstale":"2023-07-24T05:46:07.483093+0000","last_undegraded":"2023-07-24T05:46:07.483093+0000","last_fullsized":"2023-07-24T05:46:07.483093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:29:21.153570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.718880+0000","last_change":"2023-07-24T05:46:00.942370+0000","last_active":"2023-07-24T05:46:06.718880+0000","last_peered":"2023-07-24T05:46:06.718880+0000","last_clean":"2023-07-24T05:46:06.718880+0000","last_became_active":"2023-07-24T05:46:00.941928+0000","last_became_peered":"2023-07-24T05:46:00.941928+0000","last_unstale":"2023-07-24T05:46:06.718880+0000","last_undegraded":"2023-07-24T05:46:06.718880+0000","last_fullsized":"2023-07-24T05:46:06.718880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:19:59.555194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.481503+0000","last_change":"2023-07-24T05:46:00.946457+0000","last_active":"2023-07-24T05:46:06.481503+0000","last_peered":"2023-07-24T05:46:06.481503+0000","last_clean":"2023-07-24T05:46:06.481503+0000","last_became_active":"2023-07-24T05:46:00.944937+0000","last_became_peered":"2023-07-24T05:46:00.944937+0000","last_unstale":"2023-07-24T05:46:06.481503+0000","last_undegraded":"2023-07-24T05:46:06.481503+0000","last_fullsized":"2023-07-24T05:46:06.481503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:44:23.859944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023427+0000","last_change":"2023-07-24T05:46:00.934582+0000","last_active":"2023-07-24T05:46:06.023427+0000","last_peered":"2023-07-24T05:46:06.023427+0000","last_clean":"2023-07-24T05:46:06.023427+0000","last_became_active":"2023-07-24T05:46:00.933907+0000","last_became_peered":"2023-07-24T05:46:00.933907+0000","last_unstale":"2023-07-24T05:46:06.023427+0000","last_undegraded":"2023-07-24T05:46:06.023427+0000","last_fullsized":"2023-07-24T05:46:06.023427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:41:12.173555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.018439+0000","last_change":"2023-07-24T05:46:00.928680+0000","last_active":"2023-07-24T05:46:06.018439+0000","last_peered":"2023-07-24T05:46:06.018439+0000","last_clean":"2023-07-24T05:46:06.018439+0000","last_became_active":"2023-07-24T05:46:00.928276+0000","last_became_peered":"2023-07-24T05:46:00.928276+0000","last_unstale":"2023-07-24T05:46:06.018439+0000","last_undegraded":"2023-07-24T05:46:06.018439+0000","last_fullsized":"2023-07-24T05:46:06.018439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:15:26.395482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023672+0000","last_change":"2023-07-24T05:46:00.936679+0000","last_active":"2023-07-24T05:46:06.023672+0000","last_peered":"2023-07-24T05:46:06.023672+0000","last_clean":"2023-07-24T05:46:06.023672+0000","last_became_active":"2023-07-24T05:46:00.936176+0000","last_became_peered":"2023-07-24T05:46:00.936176+0000","last_unstale":"2023-07-24T05:46:06.023672+0000","last_undegraded":"2023-07-24T05:46:06.023672+0000","last_fullsized":"2023-07-24T05:46:06.023672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:46:01.670959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.720022+0000","last_change":"2023-07-24T05:46:00.940299+0000","last_active":"2023-07-24T05:46:06.720022+0000","last_peered":"2023-07-24T05:46:06.720022+0000","last_clean":"2023-07-24T05:46:06.720022+0000","last_became_active":"2023-07-24T05:46:00.940008+0000","last_became_peered":"2023-07-24T05:46:00.940008+0000","last_unstale":"2023-07-24T05:46:06.720022+0000","last_undegraded":"2023-07-24T05:46:06.720022+0000","last_fullsized":"2023-07-24T05:46:06.720022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:07:54.914500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.020567+0000","last_change":"2023-07-24T05:46:00.938329+0000","last_active":"2023-07-24T05:46:06.020567+0000","last_peered":"2023-07-24T05:46:06.020567+0000","last_clean":"2023-07-24T05:46:06.020567+0000","last_became_active":"2023-07-24T05:46:00.938046+0000","last_became_peered":"2023-07-24T05:46:00.938046+0000","last_unstale":"2023-07-24T05:46:06.020567+0000","last_undegraded":"2023-07-24T05:46:06.020567+0000","last_fullsized":"2023-07-24T05:46:06.020567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:26:06.142105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.481708+0000","last_change":"2023-07-24T05:46:00.955136+0000","last_active":"2023-07-24T05:46:06.481708+0000","last_peered":"2023-07-24T05:46:06.481708+0000","last_clean":"2023-07-24T05:46:06.481708+0000","last_became_active":"2023-07-24T05:46:00.954432+0000","last_became_peered":"2023-07-24T05:46:00.954432+0000","last_unstale":"2023-07-24T05:46:06.481708+0000","last_undegraded":"2023-07-24T05:46:06.481708+0000","last_fullsized":"2023-07-24T05:46:06.481708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:59:08.440089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.485847+0000","last_change":"2023-07-24T05:46:00.936021+0000","last_active":"2023-07-24T05:46:07.485847+0000","last_peered":"2023-07-24T05:46:07.485847+0000","last_clean":"2023-07-24T05:46:07.485847+0000","last_became_active":"2023-07-24T05:46:00.935648+0000","last_became_peered":"2023-07-24T05:46:00.935648+0000","last_unstale":"2023-07-24T05:46:07.485847+0000","last_undegraded":"2023-07-24T05:46:07.485847+0000","last_fullsized":"2023-07-24T05:46:07.485847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:04:34.146477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.018120+0000","last_change":"2023-07-24T05:46:00.944450+0000","last_active":"2023-07-24T05:46:06.018120+0000","last_peered":"2023-07-24T05:46:06.018120+0000","last_clean":"2023-07-24T05:46:06.018120+0000","last_became_active":"2023-07-24T05:46:00.943241+0000","last_became_peered":"2023-07-24T05:46:00.943241+0000","last_unstale":"2023-07-24T05:46:06.018120+0000","last_undegraded":"2023-07-24T05:46:06.018120+0000","last_fullsized":"2023-07-24T05:46:06.018120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:53:07.116935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.018724+0000","last_change":"2023-07-24T05:46:00.933437+0000","last_active":"2023-07-24T05:46:06.018724+0000","last_peered":"2023-07-24T05:46:06.018724+0000","last_clean":"2023-07-24T05:46:06.018724+0000","last_became_active":"2023-07-24T05:46:00.933148+0000","last_became_peered":"2023-07-24T05:46:00.933148+0000","last_unstale":"2023-07-24T05:46:06.018724+0000","last_undegraded":"2023-07-24T05:46:06.018724+0000","last_fullsized":"2023-07-24T05:46:06.018724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:43:12.724407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023680+0000","last_change":"2023-07-24T05:46:00.940814+0000","last_active":"2023-07-24T05:46:06.023680+0000","last_peered":"2023-07-24T05:46:06.023680+0000","last_clean":"2023-07-24T05:46:06.023680+0000","last_became_active":"2023-07-24T05:46:00.940490+0000","last_became_peered":"2023-07-24T05:46:00.940490+0000","last_unstale":"2023-07-24T05:46:06.023680+0000","last_undegraded":"2023-07-24T05:46:06.023680+0000","last_fullsized":"2023-07-24T05:46:06.023680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T16:55:24.415034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486791+0000","last_change":"2023-07-24T05:46:00.941947+0000","last_active":"2023-07-24T05:46:07.486791+0000","last_peered":"2023-07-24T05:46:07.486791+0000","last_clean":"2023-07-24T05:46:07.486791+0000","last_became_active":"2023-07-24T05:46:00.941624+0000","last_became_peered":"2023-07-24T05:46:00.941624+0000","last_unstale":"2023-07-24T05:46:07.486791+0000","last_undegraded":"2023-07-24T05:46:07.486791+0000","last_fullsized":"2023-07-24T05:46:07.486791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:18:26.734018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.719673+0000","last_change":"2023-07-24T05:46:00.933586+0000","last_active":"2023-07-24T05:46:06.719673+0000","last_peered":"2023-07-24T05:46:06.719673+0000","last_clean":"2023-07-24T05:46:06.719673+0000","last_became_active":"2023-07-24T05:46:00.933231+0000","last_became_peered":"2023-07-24T05:46:00.933231+0000","last_unstale":"2023-07-24T05:46:06.719673+0000","last_undegraded":"2023-07-24T05:46:06.719673+0000","last_fullsized":"2023-07-24T05:46:06.719673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:35:19.732787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.485426+0000","last_change":"2023-07-24T05:46:00.936425+0000","last_active":"2023-07-24T05:46:07.485426+0000","last_peered":"2023-07-24T05:46:07.485426+0000","last_clean":"2023-07-24T05:46:07.485426+0000","last_became_active":"2023-07-24T05:46:00.936057+0000","last_became_peered":"2023-07-24T05:46:00.936057+0000","last_unstale":"2023-07-24T05:46:07.485426+0000","last_undegraded":"2023-07-24T05:46:07.485426+0000","last_fullsized":"2023-07-24T05:46:07.485426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:17:32.903393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.481478+0000","last_change":"2023-07-24T05:46:00.955358+0000","last_active":"2023-07-24T05:46:06.481478+0000","last_peered":"2023-07-24T05:46:06.481478+0000","last_clean":"2023-07-24T05:46:06.481478+0000","last_became_active":"2023-07-24T05:46:00.954790+0000","last_became_peered":"2023-07-24T05:46:00.954790+0000","last_unstale":"2023-07-24T05:46:06.481478+0000","last_undegraded":"2023-07-24T05:46:06.481478+0000","last_fullsized":"2023-07-24T05:46:06.481478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:21:55.302838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.021627+0000","last_change":"2023-07-24T05:46:00.937697+0000","last_active":"2023-07-24T05:46:06.021627+0000","last_peered":"2023-07-24T05:46:06.021627+0000","last_clean":"2023-07-24T05:46:06.021627+0000","last_became_active":"2023-07-24T05:46:00.937034+0000","last_became_peered":"2023-07-24T05:46:00.937034+0000","last_unstale":"2023-07-24T05:46:06.021627+0000","last_undegraded":"2023-07-24T05:46:06.021627+0000","last_fullsized":"2023-07-24T05:46:06.021627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:39:26.893324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.720200+0000","last_change":"2023-07-24T05:46:00.936120+0000","last_active":"2023-07-24T05:46:06.720200+0000","last_peered":"2023-07-24T05:46:06.720200+0000","last_clean":"2023-07-24T05:46:06.720200+0000","last_became_active":"2023-07-24T05:46:00.935837+0000","last_became_peered":"2023-07-24T05:46:00.935837+0000","last_unstale":"2023-07-24T05:46:06.720200+0000","last_undegraded":"2023-07-24T05:46:06.720200+0000","last_fullsized":"2023-07-24T05:46:06.720200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:57:12.671093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.021362+0000","last_change":"2023-07-24T05:46:00.938400+0000","last_active":"2023-07-24T05:46:06.021362+0000","last_peered":"2023-07-24T05:46:06.021362+0000","last_clean":"2023-07-24T05:46:06.021362+0000","last_became_active":"2023-07-24T05:46:00.938021+0000","last_became_peered":"2023-07-24T05:46:00.938021+0000","last_unstale":"2023-07-24T05:46:06.021362+0000","last_undegraded":"2023-07-24T05:46:06.021362+0000","last_fullsized":"2023-07-24T05:46:06.021362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:50:30.095794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023656+0000","last_change":"2023-07-24T05:46:00.938957+0000","last_active":"2023-07-24T05:46:06.023656+0000","last_peered":"2023-07-24T05:46:06.023656+0000","last_clean":"2023-07-24T05:46:06.023656+0000","last_became_active":"2023-07-24T05:46:00.938684+0000","last_became_peered":"2023-07-24T05:46:00.938684+0000","last_unstale":"2023-07-24T05:46:06.023656+0000","last_undegraded":"2023-07-24T05:46:06.023656+0000","last_fullsized":"2023-07-24T05:46:06.023656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:54:20.745792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486581+0000","last_change":"2023-07-24T05:46:00.954433+0000","last_active":"2023-07-24T05:46:07.486581+0000","last_peered":"2023-07-24T05:46:07.486581+0000","last_clean":"2023-07-24T05:46:07.486581+0000","last_became_active":"2023-07-24T05:46:00.954144+0000","last_became_peered":"2023-07-24T05:46:00.954144+0000","last_unstale":"2023-07-24T05:46:07.486581+0000","last_undegraded":"2023-07-24T05:46:07.486581+0000","last_fullsized":"2023-07-24T05:46:07.486581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:57:39.660342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.018621+0000","last_change":"2023-07-24T05:46:00.943903+0000","last_active":"2023-07-24T05:46:06.018621+0000","last_peered":"2023-07-24T05:46:06.018621+0000","last_clean":"2023-07-24T05:46:06.018621+0000","last_became_active":"2023-07-24T05:46:00.943590+0000","last_became_peered":"2023-07-24T05:46:00.943590+0000","last_unstale":"2023-07-24T05:46:06.018621+0000","last_undegraded":"2023-07-24T05:46:06.018621+0000","last_fullsized":"2023-07-24T05:46:06.018621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:34:19.494683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4591,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":880640,"data_stored":700959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.419}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3120000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542155,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":107943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.254}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.177}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.206}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.149}]}]},{"osd":5,"up_from":14,"seq":60129542155,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":107234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.034}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1910000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3149999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.383}]}]},{"osd":4,"up_from":14,"seq":60129542154,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":111792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5780000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.552}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5069999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.653}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4770000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542155,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":108033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":107943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1180000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542155,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":107943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.335}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9930000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4460000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.169}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3660000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.206}]}]},{"osd":0,"up_from":14,"seq":60129542154,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":697532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.294}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-24T05:46:35.314 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-24T05:46:35.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.506+0000 7f8ef951d700 1 Processor -- start 2023-07-24T05:46:35.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.506+0000 7f8ef951d700 1 -- start start 2023-07-24T05:46:35.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.510+0000 7f8ef951d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8ef415ca00 0x7f8ef40d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:35.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.510+0000 7f8ef951d700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8ef406d450 0x7f8ef40b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:35.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.510+0000 7f8ef951d700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8ef40b4630 0x7f8ef40b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:35.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.510+0000 7f8ef951d700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ef40b4ac0 con 0x7f8ef406d450 2023-07-24T05:46:35.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.510+0000 7f8ef951d700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ef40d0300 con 0x7f8ef415ca00 2023-07-24T05:46:35.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.510+0000 7f8ef951d700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef415cde0 con 0x7f8ef40b4630 2023-07-24T05:46:35.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.510+0000 7f8eeb7fe700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8ef406d450 0x7f8ef40b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:35.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.510+0000 7f8ef3fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8ef415ca00 0x7f8ef40d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:35.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.510+0000 7f8eeb7fe700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8ef406d450 0x7f8ef40b40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42516/0 (socket says 172.21.15.77:42516) 2023-07-24T05:46:35.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.510+0000 7f8eeb7fe700 1 -- 172.21.15.77:0/916986033 learned_addr learned my addr 172.21.15.77:0/916986033 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:35.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.510+0000 7f8ef8d1c700 1 --2- 172.21.15.77:0/916986033 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8ef40b4630 0x7f8ef40b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:35.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.510+0000 7f8ef3fff700 1 -- 172.21.15.77:0/916986033 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8ef40b4630 msgr2=0x7f8ef40b11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:35.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.510+0000 7f8ef3fff700 1 --2- 172.21.15.77:0/916986033 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8ef40b4630 0x7f8ef40b11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:35.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.510+0000 7f8ef3fff700 1 -- 172.21.15.77:0/916986033 >> v2:172.21.15.77:3300/0 conn(0x7f8ef406d450 msgr2=0x7f8ef40b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:35.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.510+0000 7f8ef3fff700 1 --2- 172.21.15.77:0/916986033 >> v2:172.21.15.77:3300/0 conn(0x7f8ef406d450 0x7f8ef40b40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:35.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.510+0000 7f8ef3fff700 1 -- 172.21.15.77:0/916986033 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef40d2870 con 0x7f8ef415ca00 2023-07-24T05:46:35.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.510+0000 7f8eeb7fe700 1 --2- 172.21.15.77:0/916986033 >> v2:172.21.15.77:3300/0 conn(0x7f8ef406d450 0x7f8ef40b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:46:35.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.510+0000 7f8ef3fff700 1 --2- 172.21.15.77:0/916986033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ef415ca00 0x7f8ef40d2200 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8ef408c470 tx=0x7f8ee4009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b4828ca2fbd82cd server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:35.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.510+0000 7f8ef37fe700 1 -- 172.21.15.77:0/916986033 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee4005e50 con 0x7f8ef415ca00 2023-07-24T05:46:35.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.510+0000 7f8ef37fe700 1 -- 172.21.15.77:0/916986033 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee4006030 con 0x7f8ef415ca00 2023-07-24T05:46:35.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.510+0000 7f8ef37fe700 1 -- 172.21.15.77:0/916986033 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee40063c0 con 0x7f8ef415ca00 2023-07-24T05:46:35.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.510+0000 7f8ef951d700 1 -- 172.21.15.77:0/916986033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ef415ca00 msgr2=0x7f8ef40d2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:35.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.510+0000 7f8ef951d700 1 --2- 172.21.15.77:0/916986033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ef415ca00 0x7f8ef40d2200 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8ef408c470 tx=0x7f8ee4009b20 comp rx=0 tx=0).stop 2023-07-24T05:46:35.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.514+0000 7f8ef951d700 1 -- 172.21.15.77:0/916986033 shutdown_connections 2023-07-24T05:46:35.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.514+0000 7f8ef951d700 1 --2- 172.21.15.77:0/916986033 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8ef40b4630 0x7f8ef40b11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:35.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.514+0000 7f8ef951d700 1 --2- 172.21.15.77:0/916986033 >> v2:172.21.15.77:3300/0 conn(0x7f8ef406d450 0x7f8ef40b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:35.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.514+0000 7f8ef951d700 1 --2- 172.21.15.77:0/916986033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ef415ca00 0x7f8ef40d2200 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:35.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.514+0000 7f8ef951d700 1 -- 172.21.15.77:0/916986033 >> 172.21.15.77:0/916986033 conn(0x7f8ef40b7610 msgr2=0x7f8ef40b7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:35.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.514+0000 7f8ef951d700 1 -- 172.21.15.77:0/916986033 shutdown_connections 2023-07-24T05:46:35.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.514+0000 7f8ef951d700 1 -- 172.21.15.77:0/916986033 wait complete. 2023-07-24T05:46:35.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.514+0000 7f8ef951d700 1 Processor -- start 2023-07-24T05:46:35.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.514+0000 7f8ef951d700 1 -- start start 2023-07-24T05:46:35.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.518+0000 7f8ef951d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ef406d450 0x7f8ef40c6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:35.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.518+0000 7f8ef951d700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ef40b4630 0x7f8ef4160940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:35.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.518+0000 7f8ef951d700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8ef415ca00 0x7f8ef4153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:35.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.518+0000 7f8ef951d700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef40c7d40 con 0x7f8ef406d450 2023-07-24T05:46:35.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.518+0000 7f8ef951d700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef40c7040 con 0x7f8ef40b4630 2023-07-24T05:46:35.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.518+0000 7f8ef951d700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef4160e80 con 0x7f8ef415ca00 2023-07-24T05:46:35.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.518+0000 7f8ef3fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ef406d450 0x7f8ef40c6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:35.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.518+0000 7f8ef3fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ef406d450 0x7f8ef40c6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42526/0 (socket says 172.21.15.77:42526) 2023-07-24T05:46:35.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.518+0000 7f8ef3fff700 1 -- 172.21.15.77:0/2914687548 learned_addr learned my addr 172.21.15.77:0/2914687548 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:35.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.518+0000 7f8ef8d1c700 1 --2- 172.21.15.77:0/2914687548 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8ef415ca00 0x7f8ef4153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:35.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.518+0000 7f8eeb7fe700 1 --2- 172.21.15.77:0/2914687548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ef40b4630 0x7f8ef4160940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:35.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.518+0000 7f8ef3fff700 1 -- 172.21.15.77:0/2914687548 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8ef415ca00 msgr2=0x7f8ef4153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:35.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.518+0000 7f8ef3fff700 1 --2- 172.21.15.77:0/2914687548 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8ef415ca00 0x7f8ef4153070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:35.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.518+0000 7f8ef3fff700 1 -- 172.21.15.77:0/2914687548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ef40b4630 msgr2=0x7f8ef4160940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:35.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.518+0000 7f8ef3fff700 1 --2- 172.21.15.77:0/2914687548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ef40b4630 0x7f8ef4160940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:35.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.518+0000 7f8ef3fff700 1 -- 172.21.15.77:0/2914687548 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8edc009570 con 0x7f8ef406d450 2023-07-24T05:46:35.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.518+0000 7f8ef3fff700 1 --2- 172.21.15.77:0/2914687548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ef406d450 0x7f8ef40c6b00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8ee4000c00 tx=0x7f8ee4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:35.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.518+0000 7f8ef17fa700 1 -- 172.21.15.77:0/2914687548 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee4006880 con 0x7f8ef406d450 2023-07-24T05:46:35.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.518+0000 7f8ef17fa700 1 -- 172.21.15.77:0/2914687548 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee4020070 con 0x7f8ef406d450 2023-07-24T05:46:35.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.518+0000 7f8ef951d700 1 -- 172.21.15.77:0/2914687548 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ee4009450 con 0x7f8ef406d450 2023-07-24T05:46:35.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.518+0000 7f8ef17fa700 1 -- 172.21.15.77:0/2914687548 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee4004280 con 0x7f8ef406d450 2023-07-24T05:46:35.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.518+0000 7f8ef951d700 1 -- 172.21.15.77:0/2914687548 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ef40c7a60 con 0x7f8ef406d450 2023-07-24T05:46:35.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.522+0000 7f8ef951d700 1 -- 172.21.15.77:0/2914687548 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ef4072490 con 0x7f8ef406d450 2023-07-24T05:46:35.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.522+0000 7f8ef17fa700 1 -- 172.21.15.77:0/2914687548 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8ee4022030 con 0x7f8ef406d450 2023-07-24T05:46:35.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.522+0000 7f8ef17fa700 1 --2- 172.21.15.77:0/2914687548 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f8ed40662f0 0x7f8ed40687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:35.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.526+0000 7f8ef17fa700 1 -- 172.21.15.77:0/2914687548 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8ee40853a0 con 0x7f8ef406d450 2023-07-24T05:46:35.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.526+0000 7f8eeb7fe700 1 --2- 172.21.15.77:0/2914687548 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f8ed40662f0 0x7f8ed40687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:35.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.526+0000 7f8eeb7fe700 1 --2- 172.21.15.77:0/2914687548 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f8ed40662f0 0x7f8ed40687b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8ef415a070 tx=0x7f8edc0092e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:35.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.530+0000 7f8ef17fa700 1 -- 172.21.15.77:0/2914687548 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8ee4052520 con 0x7f8ef406d450 2023-07-24T05:46:35.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.686+0000 7f8ef951d700 1 -- 172.21.15.77:0/2914687548 --> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8ef40d2e30 con 0x7f8ed40662f0 2023-07-24T05:46:35.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.702+0000 7f8ef17fa700 1 -- 172.21.15.77:0/2914687548 <== mgr.4108 v2:172.21.15.103:6832/1305366540 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367151 (secure 0 0 0) 0x7f8edc004030 con 0x7f8ed40662f0 2023-07-24T05:46:35.714 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:46:35.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.710+0000 7f8ef951d700 1 -- 172.21.15.77:0/2914687548 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f8ed40662f0 msgr2=0x7f8ed40687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:35.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.710+0000 7f8ef951d700 1 --2- 172.21.15.77:0/2914687548 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f8ed40662f0 0x7f8ed40687b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8ef415a070 tx=0x7f8edc0092e0 comp rx=0 tx=0).stop 2023-07-24T05:46:35.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.710+0000 7f8ef951d700 1 -- 172.21.15.77:0/2914687548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ef406d450 msgr2=0x7f8ef40c6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:35.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.710+0000 7f8ef951d700 1 --2- 172.21.15.77:0/2914687548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ef406d450 0x7f8ef40c6b00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8ee4000c00 tx=0x7f8ee4004770 comp rx=0 tx=0).stop 2023-07-24T05:46:35.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.714+0000 7f8ef951d700 1 -- 172.21.15.77:0/2914687548 shutdown_connections 2023-07-24T05:46:35.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.714+0000 7f8ef951d700 1 --2- 172.21.15.77:0/2914687548 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f8ed40662f0 0x7f8ed40687b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:35.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.714+0000 7f8ef951d700 1 --2- 172.21.15.77:0/2914687548 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8ef415ca00 0x7f8ef4153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:35.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.714+0000 7f8ef951d700 1 --2- 172.21.15.77:0/2914687548 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ef40b4630 0x7f8ef4160940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:35.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.714+0000 7f8ef951d700 1 --2- 172.21.15.77:0/2914687548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8ef406d450 0x7f8ef40c6b00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:35.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.714+0000 7f8ef951d700 1 -- 172.21.15.77:0/2914687548 >> 172.21.15.77:0/2914687548 conn(0x7f8ef40b7610 msgr2=0x7f8ef406af50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:35.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.714+0000 7f8ef951d700 1 -- 172.21.15.77:0/2914687548 shutdown_connections 2023-07-24T05:46:35.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.714+0000 7f8ef951d700 1 -- 172.21.15.77:0/2914687548 wait complete. 2023-07-24T05:46:35.719 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-07-24T05:46:35.737 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2023-07-24T05:46:34.538334+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594959,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219412,"kb_used_data":3260,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755308,"statfs":{"total":773094113280,"available":772869435392,"internally_reserved":0,"allocated":3338240,"data_stored":2049379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005387"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.485697+0000","last_change":"2023-07-24T05:46:05.018571+0000","last_active":"2023-07-24T05:46:07.485697+0000","last_peered":"2023-07-24T05:46:07.485697+0000","last_clean":"2023-07-24T05:46:07.485697+0000","last_became_active":"2023-07-24T05:46:05.017995+0000","last_became_peered":"2023-07-24T05:46:05.017995+0000","last_unstale":"2023-07-24T05:46:07.485697+0000","last_undegraded":"2023-07-24T05:46:07.485697+0000","last_fullsized":"2023-07-24T05:46:07.485697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:09:07.896789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.720068+0000","last_change":"2023-07-24T05:45:59.909905+0000","last_active":"2023-07-24T05:46:06.720068+0000","last_peered":"2023-07-24T05:46:06.720068+0000","last_clean":"2023-07-24T05:46:06.720068+0000","last_became_active":"2023-07-24T05:45:59.909674+0000","last_became_peered":"2023-07-24T05:45:59.909674+0000","last_unstale":"2023-07-24T05:46:06.720068+0000","last_undegraded":"2023-07-24T05:46:06.720068+0000","last_fullsized":"2023-07-24T05:46:06.720068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:52:15.728826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.020712+0000","last_change":"2023-07-24T05:46:00.933508+0000","last_active":"2023-07-24T05:46:06.020712+0000","last_peered":"2023-07-24T05:46:06.020712+0000","last_clean":"2023-07-24T05:46:06.020712+0000","last_became_active":"2023-07-24T05:46:00.933149+0000","last_became_peered":"2023-07-24T05:46:00.933149+0000","last_unstale":"2023-07-24T05:46:06.020712+0000","last_undegraded":"2023-07-24T05:46:06.020712+0000","last_fullsized":"2023-07-24T05:46:06.020712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:48:28.674504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.020411+0000","last_change":"2023-07-24T05:46:05.015347+0000","last_active":"2023-07-24T05:46:06.020411+0000","last_peered":"2023-07-24T05:46:06.020411+0000","last_clean":"2023-07-24T05:46:06.020411+0000","last_became_active":"2023-07-24T05:46:05.014821+0000","last_became_peered":"2023-07-24T05:46:05.014821+0000","last_unstale":"2023-07-24T05:46:06.020411+0000","last_undegraded":"2023-07-24T05:46:06.020411+0000","last_fullsized":"2023-07-24T05:46:06.020411+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:18:33.791257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.484589+0000","last_change":"2023-07-24T05:45:59.894586+0000","last_active":"2023-07-24T05:46:07.484589+0000","last_peered":"2023-07-24T05:46:07.484589+0000","last_clean":"2023-07-24T05:46:07.484589+0000","last_became_active":"2023-07-24T05:45:59.894286+0000","last_became_peered":"2023-07-24T05:45:59.894286+0000","last_unstale":"2023-07-24T05:46:07.484589+0000","last_undegraded":"2023-07-24T05:46:07.484589+0000","last_fullsized":"2023-07-24T05:46:07.484589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:35:04.605981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.484398+0000","last_change":"2023-07-24T05:46:00.933761+0000","last_active":"2023-07-24T05:46:07.484398+0000","last_peered":"2023-07-24T05:46:07.484398+0000","last_clean":"2023-07-24T05:46:07.484398+0000","last_became_active":"2023-07-24T05:46:00.933321+0000","last_became_peered":"2023-07-24T05:46:00.933321+0000","last_unstale":"2023-07-24T05:46:07.484398+0000","last_undegraded":"2023-07-24T05:46:07.484398+0000","last_fullsized":"2023-07-24T05:46:07.484398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:28:13.314710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486274+0000","last_change":"2023-07-24T05:46:05.020875+0000","last_active":"2023-07-24T05:46:07.486274+0000","last_peered":"2023-07-24T05:46:07.486274+0000","last_clean":"2023-07-24T05:46:07.486274+0000","last_became_active":"2023-07-24T05:46:05.020425+0000","last_became_peered":"2023-07-24T05:46:05.020425+0000","last_unstale":"2023-07-24T05:46:07.486274+0000","last_undegraded":"2023-07-24T05:46:07.486274+0000","last_fullsized":"2023-07-24T05:46:07.486274+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T16:13:44.814663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486774+0000","last_change":"2023-07-24T05:45:59.917608+0000","last_active":"2023-07-24T05:46:07.486774+0000","last_peered":"2023-07-24T05:46:07.486774+0000","last_clean":"2023-07-24T05:46:07.486774+0000","last_became_active":"2023-07-24T05:45:59.917276+0000","last_became_peered":"2023-07-24T05:45:59.917276+0000","last_unstale":"2023-07-24T05:46:07.486774+0000","last_undegraded":"2023-07-24T05:46:07.486774+0000","last_fullsized":"2023-07-24T05:46:07.486774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:26:41.573346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.021965+0000","last_change":"2023-07-24T05:46:00.937906+0000","last_active":"2023-07-24T05:46:06.021965+0000","last_peered":"2023-07-24T05:46:06.021965+0000","last_clean":"2023-07-24T05:46:06.021965+0000","last_became_active":"2023-07-24T05:46:00.937395+0000","last_became_peered":"2023-07-24T05:46:00.937395+0000","last_unstale":"2023-07-24T05:46:06.021965+0000","last_undegraded":"2023-07-24T05:46:06.021965+0000","last_fullsized":"2023-07-24T05:46:06.021965+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T16:29:11.391157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.481461+0000","last_change":"2023-07-24T05:46:05.025366+0000","last_active":"2023-07-24T05:46:06.481461+0000","last_peered":"2023-07-24T05:46:06.481461+0000","last_clean":"2023-07-24T05:46:06.481461+0000","last_became_active":"2023-07-24T05:46:05.024220+0000","last_became_peered":"2023-07-24T05:46:05.024220+0000","last_unstale":"2023-07-24T05:46:06.481461+0000","last_undegraded":"2023-07-24T05:46:06.481461+0000","last_fullsized":"2023-07-24T05:46:06.481461+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:56:32.485103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486003+0000","last_change":"2023-07-24T05:45:59.917558+0000","last_active":"2023-07-24T05:46:07.486003+0000","last_peered":"2023-07-24T05:46:07.486003+0000","last_clean":"2023-07-24T05:46:07.486003+0000","last_became_active":"2023-07-24T05:45:59.917247+0000","last_became_peered":"2023-07-24T05:45:59.917247+0000","last_unstale":"2023-07-24T05:46:07.486003+0000","last_undegraded":"2023-07-24T05:46:07.486003+0000","last_fullsized":"2023-07-24T05:46:07.486003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:07:11.420006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.022778+0000","last_change":"2023-07-24T05:46:00.937863+0000","last_active":"2023-07-24T05:46:06.022778+0000","last_peered":"2023-07-24T05:46:06.022778+0000","last_clean":"2023-07-24T05:46:06.022778+0000","last_became_active":"2023-07-24T05:46:00.937533+0000","last_became_peered":"2023-07-24T05:46:00.937533+0000","last_unstale":"2023-07-24T05:46:06.022778+0000","last_undegraded":"2023-07-24T05:46:06.022778+0000","last_fullsized":"2023-07-24T05:46:06.022778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:22:28.252629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486901+0000","last_change":"2023-07-24T05:46:05.021105+0000","last_active":"2023-07-24T05:46:07.486901+0000","last_peered":"2023-07-24T05:46:07.486901+0000","last_clean":"2023-07-24T05:46:07.486901+0000","last_became_active":"2023-07-24T05:46:05.020568+0000","last_became_peered":"2023-07-24T05:46:05.020568+0000","last_unstale":"2023-07-24T05:46:07.486901+0000","last_undegraded":"2023-07-24T05:46:07.486901+0000","last_fullsized":"2023-07-24T05:46:07.486901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:37:20.869353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.720347+0000","last_change":"2023-07-24T05:45:59.904446+0000","last_active":"2023-07-24T05:46:06.720347+0000","last_peered":"2023-07-24T05:46:06.720347+0000","last_clean":"2023-07-24T05:46:06.720347+0000","last_became_active":"2023-07-24T05:45:59.900231+0000","last_became_peered":"2023-07-24T05:45:59.900231+0000","last_unstale":"2023-07-24T05:46:06.720347+0000","last_undegraded":"2023-07-24T05:46:06.720347+0000","last_fullsized":"2023-07-24T05:46:06.720347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:44:12.555935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.018863+0000","last_change":"2023-07-24T05:46:00.951996+0000","last_active":"2023-07-24T05:46:06.018863+0000","last_peered":"2023-07-24T05:46:06.018863+0000","last_clean":"2023-07-24T05:46:06.018863+0000","last_became_active":"2023-07-24T05:46:00.951595+0000","last_became_peered":"2023-07-24T05:46:00.951595+0000","last_unstale":"2023-07-24T05:46:06.018863+0000","last_undegraded":"2023-07-24T05:46:06.018863+0000","last_fullsized":"2023-07-24T05:46:06.018863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:12:50.748120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023300+0000","last_change":"2023-07-24T05:46:05.017525+0000","last_active":"2023-07-24T05:46:06.023300+0000","last_peered":"2023-07-24T05:46:06.023300+0000","last_clean":"2023-07-24T05:46:06.023300+0000","last_became_active":"2023-07-24T05:46:05.015341+0000","last_became_peered":"2023-07-24T05:46:05.015341+0000","last_unstale":"2023-07-24T05:46:06.023300+0000","last_undegraded":"2023-07-24T05:46:06.023300+0000","last_fullsized":"2023-07-24T05:46:06.023300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:21:43.930293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.022219+0000","last_change":"2023-07-24T05:45:59.908228+0000","last_active":"2023-07-24T05:46:06.022219+0000","last_peered":"2023-07-24T05:46:06.022219+0000","last_clean":"2023-07-24T05:46:06.022219+0000","last_became_active":"2023-07-24T05:45:59.907944+0000","last_became_peered":"2023-07-24T05:45:59.907944+0000","last_unstale":"2023-07-24T05:46:06.022219+0000","last_undegraded":"2023-07-24T05:46:06.022219+0000","last_fullsized":"2023-07-24T05:46:06.022219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:52:47.698647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.484788+0000","last_change":"2023-07-24T05:46:00.952847+0000","last_active":"2023-07-24T05:46:07.484788+0000","last_peered":"2023-07-24T05:46:07.484788+0000","last_clean":"2023-07-24T05:46:07.484788+0000","last_became_active":"2023-07-24T05:46:00.952573+0000","last_became_peered":"2023-07-24T05:46:00.952573+0000","last_unstale":"2023-07-24T05:46:07.484788+0000","last_undegraded":"2023-07-24T05:46:07.484788+0000","last_fullsized":"2023-07-24T05:46:07.484788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:41:28.929137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.022213+0000","last_change":"2023-07-24T05:46:05.014357+0000","last_active":"2023-07-24T05:46:06.022213+0000","last_peered":"2023-07-24T05:46:06.022213+0000","last_clean":"2023-07-24T05:46:06.022213+0000","last_became_active":"2023-07-24T05:46:05.013964+0000","last_became_peered":"2023-07-24T05:46:05.013964+0000","last_unstale":"2023-07-24T05:46:06.022213+0000","last_undegraded":"2023-07-24T05:46:06.022213+0000","last_fullsized":"2023-07-24T05:46:06.022213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:56:47.701279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486215+0000","last_change":"2023-07-24T05:45:59.907153+0000","last_active":"2023-07-24T05:46:07.486215+0000","last_peered":"2023-07-24T05:46:07.486215+0000","last_clean":"2023-07-24T05:46:07.486215+0000","last_became_active":"2023-07-24T05:45:59.906816+0000","last_became_peered":"2023-07-24T05:45:59.906816+0000","last_unstale":"2023-07-24T05:46:07.486215+0000","last_undegraded":"2023-07-24T05:46:07.486215+0000","last_fullsized":"2023-07-24T05:46:07.486215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T05:59:19.607892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.719904+0000","last_change":"2023-07-24T05:46:00.931260+0000","last_active":"2023-07-24T05:46:06.719904+0000","last_peered":"2023-07-24T05:46:06.719904+0000","last_clean":"2023-07-24T05:46:06.719904+0000","last_became_active":"2023-07-24T05:46:00.930959+0000","last_became_peered":"2023-07-24T05:46:00.930959+0000","last_unstale":"2023-07-24T05:46:06.719904+0000","last_undegraded":"2023-07-24T05:46:06.719904+0000","last_fullsized":"2023-07-24T05:46:06.719904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:56:23.036353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.719736+0000","last_change":"2023-07-24T05:46:05.017693+0000","last_active":"2023-07-24T05:46:06.719736+0000","last_peered":"2023-07-24T05:46:06.719736+0000","last_clean":"2023-07-24T05:46:06.719736+0000","last_became_active":"2023-07-24T05:46:05.015057+0000","last_became_peered":"2023-07-24T05:46:05.015057+0000","last_unstale":"2023-07-24T05:46:06.719736+0000","last_undegraded":"2023-07-24T05:46:06.719736+0000","last_fullsized":"2023-07-24T05:46:06.719736+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:21:43.441226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.483452+0000","last_change":"2023-07-24T05:45:59.908355+0000","last_active":"2023-07-24T05:46:07.483452+0000","last_peered":"2023-07-24T05:46:07.483452+0000","last_clean":"2023-07-24T05:46:07.483452+0000","last_became_active":"2023-07-24T05:45:59.907240+0000","last_became_peered":"2023-07-24T05:45:59.907240+0000","last_unstale":"2023-07-24T05:46:07.483452+0000","last_undegraded":"2023-07-24T05:46:07.483452+0000","last_fullsized":"2023-07-24T05:46:07.483452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:15:19.009984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.022429+0000","last_change":"2023-07-24T05:46:00.933306+0000","last_active":"2023-07-24T05:46:06.022429+0000","last_peered":"2023-07-24T05:46:06.022429+0000","last_clean":"2023-07-24T05:46:06.022429+0000","last_became_active":"2023-07-24T05:46:00.932306+0000","last_became_peered":"2023-07-24T05:46:00.932306+0000","last_unstale":"2023-07-24T05:46:06.022429+0000","last_undegraded":"2023-07-24T05:46:06.022429+0000","last_fullsized":"2023-07-24T05:46:06.022429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:06:46.941549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.483132+0000","last_change":"2023-07-24T05:46:00.941623+0000","last_active":"2023-07-24T05:46:07.483132+0000","last_peered":"2023-07-24T05:46:07.483132+0000","last_clean":"2023-07-24T05:46:07.483132+0000","last_became_active":"2023-07-24T05:46:00.941341+0000","last_became_peered":"2023-07-24T05:46:00.941341+0000","last_unstale":"2023-07-24T05:46:07.483132+0000","last_undegraded":"2023-07-24T05:46:07.483132+0000","last_fullsized":"2023-07-24T05:46:07.483132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:08:22.272136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.720265+0000","last_change":"2023-07-24T05:45:59.909261+0000","last_active":"2023-07-24T05:46:06.720265+0000","last_peered":"2023-07-24T05:46:06.720265+0000","last_clean":"2023-07-24T05:46:06.720265+0000","last_became_active":"2023-07-24T05:45:59.908962+0000","last_became_peered":"2023-07-24T05:45:59.908962+0000","last_unstale":"2023-07-24T05:46:06.720265+0000","last_undegraded":"2023-07-24T05:46:06.720265+0000","last_fullsized":"2023-07-24T05:46:06.720265+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:56:19.698866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.021043+0000","last_change":"2023-07-24T05:46:05.012927+0000","last_active":"2023-07-24T05:46:06.021043+0000","last_peered":"2023-07-24T05:46:06.021043+0000","last_clean":"2023-07-24T05:46:06.021043+0000","last_became_active":"2023-07-24T05:46:05.012506+0000","last_became_peered":"2023-07-24T05:46:05.012506+0000","last_unstale":"2023-07-24T05:46:06.021043+0000","last_undegraded":"2023-07-24T05:46:06.021043+0000","last_fullsized":"2023-07-24T05:46:06.021043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:48:07.287011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.483976+0000","last_change":"2023-07-24T05:46:00.931782+0000","last_active":"2023-07-24T05:46:07.483976+0000","last_peered":"2023-07-24T05:46:07.483976+0000","last_clean":"2023-07-24T05:46:07.483976+0000","last_became_active":"2023-07-24T05:46:00.931488+0000","last_became_peered":"2023-07-24T05:46:00.931488+0000","last_unstale":"2023-07-24T05:46:07.483976+0000","last_undegraded":"2023-07-24T05:46:07.483976+0000","last_fullsized":"2023-07-24T05:46:07.483976+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:34:32.612133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486848+0000","last_change":"2023-07-24T05:45:59.909882+0000","last_active":"2023-07-24T05:46:07.486848+0000","last_peered":"2023-07-24T05:46:07.486848+0000","last_clean":"2023-07-24T05:46:07.486848+0000","last_became_active":"2023-07-24T05:45:59.909623+0000","last_became_peered":"2023-07-24T05:45:59.909623+0000","last_unstale":"2023-07-24T05:46:07.486848+0000","last_undegraded":"2023-07-24T05:46:07.486848+0000","last_fullsized":"2023-07-24T05:46:07.486848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:39:16.199623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.480977+0000","last_change":"2023-07-24T05:46:05.025942+0000","last_active":"2023-07-24T05:46:06.480977+0000","last_peered":"2023-07-24T05:46:06.480977+0000","last_clean":"2023-07-24T05:46:06.480977+0000","last_became_active":"2023-07-24T05:46:05.025150+0000","last_became_peered":"2023-07-24T05:46:05.025150+0000","last_unstale":"2023-07-24T05:46:06.480977+0000","last_undegraded":"2023-07-24T05:46:06.480977+0000","last_fullsized":"2023-07-24T05:46:06.480977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:18:59.759729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.482301+0000","last_change":"2023-07-24T05:45:59.916471+0000","last_active":"2023-07-24T05:46:06.482301+0000","last_peered":"2023-07-24T05:46:06.482301+0000","last_clean":"2023-07-24T05:46:06.482301+0000","last_became_active":"2023-07-24T05:45:59.914483+0000","last_became_peered":"2023-07-24T05:45:59.914483+0000","last_unstale":"2023-07-24T05:46:06.482301+0000","last_undegraded":"2023-07-24T05:46:06.482301+0000","last_fullsized":"2023-07-24T05:46:06.482301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:14:26.354550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486144+0000","last_change":"2023-07-24T05:46:00.946206+0000","last_active":"2023-07-24T05:46:07.486144+0000","last_peered":"2023-07-24T05:46:07.486144+0000","last_clean":"2023-07-24T05:46:07.486144+0000","last_became_active":"2023-07-24T05:46:00.941357+0000","last_became_peered":"2023-07-24T05:46:00.941357+0000","last_unstale":"2023-07-24T05:46:07.486144+0000","last_undegraded":"2023-07-24T05:46:07.486144+0000","last_fullsized":"2023-07-24T05:46:07.486144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:57:39.660342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.483625+0000","last_change":"2023-07-24T05:46:05.011477+0000","last_active":"2023-07-24T05:46:07.483625+0000","last_peered":"2023-07-24T05:46:07.483625+0000","last_clean":"2023-07-24T05:46:07.483625+0000","last_became_active":"2023-07-24T05:46:05.011080+0000","last_became_peered":"2023-07-24T05:46:05.011080+0000","last_unstale":"2023-07-24T05:46:07.483625+0000","last_undegraded":"2023-07-24T05:46:07.483625+0000","last_fullsized":"2023-07-24T05:46:07.483625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:20:27.076589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"25'10","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:18.816659+0000","last_change":"2023-07-24T05:45:59.909189+0000","last_active":"2023-07-24T05:46:18.816659+0000","last_peered":"2023-07-24T05:46:18.816659+0000","last_clean":"2023-07-24T05:46:18.816659+0000","last_became_active":"2023-07-24T05:45:59.908248+0000","last_became_peered":"2023-07-24T05:45:59.908248+0000","last_unstale":"2023-07-24T05:46:18.816659+0000","last_undegraded":"2023-07-24T05:46:18.816659+0000","last_fullsized":"2023-07-24T05:46:18.816659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:04:41.772179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3793,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023001+0000","last_change":"2023-07-24T05:46:00.930080+0000","last_active":"2023-07-24T05:46:06.023001+0000","last_peered":"2023-07-24T05:46:06.023001+0000","last_clean":"2023-07-24T05:46:06.023001+0000","last_became_active":"2023-07-24T05:46:00.929737+0000","last_became_peered":"2023-07-24T05:46:00.929737+0000","last_unstale":"2023-07-24T05:46:06.023001+0000","last_undegraded":"2023-07-24T05:46:06.023001+0000","last_fullsized":"2023-07-24T05:46:06.023001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:13:45.155446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.485916+0000","last_change":"2023-07-24T05:46:05.017936+0000","last_active":"2023-07-24T05:46:07.485916+0000","last_peered":"2023-07-24T05:46:07.485916+0000","last_clean":"2023-07-24T05:46:07.485916+0000","last_became_active":"2023-07-24T05:46:05.017553+0000","last_became_peered":"2023-07-24T05:46:05.017553+0000","last_unstale":"2023-07-24T05:46:07.485916+0000","last_undegraded":"2023-07-24T05:46:07.485916+0000","last_fullsized":"2023-07-24T05:46:07.485916+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:18:15.042584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.022842+0000","last_change":"2023-07-24T05:46:00.933560+0000","last_active":"2023-07-24T05:46:06.022842+0000","last_peered":"2023-07-24T05:46:06.022842+0000","last_clean":"2023-07-24T05:46:06.022842+0000","last_became_active":"2023-07-24T05:46:00.933176+0000","last_became_peered":"2023-07-24T05:46:00.933176+0000","last_unstale":"2023-07-24T05:46:06.022842+0000","last_undegraded":"2023-07-24T05:46:06.022842+0000","last_fullsized":"2023-07-24T05:46:06.022842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:22:28.734087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.022569+0000","last_change":"2023-07-24T05:45:54.350738+0000","last_active":"2023-07-24T05:46:06.022569+0000","last_peered":"2023-07-24T05:46:06.022569+0000","last_clean":"2023-07-24T05:46:06.022569+0000","last_became_active":"2023-07-24T05:45:54.350347+0000","last_became_peered":"2023-07-24T05:45:54.350347+0000","last_unstale":"2023-07-24T05:46:06.022569+0000","last_undegraded":"2023-07-24T05:46:06.022569+0000","last_fullsized":"2023-07-24T05:46:06.022569+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:15:33.932270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.720381+0000","last_change":"2023-07-24T05:45:59.904262+0000","last_active":"2023-07-24T05:46:06.720381+0000","last_peered":"2023-07-24T05:46:06.720381+0000","last_clean":"2023-07-24T05:46:06.720381+0000","last_became_active":"2023-07-24T05:45:59.901334+0000","last_became_peered":"2023-07-24T05:45:59.901334+0000","last_unstale":"2023-07-24T05:46:06.720381+0000","last_undegraded":"2023-07-24T05:46:06.720381+0000","last_fullsized":"2023-07-24T05:46:06.720381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:58:01.493567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.483100+0000","last_change":"2023-07-24T05:46:05.016239+0000","last_active":"2023-07-24T05:46:07.483100+0000","last_peered":"2023-07-24T05:46:07.483100+0000","last_clean":"2023-07-24T05:46:07.483100+0000","last_became_active":"2023-07-24T05:46:05.015792+0000","last_became_peered":"2023-07-24T05:46:05.015792+0000","last_unstale":"2023-07-24T05:46:07.483100+0000","last_undegraded":"2023-07-24T05:46:07.483100+0000","last_fullsized":"2023-07-24T05:46:07.483100+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:52:03.648761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.483288+0000","last_change":"2023-07-24T05:46:00.933134+0000","last_active":"2023-07-24T05:46:07.483288+0000","last_peered":"2023-07-24T05:46:07.483288+0000","last_clean":"2023-07-24T05:46:07.483288+0000","last_became_active":"2023-07-24T05:46:00.932531+0000","last_became_peered":"2023-07-24T05:46:00.932531+0000","last_unstale":"2023-07-24T05:46:07.483288+0000","last_undegraded":"2023-07-24T05:46:07.483288+0000","last_fullsized":"2023-07-24T05:46:07.483288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:21:40.350408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.487206+0000","last_change":"2023-07-24T05:45:54.346766+0000","last_active":"2023-07-24T05:46:07.487206+0000","last_peered":"2023-07-24T05:46:07.487206+0000","last_clean":"2023-07-24T05:46:07.487206+0000","last_became_active":"2023-07-24T05:45:54.346404+0000","last_became_peered":"2023-07-24T05:45:54.346404+0000","last_unstale":"2023-07-24T05:46:07.487206+0000","last_undegraded":"2023-07-24T05:46:07.487206+0000","last_fullsized":"2023-07-24T05:46:07.487206+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:41:48.652814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.484987+0000","last_change":"2023-07-24T05:45:59.909030+0000","last_active":"2023-07-24T05:46:07.484987+0000","last_peered":"2023-07-24T05:46:07.484987+0000","last_clean":"2023-07-24T05:46:07.484987+0000","last_became_active":"2023-07-24T05:45:59.908731+0000","last_became_peered":"2023-07-24T05:45:59.908731+0000","last_unstale":"2023-07-24T05:46:07.484987+0000","last_undegraded":"2023-07-24T05:46:07.484987+0000","last_fullsized":"2023-07-24T05:46:07.484987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:47:28.208042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.020418+0000","last_change":"2023-07-24T05:46:05.014582+0000","last_active":"2023-07-24T05:46:06.020418+0000","last_peered":"2023-07-24T05:46:06.020418+0000","last_clean":"2023-07-24T05:46:06.020418+0000","last_became_active":"2023-07-24T05:46:05.014202+0000","last_became_peered":"2023-07-24T05:46:05.014202+0000","last_unstale":"2023-07-24T05:46:06.020418+0000","last_undegraded":"2023-07-24T05:46:06.020418+0000","last_fullsized":"2023-07-24T05:46:06.020418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:08:46.149814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.719886+0000","last_change":"2023-07-24T05:46:00.935075+0000","last_active":"2023-07-24T05:46:06.719886+0000","last_peered":"2023-07-24T05:46:06.719886+0000","last_clean":"2023-07-24T05:46:06.719886+0000","last_became_active":"2023-07-24T05:46:00.934789+0000","last_became_peered":"2023-07-24T05:46:00.934789+0000","last_unstale":"2023-07-24T05:46:06.719886+0000","last_undegraded":"2023-07-24T05:46:06.719886+0000","last_fullsized":"2023-07-24T05:46:06.719886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:35:30.780605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.482573+0000","last_change":"2023-07-24T05:45:54.355858+0000","last_active":"2023-07-24T05:46:06.482573+0000","last_peered":"2023-07-24T05:46:06.482573+0000","last_clean":"2023-07-24T05:46:06.482573+0000","last_became_active":"2023-07-24T05:45:54.355598+0000","last_became_peered":"2023-07-24T05:45:54.355598+0000","last_unstale":"2023-07-24T05:46:06.482573+0000","last_undegraded":"2023-07-24T05:46:06.482573+0000","last_fullsized":"2023-07-24T05:46:06.482573+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:04:55.110927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486464+0000","last_change":"2023-07-24T05:45:59.902462+0000","last_active":"2023-07-24T05:46:07.486464+0000","last_peered":"2023-07-24T05:46:07.486464+0000","last_clean":"2023-07-24T05:46:07.486464+0000","last_became_active":"2023-07-24T05:45:59.902137+0000","last_became_peered":"2023-07-24T05:45:59.902137+0000","last_unstale":"2023-07-24T05:46:07.486464+0000","last_undegraded":"2023-07-24T05:46:07.486464+0000","last_fullsized":"2023-07-24T05:46:07.486464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:29:00.215998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.021410+0000","last_change":"2023-07-24T05:46:05.020732+0000","last_active":"2023-07-24T05:46:06.021410+0000","last_peered":"2023-07-24T05:46:06.021410+0000","last_clean":"2023-07-24T05:46:06.021410+0000","last_became_active":"2023-07-24T05:46:05.020404+0000","last_became_peered":"2023-07-24T05:46:05.020404+0000","last_unstale":"2023-07-24T05:46:06.021410+0000","last_undegraded":"2023-07-24T05:46:06.021410+0000","last_fullsized":"2023-07-24T05:46:06.021410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:19:13.139942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486329+0000","last_change":"2023-07-24T05:46:00.932855+0000","last_active":"2023-07-24T05:46:07.486329+0000","last_peered":"2023-07-24T05:46:07.486329+0000","last_clean":"2023-07-24T05:46:07.486329+0000","last_became_active":"2023-07-24T05:46:00.932529+0000","last_became_peered":"2023-07-24T05:46:00.932529+0000","last_unstale":"2023-07-24T05:46:07.486329+0000","last_undegraded":"2023-07-24T05:46:07.486329+0000","last_fullsized":"2023-07-24T05:46:07.486329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:26:42.584506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486661+0000","last_change":"2023-07-24T05:45:54.354128+0000","last_active":"2023-07-24T05:46:07.486661+0000","last_peered":"2023-07-24T05:46:07.486661+0000","last_clean":"2023-07-24T05:46:07.486661+0000","last_became_active":"2023-07-24T05:45:54.353816+0000","last_became_peered":"2023-07-24T05:45:54.353816+0000","last_unstale":"2023-07-24T05:46:07.486661+0000","last_undegraded":"2023-07-24T05:46:07.486661+0000","last_fullsized":"2023-07-24T05:46:07.486661+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:18:49.117398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486818+0000","last_change":"2023-07-24T05:45:59.910016+0000","last_active":"2023-07-24T05:46:07.486818+0000","last_peered":"2023-07-24T05:46:07.486818+0000","last_clean":"2023-07-24T05:46:07.486818+0000","last_became_active":"2023-07-24T05:45:59.909740+0000","last_became_peered":"2023-07-24T05:45:59.909740+0000","last_unstale":"2023-07-24T05:46:07.486818+0000","last_undegraded":"2023-07-24T05:46:07.486818+0000","last_fullsized":"2023-07-24T05:46:07.486818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:29:00.215998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.719697+0000","last_change":"2023-07-24T05:46:05.024839+0000","last_active":"2023-07-24T05:46:06.719697+0000","last_peered":"2023-07-24T05:46:06.719697+0000","last_clean":"2023-07-24T05:46:06.719697+0000","last_became_active":"2023-07-24T05:46:05.024447+0000","last_became_peered":"2023-07-24T05:46:05.024447+0000","last_unstale":"2023-07-24T05:46:06.719697+0000","last_undegraded":"2023-07-24T05:46:06.719697+0000","last_fullsized":"2023-07-24T05:46:06.719697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:39:44.669092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486397+0000","last_change":"2023-07-24T05:46:00.938782+0000","last_active":"2023-07-24T05:46:07.486397+0000","last_peered":"2023-07-24T05:46:07.486397+0000","last_clean":"2023-07-24T05:46:07.486397+0000","last_became_active":"2023-07-24T05:46:00.938402+0000","last_became_peered":"2023-07-24T05:46:00.938402+0000","last_unstale":"2023-07-24T05:46:07.486397+0000","last_undegraded":"2023-07-24T05:46:07.486397+0000","last_fullsized":"2023-07-24T05:46:07.486397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:18:26.734018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023120+0000","last_change":"2023-07-24T05:45:59.909892+0000","last_active":"2023-07-24T05:46:06.023120+0000","last_peered":"2023-07-24T05:46:06.023120+0000","last_clean":"2023-07-24T05:46:06.023120+0000","last_became_active":"2023-07-24T05:45:59.909552+0000","last_became_peered":"2023-07-24T05:45:59.909552+0000","last_unstale":"2023-07-24T05:46:06.023120+0000","last_undegraded":"2023-07-24T05:46:06.023120+0000","last_fullsized":"2023-07-24T05:46:06.023120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:32:56.241515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486150+0000","last_change":"2023-07-24T05:45:54.353232+0000","last_active":"2023-07-24T05:46:07.486150+0000","last_peered":"2023-07-24T05:46:07.486150+0000","last_clean":"2023-07-24T05:46:07.486150+0000","last_became_active":"2023-07-24T05:45:54.352983+0000","last_became_peered":"2023-07-24T05:45:54.352983+0000","last_unstale":"2023-07-24T05:46:07.486150+0000","last_undegraded":"2023-07-24T05:46:07.486150+0000","last_fullsized":"2023-07-24T05:46:07.486150+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:13:51.706275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.720334+0000","last_change":"2023-07-24T05:46:05.026068+0000","last_active":"2023-07-24T05:46:06.720334+0000","last_peered":"2023-07-24T05:46:06.720334+0000","last_clean":"2023-07-24T05:46:06.720334+0000","last_became_active":"2023-07-24T05:46:05.025042+0000","last_became_peered":"2023-07-24T05:46:05.025042+0000","last_unstale":"2023-07-24T05:46:06.720334+0000","last_undegraded":"2023-07-24T05:46:06.720334+0000","last_fullsized":"2023-07-24T05:46:06.720334+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:35:03.922426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.487482+0000","last_change":"2023-07-24T05:46:00.937728+0000","last_active":"2023-07-24T05:46:07.487482+0000","last_peered":"2023-07-24T05:46:07.487482+0000","last_clean":"2023-07-24T05:46:07.487482+0000","last_became_active":"2023-07-24T05:46:00.937334+0000","last_became_peered":"2023-07-24T05:46:00.937334+0000","last_unstale":"2023-07-24T05:46:07.487482+0000","last_undegraded":"2023-07-24T05:46:07.487482+0000","last_fullsized":"2023-07-24T05:46:07.487482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:44:23.859944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.485666+0000","last_change":"2023-07-24T05:45:59.902663+0000","last_active":"2023-07-24T05:46:07.485666+0000","last_peered":"2023-07-24T05:46:07.485666+0000","last_clean":"2023-07-24T05:46:07.485666+0000","last_became_active":"2023-07-24T05:45:59.902383+0000","last_became_peered":"2023-07-24T05:45:59.902383+0000","last_unstale":"2023-07-24T05:46:07.485666+0000","last_undegraded":"2023-07-24T05:46:07.485666+0000","last_fullsized":"2023-07-24T05:46:07.485666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T05:47:06.412190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.017303+0000","last_change":"2023-07-24T05:45:54.349000+0000","last_active":"2023-07-24T05:46:06.017303+0000","last_peered":"2023-07-24T05:46:06.017303+0000","last_clean":"2023-07-24T05:46:06.017303+0000","last_became_active":"2023-07-24T05:45:54.348646+0000","last_became_peered":"2023-07-24T05:45:54.348646+0000","last_unstale":"2023-07-24T05:46:06.017303+0000","last_undegraded":"2023-07-24T05:46:06.017303+0000","last_fullsized":"2023-07-24T05:46:06.017303+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:25:22.452188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.018595+0000","last_change":"2023-07-24T05:46:05.015931+0000","last_active":"2023-07-24T05:46:06.018595+0000","last_peered":"2023-07-24T05:46:06.018595+0000","last_clean":"2023-07-24T05:46:06.018595+0000","last_became_active":"2023-07-24T05:46:05.013649+0000","last_became_peered":"2023-07-24T05:46:05.013649+0000","last_unstale":"2023-07-24T05:46:06.018595+0000","last_undegraded":"2023-07-24T05:46:06.018595+0000","last_fullsized":"2023-07-24T05:46:06.018595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:02:14.273821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.720047+0000","last_change":"2023-07-24T05:46:00.942679+0000","last_active":"2023-07-24T05:46:06.720047+0000","last_peered":"2023-07-24T05:46:06.720047+0000","last_clean":"2023-07-24T05:46:06.720047+0000","last_became_active":"2023-07-24T05:46:00.941904+0000","last_became_peered":"2023-07-24T05:46:00.941904+0000","last_unstale":"2023-07-24T05:46:06.720047+0000","last_undegraded":"2023-07-24T05:46:06.720047+0000","last_fullsized":"2023-07-24T05:46:06.720047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:37:25.195905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.718941+0000","last_change":"2023-07-24T05:45:59.905040+0000","last_active":"2023-07-24T05:46:06.718941+0000","last_peered":"2023-07-24T05:46:06.718941+0000","last_clean":"2023-07-24T05:46:06.718941+0000","last_became_active":"2023-07-24T05:45:59.904704+0000","last_became_peered":"2023-07-24T05:45:59.904704+0000","last_unstale":"2023-07-24T05:46:06.718941+0000","last_undegraded":"2023-07-24T05:46:06.718941+0000","last_fullsized":"2023-07-24T05:46:06.718941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:14:26.074102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.481364+0000","last_change":"2023-07-24T05:45:54.350803+0000","last_active":"2023-07-24T05:46:06.481364+0000","last_peered":"2023-07-24T05:46:06.481364+0000","last_clean":"2023-07-24T05:46:06.481364+0000","last_became_active":"2023-07-24T05:45:54.350427+0000","last_became_peered":"2023-07-24T05:45:54.350427+0000","last_unstale":"2023-07-24T05:46:06.481364+0000","last_undegraded":"2023-07-24T05:46:06.481364+0000","last_fullsized":"2023-07-24T05:46:06.481364+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:41:48.652814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486965+0000","last_change":"2023-07-24T05:46:05.021436+0000","last_active":"2023-07-24T05:46:07.486965+0000","last_peered":"2023-07-24T05:46:07.486965+0000","last_clean":"2023-07-24T05:46:07.486965+0000","last_became_active":"2023-07-24T05:46:05.020835+0000","last_became_peered":"2023-07-24T05:46:05.020835+0000","last_unstale":"2023-07-24T05:46:07.486965+0000","last_undegraded":"2023-07-24T05:46:07.486965+0000","last_fullsized":"2023-07-24T05:46:07.486965+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:37:20.869353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.021744+0000","last_change":"2023-07-24T05:46:00.936580+0000","last_active":"2023-07-24T05:46:06.021744+0000","last_peered":"2023-07-24T05:46:06.021744+0000","last_clean":"2023-07-24T05:46:06.021744+0000","last_became_active":"2023-07-24T05:46:00.936229+0000","last_became_peered":"2023-07-24T05:46:00.936229+0000","last_unstale":"2023-07-24T05:46:06.021744+0000","last_undegraded":"2023-07-24T05:46:06.021744+0000","last_fullsized":"2023-07-24T05:46:06.021744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:56:32.104824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.483869+0000","last_change":"2023-07-24T05:45:59.909952+0000","last_active":"2023-07-24T05:46:07.483869+0000","last_peered":"2023-07-24T05:46:07.483869+0000","last_clean":"2023-07-24T05:46:07.483869+0000","last_became_active":"2023-07-24T05:45:59.909649+0000","last_became_peered":"2023-07-24T05:45:59.909649+0000","last_unstale":"2023-07-24T05:46:07.483869+0000","last_undegraded":"2023-07-24T05:46:07.483869+0000","last_fullsized":"2023-07-24T05:46:07.483869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T16:11:54.051701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486355+0000","last_change":"2023-07-24T05:45:54.351103+0000","last_active":"2023-07-24T05:46:07.486355+0000","last_peered":"2023-07-24T05:46:07.486355+0000","last_clean":"2023-07-24T05:46:07.486355+0000","last_became_active":"2023-07-24T05:45:54.350628+0000","last_became_peered":"2023-07-24T05:45:54.350628+0000","last_unstale":"2023-07-24T05:46:07.486355+0000","last_undegraded":"2023-07-24T05:46:07.486355+0000","last_fullsized":"2023-07-24T05:46:07.486355+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T05:47:00.879682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":177,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.481430+0000","last_change":"2023-07-24T05:45:54.356765+0000","last_active":"2023-07-24T05:46:06.481430+0000","last_peered":"2023-07-24T05:46:06.481430+0000","last_clean":"2023-07-24T05:46:06.481430+0000","last_became_active":"2023-07-24T05:45:54.355687+0000","last_became_peered":"2023-07-24T05:45:54.355687+0000","last_unstale":"2023-07-24T05:46:06.481430+0000","last_undegraded":"2023-07-24T05:46:06.481430+0000","last_fullsized":"2023-07-24T05:46:06.481430+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:54:08.245065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.481843+0000","last_change":"2023-07-24T05:46:05.031446+0000","last_active":"2023-07-24T05:46:06.481843+0000","last_peered":"2023-07-24T05:46:06.481843+0000","last_clean":"2023-07-24T05:46:06.481843+0000","last_became_active":"2023-07-24T05:46:05.024845+0000","last_became_peered":"2023-07-24T05:46:05.024845+0000","last_unstale":"2023-07-24T05:46:06.481843+0000","last_undegraded":"2023-07-24T05:46:06.481843+0000","last_fullsized":"2023-07-24T05:46:06.481843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:21:24.557827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.487407+0000","last_change":"2023-07-24T05:46:00.951820+0000","last_active":"2023-07-24T05:46:07.487407+0000","last_peered":"2023-07-24T05:46:07.487407+0000","last_clean":"2023-07-24T05:46:07.487407+0000","last_became_active":"2023-07-24T05:46:00.951559+0000","last_became_peered":"2023-07-24T05:46:00.951559+0000","last_unstale":"2023-07-24T05:46:07.487407+0000","last_undegraded":"2023-07-24T05:46:07.487407+0000","last_fullsized":"2023-07-24T05:46:07.487407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:54:14.788733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.483532+0000","last_change":"2023-07-24T05:45:59.900996+0000","last_active":"2023-07-24T05:46:07.483532+0000","last_peered":"2023-07-24T05:46:07.483532+0000","last_clean":"2023-07-24T05:46:07.483532+0000","last_became_active":"2023-07-24T05:45:59.900724+0000","last_became_peered":"2023-07-24T05:45:59.900724+0000","last_unstale":"2023-07-24T05:46:07.483532+0000","last_undegraded":"2023-07-24T05:46:07.483532+0000","last_fullsized":"2023-07-24T05:46:07.483532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T05:50:54.789729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023915+0000","last_change":"2023-07-24T05:46:05.016680+0000","last_active":"2023-07-24T05:46:06.023915+0000","last_peered":"2023-07-24T05:46:06.023915+0000","last_clean":"2023-07-24T05:46:06.023915+0000","last_became_active":"2023-07-24T05:46:05.016328+0000","last_became_peered":"2023-07-24T05:46:05.016328+0000","last_unstale":"2023-07-24T05:46:06.023915+0000","last_undegraded":"2023-07-24T05:46:06.023915+0000","last_fullsized":"2023-07-24T05:46:06.023915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:23:56.011534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023923+0000","last_change":"2023-07-24T05:46:00.929728+0000","last_active":"2023-07-24T05:46:06.023923+0000","last_peered":"2023-07-24T05:46:06.023923+0000","last_clean":"2023-07-24T05:46:06.023923+0000","last_became_active":"2023-07-24T05:46:00.929370+0000","last_became_peered":"2023-07-24T05:46:00.929370+0000","last_unstale":"2023-07-24T05:46:06.023923+0000","last_undegraded":"2023-07-24T05:46:06.023923+0000","last_fullsized":"2023-07-24T05:46:06.023923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:21:03.638024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.022985+0000","last_change":"2023-07-24T05:45:59.898271+0000","last_active":"2023-07-24T05:46:06.022985+0000","last_peered":"2023-07-24T05:46:06.022985+0000","last_clean":"2023-07-24T05:46:06.022985+0000","last_became_active":"2023-07-24T05:45:59.897886+0000","last_became_peered":"2023-07-24T05:45:59.897886+0000","last_unstale":"2023-07-24T05:46:06.022985+0000","last_undegraded":"2023-07-24T05:46:06.022985+0000","last_fullsized":"2023-07-24T05:46:06.022985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:25:43.491840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486953+0000","last_change":"2023-07-24T05:46:05.028021+0000","last_active":"2023-07-24T05:46:07.486953+0000","last_peered":"2023-07-24T05:46:07.486953+0000","last_clean":"2023-07-24T05:46:07.486953+0000","last_became_active":"2023-07-24T05:46:05.027497+0000","last_became_peered":"2023-07-24T05:46:05.027497+0000","last_unstale":"2023-07-24T05:46:07.486953+0000","last_undegraded":"2023-07-24T05:46:07.486953+0000","last_fullsized":"2023-07-24T05:46:07.486953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:18:59.759729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023787+0000","last_change":"2023-07-24T05:46:00.934906+0000","last_active":"2023-07-24T05:46:06.023787+0000","last_peered":"2023-07-24T05:46:06.023787+0000","last_clean":"2023-07-24T05:46:06.023787+0000","last_became_active":"2023-07-24T05:46:00.934638+0000","last_became_peered":"2023-07-24T05:46:00.934638+0000","last_unstale":"2023-07-24T05:46:06.023787+0000","last_undegraded":"2023-07-24T05:46:06.023787+0000","last_fullsized":"2023-07-24T05:46:06.023787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:41:49.497015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.021959+0000","last_change":"2023-07-24T05:45:59.905289+0000","last_active":"2023-07-24T05:46:06.021959+0000","last_peered":"2023-07-24T05:46:06.021959+0000","last_clean":"2023-07-24T05:46:06.021959+0000","last_became_active":"2023-07-24T05:45:59.904879+0000","last_became_peered":"2023-07-24T05:45:59.904879+0000","last_unstale":"2023-07-24T05:46:06.021959+0000","last_undegraded":"2023-07-24T05:46:06.021959+0000","last_fullsized":"2023-07-24T05:46:06.021959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:27:08.531843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486029+0000","last_change":"2023-07-24T05:46:05.027486+0000","last_active":"2023-07-24T05:46:07.486029+0000","last_peered":"2023-07-24T05:46:07.486029+0000","last_clean":"2023-07-24T05:46:07.486029+0000","last_became_active":"2023-07-24T05:46:05.027085+0000","last_became_peered":"2023-07-24T05:46:05.027085+0000","last_unstale":"2023-07-24T05:46:07.486029+0000","last_undegraded":"2023-07-24T05:46:07.486029+0000","last_fullsized":"2023-07-24T05:46:07.486029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:16:02.948425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023538+0000","last_change":"2023-07-24T05:46:00.934235+0000","last_active":"2023-07-24T05:46:06.023538+0000","last_peered":"2023-07-24T05:46:06.023538+0000","last_clean":"2023-07-24T05:46:06.023538+0000","last_became_active":"2023-07-24T05:46:00.933521+0000","last_became_peered":"2023-07-24T05:46:00.933521+0000","last_unstale":"2023-07-24T05:46:06.023538+0000","last_undegraded":"2023-07-24T05:46:06.023538+0000","last_fullsized":"2023-07-24T05:46:06.023538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:20:03.823702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.484224+0000","last_change":"2023-07-24T05:45:59.908218+0000","last_active":"2023-07-24T05:46:07.484224+0000","last_peered":"2023-07-24T05:46:07.484224+0000","last_clean":"2023-07-24T05:46:07.484224+0000","last_became_active":"2023-07-24T05:45:59.905094+0000","last_became_peered":"2023-07-24T05:45:59.905094+0000","last_unstale":"2023-07-24T05:46:07.484224+0000","last_undegraded":"2023-07-24T05:46:07.484224+0000","last_fullsized":"2023-07-24T05:46:07.484224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:59:25.131271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.018333+0000","last_change":"2023-07-24T05:46:05.014000+0000","last_active":"2023-07-24T05:46:06.018333+0000","last_peered":"2023-07-24T05:46:06.018333+0000","last_clean":"2023-07-24T05:46:06.018333+0000","last_became_active":"2023-07-24T05:46:05.013545+0000","last_became_peered":"2023-07-24T05:46:05.013545+0000","last_unstale":"2023-07-24T05:46:06.018333+0000","last_undegraded":"2023-07-24T05:46:06.018333+0000","last_fullsized":"2023-07-24T05:46:06.018333+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:30:34.177072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.719968+0000","last_change":"2023-07-24T05:46:00.942615+0000","last_active":"2023-07-24T05:46:06.719968+0000","last_peered":"2023-07-24T05:46:06.719968+0000","last_clean":"2023-07-24T05:46:06.719968+0000","last_became_active":"2023-07-24T05:46:00.942343+0000","last_became_peered":"2023-07-24T05:46:00.942343+0000","last_unstale":"2023-07-24T05:46:06.719968+0000","last_undegraded":"2023-07-24T05:46:06.719968+0000","last_fullsized":"2023-07-24T05:46:06.719968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:16:15.816474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486385+0000","last_change":"2023-07-24T05:45:59.904112+0000","last_active":"2023-07-24T05:46:07.486385+0000","last_peered":"2023-07-24T05:46:07.486385+0000","last_clean":"2023-07-24T05:46:07.486385+0000","last_became_active":"2023-07-24T05:45:59.903760+0000","last_became_peered":"2023-07-24T05:45:59.903760+0000","last_unstale":"2023-07-24T05:46:07.486385+0000","last_undegraded":"2023-07-24T05:46:07.486385+0000","last_fullsized":"2023-07-24T05:46:07.486385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:18:09.932761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.017429+0000","last_change":"2023-07-24T05:46:05.014076+0000","last_active":"2023-07-24T05:46:06.017429+0000","last_peered":"2023-07-24T05:46:06.017429+0000","last_clean":"2023-07-24T05:46:06.017429+0000","last_became_active":"2023-07-24T05:46:05.013619+0000","last_became_peered":"2023-07-24T05:46:05.013619+0000","last_unstale":"2023-07-24T05:46:06.017429+0000","last_undegraded":"2023-07-24T05:46:06.017429+0000","last_fullsized":"2023-07-24T05:46:06.017429+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:43:11.918523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.021542+0000","last_change":"2023-07-24T05:46:00.940659+0000","last_active":"2023-07-24T05:46:06.021542+0000","last_peered":"2023-07-24T05:46:06.021542+0000","last_clean":"2023-07-24T05:46:06.021542+0000","last_became_active":"2023-07-24T05:46:00.940369+0000","last_became_peered":"2023-07-24T05:46:00.940369+0000","last_unstale":"2023-07-24T05:46:06.021542+0000","last_undegraded":"2023-07-24T05:46:06.021542+0000","last_fullsized":"2023-07-24T05:46:06.021542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:52:54.919489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.482583+0000","last_change":"2023-07-24T05:45:59.912501+0000","last_active":"2023-07-24T05:46:06.482583+0000","last_peered":"2023-07-24T05:46:06.482583+0000","last_clean":"2023-07-24T05:46:06.482583+0000","last_became_active":"2023-07-24T05:45:59.912147+0000","last_became_peered":"2023-07-24T05:45:59.912147+0000","last_unstale":"2023-07-24T05:46:06.482583+0000","last_undegraded":"2023-07-24T05:46:06.482583+0000","last_fullsized":"2023-07-24T05:46:06.482583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:21:00.823778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.018222+0000","last_change":"2023-07-24T05:46:05.015069+0000","last_active":"2023-07-24T05:46:06.018222+0000","last_peered":"2023-07-24T05:46:06.018222+0000","last_clean":"2023-07-24T05:46:06.018222+0000","last_became_active":"2023-07-24T05:46:05.014697+0000","last_became_peered":"2023-07-24T05:46:05.014697+0000","last_unstale":"2023-07-24T05:46:06.018222+0000","last_undegraded":"2023-07-24T05:46:06.018222+0000","last_fullsized":"2023-07-24T05:46:06.018222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:20:31.902334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.020882+0000","last_change":"2023-07-24T05:46:00.943156+0000","last_active":"2023-07-24T05:46:06.020882+0000","last_peered":"2023-07-24T05:46:06.020882+0000","last_clean":"2023-07-24T05:46:06.020882+0000","last_became_active":"2023-07-24T05:46:00.942833+0000","last_became_peered":"2023-07-24T05:46:00.942833+0000","last_unstale":"2023-07-24T05:46:06.020882+0000","last_undegraded":"2023-07-24T05:46:06.020882+0000","last_fullsized":"2023-07-24T05:46:06.020882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:20:21.843640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.482833+0000","last_change":"2023-07-24T05:45:59.915627+0000","last_active":"2023-07-24T05:46:06.482833+0000","last_peered":"2023-07-24T05:46:06.482833+0000","last_clean":"2023-07-24T05:46:06.482833+0000","last_became_active":"2023-07-24T05:45:59.914637+0000","last_became_peered":"2023-07-24T05:45:59.914637+0000","last_unstale":"2023-07-24T05:46:06.482833+0000","last_undegraded":"2023-07-24T05:46:06.482833+0000","last_fullsized":"2023-07-24T05:46:06.482833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:39:35.102402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.017196+0000","last_change":"2023-07-24T05:46:05.011172+0000","last_active":"2023-07-24T05:46:06.017196+0000","last_peered":"2023-07-24T05:46:06.017196+0000","last_clean":"2023-07-24T05:46:06.017196+0000","last_became_active":"2023-07-24T05:46:05.010777+0000","last_became_peered":"2023-07-24T05:46:05.010777+0000","last_unstale":"2023-07-24T05:46:06.017196+0000","last_undegraded":"2023-07-24T05:46:06.017196+0000","last_fullsized":"2023-07-24T05:46:06.017196+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:26:39.193132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.485649+0000","last_change":"2023-07-24T05:46:00.934405+0000","last_active":"2023-07-24T05:46:07.485649+0000","last_peered":"2023-07-24T05:46:07.485649+0000","last_clean":"2023-07-24T05:46:07.485649+0000","last_became_active":"2023-07-24T05:46:00.934126+0000","last_became_peered":"2023-07-24T05:46:00.934126+0000","last_unstale":"2023-07-24T05:46:07.485649+0000","last_undegraded":"2023-07-24T05:46:07.485649+0000","last_fullsized":"2023-07-24T05:46:07.485649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:05:57.654666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.482743+0000","last_change":"2023-07-24T05:45:59.917679+0000","last_active":"2023-07-24T05:46:06.482743+0000","last_peered":"2023-07-24T05:46:06.482743+0000","last_clean":"2023-07-24T05:46:06.482743+0000","last_became_active":"2023-07-24T05:45:59.917405+0000","last_became_peered":"2023-07-24T05:45:59.917405+0000","last_unstale":"2023-07-24T05:46:06.482743+0000","last_undegraded":"2023-07-24T05:46:06.482743+0000","last_fullsized":"2023-07-24T05:46:06.482743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:34:24.141383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.481505+0000","last_change":"2023-07-24T05:46:05.024741+0000","last_active":"2023-07-24T05:46:06.481505+0000","last_peered":"2023-07-24T05:46:06.481505+0000","last_clean":"2023-07-24T05:46:06.481505+0000","last_became_active":"2023-07-24T05:46:05.024355+0000","last_became_peered":"2023-07-24T05:46:05.024355+0000","last_unstale":"2023-07-24T05:46:06.481505+0000","last_undegraded":"2023-07-24T05:46:06.481505+0000","last_fullsized":"2023-07-24T05:46:06.481505+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:01:06.159423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486150+0000","last_change":"2023-07-24T05:46:05.025607+0000","last_active":"2023-07-24T05:46:07.486150+0000","last_peered":"2023-07-24T05:46:07.486150+0000","last_clean":"2023-07-24T05:46:07.486150+0000","last_became_active":"2023-07-24T05:46:05.025184+0000","last_became_peered":"2023-07-24T05:46:05.025184+0000","last_unstale":"2023-07-24T05:46:07.486150+0000","last_undegraded":"2023-07-24T05:46:07.486150+0000","last_fullsized":"2023-07-24T05:46:07.486150+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:07:04.576293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.020902+0000","last_change":"2023-07-24T05:45:59.893932+0000","last_active":"2023-07-24T05:46:06.020902+0000","last_peered":"2023-07-24T05:46:06.020902+0000","last_clean":"2023-07-24T05:46:06.020902+0000","last_became_active":"2023-07-24T05:45:59.893642+0000","last_became_peered":"2023-07-24T05:45:59.893642+0000","last_unstale":"2023-07-24T05:46:06.020902+0000","last_undegraded":"2023-07-24T05:46:06.020902+0000","last_fullsized":"2023-07-24T05:46:06.020902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:52:27.141526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.484842+0000","last_change":"2023-07-24T05:46:00.945824+0000","last_active":"2023-07-24T05:46:07.484842+0000","last_peered":"2023-07-24T05:46:07.484842+0000","last_clean":"2023-07-24T05:46:07.484842+0000","last_became_active":"2023-07-24T05:46:00.945507+0000","last_became_peered":"2023-07-24T05:46:00.945507+0000","last_unstale":"2023-07-24T05:46:07.484842+0000","last_undegraded":"2023-07-24T05:46:07.484842+0000","last_fullsized":"2023-07-24T05:46:07.484842+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:45:28.785621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.484595+0000","last_change":"2023-07-24T05:46:05.012722+0000","last_active":"2023-07-24T05:46:07.484595+0000","last_peered":"2023-07-24T05:46:07.484595+0000","last_clean":"2023-07-24T05:46:07.484595+0000","last_became_active":"2023-07-24T05:46:05.012277+0000","last_became_peered":"2023-07-24T05:46:05.012277+0000","last_unstale":"2023-07-24T05:46:07.484595+0000","last_undegraded":"2023-07-24T05:46:07.484595+0000","last_fullsized":"2023-07-24T05:46:07.484595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:52:02.115068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.481785+0000","last_change":"2023-07-24T05:45:59.917206+0000","last_active":"2023-07-24T05:46:06.481785+0000","last_peered":"2023-07-24T05:46:06.481785+0000","last_clean":"2023-07-24T05:46:06.481785+0000","last_became_active":"2023-07-24T05:45:59.916943+0000","last_became_peered":"2023-07-24T05:45:59.916943+0000","last_unstale":"2023-07-24T05:46:06.481785+0000","last_undegraded":"2023-07-24T05:46:06.481785+0000","last_fullsized":"2023-07-24T05:46:06.481785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:27:17.744313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.720189+0000","last_change":"2023-07-24T05:46:00.936641+0000","last_active":"2023-07-24T05:46:06.720189+0000","last_peered":"2023-07-24T05:46:06.720189+0000","last_clean":"2023-07-24T05:46:06.720189+0000","last_became_active":"2023-07-24T05:46:00.936319+0000","last_became_peered":"2023-07-24T05:46:00.936319+0000","last_unstale":"2023-07-24T05:46:06.720189+0000","last_undegraded":"2023-07-24T05:46:06.720189+0000","last_fullsized":"2023-07-24T05:46:06.720189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:10:55.303833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.719149+0000","last_change":"2023-07-24T05:45:59.900013+0000","last_active":"2023-07-24T05:46:06.719149+0000","last_peered":"2023-07-24T05:46:06.719149+0000","last_clean":"2023-07-24T05:46:06.719149+0000","last_became_active":"2023-07-24T05:45:59.899700+0000","last_became_peered":"2023-07-24T05:45:59.899700+0000","last_unstale":"2023-07-24T05:46:06.719149+0000","last_undegraded":"2023-07-24T05:46:06.719149+0000","last_fullsized":"2023-07-24T05:46:06.719149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:33:29.936263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486499+0000","last_change":"2023-07-24T05:46:00.940858+0000","last_active":"2023-07-24T05:46:07.486499+0000","last_peered":"2023-07-24T05:46:07.486499+0000","last_clean":"2023-07-24T05:46:07.486499+0000","last_became_active":"2023-07-24T05:46:00.940529+0000","last_became_peered":"2023-07-24T05:46:00.940529+0000","last_unstale":"2023-07-24T05:46:07.486499+0000","last_undegraded":"2023-07-24T05:46:07.486499+0000","last_fullsized":"2023-07-24T05:46:07.486499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:15:58.849762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.483911+0000","last_change":"2023-07-24T05:46:05.014910+0000","last_active":"2023-07-24T05:46:07.483911+0000","last_peered":"2023-07-24T05:46:07.483911+0000","last_clean":"2023-07-24T05:46:07.483911+0000","last_became_active":"2023-07-24T05:46:05.014511+0000","last_became_peered":"2023-07-24T05:46:05.014511+0000","last_unstale":"2023-07-24T05:46:07.483911+0000","last_undegraded":"2023-07-24T05:46:07.483911+0000","last_fullsized":"2023-07-24T05:46:07.483911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:34:15.032724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.481980+0000","last_change":"2023-07-24T05:45:59.916266+0000","last_active":"2023-07-24T05:46:06.481980+0000","last_peered":"2023-07-24T05:46:06.481980+0000","last_clean":"2023-07-24T05:46:06.481980+0000","last_became_active":"2023-07-24T05:45:59.914544+0000","last_became_peered":"2023-07-24T05:45:59.914544+0000","last_unstale":"2023-07-24T05:46:06.481980+0000","last_undegraded":"2023-07-24T05:46:06.481980+0000","last_fullsized":"2023-07-24T05:46:06.481980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:58.856693+0000","last_clean_scrub_stamp":"2023-07-24T05:45:58.856693+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:33:27.607916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.484475+0000","last_change":"2023-07-24T05:46:00.953089+0000","last_active":"2023-07-24T05:46:07.484475+0000","last_peered":"2023-07-24T05:46:07.484475+0000","last_clean":"2023-07-24T05:46:07.484475+0000","last_became_active":"2023-07-24T05:46:00.952556+0000","last_became_peered":"2023-07-24T05:46:00.952556+0000","last_unstale":"2023-07-24T05:46:07.484475+0000","last_undegraded":"2023-07-24T05:46:07.484475+0000","last_fullsized":"2023-07-24T05:46:07.484475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:17:13.270600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486360+0000","last_change":"2023-07-24T05:46:05.019474+0000","last_active":"2023-07-24T05:46:07.486360+0000","last_peered":"2023-07-24T05:46:07.486360+0000","last_clean":"2023-07-24T05:46:07.486360+0000","last_became_active":"2023-07-24T05:46:05.019086+0000","last_became_peered":"2023-07-24T05:46:05.019086+0000","last_unstale":"2023-07-24T05:46:07.486360+0000","last_undegraded":"2023-07-24T05:46:07.486360+0000","last_fullsized":"2023-07-24T05:46:07.486360+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:46:03.966516+0000","last_clean_scrub_stamp":"2023-07-24T05:46:03.966516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:09:07.896789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.020739+0000","last_change":"2023-07-24T05:46:00.936747+0000","last_active":"2023-07-24T05:46:06.020739+0000","last_peered":"2023-07-24T05:46:06.020739+0000","last_clean":"2023-07-24T05:46:06.020739+0000","last_became_active":"2023-07-24T05:46:00.936461+0000","last_became_peered":"2023-07-24T05:46:00.936461+0000","last_unstale":"2023-07-24T05:46:06.020739+0000","last_undegraded":"2023-07-24T05:46:06.020739+0000","last_fullsized":"2023-07-24T05:46:06.020739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:55:23.971299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.483640+0000","last_change":"2023-07-24T05:46:00.943313+0000","last_active":"2023-07-24T05:46:07.483640+0000","last_peered":"2023-07-24T05:46:07.483640+0000","last_clean":"2023-07-24T05:46:07.483640+0000","last_became_active":"2023-07-24T05:46:00.943036+0000","last_became_peered":"2023-07-24T05:46:00.943036+0000","last_unstale":"2023-07-24T05:46:07.483640+0000","last_undegraded":"2023-07-24T05:46:07.483640+0000","last_fullsized":"2023-07-24T05:46:07.483640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:00:32.924792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023237+0000","last_change":"2023-07-24T05:46:00.930795+0000","last_active":"2023-07-24T05:46:06.023237+0000","last_peered":"2023-07-24T05:46:06.023237+0000","last_clean":"2023-07-24T05:46:06.023237+0000","last_became_active":"2023-07-24T05:46:00.930447+0000","last_became_peered":"2023-07-24T05:46:00.930447+0000","last_unstale":"2023-07-24T05:46:06.023237+0000","last_undegraded":"2023-07-24T05:46:06.023237+0000","last_fullsized":"2023-07-24T05:46:06.023237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:28:47.348353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.484078+0000","last_change":"2023-07-24T05:46:00.945856+0000","last_active":"2023-07-24T05:46:07.484078+0000","last_peered":"2023-07-24T05:46:07.484078+0000","last_clean":"2023-07-24T05:46:07.484078+0000","last_became_active":"2023-07-24T05:46:00.945620+0000","last_became_peered":"2023-07-24T05:46:00.945620+0000","last_unstale":"2023-07-24T05:46:07.484078+0000","last_undegraded":"2023-07-24T05:46:07.484078+0000","last_fullsized":"2023-07-24T05:46:07.484078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:02:38.151470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486593+0000","last_change":"2023-07-24T05:46:00.946115+0000","last_active":"2023-07-24T05:46:07.486593+0000","last_peered":"2023-07-24T05:46:07.486593+0000","last_clean":"2023-07-24T05:46:07.486593+0000","last_became_active":"2023-07-24T05:46:00.945731+0000","last_became_peered":"2023-07-24T05:46:00.945731+0000","last_unstale":"2023-07-24T05:46:07.486593+0000","last_undegraded":"2023-07-24T05:46:07.486593+0000","last_fullsized":"2023-07-24T05:46:07.486593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:39:17.210783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486565+0000","last_change":"2023-07-24T05:46:00.935106+0000","last_active":"2023-07-24T05:46:07.486565+0000","last_peered":"2023-07-24T05:46:07.486565+0000","last_clean":"2023-07-24T05:46:07.486565+0000","last_became_active":"2023-07-24T05:46:00.934759+0000","last_became_peered":"2023-07-24T05:46:00.934759+0000","last_unstale":"2023-07-24T05:46:07.486565+0000","last_undegraded":"2023-07-24T05:46:07.486565+0000","last_fullsized":"2023-07-24T05:46:07.486565+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T05:59:20.619052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.487093+0000","last_change":"2023-07-24T05:46:00.937903+0000","last_active":"2023-07-24T05:46:07.487093+0000","last_peered":"2023-07-24T05:46:07.487093+0000","last_clean":"2023-07-24T05:46:07.487093+0000","last_became_active":"2023-07-24T05:46:00.937520+0000","last_became_peered":"2023-07-24T05:46:00.937520+0000","last_unstale":"2023-07-24T05:46:07.487093+0000","last_undegraded":"2023-07-24T05:46:07.487093+0000","last_fullsized":"2023-07-24T05:46:07.487093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:56:28.386440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.487373+0000","last_change":"2023-07-24T05:46:00.950064+0000","last_active":"2023-07-24T05:46:07.487373+0000","last_peered":"2023-07-24T05:46:07.487373+0000","last_clean":"2023-07-24T05:46:07.487373+0000","last_became_active":"2023-07-24T05:46:00.949415+0000","last_became_peered":"2023-07-24T05:46:00.949415+0000","last_unstale":"2023-07-24T05:46:07.487373+0000","last_undegraded":"2023-07-24T05:46:07.487373+0000","last_fullsized":"2023-07-24T05:46:07.487373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:01:02.060760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.481115+0000","last_change":"2023-07-24T05:46:00.945119+0000","last_active":"2023-07-24T05:46:06.481115+0000","last_peered":"2023-07-24T05:46:06.481115+0000","last_clean":"2023-07-24T05:46:06.481115+0000","last_became_active":"2023-07-24T05:46:00.944813+0000","last_became_peered":"2023-07-24T05:46:00.944813+0000","last_unstale":"2023-07-24T05:46:06.481115+0000","last_undegraded":"2023-07-24T05:46:06.481115+0000","last_fullsized":"2023-07-24T05:46:06.481115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:37:16.770689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.483093+0000","last_change":"2023-07-24T05:46:00.935631+0000","last_active":"2023-07-24T05:46:07.483093+0000","last_peered":"2023-07-24T05:46:07.483093+0000","last_clean":"2023-07-24T05:46:07.483093+0000","last_became_active":"2023-07-24T05:46:00.935367+0000","last_became_peered":"2023-07-24T05:46:00.935367+0000","last_unstale":"2023-07-24T05:46:07.483093+0000","last_undegraded":"2023-07-24T05:46:07.483093+0000","last_fullsized":"2023-07-24T05:46:07.483093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:29:21.153570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.718880+0000","last_change":"2023-07-24T05:46:00.942370+0000","last_active":"2023-07-24T05:46:06.718880+0000","last_peered":"2023-07-24T05:46:06.718880+0000","last_clean":"2023-07-24T05:46:06.718880+0000","last_became_active":"2023-07-24T05:46:00.941928+0000","last_became_peered":"2023-07-24T05:46:00.941928+0000","last_unstale":"2023-07-24T05:46:06.718880+0000","last_undegraded":"2023-07-24T05:46:06.718880+0000","last_fullsized":"2023-07-24T05:46:06.718880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:19:59.555194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.481503+0000","last_change":"2023-07-24T05:46:00.946457+0000","last_active":"2023-07-24T05:46:06.481503+0000","last_peered":"2023-07-24T05:46:06.481503+0000","last_clean":"2023-07-24T05:46:06.481503+0000","last_became_active":"2023-07-24T05:46:00.944937+0000","last_became_peered":"2023-07-24T05:46:00.944937+0000","last_unstale":"2023-07-24T05:46:06.481503+0000","last_undegraded":"2023-07-24T05:46:06.481503+0000","last_fullsized":"2023-07-24T05:46:06.481503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:44:23.859944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023427+0000","last_change":"2023-07-24T05:46:00.934582+0000","last_active":"2023-07-24T05:46:06.023427+0000","last_peered":"2023-07-24T05:46:06.023427+0000","last_clean":"2023-07-24T05:46:06.023427+0000","last_became_active":"2023-07-24T05:46:00.933907+0000","last_became_peered":"2023-07-24T05:46:00.933907+0000","last_unstale":"2023-07-24T05:46:06.023427+0000","last_undegraded":"2023-07-24T05:46:06.023427+0000","last_fullsized":"2023-07-24T05:46:06.023427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:41:12.173555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.018439+0000","last_change":"2023-07-24T05:46:00.928680+0000","last_active":"2023-07-24T05:46:06.018439+0000","last_peered":"2023-07-24T05:46:06.018439+0000","last_clean":"2023-07-24T05:46:06.018439+0000","last_became_active":"2023-07-24T05:46:00.928276+0000","last_became_peered":"2023-07-24T05:46:00.928276+0000","last_unstale":"2023-07-24T05:46:06.018439+0000","last_undegraded":"2023-07-24T05:46:06.018439+0000","last_fullsized":"2023-07-24T05:46:06.018439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:15:26.395482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023672+0000","last_change":"2023-07-24T05:46:00.936679+0000","last_active":"2023-07-24T05:46:06.023672+0000","last_peered":"2023-07-24T05:46:06.023672+0000","last_clean":"2023-07-24T05:46:06.023672+0000","last_became_active":"2023-07-24T05:46:00.936176+0000","last_became_peered":"2023-07-24T05:46:00.936176+0000","last_unstale":"2023-07-24T05:46:06.023672+0000","last_undegraded":"2023-07-24T05:46:06.023672+0000","last_fullsized":"2023-07-24T05:46:06.023672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:46:01.670959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.720022+0000","last_change":"2023-07-24T05:46:00.940299+0000","last_active":"2023-07-24T05:46:06.720022+0000","last_peered":"2023-07-24T05:46:06.720022+0000","last_clean":"2023-07-24T05:46:06.720022+0000","last_became_active":"2023-07-24T05:46:00.940008+0000","last_became_peered":"2023-07-24T05:46:00.940008+0000","last_unstale":"2023-07-24T05:46:06.720022+0000","last_undegraded":"2023-07-24T05:46:06.720022+0000","last_fullsized":"2023-07-24T05:46:06.720022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:07:54.914500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.020567+0000","last_change":"2023-07-24T05:46:00.938329+0000","last_active":"2023-07-24T05:46:06.020567+0000","last_peered":"2023-07-24T05:46:06.020567+0000","last_clean":"2023-07-24T05:46:06.020567+0000","last_became_active":"2023-07-24T05:46:00.938046+0000","last_became_peered":"2023-07-24T05:46:00.938046+0000","last_unstale":"2023-07-24T05:46:06.020567+0000","last_undegraded":"2023-07-24T05:46:06.020567+0000","last_fullsized":"2023-07-24T05:46:06.020567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:26:06.142105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.481708+0000","last_change":"2023-07-24T05:46:00.955136+0000","last_active":"2023-07-24T05:46:06.481708+0000","last_peered":"2023-07-24T05:46:06.481708+0000","last_clean":"2023-07-24T05:46:06.481708+0000","last_became_active":"2023-07-24T05:46:00.954432+0000","last_became_peered":"2023-07-24T05:46:00.954432+0000","last_unstale":"2023-07-24T05:46:06.481708+0000","last_undegraded":"2023-07-24T05:46:06.481708+0000","last_fullsized":"2023-07-24T05:46:06.481708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:59:08.440089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.485847+0000","last_change":"2023-07-24T05:46:00.936021+0000","last_active":"2023-07-24T05:46:07.485847+0000","last_peered":"2023-07-24T05:46:07.485847+0000","last_clean":"2023-07-24T05:46:07.485847+0000","last_became_active":"2023-07-24T05:46:00.935648+0000","last_became_peered":"2023-07-24T05:46:00.935648+0000","last_unstale":"2023-07-24T05:46:07.485847+0000","last_undegraded":"2023-07-24T05:46:07.485847+0000","last_fullsized":"2023-07-24T05:46:07.485847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:04:34.146477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.018120+0000","last_change":"2023-07-24T05:46:00.944450+0000","last_active":"2023-07-24T05:46:06.018120+0000","last_peered":"2023-07-24T05:46:06.018120+0000","last_clean":"2023-07-24T05:46:06.018120+0000","last_became_active":"2023-07-24T05:46:00.943241+0000","last_became_peered":"2023-07-24T05:46:00.943241+0000","last_unstale":"2023-07-24T05:46:06.018120+0000","last_undegraded":"2023-07-24T05:46:06.018120+0000","last_fullsized":"2023-07-24T05:46:06.018120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:53:07.116935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.018724+0000","last_change":"2023-07-24T05:46:00.933437+0000","last_active":"2023-07-24T05:46:06.018724+0000","last_peered":"2023-07-24T05:46:06.018724+0000","last_clean":"2023-07-24T05:46:06.018724+0000","last_became_active":"2023-07-24T05:46:00.933148+0000","last_became_peered":"2023-07-24T05:46:00.933148+0000","last_unstale":"2023-07-24T05:46:06.018724+0000","last_undegraded":"2023-07-24T05:46:06.018724+0000","last_fullsized":"2023-07-24T05:46:06.018724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:43:12.724407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023680+0000","last_change":"2023-07-24T05:46:00.940814+0000","last_active":"2023-07-24T05:46:06.023680+0000","last_peered":"2023-07-24T05:46:06.023680+0000","last_clean":"2023-07-24T05:46:06.023680+0000","last_became_active":"2023-07-24T05:46:00.940490+0000","last_became_peered":"2023-07-24T05:46:00.940490+0000","last_unstale":"2023-07-24T05:46:06.023680+0000","last_undegraded":"2023-07-24T05:46:06.023680+0000","last_fullsized":"2023-07-24T05:46:06.023680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T16:55:24.415034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486791+0000","last_change":"2023-07-24T05:46:00.941947+0000","last_active":"2023-07-24T05:46:07.486791+0000","last_peered":"2023-07-24T05:46:07.486791+0000","last_clean":"2023-07-24T05:46:07.486791+0000","last_became_active":"2023-07-24T05:46:00.941624+0000","last_became_peered":"2023-07-24T05:46:00.941624+0000","last_unstale":"2023-07-24T05:46:07.486791+0000","last_undegraded":"2023-07-24T05:46:07.486791+0000","last_fullsized":"2023-07-24T05:46:07.486791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:18:26.734018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.719673+0000","last_change":"2023-07-24T05:46:00.933586+0000","last_active":"2023-07-24T05:46:06.719673+0000","last_peered":"2023-07-24T05:46:06.719673+0000","last_clean":"2023-07-24T05:46:06.719673+0000","last_became_active":"2023-07-24T05:46:00.933231+0000","last_became_peered":"2023-07-24T05:46:00.933231+0000","last_unstale":"2023-07-24T05:46:06.719673+0000","last_undegraded":"2023-07-24T05:46:06.719673+0000","last_fullsized":"2023-07-24T05:46:06.719673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:35:19.732787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.485426+0000","last_change":"2023-07-24T05:46:00.936425+0000","last_active":"2023-07-24T05:46:07.485426+0000","last_peered":"2023-07-24T05:46:07.485426+0000","last_clean":"2023-07-24T05:46:07.485426+0000","last_became_active":"2023-07-24T05:46:00.936057+0000","last_became_peered":"2023-07-24T05:46:00.936057+0000","last_unstale":"2023-07-24T05:46:07.485426+0000","last_undegraded":"2023-07-24T05:46:07.485426+0000","last_fullsized":"2023-07-24T05:46:07.485426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:17:32.903393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.481478+0000","last_change":"2023-07-24T05:46:00.955358+0000","last_active":"2023-07-24T05:46:06.481478+0000","last_peered":"2023-07-24T05:46:06.481478+0000","last_clean":"2023-07-24T05:46:06.481478+0000","last_became_active":"2023-07-24T05:46:00.954790+0000","last_became_peered":"2023-07-24T05:46:00.954790+0000","last_unstale":"2023-07-24T05:46:06.481478+0000","last_undegraded":"2023-07-24T05:46:06.481478+0000","last_fullsized":"2023-07-24T05:46:06.481478+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:21:55.302838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.021627+0000","last_change":"2023-07-24T05:46:00.937697+0000","last_active":"2023-07-24T05:46:06.021627+0000","last_peered":"2023-07-24T05:46:06.021627+0000","last_clean":"2023-07-24T05:46:06.021627+0000","last_became_active":"2023-07-24T05:46:00.937034+0000","last_became_peered":"2023-07-24T05:46:00.937034+0000","last_unstale":"2023-07-24T05:46:06.021627+0000","last_undegraded":"2023-07-24T05:46:06.021627+0000","last_fullsized":"2023-07-24T05:46:06.021627+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:39:26.893324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.720200+0000","last_change":"2023-07-24T05:46:00.936120+0000","last_active":"2023-07-24T05:46:06.720200+0000","last_peered":"2023-07-24T05:46:06.720200+0000","last_clean":"2023-07-24T05:46:06.720200+0000","last_became_active":"2023-07-24T05:46:00.935837+0000","last_became_peered":"2023-07-24T05:46:00.935837+0000","last_unstale":"2023-07-24T05:46:06.720200+0000","last_undegraded":"2023-07-24T05:46:06.720200+0000","last_fullsized":"2023-07-24T05:46:06.720200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:57:12.671093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.021362+0000","last_change":"2023-07-24T05:46:00.938400+0000","last_active":"2023-07-24T05:46:06.021362+0000","last_peered":"2023-07-24T05:46:06.021362+0000","last_clean":"2023-07-24T05:46:06.021362+0000","last_became_active":"2023-07-24T05:46:00.938021+0000","last_became_peered":"2023-07-24T05:46:00.938021+0000","last_unstale":"2023-07-24T05:46:06.021362+0000","last_undegraded":"2023-07-24T05:46:06.021362+0000","last_fullsized":"2023-07-24T05:46:06.021362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:50:30.095794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.023656+0000","last_change":"2023-07-24T05:46:00.938957+0000","last_active":"2023-07-24T05:46:06.023656+0000","last_peered":"2023-07-24T05:46:06.023656+0000","last_clean":"2023-07-24T05:46:06.023656+0000","last_became_active":"2023-07-24T05:46:00.938684+0000","last_became_peered":"2023-07-24T05:46:00.938684+0000","last_unstale":"2023-07-24T05:46:06.023656+0000","last_undegraded":"2023-07-24T05:46:06.023656+0000","last_fullsized":"2023-07-24T05:46:06.023656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:54:20.745792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:07.486581+0000","last_change":"2023-07-24T05:46:00.954433+0000","last_active":"2023-07-24T05:46:07.486581+0000","last_peered":"2023-07-24T05:46:07.486581+0000","last_clean":"2023-07-24T05:46:07.486581+0000","last_became_active":"2023-07-24T05:46:00.954144+0000","last_became_peered":"2023-07-24T05:46:00.954144+0000","last_unstale":"2023-07-24T05:46:07.486581+0000","last_undegraded":"2023-07-24T05:46:07.486581+0000","last_fullsized":"2023-07-24T05:46:07.486581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:57:39.660342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-07-24T05:46:06.018621+0000","last_change":"2023-07-24T05:46:00.943903+0000","last_active":"2023-07-24T05:46:06.018621+0000","last_peered":"2023-07-24T05:46:06.018621+0000","last_clean":"2023-07-24T05:46:06.018621+0000","last_became_active":"2023-07-24T05:46:00.943590+0000","last_became_peered":"2023-07-24T05:46:00.943590+0000","last_unstale":"2023-07-24T05:46:06.018621+0000","last_undegraded":"2023-07-24T05:46:06.018621+0000","last_fullsized":"2023-07-24T05:46:06.018621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:59.867852+0000","last_clean_scrub_stamp":"2023-07-24T05:45:59.867852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:34:19.494683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4591,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":880640,"data_stored":700959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.419}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3120000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542155,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":107943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.254}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.177}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.206}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.149}]}]},{"osd":5,"up_from":14,"seq":60129542155,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":107234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.034}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1910000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3149999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0760000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.383}]}]},{"osd":4,"up_from":14,"seq":60129542154,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":111792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5780000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.552}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5069999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.653}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4770000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542155,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":108033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.054}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]}]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":107943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1180000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542155,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":107943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.335}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9930000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4460000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.169}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3660000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.206}]}]},{"osd":0,"up_from":14,"seq":60129542154,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":697532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.234}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.294}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-24T05:46:35.744 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-24T05:46:35.745 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-07-24T05:46:35.745 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-07-24T05:46:35.745 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-07-24T05:46:35.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.942+0000 7fd09da2c700 1 Processor -- start 2023-07-24T05:46:35.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.942+0000 7fd09da2c700 1 -- start start 2023-07-24T05:46:35.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.946+0000 7fd09da2c700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd0980cdb30 0x7fd0980ca340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:35.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.946+0000 7fd09da2c700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0980c2b10 con 0x7fd0980cdf10 2023-07-24T05:46:35.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.946+0000 7fd09da2c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0980c2d60 con 0x7fd0980b2300 2023-07-24T05:46:35.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.946+0000 7fd09da2c700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0980c3320 con 0x7fd0980cdb30 2023-07-24T05:46:35.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.946+0000 7fd096ffd700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd0980cdb30 0x7fd0980ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:35.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.946+0000 7fd0967fc700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd0980cdf10 0x7fd0980ca880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:53672/0 (socket says 172.21.15.77:53672) 2023-07-24T05:46:35.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.946+0000 7fd0967fc700 1 -- 172.21.15.77:0/3779361232 learned_addr learned my addr 172.21.15.77:0/3779361232 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:35.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.946+0000 7fd096ffd700 1 -- 172.21.15.77:0/3779361232 >> v1:172.21.15.103:6789/0 conn(0x7fd0980b2300 legacy=0x7fd0980b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:35.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.946+0000 7fd096ffd700 1 -- 172.21.15.77:0/3779361232 >> v1:172.21.15.77:6789/0 conn(0x7fd0980cdf10 legacy=0x7fd0980ca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:35.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.946+0000 7fd096ffd700 1 -- 172.21.15.77:0/3779361232 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0980c3040 con 0x7fd0980cdb30 2023-07-24T05:46:35.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.946+0000 7fd096ffd700 1 --2- 172.21.15.77:0/3779361232 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0980cdb30 0x7fd0980ca340 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd088009850 tx=0x7fd088009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bec032617d594589 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:35.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.946+0000 7fd095ffb700 1 -- 172.21.15.77:0/3779361232 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd088011830 con 0x7fd0980cdb30 2023-07-24T05:46:35.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.946+0000 7fd095ffb700 1 -- 172.21.15.77:0/3779361232 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd088011990 con 0x7fd0980cdb30 2023-07-24T05:46:35.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.946+0000 7fd095ffb700 1 -- 172.21.15.77:0/3779361232 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd088011d20 con 0x7fd0980cdb30 2023-07-24T05:46:35.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.946+0000 7fd09da2c700 1 -- 172.21.15.77:0/3779361232 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0980cdb30 msgr2=0x7fd0980ca340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:35.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.946+0000 7fd09da2c700 1 --2- 172.21.15.77:0/3779361232 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0980cdb30 0x7fd0980ca340 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd088009850 tx=0x7fd088009b60 comp rx=0 tx=0).stop 2023-07-24T05:46:35.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.950+0000 7fd09da2c700 1 -- 172.21.15.77:0/3779361232 shutdown_connections 2023-07-24T05:46:35.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.950+0000 7fd09da2c700 1 --2- 172.21.15.77:0/3779361232 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0980cdb30 0x7fd0980ca340 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:35.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.950+0000 7fd09da2c700 1 -- 172.21.15.77:0/3779361232 >> 172.21.15.77:0/3779361232 conn(0x7fd0980b17e0 msgr2=0x7fd0980b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:35.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.950+0000 7fd09da2c700 1 -- 172.21.15.77:0/3779361232 shutdown_connections 2023-07-24T05:46:35.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.950+0000 7fd09da2c700 1 -- 172.21.15.77:0/3779361232 wait complete. 2023-07-24T05:46:35.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.950+0000 7fd09da2c700 1 Processor -- start 2023-07-24T05:46:35.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.954+0000 7fd09da2c700 1 -- start start 2023-07-24T05:46:35.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.954+0000 7fd09da2c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0980b2300 0x7fd09815a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:35.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.954+0000 7fd09da2c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd0980cdb30 0x7fd09815b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:35.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.954+0000 7fd09da2c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0980cdf10 0x7fd09815ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:35.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.954+0000 7fd09da2c700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0981f7c10 con 0x7fd0980b2300 2023-07-24T05:46:35.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.954+0000 7fd09da2c700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09815c730 con 0x7fd0980cdf10 2023-07-24T05:46:35.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.954+0000 7fd09da2c700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd09815be90 con 0x7fd0980cdb30 2023-07-24T05:46:35.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.954+0000 7fd096ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0980b2300 0x7fd09815a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:35.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.954+0000 7fd096ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0980b2300 0x7fd09815a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42542/0 (socket says 172.21.15.77:42542) 2023-07-24T05:46:35.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.954+0000 7fd096ffd700 1 -- 172.21.15.77:0/1805442121 learned_addr learned my addr 172.21.15.77:0/1805442121 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:35.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.954+0000 7fd096ffd700 1 -- 172.21.15.77:0/1805442121 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd0980cdb30 msgr2=0x7fd09815b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:35.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.954+0000 7fd097fff700 1 --2- 172.21.15.77:0/1805442121 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0980cdf10 0x7fd09815ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:35.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.954+0000 7fd0967fc700 1 --2- 172.21.15.77:0/1805442121 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd0980cdb30 0x7fd09815b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:35.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.954+0000 7fd096ffd700 1 --2- 172.21.15.77:0/1805442121 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd0980cdb30 0x7fd09815b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:35.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.954+0000 7fd096ffd700 1 -- 172.21.15.77:0/1805442121 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0980cdf10 msgr2=0x7fd09815ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:35.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.954+0000 7fd096ffd700 1 --2- 172.21.15.77:0/1805442121 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0980cdf10 0x7fd09815ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:35.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.954+0000 7fd096ffd700 1 -- 172.21.15.77:0/1805442121 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0880094b0 con 0x7fd0980b2300 2023-07-24T05:46:35.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.954+0000 7fd097fff700 1 --2- 172.21.15.77:0/1805442121 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0980cdf10 0x7fd09815ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:46:35.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.954+0000 7fd0967fc700 1 --2- 172.21.15.77:0/1805442121 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd0980cdb30 0x7fd09815b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:46:35.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.954+0000 7fd096ffd700 1 --2- 172.21.15.77:0/1805442121 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0980b2300 0x7fd09815a180 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd088009fd0 tx=0x7fd088004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:35.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.954+0000 7fd08ffff700 1 -- 172.21.15.77:0/1805442121 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0880038c0 con 0x7fd0980b2300 2023-07-24T05:46:35.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.954+0000 7fd08ffff700 1 -- 172.21.15.77:0/1805442121 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd08801e070 con 0x7fd0980b2300 2023-07-24T05:46:35.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.954+0000 7fd09da2c700 1 -- 172.21.15.77:0/1805442121 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd09815c170 con 0x7fd0980b2300 2023-07-24T05:46:35.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.958+0000 7fd08ffff700 1 -- 172.21.15.77:0/1805442121 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd088003c60 con 0x7fd0980b2300 2023-07-24T05:46:35.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.958+0000 7fd09da2c700 1 -- 172.21.15.77:0/1805442121 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0980c5300 con 0x7fd0980b2300 2023-07-24T05:46:35.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.958+0000 7fd09da2c700 1 -- 172.21.15.77:0/1805442121 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0980c5160 con 0x7fd0980b2300 2023-07-24T05:46:35.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.958+0000 7fd08ffff700 1 -- 172.21.15.77:0/1805442121 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd088025480 con 0x7fd0980b2300 2023-07-24T05:46:35.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.962+0000 7fd08ffff700 1 --2- 172.21.15.77:0/1805442121 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd0780662f0 0x7fd0780687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:35.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.962+0000 7fd08ffff700 1 -- 172.21.15.77:0/1805442121 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd088020070 con 0x7fd0980b2300 2023-07-24T05:46:35.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.962+0000 7fd0967fc700 1 --2- 172.21.15.77:0/1805442121 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd0780662f0 0x7fd0780687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:35.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.962+0000 7fd0967fc700 1 --2- 172.21.15.77:0/1805442121 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd0780662f0 0x7fd0780687b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd080005930 tx=0x7fd080009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:35.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:35.966+0000 7fd08ffff700 1 -- 172.21.15.77:0/1805442121 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd0980c5160 con 0x7fd0980b2300 2023-07-24T05:46:36.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.170+0000 7fd09da2c700 1 -- 172.21.15.77:0/1805442121 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd0980c5160 con 0x7fd0980b2300 2023-07-24T05:46:36.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.170+0000 7fd08ffff700 1 -- 172.21.15.77:0/1805442121 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fd0980c5160 con 0x7fd0980b2300 2023-07-24T05:46:36.175 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:46:36.175 INFO:teuthology.orchestra.run.smithi077.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-07-24T05:46:36.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.174+0000 7fd09da2c700 1 -- 172.21.15.77:0/1805442121 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd0780662f0 msgr2=0x7fd0780687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:36.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.174+0000 7fd09da2c700 1 --2- 172.21.15.77:0/1805442121 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd0780662f0 0x7fd0780687b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd080005930 tx=0x7fd080009040 comp rx=0 tx=0).stop 2023-07-24T05:46:36.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.174+0000 7fd09da2c700 1 -- 172.21.15.77:0/1805442121 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0980b2300 msgr2=0x7fd09815a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:36.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.174+0000 7fd09da2c700 1 --2- 172.21.15.77:0/1805442121 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0980b2300 0x7fd09815a180 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd088009fd0 tx=0x7fd088004770 comp rx=0 tx=0).stop 2023-07-24T05:46:36.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.174+0000 7fd09da2c700 1 -- 172.21.15.77:0/1805442121 shutdown_connections 2023-07-24T05:46:36.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.174+0000 7fd09da2c700 1 --2- 172.21.15.77:0/1805442121 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0980cdf10 0x7fd09815ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:36.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.174+0000 7fd09da2c700 1 --2- 172.21.15.77:0/1805442121 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd0780662f0 0x7fd0780687b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:36.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.174+0000 7fd09da2c700 1 --2- 172.21.15.77:0/1805442121 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd0980cdb30 0x7fd09815b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:36.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.174+0000 7fd09da2c700 1 --2- 172.21.15.77:0/1805442121 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd0980b2300 0x7fd09815a180 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:36.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.174+0000 7fd09da2c700 1 -- 172.21.15.77:0/1805442121 >> 172.21.15.77:0/1805442121 conn(0x7fd0980b17e0 msgr2=0x7fd0980b4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:36.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.174+0000 7fd09da2c700 1 -- 172.21.15.77:0/1805442121 shutdown_connections 2023-07-24T05:46:36.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.174+0000 7fd09da2c700 1 -- 172.21.15.77:0/1805442121 wait complete. 2023-07-24T05:46:36.196 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-07-24T05:46:36.197 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-24T05:46:36.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.362+0000 7f82034b5700 1 Processor -- start 2023-07-24T05:46:36.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.362+0000 7f82034b5700 1 -- start start 2023-07-24T05:46:36.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.362+0000 7f82034b5700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f81fc161030 0x7f81fc0c13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:36.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.362+0000 7f82034b5700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f81fc069ef0 0x7f81fc0c1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:36.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.362+0000 7f82034b5700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f81fc0cac90 0x7f81fc164b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:36.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.362+0000 7f82034b5700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81fc06b810 con 0x7f81fc161030 2023-07-24T05:46:36.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.362+0000 7f82034b5700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81fc0cb230 con 0x7f81fc069ef0 2023-07-24T05:46:36.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.362+0000 7f82034b5700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc0cb510 con 0x7f81fc0cac90 2023-07-24T05:46:36.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.366+0000 7f8201251700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f81fc161030 0x7f81fc0c13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:36.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.366+0000 7f8201251700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f81fc161030 0x7f81fc0c13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42544/0 (socket says 172.21.15.77:42544) 2023-07-24T05:46:36.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.366+0000 7f8201251700 1 -- 172.21.15.77:0/1865267490 learned_addr learned my addr 172.21.15.77:0/1865267490 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:36.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.366+0000 7f8201a52700 1 --2- 172.21.15.77:0/1865267490 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f81fc0cac90 0x7f81fc164b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:36.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.366+0000 7f8200a50700 1 --2- 172.21.15.77:0/1865267490 >> v2:172.21.15.103:3300/0 conn(0x7f81fc069ef0 0x7f81fc0c1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:36.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.366+0000 7f8201251700 1 -- 172.21.15.77:0/1865267490 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f81fc0cac90 msgr2=0x7f81fc164b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:36.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.366+0000 7f8201251700 1 --2- 172.21.15.77:0/1865267490 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f81fc0cac90 0x7f81fc164b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:36.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.366+0000 7f8201251700 1 -- 172.21.15.77:0/1865267490 >> v2:172.21.15.103:3300/0 conn(0x7f81fc069ef0 msgr2=0x7f81fc0c1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:36.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.366+0000 7f8201251700 1 --2- 172.21.15.77:0/1865267490 >> v2:172.21.15.103:3300/0 conn(0x7f81fc069ef0 0x7f81fc0c1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:36.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.366+0000 7f8201251700 1 -- 172.21.15.77:0/1865267490 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81fc0cb7f0 con 0x7f81fc161030 2023-07-24T05:46:36.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.366+0000 7f8201251700 1 --2- 172.21.15.77:0/1865267490 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81fc161030 0x7f81fc0c13e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f81fc09c330 tx=0x7f81f8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d2f28feb19dcd4e server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:36.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.366+0000 7f81f3fff700 1 -- 172.21.15.77:0/1865267490 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f8005e50 con 0x7f81fc161030 2023-07-24T05:46:36.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.366+0000 7f81f3fff700 1 -- 172.21.15.77:0/1865267490 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f8006030 con 0x7f81fc161030 2023-07-24T05:46:36.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.366+0000 7f81f3fff700 1 -- 172.21.15.77:0/1865267490 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f80063c0 con 0x7f81fc161030 2023-07-24T05:46:36.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.366+0000 7f82034b5700 1 -- 172.21.15.77:0/1865267490 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81fc161030 msgr2=0x7f81fc0c13e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:36.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.366+0000 7f82034b5700 1 --2- 172.21.15.77:0/1865267490 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81fc161030 0x7f81fc0c13e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f81fc09c330 tx=0x7f81f8009bf0 comp rx=0 tx=0).stop 2023-07-24T05:46:36.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.366+0000 7f82034b5700 1 -- 172.21.15.77:0/1865267490 shutdown_connections 2023-07-24T05:46:36.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.366+0000 7f82034b5700 1 --2- 172.21.15.77:0/1865267490 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f81fc0cac90 0x7f81fc164b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:36.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.366+0000 7f82034b5700 1 --2- 172.21.15.77:0/1865267490 >> v2:172.21.15.103:3300/0 conn(0x7f81fc069ef0 0x7f81fc0c1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:36.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.366+0000 7f82034b5700 1 --2- 172.21.15.77:0/1865267490 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81fc161030 0x7f81fc0c13e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:36.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.366+0000 7f82034b5700 1 -- 172.21.15.77:0/1865267490 >> 172.21.15.77:0/1865267490 conn(0x7f81fc0ce410 msgr2=0x7f81fc0ce7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:36.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.366+0000 7f82034b5700 1 -- 172.21.15.77:0/1865267490 shutdown_connections 2023-07-24T05:46:36.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.366+0000 7f82034b5700 1 -- 172.21.15.77:0/1865267490 wait complete. 2023-07-24T05:46:36.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.370+0000 7f82034b5700 1 Processor -- start 2023-07-24T05:46:36.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.370+0000 7f82034b5700 1 -- start start 2023-07-24T05:46:36.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.370+0000 7f82034b5700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81fc069ef0 0x7f81fc1641e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:36.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.370+0000 7f82034b5700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81fc0cac90 0x7f81fc097a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:36.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.370+0000 7f82034b5700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f81fc161030 0x7f81fc158810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:36.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.370+0000 7f82034b5700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc163d50 con 0x7f81fc0cac90 2023-07-24T05:46:36.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.370+0000 7f82034b5700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc162ea0 con 0x7f81fc069ef0 2023-07-24T05:46:36.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.370+0000 7f82034b5700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81fc163140 con 0x7f81fc161030 2023-07-24T05:46:36.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.370+0000 7f8200a50700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81fc0cac90 0x7f81fc097a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:36.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.370+0000 7f8200a50700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81fc0cac90 0x7f81fc097a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42550/0 (socket says 172.21.15.77:42550) 2023-07-24T05:46:36.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.370+0000 7f8200a50700 1 -- 172.21.15.77:0/917600629 learned_addr learned my addr 172.21.15.77:0/917600629 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:36.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.374+0000 7f8201251700 1 --2- 172.21.15.77:0/917600629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81fc069ef0 0x7f81fc1641e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:36.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.374+0000 7f8201a52700 1 --2- 172.21.15.77:0/917600629 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f81fc161030 0x7f81fc158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:36.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.374+0000 7f8200a50700 1 -- 172.21.15.77:0/917600629 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f81fc161030 msgr2=0x7f81fc158810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:36.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.374+0000 7f8200a50700 1 --2- 172.21.15.77:0/917600629 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f81fc161030 0x7f81fc158810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:36.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.374+0000 7f8200a50700 1 -- 172.21.15.77:0/917600629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81fc069ef0 msgr2=0x7f81fc1641e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:36.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.374+0000 7f8200a50700 1 --2- 172.21.15.77:0/917600629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81fc069ef0 0x7f81fc1641e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:36.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.374+0000 7f8200a50700 1 -- 172.21.15.77:0/917600629 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f8009520 con 0x7f81fc0cac90 2023-07-24T05:46:36.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.374+0000 7f8201a52700 1 --2- 172.21.15.77:0/917600629 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f81fc161030 0x7f81fc158810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:46:36.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.374+0000 7f8200a50700 1 --2- 172.21.15.77:0/917600629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81fc0cac90 0x7f81fc097a40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f81ec00e790 tx=0x7f81ec00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:36.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.374+0000 7f81f1ffb700 1 -- 172.21.15.77:0/917600629 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ec013680 con 0x7f81fc0cac90 2023-07-24T05:46:36.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.374+0000 7f82034b5700 1 -- 172.21.15.77:0/917600629 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81fc163420 con 0x7f81fc0cac90 2023-07-24T05:46:36.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.374+0000 7f81f1ffb700 1 -- 172.21.15.77:0/917600629 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81ec0137e0 con 0x7f81fc0cac90 2023-07-24T05:46:36.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.374+0000 7f81f1ffb700 1 -- 172.21.15.77:0/917600629 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ec013b70 con 0x7f81fc0cac90 2023-07-24T05:46:36.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.374+0000 7f82034b5700 1 -- 172.21.15.77:0/917600629 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81fc1639e0 con 0x7f81fc0cac90 2023-07-24T05:46:36.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.374+0000 7f82034b5700 1 -- 172.21.15.77:0/917600629 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81fc04df10 con 0x7f81fc0cac90 2023-07-24T05:46:36.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.378+0000 7f81f1ffb700 1 -- 172.21.15.77:0/917600629 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f81ec013cd0 con 0x7f81fc0cac90 2023-07-24T05:46:36.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.378+0000 7f81f1ffb700 1 --2- 172.21.15.77:0/917600629 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f81e00662f0 0x7f81e00687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:36.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.378+0000 7f81f1ffb700 1 -- 172.21.15.77:0/917600629 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f81ec083ca0 con 0x7f81fc0cac90 2023-07-24T05:46:36.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.378+0000 7f8201251700 1 --2- 172.21.15.77:0/917600629 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f81e00662f0 0x7f81e00687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:36.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.382+0000 7f8201251700 1 --2- 172.21.15.77:0/917600629 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f81e00662f0 0x7f81e00687b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f81f8009c30 tx=0x7f81f8008070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:36.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.386+0000 7f81f1ffb700 1 -- 172.21.15.77:0/917600629 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f81ec050da0 con 0x7f81fc0cac90 2023-07-24T05:46:36.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.562+0000 7f82034b5700 1 -- 172.21.15.77:0/917600629 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81fc0adc30 con 0x7f81fc0cac90 2023-07-24T05:46:36.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.562+0000 7f81f1ffb700 1 -- 172.21.15.77:0/917600629 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20108 (secure 0 0 0) 0x7f81ec0543c0 con 0x7f81fc0cac90 2023-07-24T05:46:36.569 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:46:36.569 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":25,"fsid":"5aed5f7b-fb55-4d95-9c02-c6adbb1677b4","created":"2023-07-24T05:45:39.639731+0000","modified":"2023-07-24T05:46:05.445306+0000","last_up_change":"2023-07-24T05:45:52.319670+0000","last_in_change":"2023-07-24T05:45:43.643277+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-24T05:45:52.610430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-24T05:45:52.773787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-24T05:45:58.121732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-24T05:45:59.368726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-24T05:46:03.032057+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ffa0d496-461a-4053-b764-0627d969521b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6812","nonce":825987196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6817","nonce":825987196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6831","nonce":825987196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6824","nonce":825987196}]},"public_addr":"172.21.15.77:6812/825987196","cluster_addr":"172.21.15.77:6817/825987196","heartbeat_back_addr":"172.21.15.77:6831/825987196","heartbeat_front_addr":"172.21.15.77:6824/825987196","state":["exists","up"]},{"osd":1,"uuid":"9f595e5e-5c43-49bc-8ce4-ee70575c90da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6801","nonce":4133026815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6803","nonce":4133026815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6807","nonce":4133026815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6805","nonce":4133026815}]},"public_addr":"172.21.15.77:6801/4133026815","cluster_addr":"172.21.15.77:6803/4133026815","heartbeat_back_addr":"172.21.15.77:6807/4133026815","heartbeat_front_addr":"172.21.15.77:6805/4133026815","state":["exists","up"]},{"osd":2,"uuid":"2ac177aa-4d7d-4262-bd54-d2b9f29f4c3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6811","nonce":2394142159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6819","nonce":2394142159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6830","nonce":2394142159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6825","nonce":2394142159}]},"public_addr":"172.21.15.77:6811/2394142159","cluster_addr":"172.21.15.77:6819/2394142159","heartbeat_back_addr":"172.21.15.77:6830/2394142159","heartbeat_front_addr":"172.21.15.77:6825/2394142159","state":["exists","up"]},{"osd":3,"uuid":"17d7a251-19e8-484c-8172-a578ab3da153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6813","nonce":1492113982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6818","nonce":1492113982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6829","nonce":1492113982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6823","nonce":1492113982}]},"public_addr":"172.21.15.77:6813/1492113982","cluster_addr":"172.21.15.77:6818/1492113982","heartbeat_back_addr":"172.21.15.77:6829/1492113982","heartbeat_front_addr":"172.21.15.77:6823/1492113982","state":["exists","up"]},{"osd":4,"uuid":"bf63ca05-f06d-4e0f-ac44-2a416c70b919","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6825","nonce":1080481057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6827","nonce":1080481057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6831","nonce":1080481057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6829","nonce":1080481057}]},"public_addr":"172.21.15.103:6825/1080481057","cluster_addr":"172.21.15.103:6827/1080481057","heartbeat_back_addr":"172.21.15.103:6831/1080481057","heartbeat_front_addr":"172.21.15.103:6829/1080481057","state":["exists","up"]},{"osd":5,"uuid":"65a11a35-9e9f-4b3c-9fe3-b658d62b9318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6811","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6813","nonce":2756677504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6818","nonce":2756677504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6823","nonce":2756677504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6821","nonce":2756677504}]},"public_addr":"172.21.15.103:6813/2756677504","cluster_addr":"172.21.15.103:6818/2756677504","heartbeat_back_addr":"172.21.15.103:6823/2756677504","heartbeat_front_addr":"172.21.15.103:6821/2756677504","state":["exists","up"]},{"osd":6,"uuid":"750c1f87-686c-40b4-94a1-1a299dc78f3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6809","nonce":568977764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6812","nonce":568977764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6819","nonce":568977764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6815","nonce":568977764}]},"public_addr":"172.21.15.103:6809/568977764","cluster_addr":"172.21.15.103:6812/568977764","heartbeat_back_addr":"172.21.15.103:6819/568977764","heartbeat_front_addr":"172.21.15.103:6815/568977764","state":["exists","up"]},{"osd":7,"uuid":"d5fe4fb6-2e09-4158-885b-403803c85822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6801","nonce":1074557176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6803","nonce":1074557176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6807","nonce":1074557176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6805","nonce":1074557176}]},"public_addr":"172.21.15.103:6801/1074557176","cluster_addr":"172.21.15.103:6803/1074557176","heartbeat_back_addr":"172.21.15.103:6807/1074557176","heartbeat_front_addr":"172.21.15.103:6805/1074557176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.631032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.154109+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.398587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.679089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.311218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.353726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.314372+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.126212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-24T05:46:36.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.566+0000 7f82034b5700 1 -- 172.21.15.77:0/917600629 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f81e00662f0 msgr2=0x7f81e00687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:36.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.566+0000 7f82034b5700 1 --2- 172.21.15.77:0/917600629 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f81e00662f0 0x7f81e00687b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f81f8009c30 tx=0x7f81f8008070 comp rx=0 tx=0).stop 2023-07-24T05:46:36.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.566+0000 7f82034b5700 1 -- 172.21.15.77:0/917600629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81fc0cac90 msgr2=0x7f81fc097a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:36.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.566+0000 7f82034b5700 1 --2- 172.21.15.77:0/917600629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81fc0cac90 0x7f81fc097a40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f81ec00e790 tx=0x7f81ec00eb50 comp rx=0 tx=0).stop 2023-07-24T05:46:36.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.566+0000 7f82034b5700 1 -- 172.21.15.77:0/917600629 shutdown_connections 2023-07-24T05:46:36.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.566+0000 7f82034b5700 1 --2- 172.21.15.77:0/917600629 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f81e00662f0 0x7f81e00687b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:36.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.566+0000 7f82034b5700 1 --2- 172.21.15.77:0/917600629 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f81fc161030 0x7f81fc158810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:36.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.566+0000 7f82034b5700 1 --2- 172.21.15.77:0/917600629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81fc0cac90 0x7f81fc097a40 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:36.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.566+0000 7f82034b5700 1 --2- 172.21.15.77:0/917600629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f81fc069ef0 0x7f81fc1641e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:36.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.566+0000 7f82034b5700 1 -- 172.21.15.77:0/917600629 >> 172.21.15.77:0/917600629 conn(0x7f81fc0ce410 msgr2=0x7f81fc0cd060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:36.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.566+0000 7f82034b5700 1 -- 172.21.15.77:0/917600629 shutdown_connections 2023-07-24T05:46:36.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.566+0000 7f82034b5700 1 -- 172.21.15.77:0/917600629 wait complete. 2023-07-24T05:46:36.593 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-24T05:45:52.610430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-24T05:45:52.773787+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-24T05:45:58.121732+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-24T05:45:59.368726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-24T05:46:03.032057+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-24T05:46:36.594 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-24T05:46:36.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.766+0000 7f19c1227700 1 Processor -- start 2023-07-24T05:46:36.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.766+0000 7f19c1227700 1 -- start start 2023-07-24T05:46:36.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.766+0000 7f19c1227700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f19bc15a950 0x7f19bc0b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:36.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.766+0000 7f19c1227700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f19bc06a220 0x7f19bc06d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:36.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.766+0000 7f19c1227700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19bc06b000 con 0x7f19bc0c4e70 2023-07-24T05:46:36.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.766+0000 7f19c1227700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19bc0b1ac0 con 0x7f19bc15a950 2023-07-24T05:46:36.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.766+0000 7f19c1227700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19bc06a7c0 con 0x7f19bc06a220 2023-07-24T05:46:36.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.766+0000 7f19bbfff700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f19bc15a950 0x7f19bc0b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:36.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.766+0000 7f19bbfff700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f19bc15a950 0x7f19bc0b1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42558/0 (socket says 172.21.15.77:42558) 2023-07-24T05:46:36.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.766+0000 7f19bbfff700 1 -- 172.21.15.77:0/2869691894 learned_addr learned my addr 172.21.15.77:0/2869691894 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:36.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.770+0000 7f19c0a26700 1 --2- 172.21.15.77:0/2869691894 >> v2:172.21.15.103:3300/0 conn(0x7f19bc06a220 0x7f19bc06d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:36.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.770+0000 7f19bbfff700 1 -- 172.21.15.77:0/2869691894 >> v2:172.21.15.103:3300/0 conn(0x7f19bc06a220 msgr2=0x7f19bc06d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:36.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.770+0000 7f19bbfff700 1 --2- 172.21.15.77:0/2869691894 >> v2:172.21.15.103:3300/0 conn(0x7f19bc06a220 0x7f19bc06d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:36.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.770+0000 7f19bbfff700 1 -- 172.21.15.77:0/2869691894 >> v1:172.21.15.77:6789/0 conn(0x7f19bc0c4e70 legacy=0x7f19bc069b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:36.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.770+0000 7f19bbfff700 1 -- 172.21.15.77:0/2869691894 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19bc06aaa0 con 0x7f19bc15a950 2023-07-24T05:46:36.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.770+0000 7f19bbfff700 1 --2- 172.21.15.77:0/2869691894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19bc15a950 0x7f19bc0b1f10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f19bc0ac790 tx=0x7f19b400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b06910d94200ed84 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:36.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.770+0000 7f19baffd700 1 -- 172.21.15.77:0/2869691894 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b400e070 con 0x7f19bc15a950 2023-07-24T05:46:36.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.770+0000 7f19baffd700 1 -- 172.21.15.77:0/2869691894 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b4003a40 con 0x7f19bc15a950 2023-07-24T05:46:36.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.770+0000 7f19baffd700 1 -- 172.21.15.77:0/2869691894 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b4003df0 con 0x7f19bc15a950 2023-07-24T05:46:36.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.770+0000 7f19c1227700 1 -- 172.21.15.77:0/2869691894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19bc15a950 msgr2=0x7f19bc0b1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:36.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.770+0000 7f19c1227700 1 --2- 172.21.15.77:0/2869691894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19bc15a950 0x7f19bc0b1f10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f19bc0ac790 tx=0x7f19b400b330 comp rx=0 tx=0).stop 2023-07-24T05:46:36.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.770+0000 7f19c1227700 1 -- 172.21.15.77:0/2869691894 shutdown_connections 2023-07-24T05:46:36.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.770+0000 7f19c1227700 1 --2- 172.21.15.77:0/2869691894 >> v2:172.21.15.103:3300/0 conn(0x7f19bc06a220 0x7f19bc06d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:36.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.770+0000 7f19c1227700 1 --2- 172.21.15.77:0/2869691894 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19bc15a950 0x7f19bc0b1f10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:36.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.770+0000 7f19c1227700 1 -- 172.21.15.77:0/2869691894 >> 172.21.15.77:0/2869691894 conn(0x7f19bc0ce260 msgr2=0x7f19bc0ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:36.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.770+0000 7f19c1227700 1 -- 172.21.15.77:0/2869691894 shutdown_connections 2023-07-24T05:46:36.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.770+0000 7f19c1227700 1 -- 172.21.15.77:0/2869691894 wait complete. 2023-07-24T05:46:36.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.774+0000 7f19c1227700 1 Processor -- start 2023-07-24T05:46:36.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.774+0000 7f19c1227700 1 -- start start 2023-07-24T05:46:36.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.774+0000 7f19c1227700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19bc06a220 0x7f19bc0cc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:36.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.778+0000 7f19c1227700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19bc0c4e70 0x7f19bc154760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:36.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.778+0000 7f19c1227700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f19bc15a950 0x7f19bc0710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:36.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.778+0000 7f19c1227700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc0cdee0 con 0x7f19bc0c4e70 2023-07-24T05:46:36.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.778+0000 7f19c1227700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc0cccf0 con 0x7f19bc06a220 2023-07-24T05:46:36.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.778+0000 7f19c1227700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc154ca0 con 0x7f19bc15a950 2023-07-24T05:46:36.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.778+0000 7f19bb7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19bc0c4e70 0x7f19bc154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:36.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.778+0000 7f19bb7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19bc0c4e70 0x7f19bc154760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42570/0 (socket says 172.21.15.77:42570) 2023-07-24T05:46:36.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.778+0000 7f19bb7fe700 1 -- 172.21.15.77:0/1787276138 learned_addr learned my addr 172.21.15.77:0/1787276138 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:36.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.778+0000 7f19bbfff700 1 --2- 172.21.15.77:0/1787276138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19bc06a220 0x7f19bc0cc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:36.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.778+0000 7f19c0a26700 1 --2- 172.21.15.77:0/1787276138 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f19bc15a950 0x7f19bc0710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:36.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.778+0000 7f19bb7fe700 1 -- 172.21.15.77:0/1787276138 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f19bc15a950 msgr2=0x7f19bc0710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:36.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.778+0000 7f19bb7fe700 1 --2- 172.21.15.77:0/1787276138 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f19bc15a950 0x7f19bc0710f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:36.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.778+0000 7f19bb7fe700 1 -- 172.21.15.77:0/1787276138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19bc06a220 msgr2=0x7f19bc0cc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:36.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.778+0000 7f19bb7fe700 1 --2- 172.21.15.77:0/1787276138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19bc06a220 0x7f19bc0cc7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:36.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.778+0000 7f19bb7fe700 1 -- 172.21.15.77:0/1787276138 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b4009b30 con 0x7f19bc0c4e70 2023-07-24T05:46:36.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.778+0000 7f19bb7fe700 1 --2- 172.21.15.77:0/1787276138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19bc0c4e70 0x7f19bc154760 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f19b000c4e0 tx=0x7f19b000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:36.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.778+0000 7f19b8ff9700 1 -- 172.21.15.77:0/1787276138 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b0011790 con 0x7f19bc0c4e70 2023-07-24T05:46:36.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.778+0000 7f19b8ff9700 1 -- 172.21.15.77:0/1787276138 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b0011910 con 0x7f19bc0c4e70 2023-07-24T05:46:36.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.778+0000 7f19c1227700 1 -- 172.21.15.77:0/1787276138 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19bc0cd920 con 0x7f19bc0c4e70 2023-07-24T05:46:36.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.778+0000 7f19b8ff9700 1 -- 172.21.15.77:0/1787276138 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b0011cc0 con 0x7f19bc0c4e70 2023-07-24T05:46:36.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.778+0000 7f19c1227700 1 -- 172.21.15.77:0/1787276138 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19bc0cbfb0 con 0x7f19bc0c4e70 2023-07-24T05:46:36.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.782+0000 7f19c1227700 1 -- 172.21.15.77:0/1787276138 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19bc06bd40 con 0x7f19bc0c4e70 2023-07-24T05:46:36.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.782+0000 7f19b8ff9700 1 -- 172.21.15.77:0/1787276138 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f19b001c460 con 0x7f19bc0c4e70 2023-07-24T05:46:36.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.782+0000 7f19b8ff9700 1 --2- 172.21.15.77:0/1787276138 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f19a80662f0 0x7f19a80687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:36.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.782+0000 7f19b8ff9700 1 -- 172.21.15.77:0/1787276138 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f19b0083ca0 con 0x7f19bc0c4e70 2023-07-24T05:46:36.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.782+0000 7f19bbfff700 1 --2- 172.21.15.77:0/1787276138 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f19a80662f0 0x7f19a80687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:36.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.786+0000 7f19bbfff700 1 --2- 172.21.15.77:0/1787276138 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f19a80662f0 0x7f19a80687b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f19b4015040 tx=0x7f19b4009000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:36.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.790+0000 7f19b8ff9700 1 -- 172.21.15.77:0/1787276138 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f19b0050e30 con 0x7f19bc0c4e70 2023-07-24T05:46:36.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.958+0000 7f19c1227700 1 -- 172.21.15.77:0/1787276138 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f19bc072490 con 0x7f19bc0c4e70 2023-07-24T05:46:36.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.962+0000 7f19b8ff9700 1 -- 172.21.15.77:0/1787276138 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f19b0054450 con 0x7f19bc0c4e70 2023-07-24T05:46:36.966 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-07-24T05:46:36.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.962+0000 7f19c1227700 1 -- 172.21.15.77:0/1787276138 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f19a80662f0 msgr2=0x7f19a80687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:36.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.962+0000 7f19c1227700 1 --2- 172.21.15.77:0/1787276138 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f19a80662f0 0x7f19a80687b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f19b4015040 tx=0x7f19b4009000 comp rx=0 tx=0).stop 2023-07-24T05:46:36.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.962+0000 7f19c1227700 1 -- 172.21.15.77:0/1787276138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19bc0c4e70 msgr2=0x7f19bc154760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:36.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.962+0000 7f19c1227700 1 --2- 172.21.15.77:0/1787276138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19bc0c4e70 0x7f19bc154760 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f19b000c4e0 tx=0x7f19b000c7f0 comp rx=0 tx=0).stop 2023-07-24T05:46:36.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.962+0000 7f19c1227700 1 -- 172.21.15.77:0/1787276138 shutdown_connections 2023-07-24T05:46:36.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.962+0000 7f19c1227700 1 --2- 172.21.15.77:0/1787276138 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f19a80662f0 0x7f19a80687b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:36.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.962+0000 7f19c1227700 1 --2- 172.21.15.77:0/1787276138 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f19bc15a950 0x7f19bc0710f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:36.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.962+0000 7f19c1227700 1 --2- 172.21.15.77:0/1787276138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f19bc0c4e70 0x7f19bc154760 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:36.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.962+0000 7f19c1227700 1 --2- 172.21.15.77:0/1787276138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19bc06a220 0x7f19bc0cc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:36.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.962+0000 7f19c1227700 1 -- 172.21.15.77:0/1787276138 >> 172.21.15.77:0/1787276138 conn(0x7f19bc0ce260 msgr2=0x7f19bc0abd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:36.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.962+0000 7f19c1227700 1 -- 172.21.15.77:0/1787276138 shutdown_connections 2023-07-24T05:46:36.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:36.962+0000 7f19c1227700 1 -- 172.21.15.77:0/1787276138 wait complete. 2023-07-24T05:46:36.992 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-24T05:46:37.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.154+0000 7f6f3e924700 1 Processor -- start 2023-07-24T05:46:37.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.158+0000 7f6f3e924700 1 -- start start 2023-07-24T05:46:37.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.158+0000 7f6f3e924700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6f380c1230 0x7f6f380ac380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:37.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.158+0000 7f6f3e924700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6f3806d350 0x7f6f380ab150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:37.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.158+0000 7f6f3e924700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f381616d0 con 0x7f6f381611b0 2023-07-24T05:46:37.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.158+0000 7f6f3e924700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f380b1d10 con 0x7f6f380c1230 2023-07-24T05:46:37.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.158+0000 7f6f3e924700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f381619b0 con 0x7f6f3806d350 2023-07-24T05:46:37.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.158+0000 7f6f3d922700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6f380c1230 0x7f6f380ac380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:37.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.158+0000 7f6f3d121700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f6f381611b0 0x7f6f380c1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.77:57484/0 (socket says 172.21.15.77:57484) 2023-07-24T05:46:37.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.158+0000 7f6f3d121700 1 -- 172.21.15.77:0/1639408800 learned_addr learned my addr 172.21.15.77:0/1639408800 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:37.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.158+0000 7f6f3e123700 1 --2- 172.21.15.77:0/1639408800 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6f3806d350 0x7f6f380ab150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:37.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.158+0000 7f6f3c920700 1 -- 172.21.15.77:0/1639408800 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2943614804 0 0) 0x7f6f381616d0 con 0x7f6f381611b0 2023-07-24T05:46:37.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.158+0000 7f6f3c920700 1 -- 172.21.15.77:0/1639408800 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f240035d0 con 0x7f6f381611b0 2023-07-24T05:46:37.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.158+0000 7f6f3d922700 1 -- 172.21.15.77:0/1639408800 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6f3806d350 msgr2=0x7f6f380ab150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:37.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.158+0000 7f6f3d922700 1 --2- 172.21.15.77:0/1639408800 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6f3806d350 0x7f6f380ab150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:37.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.158+0000 7f6f3d922700 1 -- 172.21.15.77:0/1639408800 >> v1:172.21.15.103:6789/0 conn(0x7f6f381611b0 legacy=0x7f6f380c1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:37.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.158+0000 7f6f3d922700 1 -- 172.21.15.77:0/1639408800 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f38161c90 con 0x7f6f380c1230 2023-07-24T05:46:37.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.158+0000 7f6f3e123700 1 --2- 172.21.15.77:0/1639408800 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6f3806d350 0x7f6f380ab150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:46:37.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.162+0000 7f6f3d922700 1 --2- 172.21.15.77:0/1639408800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f380c1230 0x7f6f380ac380 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6f34009850 tx=0x7f6f34009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a181a46606fee4 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:37.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.162+0000 7f6f3c920700 1 -- 172.21.15.77:0/1639408800 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f34011830 con 0x7f6f380c1230 2023-07-24T05:46:37.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.162+0000 7f6f3c920700 1 -- 172.21.15.77:0/1639408800 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f34011990 con 0x7f6f380c1230 2023-07-24T05:46:37.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.162+0000 7f6f3c920700 1 -- 172.21.15.77:0/1639408800 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f34011d40 con 0x7f6f380c1230 2023-07-24T05:46:37.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.162+0000 7f6f3e924700 1 -- 172.21.15.77:0/1639408800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f380c1230 msgr2=0x7f6f380ac380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:37.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.162+0000 7f6f3e924700 1 --2- 172.21.15.77:0/1639408800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f380c1230 0x7f6f380ac380 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6f34009850 tx=0x7f6f34009b60 comp rx=0 tx=0).stop 2023-07-24T05:46:37.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.162+0000 7f6f3e924700 1 -- 172.21.15.77:0/1639408800 shutdown_connections 2023-07-24T05:46:37.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.162+0000 7f6f3e924700 1 --2- 172.21.15.77:0/1639408800 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6f3806d350 0x7f6f380ab150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:37.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.162+0000 7f6f3e924700 1 --2- 172.21.15.77:0/1639408800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f380c1230 0x7f6f380ac380 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:37.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.162+0000 7f6f3e924700 1 -- 172.21.15.77:0/1639408800 >> 172.21.15.77:0/1639408800 conn(0x7f6f380ce260 msgr2=0x7f6f380ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:37.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.162+0000 7f6f3e924700 1 -- 172.21.15.77:0/1639408800 shutdown_connections 2023-07-24T05:46:37.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.162+0000 7f6f3e924700 1 -- 172.21.15.77:0/1639408800 wait complete. 2023-07-24T05:46:37.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.166+0000 7f6f3e924700 1 Processor -- start 2023-07-24T05:46:37.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.166+0000 7f6f3e924700 1 -- start start 2023-07-24T05:46:37.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.166+0000 7f6f3e924700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f3806d350 0x7f6f381fa830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:37.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.166+0000 7f6f3e924700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6f380c1230 0x7f6f3815d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:37.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.166+0000 7f6f3e924700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f381611b0 0x7f6f3815f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:37.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.166+0000 7f6f3e924700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f380c5330 con 0x7f6f381611b0 2023-07-24T05:46:37.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.166+0000 7f6f3e924700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f381fad70 con 0x7f6f3806d350 2023-07-24T05:46:37.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.166+0000 7f6f3e924700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3815de30 con 0x7f6f380c1230 2023-07-24T05:46:37.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.166+0000 7f6f3e123700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f381611b0 0x7f6f3815f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:37.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.166+0000 7f6f3e123700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f381611b0 0x7f6f3815f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42594/0 (socket says 172.21.15.77:42594) 2023-07-24T05:46:37.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.166+0000 7f6f3e123700 1 -- 172.21.15.77:0/4246261443 learned_addr learned my addr 172.21.15.77:0/4246261443 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:37.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.166+0000 7f6f3d922700 1 --2- 172.21.15.77:0/4246261443 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f3806d350 0x7f6f381fa830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:37.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.166+0000 7f6f3d121700 1 --2- 172.21.15.77:0/4246261443 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6f380c1230 0x7f6f3815d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:37.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.170+0000 7f6f3e123700 1 -- 172.21.15.77:0/4246261443 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6f380c1230 msgr2=0x7f6f3815d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:37.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.170+0000 7f6f3e123700 1 --2- 172.21.15.77:0/4246261443 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6f380c1230 0x7f6f3815d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:37.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.170+0000 7f6f3e123700 1 -- 172.21.15.77:0/4246261443 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f3806d350 msgr2=0x7f6f381fa830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:37.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.170+0000 7f6f3e123700 1 --2- 172.21.15.77:0/4246261443 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f3806d350 0x7f6f381fa830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:37.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.170+0000 7f6f3e123700 1 -- 172.21.15.77:0/4246261443 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f30009a70 con 0x7f6f381611b0 2023-07-24T05:46:37.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.170+0000 7f6f3e123700 1 --2- 172.21.15.77:0/4246261443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f381611b0 0x7f6f3815f340 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6f30009f00 tx=0x7f6f3000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:37.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.170+0000 7f6f2e7fc700 1 -- 172.21.15.77:0/4246261443 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f30009d70 con 0x7f6f381611b0 2023-07-24T05:46:37.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.170+0000 7f6f2e7fc700 1 -- 172.21.15.77:0/4246261443 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f3000f040 con 0x7f6f381611b0 2023-07-24T05:46:37.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.170+0000 7f6f3e924700 1 -- 172.21.15.77:0/4246261443 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f340094b0 con 0x7f6f381611b0 2023-07-24T05:46:37.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.170+0000 7f6f2e7fc700 1 -- 172.21.15.77:0/4246261443 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3000cd70 con 0x7f6f381611b0 2023-07-24T05:46:37.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.170+0000 7f6f3e924700 1 -- 172.21.15.77:0/4246261443 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f380c5860 con 0x7f6f381611b0 2023-07-24T05:46:37.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.170+0000 7f6f3e924700 1 -- 172.21.15.77:0/4246261443 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f3806bae0 con 0x7f6f381611b0 2023-07-24T05:46:37.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.170+0000 7f6f2e7fc700 1 -- 172.21.15.77:0/4246261443 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6f30014480 con 0x7f6f381611b0 2023-07-24T05:46:37.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.174+0000 7f6f2e7fc700 1 --2- 172.21.15.77:0/4246261443 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6f1c0662f0 0x7f6f1c0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:37.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.174+0000 7f6f2e7fc700 1 -- 172.21.15.77:0/4246261443 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6f300845e0 con 0x7f6f381611b0 2023-07-24T05:46:37.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.174+0000 7f6f3d922700 1 --2- 172.21.15.77:0/4246261443 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6f1c0662f0 0x7f6f1c0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:37.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.174+0000 7f6f3d922700 1 --2- 172.21.15.77:0/4246261443 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6f1c0662f0 0x7f6f1c0687b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6f340090b0 tx=0x7f6f34008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:37.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.178+0000 7f6f2e7fc700 1 -- 172.21.15.77:0/4246261443 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6f30051760 con 0x7f6f381611b0 2023-07-24T05:46:37.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.350+0000 7f6f3e924700 1 -- 172.21.15.77:0/4246261443 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6f38072490 con 0x7f6f381611b0 2023-07-24T05:46:37.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.350+0000 7f6f2e7fc700 1 -- 172.21.15.77:0/4246261443 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6f30054d80 con 0x7f6f381611b0 2023-07-24T05:46:37.355 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 8 2023-07-24T05:46:37.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.354+0000 7f6f3e924700 1 -- 172.21.15.77:0/4246261443 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6f1c0662f0 msgr2=0x7f6f1c0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:37.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.354+0000 7f6f3e924700 1 --2- 172.21.15.77:0/4246261443 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6f1c0662f0 0x7f6f1c0687b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6f340090b0 tx=0x7f6f34008030 comp rx=0 tx=0).stop 2023-07-24T05:46:37.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.354+0000 7f6f3e924700 1 -- 172.21.15.77:0/4246261443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f381611b0 msgr2=0x7f6f3815f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:37.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.354+0000 7f6f3e924700 1 --2- 172.21.15.77:0/4246261443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f381611b0 0x7f6f3815f340 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6f30009f00 tx=0x7f6f3000c3a0 comp rx=0 tx=0).stop 2023-07-24T05:46:37.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.354+0000 7f6f3e924700 1 -- 172.21.15.77:0/4246261443 shutdown_connections 2023-07-24T05:46:37.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.354+0000 7f6f3e924700 1 --2- 172.21.15.77:0/4246261443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f381611b0 0x7f6f3815f340 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:37.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.354+0000 7f6f3e924700 1 --2- 172.21.15.77:0/4246261443 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6f1c0662f0 0x7f6f1c0687b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:37.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.354+0000 7f6f3e924700 1 --2- 172.21.15.77:0/4246261443 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6f380c1230 0x7f6f3815d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:37.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.354+0000 7f6f3e924700 1 --2- 172.21.15.77:0/4246261443 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f3806d350 0x7f6f381fa830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:37.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.354+0000 7f6f3e924700 1 -- 172.21.15.77:0/4246261443 >> 172.21.15.77:0/4246261443 conn(0x7f6f380ce260 msgr2=0x7f6f380ac170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:37.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.354+0000 7f6f3e924700 1 -- 172.21.15.77:0/4246261443 shutdown_connections 2023-07-24T05:46:37.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.354+0000 7f6f3e924700 1 -- 172.21.15.77:0/4246261443 wait complete. 2023-07-24T05:46:37.380 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-24T05:46:37.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.554+0000 7f63927d2700 1 Processor -- start 2023-07-24T05:46:37.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.554+0000 7f63927d2700 1 -- start start 2023-07-24T05:46:37.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.558+0000 7f63927d2700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f638c0d2fc0 0x7f638c0b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:37.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.558+0000 7f63927d2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f638c15db20 0x7f638c0d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:37.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.558+0000 7f63927d2700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f638c160fa0 con 0x7f638c06afc0 2023-07-24T05:46:37.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.558+0000 7f63927d2700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f638c0d0360 con 0x7f638c0d2fc0 2023-07-24T05:46:37.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.558+0000 7f63927d2700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f638c0b20b0 con 0x7f638c15db20 2023-07-24T05:46:37.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.558+0000 7f63837fe700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f638c0d2fc0 0x7f638c0b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:37.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.558+0000 7f63837fe700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f638c0d2fc0 0x7f638c0b1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42606/0 (socket says 172.21.15.77:42606) 2023-07-24T05:46:37.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.558+0000 7f63837fe700 1 -- 172.21.15.77:0/46511107 learned_addr learned my addr 172.21.15.77:0/46511107 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:37.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.558+0000 7f6390d6f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f638c15db20 0x7f638c0d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:37.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.558+0000 7f63837fe700 1 -- 172.21.15.77:0/46511107 >> v2:172.21.15.103:3300/0 conn(0x7f638c15db20 msgr2=0x7f638c0d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:37.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.558+0000 7f63837fe700 1 --2- 172.21.15.77:0/46511107 >> v2:172.21.15.103:3300/0 conn(0x7f638c15db20 0x7f638c0d1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:37.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.558+0000 7f63837fe700 1 -- 172.21.15.77:0/46511107 >> v1:172.21.15.103:6789/0 conn(0x7f638c06afc0 legacy=0x7f638c0d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:37.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.558+0000 7f63837fe700 1 -- 172.21.15.77:0/46511107 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f638c160670 con 0x7f638c0d2fc0 2023-07-24T05:46:37.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.558+0000 7f6390d6f700 1 --2- 172.21.15.77:0/46511107 >> v2:172.21.15.103:3300/0 conn(0x7f638c15db20 0x7f638c0d1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:46:37.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.558+0000 7f63837fe700 1 --2- 172.21.15.77:0/46511107 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f638c0d2fc0 0x7f638c0b1a20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f638c08bd50 tx=0x7f6374009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b979317aa163b4e server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:37.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.558+0000 7f638b7fe700 1 -- 172.21.15.77:0/46511107 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6374011830 con 0x7f638c0d2fc0 2023-07-24T05:46:37.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.558+0000 7f638b7fe700 1 -- 172.21.15.77:0/46511107 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6374011990 con 0x7f638c0d2fc0 2023-07-24T05:46:37.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.558+0000 7f638b7fe700 1 -- 172.21.15.77:0/46511107 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6374011d20 con 0x7f638c0d2fc0 2023-07-24T05:46:37.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.562+0000 7f63927d2700 1 -- 172.21.15.77:0/46511107 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f638c0d2fc0 msgr2=0x7f638c0b1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:37.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.562+0000 7f63927d2700 1 --2- 172.21.15.77:0/46511107 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f638c0d2fc0 0x7f638c0b1a20 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f638c08bd50 tx=0x7f6374009bf0 comp rx=0 tx=0).stop 2023-07-24T05:46:37.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.562+0000 7f63927d2700 1 -- 172.21.15.77:0/46511107 shutdown_connections 2023-07-24T05:46:37.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.562+0000 7f63927d2700 1 --2- 172.21.15.77:0/46511107 >> v2:172.21.15.103:3300/0 conn(0x7f638c15db20 0x7f638c0d1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:37.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.562+0000 7f63927d2700 1 --2- 172.21.15.77:0/46511107 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f638c0d2fc0 0x7f638c0b1a20 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:37.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.562+0000 7f63927d2700 1 -- 172.21.15.77:0/46511107 >> 172.21.15.77:0/46511107 conn(0x7f638c09bc20 msgr2=0x7f638c0b7920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:37.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.562+0000 7f63927d2700 1 -- 172.21.15.77:0/46511107 shutdown_connections 2023-07-24T05:46:37.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.562+0000 7f63927d2700 1 -- 172.21.15.77:0/46511107 wait complete. 2023-07-24T05:46:37.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.562+0000 7f63927d2700 1 Processor -- start 2023-07-24T05:46:37.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.562+0000 7f63927d2700 1 -- start start 2023-07-24T05:46:37.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.566+0000 7f63927d2700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f638c06afc0 0x7f638c156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:37.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.566+0000 7f63927d2700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f638c0d2fc0 0x7f638c1e6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:37.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.566+0000 7f63927d2700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f638c15db20 0x7f638c1e84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:37.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.566+0000 7f63927d2700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638c1e7c40 con 0x7f638c06afc0 2023-07-24T05:46:37.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.566+0000 7f63927d2700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638c157360 con 0x7f638c15db20 2023-07-24T05:46:37.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.566+0000 7f63927d2700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f638c0ca640 con 0x7f638c0d2fc0 2023-07-24T05:46:37.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.566+0000 7f638bfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f638c06afc0 0x7f638c156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:37.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.566+0000 7f638bfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f638c06afc0 0x7f638c156e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42610/0 (socket says 172.21.15.77:42610) 2023-07-24T05:46:37.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.566+0000 7f638bfff700 1 -- 172.21.15.77:0/359732454 learned_addr learned my addr 172.21.15.77:0/359732454 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:37.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.566+0000 7f63837fe700 1 --2- 172.21.15.77:0/359732454 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f638c0d2fc0 0x7f638c1e6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:37.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.566+0000 7f6390d6f700 1 --2- 172.21.15.77:0/359732454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f638c15db20 0x7f638c1e84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:37.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.566+0000 7f638bfff700 1 -- 172.21.15.77:0/359732454 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f638c0d2fc0 msgr2=0x7f638c1e6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:37.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.566+0000 7f638bfff700 1 --2- 172.21.15.77:0/359732454 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f638c0d2fc0 0x7f638c1e6b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:37.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.566+0000 7f638bfff700 1 -- 172.21.15.77:0/359732454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f638c15db20 msgr2=0x7f638c1e84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:37.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.566+0000 7f638bfff700 1 --2- 172.21.15.77:0/359732454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f638c15db20 0x7f638c1e84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:37.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.566+0000 7f638bfff700 1 -- 172.21.15.77:0/359732454 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6384009a70 con 0x7f638c06afc0 2023-07-24T05:46:37.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.566+0000 7f6390d6f700 1 --2- 172.21.15.77:0/359732454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f638c15db20 0x7f638c1e84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:46:37.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.566+0000 7f638bfff700 1 --2- 172.21.15.77:0/359732454 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f638c06afc0 0x7f638c156e20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f637c00c500 tx=0x7f637c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:37.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.566+0000 7f63897fa700 1 -- 172.21.15.77:0/359732454 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637c0052d0 con 0x7f638c06afc0 2023-07-24T05:46:37.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.566+0000 7f63897fa700 1 -- 172.21.15.77:0/359732454 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f637c005430 con 0x7f638c06afc0 2023-07-24T05:46:37.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.566+0000 7f63927d2700 1 -- 172.21.15.77:0/359732454 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6374009570 con 0x7f638c06afc0 2023-07-24T05:46:37.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.566+0000 7f63897fa700 1 -- 172.21.15.77:0/359732454 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637c0055a0 con 0x7f638c06afc0 2023-07-24T05:46:37.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.566+0000 7f63927d2700 1 -- 172.21.15.77:0/359732454 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f638c1e7680 con 0x7f638c06afc0 2023-07-24T05:46:37.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.566+0000 7f63927d2700 1 -- 172.21.15.77:0/359732454 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f638c04df10 con 0x7f638c06afc0 2023-07-24T05:46:37.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.570+0000 7f63897fa700 1 -- 172.21.15.77:0/359732454 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f637c0038e0 con 0x7f638c06afc0 2023-07-24T05:46:37.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.570+0000 7f63897fa700 1 --2- 172.21.15.77:0/359732454 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f636c066320 0x7f636c0687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:37.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.570+0000 7f63897fa700 1 -- 172.21.15.77:0/359732454 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f637c083510 con 0x7f638c06afc0 2023-07-24T05:46:37.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.574+0000 7f63837fe700 1 --2- 172.21.15.77:0/359732454 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f636c066320 0x7f636c0687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:37.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.574+0000 7f63837fe700 1 --2- 172.21.15.77:0/359732454 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f636c066320 0x7f636c0687e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6374000c00 tx=0x7f6374008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:37.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.578+0000 7f63897fa700 1 -- 172.21.15.77:0/359732454 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f637c050600 con 0x7f638c06afc0 2023-07-24T05:46:37.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.746+0000 7f63927d2700 1 -- 172.21.15.77:0/359732454 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f638c1e7a20 con 0x7f638c06afc0 2023-07-24T05:46:37.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.750+0000 7f63897fa700 1 -- 172.21.15.77:0/359732454 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f637c053c20 con 0x7f638c06afc0 2023-07-24T05:46:37.753 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-07-24T05:46:37.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.750+0000 7f63927d2700 1 -- 172.21.15.77:0/359732454 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f636c066320 msgr2=0x7f636c0687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:37.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.750+0000 7f63927d2700 1 --2- 172.21.15.77:0/359732454 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f636c066320 0x7f636c0687e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6374000c00 tx=0x7f6374008030 comp rx=0 tx=0).stop 2023-07-24T05:46:37.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.750+0000 7f63927d2700 1 -- 172.21.15.77:0/359732454 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f638c06afc0 msgr2=0x7f638c156e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:37.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.750+0000 7f63927d2700 1 --2- 172.21.15.77:0/359732454 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f638c06afc0 0x7f638c156e20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f637c00c500 tx=0x7f637c00c810 comp rx=0 tx=0).stop 2023-07-24T05:46:37.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.750+0000 7f63927d2700 1 -- 172.21.15.77:0/359732454 shutdown_connections 2023-07-24T05:46:37.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.750+0000 7f63927d2700 1 --2- 172.21.15.77:0/359732454 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f638c15db20 0x7f638c1e84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:37.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.750+0000 7f63927d2700 1 --2- 172.21.15.77:0/359732454 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f636c066320 0x7f636c0687e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:37.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.750+0000 7f63927d2700 1 --2- 172.21.15.77:0/359732454 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f638c0d2fc0 0x7f638c1e6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:37.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.750+0000 7f63927d2700 1 --2- 172.21.15.77:0/359732454 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f638c06afc0 0x7f638c156e20 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:37.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.750+0000 7f63927d2700 1 -- 172.21.15.77:0/359732454 >> 172.21.15.77:0/359732454 conn(0x7f638c09bc20 msgr2=0x7f638c0b0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:37.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.750+0000 7f63927d2700 1 -- 172.21.15.77:0/359732454 shutdown_connections 2023-07-24T05:46:37.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.750+0000 7f63927d2700 1 -- 172.21.15.77:0/359732454 wait complete. 2023-07-24T05:46:37.776 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-24T05:46:37.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.946+0000 7fb6b2447700 1 Processor -- start 2023-07-24T05:46:37.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.946+0000 7fb6b2447700 1 -- start start 2023-07-24T05:46:37.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.950+0000 7fb6b2447700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb6ac15c870 0x7fb6ac0cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:37.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.950+0000 7fb6b2447700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb6ac15cc50 0x7fb6ac0b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:37.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.950+0000 7fb6b2447700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6ac0cf520 con 0x7fb6ac06a520 2023-07-24T05:46:37.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.950+0000 7fb6b2447700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6ac06aaa0 con 0x7fb6ac15cc50 2023-07-24T05:46:37.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.950+0000 7fb6b2447700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6ac06ad80 con 0x7fb6ac15c870 2023-07-24T05:46:37.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.950+0000 7fb6b1c46700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb6ac06a520 0x7fb6ac0b40e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:53678/0 (socket says 172.21.15.77:53678) 2023-07-24T05:46:37.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.950+0000 7fb6b1c46700 1 -- 172.21.15.77:0/2600499256 learned_addr learned my addr 172.21.15.77:0/2600499256 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:37.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.950+0000 7fb6b0c44700 1 --2- 172.21.15.77:0/2600499256 >> v2:172.21.15.77:3300/0 conn(0x7fb6ac15cc50 0x7fb6ac0b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:37.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.950+0000 7fb6b1445700 1 --2- 172.21.15.77:0/2600499256 >> v2:172.21.15.103:3300/0 conn(0x7fb6ac15c870 0x7fb6ac0cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:37.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.950+0000 7fb6a3fff700 1 -- 172.21.15.77:0/2600499256 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3019317455 0 0) 0x7fb6ac0cf520 con 0x7fb6ac06a520 2023-07-24T05:46:37.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.950+0000 7fb6a3fff700 1 -- 172.21.15.77:0/2600499256 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6980035d0 con 0x7fb6ac06a520 2023-07-24T05:46:37.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.950+0000 7fb6b0c44700 1 -- 172.21.15.77:0/2600499256 >> v2:172.21.15.103:3300/0 conn(0x7fb6ac15c870 msgr2=0x7fb6ac0cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:37.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.950+0000 7fb6b0c44700 1 --2- 172.21.15.77:0/2600499256 >> v2:172.21.15.103:3300/0 conn(0x7fb6ac15c870 0x7fb6ac0cefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:37.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.950+0000 7fb6b0c44700 1 -- 172.21.15.77:0/2600499256 >> v1:172.21.15.77:6789/0 conn(0x7fb6ac06a520 legacy=0x7fb6ac0b40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:37.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.950+0000 7fb6b0c44700 1 -- 172.21.15.77:0/2600499256 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6ac06b060 con 0x7fb6ac15cc50 2023-07-24T05:46:37.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.950+0000 7fb6b0c44700 1 --2- 172.21.15.77:0/2600499256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6ac15cc50 0x7fb6ac0b1b20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac0b7e30 tx=0x7fb69c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ba89250619b3372 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:37.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.954+0000 7fb6a3fff700 1 -- 172.21.15.77:0/2600499256 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69c011830 con 0x7fb6ac15cc50 2023-07-24T05:46:37.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.954+0000 7fb6a3fff700 1 -- 172.21.15.77:0/2600499256 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb69c011990 con 0x7fb6ac15cc50 2023-07-24T05:46:37.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.954+0000 7fb6a3fff700 1 -- 172.21.15.77:0/2600499256 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69c011d20 con 0x7fb6ac15cc50 2023-07-24T05:46:37.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.954+0000 7fb6b2447700 1 -- 172.21.15.77:0/2600499256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6ac15cc50 msgr2=0x7fb6ac0b1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:37.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.954+0000 7fb6b2447700 1 --2- 172.21.15.77:0/2600499256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6ac15cc50 0x7fb6ac0b1b20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac0b7e30 tx=0x7fb69c009b30 comp rx=0 tx=0).stop 2023-07-24T05:46:37.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.954+0000 7fb6b2447700 1 -- 172.21.15.77:0/2600499256 shutdown_connections 2023-07-24T05:46:37.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.954+0000 7fb6b2447700 1 --2- 172.21.15.77:0/2600499256 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6ac15cc50 0x7fb6ac0b1b20 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:37.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.954+0000 7fb6b2447700 1 --2- 172.21.15.77:0/2600499256 >> v2:172.21.15.103:3300/0 conn(0x7fb6ac15c870 0x7fb6ac0cefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:37.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.954+0000 7fb6b2447700 1 -- 172.21.15.77:0/2600499256 >> 172.21.15.77:0/2600499256 conn(0x7fb6ac089f80 msgr2=0x7fb6ac09b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:37.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.954+0000 7fb6b2447700 1 -- 172.21.15.77:0/2600499256 shutdown_connections 2023-07-24T05:46:37.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.954+0000 7fb6b2447700 1 -- 172.21.15.77:0/2600499256 wait complete. 2023-07-24T05:46:37.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.958+0000 7fb6b2447700 1 Processor -- start 2023-07-24T05:46:37.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.958+0000 7fb6b2447700 1 -- start start 2023-07-24T05:46:37.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.958+0000 7fb6b2447700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb6ac06a520 0x7fb6ac0c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:37.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.958+0000 7fb6b2447700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6ac15c870 0x7fb6ac14da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:37.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.958+0000 7fb6b2447700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6ac15cc50 0x7fb6ac1e5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:37.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.958+0000 7fb6b2447700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac0c9040 con 0x7fb6ac15cc50 2023-07-24T05:46:37.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.958+0000 7fb6b2447700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac0ca460 con 0x7fb6ac15c870 2023-07-24T05:46:37.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.958+0000 7fb6b2447700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac0c6c60 con 0x7fb6ac06a520 2023-07-24T05:46:37.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.958+0000 7fb6b1c46700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6ac15cc50 0x7fb6ac1e5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:37.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.958+0000 7fb6b1c46700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6ac15cc50 0x7fb6ac1e5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42628/0 (socket says 172.21.15.77:42628) 2023-07-24T05:46:37.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.958+0000 7fb6b1c46700 1 -- 172.21.15.77:0/1426342033 learned_addr learned my addr 172.21.15.77:0/1426342033 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:37.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.958+0000 7fb6b1445700 1 --2- 172.21.15.77:0/1426342033 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb6ac06a520 0x7fb6ac0c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:37.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.958+0000 7fb6b0c44700 1 --2- 172.21.15.77:0/1426342033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6ac15c870 0x7fb6ac14da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:37.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.958+0000 7fb6b1c46700 1 -- 172.21.15.77:0/1426342033 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb6ac06a520 msgr2=0x7fb6ac0c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:37.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.958+0000 7fb6b1c46700 1 --2- 172.21.15.77:0/1426342033 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb6ac06a520 0x7fb6ac0c87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:37.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.958+0000 7fb6b1c46700 1 -- 172.21.15.77:0/1426342033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6ac15c870 msgr2=0x7fb6ac14da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:37.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.958+0000 7fb6b1c46700 1 --2- 172.21.15.77:0/1426342033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6ac15c870 0x7fb6ac14da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:37.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.958+0000 7fb6b1c46700 1 -- 172.21.15.77:0/1426342033 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb69c0094b0 con 0x7fb6ac15cc50 2023-07-24T05:46:37.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.958+0000 7fb6b1445700 1 --2- 172.21.15.77:0/1426342033 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb6ac06a520 0x7fb6ac0c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:46:37.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.958+0000 7fb6b0c44700 1 --2- 172.21.15.77:0/1426342033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6ac15c870 0x7fb6ac14da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:46:37.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.958+0000 7fb6b1c46700 1 --2- 172.21.15.77:0/1426342033 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6ac15cc50 0x7fb6ac1e5910 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb6a400caa0 tx=0x7fb6a400cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:37.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.958+0000 7fb6a1ffb700 1 -- 172.21.15.77:0/1426342033 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a400a7b0 con 0x7fb6ac15cc50 2023-07-24T05:46:37.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.958+0000 7fb6a1ffb700 1 -- 172.21.15.77:0/1426342033 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6a400a910 con 0x7fb6ac15cc50 2023-07-24T05:46:37.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.958+0000 7fb6b2447700 1 -- 172.21.15.77:0/1426342033 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6ac0c6f40 con 0x7fb6ac15cc50 2023-07-24T05:46:37.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.958+0000 7fb6a1ffb700 1 -- 172.21.15.77:0/1426342033 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a400aca0 con 0x7fb6ac15cc50 2023-07-24T05:46:37.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.962+0000 7fb6b2447700 1 -- 172.21.15.77:0/1426342033 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6ac0c7220 con 0x7fb6ac15cc50 2023-07-24T05:46:37.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.962+0000 7fb6b2447700 1 -- 172.21.15.77:0/1426342033 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6ac0cf400 con 0x7fb6ac15cc50 2023-07-24T05:46:37.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.962+0000 7fb6a1ffb700 1 -- 172.21.15.77:0/1426342033 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb6a401b3b0 con 0x7fb6ac15cc50 2023-07-24T05:46:37.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.966+0000 7fb6a1ffb700 1 --2- 172.21.15.77:0/1426342033 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb6900662f0 0x7fb6900687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:37.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.966+0000 7fb6a1ffb700 1 -- 172.21.15.77:0/1426342033 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb6a4083a70 con 0x7fb6ac15cc50 2023-07-24T05:46:37.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.966+0000 7fb6b1445700 1 --2- 172.21.15.77:0/1426342033 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb6900662f0 0x7fb6900687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:37.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.966+0000 7fb6b1445700 1 --2- 172.21.15.77:0/1426342033 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb6900662f0 0x7fb6900687b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac0c64b0 tx=0x7fb6a8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:37.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:37.970+0000 7fb6a1ffb700 1 -- 172.21.15.77:0/1426342033 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb6a4050c00 con 0x7fb6ac15cc50 2023-07-24T05:46:38.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.142+0000 7fb6b2447700 1 -- 172.21.15.77:0/1426342033 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb6ac0ca620 con 0x7fb6ac15cc50 2023-07-24T05:46:38.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.142+0000 7fb6a1ffb700 1 -- 172.21.15.77:0/1426342033 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb6a4054220 con 0x7fb6ac15cc50 2023-07-24T05:46:38.148 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-07-24T05:46:38.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.146+0000 7fb6b2447700 1 -- 172.21.15.77:0/1426342033 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb6900662f0 msgr2=0x7fb6900687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:38.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.146+0000 7fb6b2447700 1 --2- 172.21.15.77:0/1426342033 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb6900662f0 0x7fb6900687b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac0c64b0 tx=0x7fb6a8008040 comp rx=0 tx=0).stop 2023-07-24T05:46:38.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.146+0000 7fb6b2447700 1 -- 172.21.15.77:0/1426342033 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6ac15cc50 msgr2=0x7fb6ac1e5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:38.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.146+0000 7fb6b2447700 1 --2- 172.21.15.77:0/1426342033 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6ac15cc50 0x7fb6ac1e5910 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb6a400caa0 tx=0x7fb6a400cb80 comp rx=0 tx=0).stop 2023-07-24T05:46:38.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.146+0000 7fb6b2447700 1 -- 172.21.15.77:0/1426342033 shutdown_connections 2023-07-24T05:46:38.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.146+0000 7fb6b2447700 1 --2- 172.21.15.77:0/1426342033 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb6ac15cc50 0x7fb6ac1e5910 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:38.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.146+0000 7fb6b2447700 1 --2- 172.21.15.77:0/1426342033 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6ac15c870 0x7fb6ac14da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:38.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.146+0000 7fb6b2447700 1 --2- 172.21.15.77:0/1426342033 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb6900662f0 0x7fb6900687b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:38.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.146+0000 7fb6b2447700 1 --2- 172.21.15.77:0/1426342033 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb6ac06a520 0x7fb6ac0c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:38.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.146+0000 7fb6b2447700 1 -- 172.21.15.77:0/1426342033 >> 172.21.15.77:0/1426342033 conn(0x7fb6ac089f80 msgr2=0x7fb6ac15bb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:38.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.146+0000 7fb6b2447700 1 -- 172.21.15.77:0/1426342033 shutdown_connections 2023-07-24T05:46:38.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.146+0000 7fb6b2447700 1 -- 172.21.15.77:0/1426342033 wait complete. 2023-07-24T05:46:38.173 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-24T05:46:38.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.342+0000 7f053b489700 1 Processor -- start 2023-07-24T05:46:38.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.342+0000 7f053b489700 1 -- start start 2023-07-24T05:46:38.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.342+0000 7f053b489700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f053406bb60 0x7f05340ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:38.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.342+0000 7f053b489700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f05340ced80 0x7f0534070360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:38.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.342+0000 7f053b489700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f053406c1d0 con 0x7f0534159840 2023-07-24T05:46:38.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.342+0000 7f053b489700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f053406daa0 con 0x7f053406bb60 2023-07-24T05:46:38.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.342+0000 7f053b489700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f053406bfc0 con 0x7f05340ced80 2023-07-24T05:46:38.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.342+0000 7f053a487700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f0534159840 0x7f053406fc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:53688/0 (socket says 172.21.15.77:53688) 2023-07-24T05:46:38.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.342+0000 7f053a487700 1 -- 172.21.15.77:0/3951837199 learned_addr learned my addr 172.21.15.77:0/3951837199 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:38.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.346+0000 7f0539c86700 1 --2- 172.21.15.77:0/3951837199 >> v2:172.21.15.77:3300/0 conn(0x7f053406bb60 0x7f05340ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:38.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.346+0000 7f053ac88700 1 --2- 172.21.15.77:0/3951837199 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f05340ced80 0x7f0534070360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:38.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.346+0000 7f0539485700 1 -- 172.21.15.77:0/3951837199 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2752386983 0 0) 0x7f053406c1d0 con 0x7f0534159840 2023-07-24T05:46:38.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.346+0000 7f0539485700 1 -- 172.21.15.77:0/3951837199 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f051c0035d0 con 0x7f0534159840 2023-07-24T05:46:38.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.346+0000 7f0539c86700 1 -- 172.21.15.77:0/3951837199 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f05340ced80 msgr2=0x7f0534070360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:38.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.346+0000 7f0539c86700 1 --2- 172.21.15.77:0/3951837199 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f05340ced80 0x7f0534070360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:38.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.346+0000 7f0539c86700 1 -- 172.21.15.77:0/3951837199 >> v1:172.21.15.77:6789/0 conn(0x7f0534159840 legacy=0x7f053406fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:38.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.346+0000 7f0539c86700 1 -- 172.21.15.77:0/3951837199 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05340c92c0 con 0x7f053406bb60 2023-07-24T05:46:38.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.346+0000 7f0539c86700 1 --2- 172.21.15.77:0/3951837199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f053406bb60 0x7f05340ca2d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0528009850 tx=0x7f0528009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d54a363aa1581c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:38.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.346+0000 7f0539485700 1 -- 172.21.15.77:0/3951837199 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0528011830 con 0x7f053406bb60 2023-07-24T05:46:38.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.346+0000 7f0539485700 1 -- 172.21.15.77:0/3951837199 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0528011990 con 0x7f053406bb60 2023-07-24T05:46:38.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.346+0000 7f0539485700 1 -- 172.21.15.77:0/3951837199 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0528011d40 con 0x7f053406bb60 2023-07-24T05:46:38.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.346+0000 7f053b489700 1 -- 172.21.15.77:0/3951837199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f053406bb60 msgr2=0x7f05340ca2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:38.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.346+0000 7f053b489700 1 --2- 172.21.15.77:0/3951837199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f053406bb60 0x7f05340ca2d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0528009850 tx=0x7f0528009b60 comp rx=0 tx=0).stop 2023-07-24T05:46:38.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.346+0000 7f053b489700 1 -- 172.21.15.77:0/3951837199 shutdown_connections 2023-07-24T05:46:38.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.346+0000 7f053b489700 1 --2- 172.21.15.77:0/3951837199 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f05340ced80 0x7f0534070360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:38.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.346+0000 7f053b489700 1 --2- 172.21.15.77:0/3951837199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f053406bb60 0x7f05340ca2d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:38.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.350+0000 7f053b489700 1 -- 172.21.15.77:0/3951837199 >> 172.21.15.77:0/3951837199 conn(0x7f05340ce260 msgr2=0x7f05340ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:38.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.350+0000 7f053b489700 1 -- 172.21.15.77:0/3951837199 shutdown_connections 2023-07-24T05:46:38.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.350+0000 7f053b489700 1 -- 172.21.15.77:0/3951837199 wait complete. 2023-07-24T05:46:38.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.350+0000 7f053b489700 1 Processor -- start 2023-07-24T05:46:38.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.350+0000 7f053b489700 1 -- start start 2023-07-24T05:46:38.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.354+0000 7f053b489700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f053406bb60 0x7f0534155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:38.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.354+0000 7f053b489700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f05340ced80 0x7f0534155a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:38.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.354+0000 7f053b489700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0534159840 0x7f05341e4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:38.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.354+0000 7f053b489700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053415c420 con 0x7f053406bb60 2023-07-24T05:46:38.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.354+0000 7f053b489700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0534156490 con 0x7f0534159840 2023-07-24T05:46:38.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.354+0000 7f053b489700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0534156770 con 0x7f05340ced80 2023-07-24T05:46:38.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.354+0000 7f053a487700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f053406bb60 0x7f0534155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:38.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.354+0000 7f053a487700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f053406bb60 0x7f0534155290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42634/0 (socket says 172.21.15.77:42634) 2023-07-24T05:46:38.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.354+0000 7f053a487700 1 -- 172.21.15.77:0/1982186440 learned_addr learned my addr 172.21.15.77:0/1982186440 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:38.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.354+0000 7f0539c86700 1 --2- 172.21.15.77:0/1982186440 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f05340ced80 0x7f0534155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:38.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.354+0000 7f053ac88700 1 --2- 172.21.15.77:0/1982186440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0534159840 0x7f05341e4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:38.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.354+0000 7f053a487700 1 -- 172.21.15.77:0/1982186440 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f05340ced80 msgr2=0x7f0534155a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:38.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.354+0000 7f053a487700 1 --2- 172.21.15.77:0/1982186440 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f05340ced80 0x7f0534155a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:38.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.354+0000 7f053a487700 1 -- 172.21.15.77:0/1982186440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0534159840 msgr2=0x7f05341e4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:38.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.354+0000 7f053a487700 1 --2- 172.21.15.77:0/1982186440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0534159840 0x7f05341e4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:38.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.354+0000 7f053a487700 1 -- 172.21.15.77:0/1982186440 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05280094b0 con 0x7f053406bb60 2023-07-24T05:46:38.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.354+0000 7f053a487700 1 --2- 172.21.15.77:0/1982186440 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f053406bb60 0x7f0534155290 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f052400cbc0 tx=0x7f052400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:38.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.354+0000 7f0532ffd700 1 -- 172.21.15.77:0/1982186440 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0524007480 con 0x7f053406bb60 2023-07-24T05:46:38.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.354+0000 7f0532ffd700 1 -- 172.21.15.77:0/1982186440 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05240075e0 con 0x7f053406bb60 2023-07-24T05:46:38.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.354+0000 7f0532ffd700 1 -- 172.21.15.77:0/1982186440 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0524007950 con 0x7f053406bb60 2023-07-24T05:46:38.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.354+0000 7f053b489700 1 -- 172.21.15.77:0/1982186440 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0534156a50 con 0x7f053406bb60 2023-07-24T05:46:38.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.354+0000 7f053b489700 1 -- 172.21.15.77:0/1982186440 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0534156d30 con 0x7f053406bb60 2023-07-24T05:46:38.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.358+0000 7f053b489700 1 -- 172.21.15.77:0/1982186440 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05341e2140 con 0x7f053406bb60 2023-07-24T05:46:38.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.358+0000 7f0532ffd700 1 -- 172.21.15.77:0/1982186440 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f052401b3b0 con 0x7f053406bb60 2023-07-24T05:46:38.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.358+0000 7f0532ffd700 1 --2- 172.21.15.77:0/1982186440 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f05200662f0 0x7f05200687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:38.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.358+0000 7f0532ffd700 1 -- 172.21.15.77:0/1982186440 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f05240839f0 con 0x7f053406bb60 2023-07-24T05:46:38.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.362+0000 7f0539c86700 1 --2- 172.21.15.77:0/1982186440 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f05200662f0 0x7f05200687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:38.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.362+0000 7f0539c86700 1 --2- 172.21.15.77:0/1982186440 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f05200662f0 0x7f05200687b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f05280090b0 tx=0x7f0528008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:38.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.366+0000 7f0532ffd700 1 -- 172.21.15.77:0/1982186440 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f05341e2140 con 0x7f053406bb60 2023-07-24T05:46:38.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.538+0000 7f053b489700 1 -- 172.21.15.77:0/1982186440 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f05341e2140 con 0x7f053406bb60 2023-07-24T05:46:38.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.538+0000 7f0532ffd700 1 -- 172.21.15.77:0/1982186440 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f05341e2140 con 0x7f053406bb60 2023-07-24T05:46:38.542 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-07-24T05:46:38.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.542+0000 7f053b489700 1 -- 172.21.15.77:0/1982186440 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f05200662f0 msgr2=0x7f05200687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:38.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.542+0000 7f053b489700 1 --2- 172.21.15.77:0/1982186440 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f05200662f0 0x7f05200687b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f05280090b0 tx=0x7f0528008030 comp rx=0 tx=0).stop 2023-07-24T05:46:38.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.542+0000 7f053b489700 1 -- 172.21.15.77:0/1982186440 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f053406bb60 msgr2=0x7f0534155290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:38.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.542+0000 7f053b489700 1 --2- 172.21.15.77:0/1982186440 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f053406bb60 0x7f0534155290 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f052400cbc0 tx=0x7f052400cbf0 comp rx=0 tx=0).stop 2023-07-24T05:46:38.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.542+0000 7f053b489700 1 -- 172.21.15.77:0/1982186440 shutdown_connections 2023-07-24T05:46:38.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.542+0000 7f053b489700 1 --2- 172.21.15.77:0/1982186440 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0534159840 0x7f05341e4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:38.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.542+0000 7f053b489700 1 --2- 172.21.15.77:0/1982186440 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f05200662f0 0x7f05200687b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:38.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.542+0000 7f053b489700 1 --2- 172.21.15.77:0/1982186440 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f05340ced80 0x7f0534155a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:38.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.542+0000 7f053b489700 1 --2- 172.21.15.77:0/1982186440 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f053406bb60 0x7f0534155290 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:38.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.542+0000 7f053b489700 1 -- 172.21.15.77:0/1982186440 >> 172.21.15.77:0/1982186440 conn(0x7f05340ce260 msgr2=0x7f05340b0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:38.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.542+0000 7f053b489700 1 -- 172.21.15.77:0/1982186440 shutdown_connections 2023-07-24T05:46:38.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.542+0000 7f053b489700 1 -- 172.21.15.77:0/1982186440 wait complete. 2023-07-24T05:46:38.566 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-24T05:46:38.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.730+0000 7f84c0edf700 1 Processor -- start 2023-07-24T05:46:38.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.730+0000 7f84c0edf700 1 -- start start 2023-07-24T05:46:38.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.734+0000 7f84c0edf700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f84bc15e4c0 0x7f84bc15e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:38.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.734+0000 7f84c0edf700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84bc06bb60 con 0x7f84bc06cac0 2023-07-24T05:46:38.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.734+0000 7f84c0edf700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84bc15f380 con 0x7f84bc0ca940 2023-07-24T05:46:38.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.734+0000 7f84c0edf700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84bc15ee90 con 0x7f84bc15e4c0 2023-07-24T05:46:38.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.734+0000 7f84ba59c700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f84bc06cac0 0x7f84bc06cea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:53690/0 (socket says 172.21.15.77:53690) 2023-07-24T05:46:38.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.734+0000 7f84ba59c700 1 -- 172.21.15.77:0/518969240 learned_addr learned my addr 172.21.15.77:0/518969240 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:38.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.734+0000 7f84b9d9b700 1 --2- 172.21.15.77:0/518969240 >> v2:172.21.15.103:3300/0 conn(0x7f84bc15e4c0 0x7f84bc15e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:38.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.734+0000 7f84b959a700 1 -- 172.21.15.77:0/518969240 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3431297432 0 0) 0x7f84bc06bb60 con 0x7f84bc06cac0 2023-07-24T05:46:38.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.734+0000 7f84b959a700 1 -- 172.21.15.77:0/518969240 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84a40035d0 con 0x7f84bc06cac0 2023-07-24T05:46:38.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.734+0000 7f84b959a700 1 -- 172.21.15.77:0/518969240 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 229608562 0 0) 0x7f84a40035d0 con 0x7f84bc06cac0 2023-07-24T05:46:38.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.734+0000 7f84b959a700 1 -- 172.21.15.77:0/518969240 >> v2:172.21.15.103:3300/0 conn(0x7f84bc15e4c0 msgr2=0x7f84bc15e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:38.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.734+0000 7f84b959a700 1 --2- 172.21.15.77:0/518969240 >> v2:172.21.15.103:3300/0 conn(0x7f84bc15e4c0 0x7f84bc15e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:38.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.734+0000 7f84b959a700 1 -- 172.21.15.77:0/518969240 >> v1:172.21.15.103:6789/0 conn(0x7f84bc0ca940 legacy=0x7f84bc0cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:38.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.734+0000 7f84b959a700 1 -- 172.21.15.77:0/518969240 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84bc15f0a0 con 0x7f84bc06cac0 2023-07-24T05:46:38.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.734+0000 7f84b959a700 1 -- 172.21.15.77:0/518969240 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4109865209 0 0) 0x7f84ac0054c0 con 0x7f84bc06cac0 2023-07-24T05:46:38.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.734+0000 7f84b959a700 1 -- 172.21.15.77:0/518969240 >> v1:172.21.15.77:6789/0 conn(0x7f84bc06cac0 legacy=0x7f84bc06cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:38.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.734+0000 7f84b959a700 1 --2- 172.21.15.77:0/518969240 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f84a4003a70 0x7f84a4003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:38.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.734+0000 7f84b959a700 1 --2- 172.21.15.77:0/518969240 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84a4004870 0x7f84a4004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:38.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.734+0000 7f84b959a700 1 --2- 172.21.15.77:0/518969240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84a4005230 0x7f84a400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:38.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.738+0000 7f84b959a700 1 -- 172.21.15.77:0/518969240 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc15ee90 con 0x7f84a4004870 2023-07-24T05:46:38.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.738+0000 7f84b959a700 1 -- 172.21.15.77:0/518969240 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a400c130 con 0x7f84a4005230 2023-07-24T05:46:38.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.738+0000 7f84b959a700 1 -- 172.21.15.77:0/518969240 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a4010700 con 0x7f84a4003a70 2023-07-24T05:46:38.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.738+0000 7f84b9d9b700 1 --2- 172.21.15.77:0/518969240 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84a4004870 0x7f84a4004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:38.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.738+0000 7f84bad9d700 1 --2- 172.21.15.77:0/518969240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84a4005230 0x7f84a400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:38.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.738+0000 7f84ba59c700 1 --2- 172.21.15.77:0/518969240 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f84a4003a70 0x7f84a4003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:38.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.738+0000 7f84b9d9b700 1 -- 172.21.15.77:0/518969240 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f84a4003a70 msgr2=0x7f84a4003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:38.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.738+0000 7f84b9d9b700 1 --2- 172.21.15.77:0/518969240 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f84a4003a70 0x7f84a4003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:38.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.738+0000 7f84b9d9b700 1 -- 172.21.15.77:0/518969240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84a4005230 msgr2=0x7f84a400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:38.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.738+0000 7f84b9d9b700 1 --2- 172.21.15.77:0/518969240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84a4005230 0x7f84a400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:38.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.738+0000 7f84b9d9b700 1 -- 172.21.15.77:0/518969240 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a40035d0 con 0x7f84a4004870 2023-07-24T05:46:38.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.738+0000 7f84bad9d700 1 -- 172.21.15.77:0/518969240 reap_dead start 2023-07-24T05:46:38.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.738+0000 7f84b9d9b700 1 --2- 172.21.15.77:0/518969240 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84a4004870 0x7f84a4004cf0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f84b0009b70 tx=0x7f84a40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93e54ac6158d527b server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:38.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.738+0000 7f84b959a700 1 -- 172.21.15.77:0/518969240 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b000e6c0 con 0x7f84a4004870 2023-07-24T05:46:38.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.738+0000 7f84b959a700 1 -- 172.21.15.77:0/518969240 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b000e820 con 0x7f84a4004870 2023-07-24T05:46:38.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.738+0000 7f84b959a700 1 -- 172.21.15.77:0/518969240 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b000eb90 con 0x7f84a4004870 2023-07-24T05:46:38.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.738+0000 7f84c0edf700 1 -- 172.21.15.77:0/518969240 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84a4004870 msgr2=0x7f84a4004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:38.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.738+0000 7f84c0edf700 1 --2- 172.21.15.77:0/518969240 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84a4004870 0x7f84a4004cf0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f84b0009b70 tx=0x7f84a40058a0 comp rx=0 tx=0).stop 2023-07-24T05:46:38.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.738+0000 7f84c0edf700 1 -- 172.21.15.77:0/518969240 shutdown_connections 2023-07-24T05:46:38.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.738+0000 7f84c0edf700 1 --2- 172.21.15.77:0/518969240 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84a4004870 0x7f84a4004cf0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:38.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.738+0000 7f84c0edf700 1 -- 172.21.15.77:0/518969240 >> 172.21.15.77:0/518969240 conn(0x7f84bc0ce410 msgr2=0x7f84bc0ce7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:38.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.738+0000 7f84c0edf700 1 -- 172.21.15.77:0/518969240 shutdown_connections 2023-07-24T05:46:38.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.738+0000 7f84c0edf700 1 -- 172.21.15.77:0/518969240 wait complete. 2023-07-24T05:46:38.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.742+0000 7f84c0edf700 1 Processor -- start 2023-07-24T05:46:38.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.742+0000 7f84c0edf700 1 -- start start 2023-07-24T05:46:38.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.746+0000 7f84c0edf700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84a4004870 0x7f84bc157810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:38.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.746+0000 7f84c0edf700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f84bc1588b0 0x7f84bc0ac030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:38.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.746+0000 7f84c0edf700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84bc158d10 0x7f84bc0ac570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:38.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.746+0000 7f84c0edf700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc0c4580 con 0x7f84bc158d10 2023-07-24T05:46:38.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.746+0000 7f84c0edf700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc0c34e0 con 0x7f84a4004870 2023-07-24T05:46:38.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.746+0000 7f84c0edf700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc0c37c0 con 0x7f84bc1588b0 2023-07-24T05:46:38.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.746+0000 7f84bad9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84bc158d10 0x7f84bc0ac570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:38.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.746+0000 7f84bad9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84bc158d10 0x7f84bc0ac570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42644/0 (socket says 172.21.15.77:42644) 2023-07-24T05:46:38.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.746+0000 7f84bad9d700 1 -- 172.21.15.77:0/4292956458 learned_addr learned my addr 172.21.15.77:0/4292956458 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:38.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.746+0000 7f84ba59c700 1 --2- 172.21.15.77:0/4292956458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84a4004870 0x7f84bc157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:38.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.746+0000 7f84b9d9b700 1 --2- 172.21.15.77:0/4292956458 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f84bc1588b0 0x7f84bc0ac030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:38.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.746+0000 7f84bad9d700 1 -- 172.21.15.77:0/4292956458 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f84bc1588b0 msgr2=0x7f84bc0ac030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:38.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.746+0000 7f84bad9d700 1 --2- 172.21.15.77:0/4292956458 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f84bc1588b0 0x7f84bc0ac030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:38.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.746+0000 7f84bad9d700 1 -- 172.21.15.77:0/4292956458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84a4004870 msgr2=0x7f84bc157810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:38.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.746+0000 7f84bad9d700 1 --2- 172.21.15.77:0/4292956458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84a4004870 0x7f84bc157810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:38.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.746+0000 7f84bad9d700 1 -- 172.21.15.77:0/4292956458 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84bc0c3aa0 con 0x7f84bc158d10 2023-07-24T05:46:38.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.746+0000 7f84b9d9b700 1 --2- 172.21.15.77:0/4292956458 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f84bc1588b0 0x7f84bc0ac030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:46:38.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.746+0000 7f84ba59c700 1 --2- 172.21.15.77:0/4292956458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84a4004870 0x7f84bc157810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:46:38.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.746+0000 7f84bad9d700 1 --2- 172.21.15.77:0/4292956458 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84bc158d10 0x7f84bc0ac570 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f84bc0723b0 tx=0x7f84b400f8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:38.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.746+0000 7f84aaffd700 1 -- 172.21.15.77:0/4292956458 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b400fe70 con 0x7f84bc158d10 2023-07-24T05:46:38.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.746+0000 7f84aaffd700 1 -- 172.21.15.77:0/4292956458 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b40052e0 con 0x7f84bc158d10 2023-07-24T05:46:38.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.746+0000 7f84aaffd700 1 -- 172.21.15.77:0/4292956458 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b40036a0 con 0x7f84bc158d10 2023-07-24T05:46:38.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.746+0000 7f84c0edf700 1 -- 172.21.15.77:0/4292956458 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84bc0c3d80 con 0x7f84bc158d10 2023-07-24T05:46:38.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.746+0000 7f84c0edf700 1 -- 172.21.15.77:0/4292956458 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84bc159760 con 0x7f84bc158d10 2023-07-24T05:46:38.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.746+0000 7f84c0edf700 1 -- 172.21.15.77:0/4292956458 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84bc159920 con 0x7f84bc158d10 2023-07-24T05:46:38.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.750+0000 7f84aaffd700 1 -- 172.21.15.77:0/4292956458 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f84b4003800 con 0x7f84bc158d10 2023-07-24T05:46:38.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.750+0000 7f84aaffd700 1 --2- 172.21.15.77:0/4292956458 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f849c0662f0 0x7f849c0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:38.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.750+0000 7f84aaffd700 1 -- 172.21.15.77:0/4292956458 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f84b4083b20 con 0x7f84bc158d10 2023-07-24T05:46:38.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.754+0000 7f84ba59c700 1 --2- 172.21.15.77:0/4292956458 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f849c0662f0 0x7f849c0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:38.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.754+0000 7f84ba59c700 1 --2- 172.21.15.77:0/4292956458 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f849c0662f0 0x7f849c0687b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f84ac004ea0 tx=0x7f84ac009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:38.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.758+0000 7f84aaffd700 1 -- 172.21.15.77:0/4292956458 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f84bc159920 con 0x7f84bc158d10 2023-07-24T05:46:38.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.962+0000 7f84c0edf700 1 -- 172.21.15.77:0/4292956458 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84bc0c42a0 con 0x7f84bc158d10 2023-07-24T05:46:38.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.962+0000 7f84aaffd700 1 -- 172.21.15.77:0/4292956458 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f84bc0c42a0 con 0x7f84bc158d10 2023-07-24T05:46:38.969 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:46:38.969 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/4201639271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4201639271},{"type":"v1","addr":"172.21.15.77:6834","nonce":4201639271}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/993116623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":993116623},{"type":"v1","addr":"172.21.15.103:6835","nonce":993116623}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/1196529067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":1196529067},{"type":"v1","addr":"172.21.15.103:6837","nonce":1196529067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-24T05:46:00.395327+0000","modified":"2023-07-24T05:46:27.438873+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6835/2428690206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2428690206},{"type":"v1","addr":"172.21.15.77:6835","nonce":2428690206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-24T05:46:38.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.966+0000 7f84c0edf700 1 -- 172.21.15.77:0/4292956458 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f849c0662f0 msgr2=0x7f849c0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:38.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.966+0000 7f84c0edf700 1 --2- 172.21.15.77:0/4292956458 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f849c0662f0 0x7f849c0687b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f84ac004ea0 tx=0x7f84ac009040 comp rx=0 tx=0).stop 2023-07-24T05:46:38.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.966+0000 7f84c0edf700 1 -- 172.21.15.77:0/4292956458 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84bc158d10 msgr2=0x7f84bc0ac570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:38.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.966+0000 7f84c0edf700 1 --2- 172.21.15.77:0/4292956458 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84bc158d10 0x7f84bc0ac570 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f84bc0723b0 tx=0x7f84b400f8d0 comp rx=0 tx=0).stop 2023-07-24T05:46:38.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.966+0000 7f84c0edf700 1 -- 172.21.15.77:0/4292956458 shutdown_connections 2023-07-24T05:46:38.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.966+0000 7f84c0edf700 1 --2- 172.21.15.77:0/4292956458 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f84bc158d10 0x7f84bc0ac570 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:38.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.966+0000 7f84c0edf700 1 --2- 172.21.15.77:0/4292956458 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f849c0662f0 0x7f849c0687b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:38.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.966+0000 7f84c0edf700 1 --2- 172.21.15.77:0/4292956458 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f84bc1588b0 0x7f84bc0ac030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:38.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.966+0000 7f84c0edf700 1 --2- 172.21.15.77:0/4292956458 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f84a4004870 0x7f84bc157810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:38.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.966+0000 7f84c0edf700 1 -- 172.21.15.77:0/4292956458 >> 172.21.15.77:0/4292956458 conn(0x7f84bc0ce410 msgr2=0x7f84bc0706b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:38.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.966+0000 7f84c0edf700 1 -- 172.21.15.77:0/4292956458 shutdown_connections 2023-07-24T05:46:38.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:38.966+0000 7f84c0edf700 1 -- 172.21.15.77:0/4292956458 wait complete. 2023-07-24T05:46:38.974 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 9 2023-07-24T05:46:38.995 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-24T05:46:39.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.158+0000 7f05fe570700 1 Processor -- start 2023-07-24T05:46:39.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.158+0000 7f05fe570700 1 -- start start 2023-07-24T05:46:39.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.162+0000 7f05fe570700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f05f806bc30 0x7f05f80cf240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:39.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.162+0000 7f05fe570700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f05f80cfa00 0x7f05f80d27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:39.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.162+0000 7f05fe570700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05f806d520 con 0x7f05f815cc70 2023-07-24T05:46:39.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.162+0000 7f05fe570700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05f806da80 con 0x7f05f80cfa00 2023-07-24T05:46:39.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.162+0000 7f05fe570700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05f815d050 con 0x7f05f806bc30 2023-07-24T05:46:39.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.162+0000 7f05fcb0d700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f05f80cfa00 0x7f05f80d27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:39.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.162+0000 7f05fcb0d700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f05f80cfa00 0x7f05f80d27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42652/0 (socket says 172.21.15.77:42652) 2023-07-24T05:46:39.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.162+0000 7f05fcb0d700 1 -- 172.21.15.77:0/1972691395 learned_addr learned my addr 172.21.15.77:0/1972691395 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:39.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.162+0000 7f05ef7fe700 1 --2- 172.21.15.77:0/1972691395 >> v2:172.21.15.103:3300/0 conn(0x7f05f806bc30 0x7f05f80cf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:39.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.162+0000 7f05fcb0d700 1 -- 172.21.15.77:0/1972691395 >> v2:172.21.15.103:3300/0 conn(0x7f05f806bc30 msgr2=0x7f05f80cf240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:39.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.162+0000 7f05fcb0d700 1 --2- 172.21.15.77:0/1972691395 >> v2:172.21.15.103:3300/0 conn(0x7f05f806bc30 0x7f05f80cf240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:39.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.162+0000 7f05fcb0d700 1 -- 172.21.15.77:0/1972691395 >> v1:172.21.15.103:6789/0 conn(0x7f05f815cc70 legacy=0x7f05f806ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:39.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.162+0000 7f05fcb0d700 1 -- 172.21.15.77:0/1972691395 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f80b2070 con 0x7f05f80cfa00 2023-07-24T05:46:39.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.162+0000 7f05ef7fe700 1 --2- 172.21.15.77:0/1972691395 >> v2:172.21.15.103:3300/0 conn(0x7f05f806bc30 0x7f05f80cf240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:46:39.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.162+0000 7f05fcb0d700 1 --2- 172.21.15.77:0/1972691395 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05f80cfa00 0x7f05f80d27c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f05f808c680 tx=0x7f05f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e15b66deea13511c server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:39.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.162+0000 7f05f77fe700 1 -- 172.21.15.77:0/1972691395 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f000e070 con 0x7f05f80cfa00 2023-07-24T05:46:39.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.162+0000 7f05f77fe700 1 -- 172.21.15.77:0/1972691395 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f000b9c0 con 0x7f05f80cfa00 2023-07-24T05:46:39.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.162+0000 7f05f77fe700 1 -- 172.21.15.77:0/1972691395 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f000bd70 con 0x7f05f80cfa00 2023-07-24T05:46:39.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.166+0000 7f05fe570700 1 -- 172.21.15.77:0/1972691395 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05f80cfa00 msgr2=0x7f05f80d27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:39.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.166+0000 7f05fe570700 1 --2- 172.21.15.77:0/1972691395 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05f80cfa00 0x7f05f80d27c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f05f808c680 tx=0x7f05f000b330 comp rx=0 tx=0).stop 2023-07-24T05:46:39.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.166+0000 7f05fe570700 1 -- 172.21.15.77:0/1972691395 shutdown_connections 2023-07-24T05:46:39.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.166+0000 7f05fe570700 1 --2- 172.21.15.77:0/1972691395 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05f80cfa00 0x7f05f80d27c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:39.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.166+0000 7f05fe570700 1 --2- 172.21.15.77:0/1972691395 >> v2:172.21.15.103:3300/0 conn(0x7f05f806bc30 0x7f05f80cf240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:39.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.166+0000 7f05fe570700 1 -- 172.21.15.77:0/1972691395 >> 172.21.15.77:0/1972691395 conn(0x7f05f80b7a10 msgr2=0x7f05f809bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:39.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.166+0000 7f05fe570700 1 -- 172.21.15.77:0/1972691395 shutdown_connections 2023-07-24T05:46:39.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.166+0000 7f05fe570700 1 -- 172.21.15.77:0/1972691395 wait complete. 2023-07-24T05:46:39.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.170+0000 7f05fe570700 1 Processor -- start 2023-07-24T05:46:39.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.170+0000 7f05fe570700 1 -- start start 2023-07-24T05:46:39.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.170+0000 7f05fe570700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05f806bc30 0x7f05f815fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:39.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.170+0000 7f05fe570700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05f80cfa00 0x7f05f814dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:39.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.170+0000 7f05fe570700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f05f815cc70 0x7f05f80c9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:39.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.170+0000 7f05fe570700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f80b2c00 con 0x7f05f80cfa00 2023-07-24T05:46:39.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.170+0000 7f05fe570700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f80b2e80 con 0x7f05f806bc30 2023-07-24T05:46:39.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.170+0000 7f05fe570700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f80b3160 con 0x7f05f815cc70 2023-07-24T05:46:39.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.170+0000 7f05ef7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05f80cfa00 0x7f05f814dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:39.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.170+0000 7f05ef7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05f80cfa00 0x7f05f814dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42654/0 (socket says 172.21.15.77:42654) 2023-07-24T05:46:39.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.170+0000 7f05ef7fe700 1 -- 172.21.15.77:0/1286630297 learned_addr learned my addr 172.21.15.77:0/1286630297 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:39.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.170+0000 7f05fcb0d700 1 --2- 172.21.15.77:0/1286630297 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f05f815cc70 0x7f05f80c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:39.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.170+0000 7f05f7fff700 1 --2- 172.21.15.77:0/1286630297 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05f806bc30 0x7f05f815fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:39.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.170+0000 7f05ef7fe700 1 -- 172.21.15.77:0/1286630297 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f05f815cc70 msgr2=0x7f05f80c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:39.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.170+0000 7f05ef7fe700 1 --2- 172.21.15.77:0/1286630297 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f05f815cc70 0x7f05f80c9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:39.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.170+0000 7f05ef7fe700 1 -- 172.21.15.77:0/1286630297 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05f806bc30 msgr2=0x7f05f815fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:39.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.170+0000 7f05ef7fe700 1 --2- 172.21.15.77:0/1286630297 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05f806bc30 0x7f05f815fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:39.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.170+0000 7f05ef7fe700 1 -- 172.21.15.77:0/1286630297 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f0009b30 con 0x7f05f80cfa00 2023-07-24T05:46:39.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.170+0000 7f05ef7fe700 1 --2- 172.21.15.77:0/1286630297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05f80cfa00 0x7f05f814dc40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f05e000e810 tx=0x7f05e000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:39.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.174+0000 7f05f57fa700 1 -- 172.21.15.77:0/1286630297 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e0004230 con 0x7f05f80cfa00 2023-07-24T05:46:39.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.174+0000 7f05f57fa700 1 -- 172.21.15.77:0/1286630297 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e0004390 con 0x7f05f80cfa00 2023-07-24T05:46:39.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.174+0000 7f05fe570700 1 -- 172.21.15.77:0/1286630297 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05f80b3440 con 0x7f05f80cfa00 2023-07-24T05:46:39.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.174+0000 7f05f57fa700 1 -- 172.21.15.77:0/1286630297 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e00036c0 con 0x7f05f80cfa00 2023-07-24T05:46:39.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.174+0000 7f05fe570700 1 -- 172.21.15.77:0/1286630297 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05f815b890 con 0x7f05f80cfa00 2023-07-24T05:46:39.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.174+0000 7f05fe570700 1 -- 172.21.15.77:0/1286630297 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05f8066ed0 con 0x7f05f80cfa00 2023-07-24T05:46:39.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.174+0000 7f05f57fa700 1 -- 172.21.15.77:0/1286630297 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f05e0003840 con 0x7f05f80cfa00 2023-07-24T05:46:39.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.178+0000 7f05f57fa700 1 --2- 172.21.15.77:0/1286630297 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f05dc0662f0 0x7f05dc0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:39.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.178+0000 7f05f57fa700 1 -- 172.21.15.77:0/1286630297 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f05e0083990 con 0x7f05f80cfa00 2023-07-24T05:46:39.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.178+0000 7f05f7fff700 1 --2- 172.21.15.77:0/1286630297 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f05dc0662f0 0x7f05dc0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:39.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.178+0000 7f05f7fff700 1 --2- 172.21.15.77:0/1286630297 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f05dc0662f0 0x7f05dc0687b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f05e8000f60 tx=0x7f05e8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:39.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.182+0000 7f05f57fa700 1 -- 172.21.15.77:0/1286630297 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f05e0050a80 con 0x7f05f80cfa00 2023-07-24T05:46:39.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.358+0000 7f05fe570700 1 -- 172.21.15.77:0/1286630297 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05f80d35f0 con 0x7f05f80cfa00 2023-07-24T05:46:39.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.362+0000 7f05f57fa700 1 -- 172.21.15.77:0/1286630297 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20108 (secure 0 0 0) 0x7f05e00540a0 con 0x7f05f80cfa00 2023-07-24T05:46:39.366 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:46:39.366 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":25,"fsid":"5aed5f7b-fb55-4d95-9c02-c6adbb1677b4","created":"2023-07-24T05:45:39.639731+0000","modified":"2023-07-24T05:46:05.445306+0000","last_up_change":"2023-07-24T05:45:52.319670+0000","last_in_change":"2023-07-24T05:45:43.643277+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-24T05:45:52.610430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-24T05:45:52.773787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-24T05:45:58.121732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-24T05:45:59.368726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-24T05:46:03.032057+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ffa0d496-461a-4053-b764-0627d969521b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6812","nonce":825987196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6817","nonce":825987196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6831","nonce":825987196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6824","nonce":825987196}]},"public_addr":"172.21.15.77:6812/825987196","cluster_addr":"172.21.15.77:6817/825987196","heartbeat_back_addr":"172.21.15.77:6831/825987196","heartbeat_front_addr":"172.21.15.77:6824/825987196","state":["exists","up"]},{"osd":1,"uuid":"9f595e5e-5c43-49bc-8ce4-ee70575c90da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6801","nonce":4133026815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6803","nonce":4133026815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6807","nonce":4133026815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6805","nonce":4133026815}]},"public_addr":"172.21.15.77:6801/4133026815","cluster_addr":"172.21.15.77:6803/4133026815","heartbeat_back_addr":"172.21.15.77:6807/4133026815","heartbeat_front_addr":"172.21.15.77:6805/4133026815","state":["exists","up"]},{"osd":2,"uuid":"2ac177aa-4d7d-4262-bd54-d2b9f29f4c3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6811","nonce":2394142159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6819","nonce":2394142159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6830","nonce":2394142159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6825","nonce":2394142159}]},"public_addr":"172.21.15.77:6811/2394142159","cluster_addr":"172.21.15.77:6819/2394142159","heartbeat_back_addr":"172.21.15.77:6830/2394142159","heartbeat_front_addr":"172.21.15.77:6825/2394142159","state":["exists","up"]},{"osd":3,"uuid":"17d7a251-19e8-484c-8172-a578ab3da153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6813","nonce":1492113982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6818","nonce":1492113982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6829","nonce":1492113982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6823","nonce":1492113982}]},"public_addr":"172.21.15.77:6813/1492113982","cluster_addr":"172.21.15.77:6818/1492113982","heartbeat_back_addr":"172.21.15.77:6829/1492113982","heartbeat_front_addr":"172.21.15.77:6823/1492113982","state":["exists","up"]},{"osd":4,"uuid":"bf63ca05-f06d-4e0f-ac44-2a416c70b919","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6825","nonce":1080481057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6827","nonce":1080481057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6831","nonce":1080481057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6829","nonce":1080481057}]},"public_addr":"172.21.15.103:6825/1080481057","cluster_addr":"172.21.15.103:6827/1080481057","heartbeat_back_addr":"172.21.15.103:6831/1080481057","heartbeat_front_addr":"172.21.15.103:6829/1080481057","state":["exists","up"]},{"osd":5,"uuid":"65a11a35-9e9f-4b3c-9fe3-b658d62b9318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6811","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6813","nonce":2756677504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6818","nonce":2756677504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6823","nonce":2756677504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6821","nonce":2756677504}]},"public_addr":"172.21.15.103:6813/2756677504","cluster_addr":"172.21.15.103:6818/2756677504","heartbeat_back_addr":"172.21.15.103:6823/2756677504","heartbeat_front_addr":"172.21.15.103:6821/2756677504","state":["exists","up"]},{"osd":6,"uuid":"750c1f87-686c-40b4-94a1-1a299dc78f3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6809","nonce":568977764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6812","nonce":568977764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6819","nonce":568977764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6815","nonce":568977764}]},"public_addr":"172.21.15.103:6809/568977764","cluster_addr":"172.21.15.103:6812/568977764","heartbeat_back_addr":"172.21.15.103:6819/568977764","heartbeat_front_addr":"172.21.15.103:6815/568977764","state":["exists","up"]},{"osd":7,"uuid":"d5fe4fb6-2e09-4158-885b-403803c85822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6801","nonce":1074557176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6803","nonce":1074557176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6807","nonce":1074557176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6805","nonce":1074557176}]},"public_addr":"172.21.15.103:6801/1074557176","cluster_addr":"172.21.15.103:6803/1074557176","heartbeat_back_addr":"172.21.15.103:6807/1074557176","heartbeat_front_addr":"172.21.15.103:6805/1074557176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.631032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.154109+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.398587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.679089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.311218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.353726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.314372+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.126212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-24T05:46:39.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.366+0000 7f05fe570700 1 -- 172.21.15.77:0/1286630297 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f05dc0662f0 msgr2=0x7f05dc0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:39.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.366+0000 7f05fe570700 1 --2- 172.21.15.77:0/1286630297 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f05dc0662f0 0x7f05dc0687b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f05e8000f60 tx=0x7f05e8009040 comp rx=0 tx=0).stop 2023-07-24T05:46:39.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.366+0000 7f05fe570700 1 -- 172.21.15.77:0/1286630297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05f80cfa00 msgr2=0x7f05f814dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:39.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.366+0000 7f05fe570700 1 --2- 172.21.15.77:0/1286630297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05f80cfa00 0x7f05f814dc40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f05e000e810 tx=0x7f05e000eb20 comp rx=0 tx=0).stop 2023-07-24T05:46:39.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.366+0000 7f05fe570700 1 -- 172.21.15.77:0/1286630297 shutdown_connections 2023-07-24T05:46:39.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.366+0000 7f05fe570700 1 --2- 172.21.15.77:0/1286630297 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f05dc0662f0 0x7f05dc0687b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:39.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.366+0000 7f05fe570700 1 --2- 172.21.15.77:0/1286630297 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f05f815cc70 0x7f05f80c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:39.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.366+0000 7f05fe570700 1 --2- 172.21.15.77:0/1286630297 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05f80cfa00 0x7f05f814dc40 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:39.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.366+0000 7f05fe570700 1 --2- 172.21.15.77:0/1286630297 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05f806bc30 0x7f05f815fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:39.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.366+0000 7f05fe570700 1 -- 172.21.15.77:0/1286630297 >> 172.21.15.77:0/1286630297 conn(0x7f05f80b7a10 msgr2=0x7f05f80af620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:39.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.366+0000 7f05fe570700 1 -- 172.21.15.77:0/1286630297 shutdown_connections 2023-07-24T05:46:39.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.366+0000 7f05fe570700 1 -- 172.21.15.77:0/1286630297 wait complete. 2023-07-24T05:46:39.389 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-24T05:45:52.610430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-24T05:45:52.773787+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-24T05:45:58.121732+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-24T05:45:59.368726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-24T05:46:03.032057+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-24T05:46:39.390 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-24T05:46:39.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.554+0000 7f1bd65ea700 1 Processor -- start 2023-07-24T05:46:39.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.554+0000 7f1bd65ea700 1 -- start start 2023-07-24T05:46:39.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.558+0000 7f1bd65ea700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1bd00cb530 0x7f1bd00c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:39.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.558+0000 7f1bd65ea700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1bd00ca250 0x7f1bd00cc010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:39.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.558+0000 7f1bd65ea700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bd00add10 con 0x7f1bd00ad930 2023-07-24T05:46:39.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.558+0000 7f1bd65ea700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bd00cf2f0 con 0x7f1bd00ca250 2023-07-24T05:46:39.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.558+0000 7f1bd65ea700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd015e530 con 0x7f1bd00cb530 2023-07-24T05:46:39.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.558+0000 7f1bd4b87700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1bd00ca250 0x7f1bd00cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:39.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.558+0000 7f1bd4b87700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1bd00ca250 0x7f1bd00cc010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42670/0 (socket says 172.21.15.77:42670) 2023-07-24T05:46:39.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.558+0000 7f1bd4b87700 1 -- 172.21.15.77:0/1342107196 learned_addr learned my addr 172.21.15.77:0/1342107196 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:39.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.558+0000 7f1bc77fe700 1 --2- 172.21.15.77:0/1342107196 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1bd00cb530 0x7f1bd00c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:39.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.558+0000 7f1bd4b87700 1 -- 172.21.15.77:0/1342107196 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1bd00cb530 msgr2=0x7f1bd00c9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:39.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.558+0000 7f1bd4b87700 1 --2- 172.21.15.77:0/1342107196 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1bd00cb530 0x7f1bd00c9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:39.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.558+0000 7f1bd4b87700 1 -- 172.21.15.77:0/1342107196 >> v1:172.21.15.103:6789/0 conn(0x7f1bd00ad930 legacy=0x7f1bd00cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:39.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.558+0000 7f1bcf7fe700 1 -- 172.21.15.77:0/1342107196 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2203829840 0 0) 0x7f1bd00add10 con 0x7f1bd00ad930 2023-07-24T05:46:39.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.558+0000 7f1bd4b87700 1 -- 172.21.15.77:0/1342107196 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd015ae00 con 0x7f1bd00ca250 2023-07-24T05:46:39.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.558+0000 7f1bd4b87700 1 --2- 172.21.15.77:0/1342107196 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bd00ca250 0x7f1bd00cc010 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8009e50 tx=0x7f1bc800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b0254e6001e99d7 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:39.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.558+0000 7f1bcf7fe700 1 -- 172.21.15.77:0/1342107196 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc800e070 con 0x7f1bd00ca250 2023-07-24T05:46:39.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.558+0000 7f1bcf7fe700 1 -- 172.21.15.77:0/1342107196 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc800b910 con 0x7f1bd00ca250 2023-07-24T05:46:39.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.558+0000 7f1bcf7fe700 1 -- 172.21.15.77:0/1342107196 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc800bcc0 con 0x7f1bd00ca250 2023-07-24T05:46:39.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.562+0000 7f1bd65ea700 1 -- 172.21.15.77:0/1342107196 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bd00ca250 msgr2=0x7f1bd00cc010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:39.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.562+0000 7f1bd65ea700 1 --2- 172.21.15.77:0/1342107196 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bd00ca250 0x7f1bd00cc010 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8009e50 tx=0x7f1bc800b330 comp rx=0 tx=0).stop 2023-07-24T05:46:39.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.562+0000 7f1bd65ea700 1 -- 172.21.15.77:0/1342107196 shutdown_connections 2023-07-24T05:46:39.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.562+0000 7f1bd65ea700 1 --2- 172.21.15.77:0/1342107196 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bd00ca250 0x7f1bd00cc010 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:39.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.562+0000 7f1bd65ea700 1 --2- 172.21.15.77:0/1342107196 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1bd00cb530 0x7f1bd00c9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:39.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.562+0000 7f1bd65ea700 1 -- 172.21.15.77:0/1342107196 >> 172.21.15.77:0/1342107196 conn(0x7f1bd00ce440 msgr2=0x7f1bd00ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:39.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.562+0000 7f1bd65ea700 1 -- 172.21.15.77:0/1342107196 shutdown_connections 2023-07-24T05:46:39.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.562+0000 7f1bd65ea700 1 -- 172.21.15.77:0/1342107196 wait complete. 2023-07-24T05:46:39.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.566+0000 7f1bd65ea700 1 Processor -- start 2023-07-24T05:46:39.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.566+0000 7f1bd65ea700 1 -- start start 2023-07-24T05:46:39.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.566+0000 7f1bd65ea700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bd00ad930 0x7f1bd006c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:39.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.566+0000 7f1bd65ea700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bd00ca250 0x7f1bd01f95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:39.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.566+0000 7f1bd65ea700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1bd00cb530 0x7f1bd01f9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:39.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.566+0000 7f1bd65ea700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd00ab380 con 0x7f1bd00ca250 2023-07-24T05:46:39.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.566+0000 7f1bd65ea700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd006c760 con 0x7f1bd00ad930 2023-07-24T05:46:39.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.566+0000 7f1bd65ea700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd006c990 con 0x7f1bd00cb530 2023-07-24T05:46:39.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.566+0000 7f1bc77fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bd00ca250 0x7f1bd01f95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:39.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.570+0000 7f1bc77fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bd00ca250 0x7f1bd01f95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42682/0 (socket says 172.21.15.77:42682) 2023-07-24T05:46:39.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.570+0000 7f1bc77fe700 1 -- 172.21.15.77:0/3742295135 learned_addr learned my addr 172.21.15.77:0/3742295135 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:39.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.570+0000 7f1bd4b87700 1 --2- 172.21.15.77:0/3742295135 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1bd00cb530 0x7f1bd01f9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:39.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.570+0000 7f1bcffff700 1 --2- 172.21.15.77:0/3742295135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bd00ad930 0x7f1bd006c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:39.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.570+0000 7f1bc77fe700 1 -- 172.21.15.77:0/3742295135 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1bd00cb530 msgr2=0x7f1bd01f9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:39.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.570+0000 7f1bc77fe700 1 --2- 172.21.15.77:0/3742295135 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1bd00cb530 0x7f1bd01f9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:39.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.570+0000 7f1bc77fe700 1 -- 172.21.15.77:0/3742295135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bd00ad930 msgr2=0x7f1bd006c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:39.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.570+0000 7f1bc77fe700 1 --2- 172.21.15.77:0/3742295135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bd00ad930 0x7f1bd006c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:39.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.570+0000 7f1bc77fe700 1 -- 172.21.15.77:0/3742295135 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc8009b30 con 0x7f1bd00ca250 2023-07-24T05:46:39.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.570+0000 7f1bcffff700 1 --2- 172.21.15.77:0/3742295135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bd00ad930 0x7f1bd006c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:46:39.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.570+0000 7f1bc77fe700 1 --2- 172.21.15.77:0/3742295135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bd00ca250 0x7f1bd01f95e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1bb800e870 tx=0x7f1bb800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:39.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.570+0000 7f1bcd7fa700 1 -- 172.21.15.77:0/3742295135 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb80095c0 con 0x7f1bd00ca250 2023-07-24T05:46:39.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.570+0000 7f1bcd7fa700 1 -- 172.21.15.77:0/3742295135 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb8013680 con 0x7f1bd00ca250 2023-07-24T05:46:39.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.570+0000 7f1bd65ea700 1 -- 172.21.15.77:0/3742295135 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd006cc70 con 0x7f1bd00ca250 2023-07-24T05:46:39.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.570+0000 7f1bcd7fa700 1 -- 172.21.15.77:0/3742295135 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb8013a10 con 0x7f1bd00ca250 2023-07-24T05:46:39.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.570+0000 7f1bd65ea700 1 -- 172.21.15.77:0/3742295135 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd006d230 con 0x7f1bd00ca250 2023-07-24T05:46:39.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.570+0000 7f1bd65ea700 1 -- 172.21.15.77:0/3742295135 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bd004df10 con 0x7f1bd00ca250 2023-07-24T05:46:39.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.570+0000 7f1bcd7fa700 1 -- 172.21.15.77:0/3742295135 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1bb8013b70 con 0x7f1bd00ca250 2023-07-24T05:46:39.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.574+0000 7f1bcd7fa700 1 --2- 172.21.15.77:0/3742295135 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f1bb4066320 0x7f1bb40687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:39.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.574+0000 7f1bcd7fa700 1 -- 172.21.15.77:0/3742295135 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1bb8083eb0 con 0x7f1bd00ca250 2023-07-24T05:46:39.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.574+0000 7f1bcffff700 1 --2- 172.21.15.77:0/3742295135 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f1bb4066320 0x7f1bb40687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:39.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.574+0000 7f1bcffff700 1 --2- 172.21.15.77:0/3742295135 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f1bb4066320 0x7f1bb40687e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0000fb0 tx=0x7f1bc0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:39.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.578+0000 7f1bcd7fa700 1 -- 172.21.15.77:0/3742295135 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1bb8054b60 con 0x7f1bd00ca250 2023-07-24T05:46:39.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.750+0000 7f1bd65ea700 1 -- 172.21.15.77:0/3742295135 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1bd00cd2d0 con 0x7f1bd00ca250 2023-07-24T05:46:39.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.750+0000 7f1bcd7fa700 1 -- 172.21.15.77:0/3742295135 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1bb80546f0 con 0x7f1bd00ca250 2023-07-24T05:46:39.756 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-07-24T05:46:39.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.754+0000 7f1bd65ea700 1 -- 172.21.15.77:0/3742295135 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f1bb4066320 msgr2=0x7f1bb40687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:39.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.754+0000 7f1bd65ea700 1 --2- 172.21.15.77:0/3742295135 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f1bb4066320 0x7f1bb40687e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0000fb0 tx=0x7f1bc0009040 comp rx=0 tx=0).stop 2023-07-24T05:46:39.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.754+0000 7f1bd65ea700 1 -- 172.21.15.77:0/3742295135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bd00ca250 msgr2=0x7f1bd01f95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:39.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.754+0000 7f1bd65ea700 1 --2- 172.21.15.77:0/3742295135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bd00ca250 0x7f1bd01f95e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1bb800e870 tx=0x7f1bb800eb80 comp rx=0 tx=0).stop 2023-07-24T05:46:39.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.754+0000 7f1bd65ea700 1 -- 172.21.15.77:0/3742295135 shutdown_connections 2023-07-24T05:46:39.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.754+0000 7f1bd65ea700 1 --2- 172.21.15.77:0/3742295135 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f1bb4066320 0x7f1bb40687e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:39.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.754+0000 7f1bd65ea700 1 --2- 172.21.15.77:0/3742295135 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1bd00cb530 0x7f1bd01f9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:39.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.754+0000 7f1bd65ea700 1 --2- 172.21.15.77:0/3742295135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bd00ca250 0x7f1bd01f95e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:39.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.754+0000 7f1bd65ea700 1 --2- 172.21.15.77:0/3742295135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1bd00ad930 0x7f1bd006c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:39.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.758+0000 7f1bd65ea700 1 -- 172.21.15.77:0/3742295135 >> 172.21.15.77:0/3742295135 conn(0x7f1bd00ce440 msgr2=0x7f1bd00ab530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:39.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.758+0000 7f1bd65ea700 1 -- 172.21.15.77:0/3742295135 shutdown_connections 2023-07-24T05:46:39.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.758+0000 7f1bd65ea700 1 -- 172.21.15.77:0/3742295135 wait complete. 2023-07-24T05:46:39.782 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-24T05:46:39.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.958+0000 7f832c5bf700 1 Processor -- start 2023-07-24T05:46:39.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.958+0000 7f832c5bf700 1 -- start start 2023-07-24T05:46:39.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.958+0000 7f832c5bf700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f83240cc010 0x7f8324069b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:39.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.958+0000 7f832c5bf700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83240c9280 con 0x7f8324158ec0 2023-07-24T05:46:39.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.958+0000 7f832c5bf700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83240cc890 con 0x7f832406a050 2023-07-24T05:46:39.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.958+0000 7f832c5bf700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83240ab050 con 0x7f83240cc010 2023-07-24T05:46:39.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.962+0000 7f832a35b700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f8324158ec0 0x7f83240cb8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:53700/0 (socket says 172.21.15.77:53700) 2023-07-24T05:46:39.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.962+0000 7f832a35b700 1 -- 172.21.15.77:0/1780824927 learned_addr learned my addr 172.21.15.77:0/1780824927 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:39.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.962+0000 7f8329b5a700 1 --2- 172.21.15.77:0/1780824927 >> v2:172.21.15.103:3300/0 conn(0x7f83240cc010 0x7f8324069b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:39.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.962+0000 7f8329359700 1 -- 172.21.15.77:0/1780824927 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3481252516 0 0) 0x7f83240c9280 con 0x7f8324158ec0 2023-07-24T05:46:39.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.962+0000 7f8329359700 1 -- 172.21.15.77:0/1780824927 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83100035d0 con 0x7f8324158ec0 2023-07-24T05:46:39.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.962+0000 7f8329359700 1 -- 172.21.15.77:0/1780824927 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2340839273 0 0) 0x7f83240cc890 con 0x7f832406a050 2023-07-24T05:46:39.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.962+0000 7f8329359700 1 -- 172.21.15.77:0/1780824927 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83240c9280 con 0x7f832406a050 2023-07-24T05:46:39.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.962+0000 7f8329b5a700 1 -- 172.21.15.77:0/1780824927 >> v1:172.21.15.103:6789/0 conn(0x7f832406a050 legacy=0x7f832406a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:39.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.962+0000 7f8329b5a700 1 -- 172.21.15.77:0/1780824927 >> v1:172.21.15.77:6789/0 conn(0x7f8324158ec0 legacy=0x7f83240cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:39.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.962+0000 7f8329b5a700 1 -- 172.21.15.77:0/1780824927 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83240cc5b0 con 0x7f83240cc010 2023-07-24T05:46:39.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.962+0000 7f8329b5a700 1 --2- 172.21.15.77:0/1780824927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83240cc010 0x7f8324069b10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8314009850 tx=0x7f8314009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f5efb3f6c07e9c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:39.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.962+0000 7f8329359700 1 -- 172.21.15.77:0/1780824927 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8314011830 con 0x7f83240cc010 2023-07-24T05:46:39.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.962+0000 7f8329359700 1 -- 172.21.15.77:0/1780824927 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8314011990 con 0x7f83240cc010 2023-07-24T05:46:39.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.962+0000 7f8329359700 1 -- 172.21.15.77:0/1780824927 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8314011d00 con 0x7f83240cc010 2023-07-24T05:46:39.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.962+0000 7f832c5bf700 1 -- 172.21.15.77:0/1780824927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83240cc010 msgr2=0x7f8324069b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:39.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.966+0000 7f832c5bf700 1 --2- 172.21.15.77:0/1780824927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83240cc010 0x7f8324069b10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8314009850 tx=0x7f8314009b60 comp rx=0 tx=0).stop 2023-07-24T05:46:39.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.966+0000 7f832c5bf700 1 -- 172.21.15.77:0/1780824927 shutdown_connections 2023-07-24T05:46:39.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.966+0000 7f832c5bf700 1 --2- 172.21.15.77:0/1780824927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83240cc010 0x7f8324069b10 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:39.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.966+0000 7f832c5bf700 1 -- 172.21.15.77:0/1780824927 >> 172.21.15.77:0/1780824927 conn(0x7f83240ce440 msgr2=0x7f83240ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:39.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.966+0000 7f832c5bf700 1 -- 172.21.15.77:0/1780824927 shutdown_connections 2023-07-24T05:46:39.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.966+0000 7f832c5bf700 1 -- 172.21.15.77:0/1780824927 wait complete. 2023-07-24T05:46:39.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.970+0000 7f832c5bf700 1 Processor -- start 2023-07-24T05:46:39.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.970+0000 7f832c5bf700 1 -- start start 2023-07-24T05:46:39.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.970+0000 7f832c5bf700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f832406a050 0x7f83240abd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:39.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.970+0000 7f832c5bf700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83240cc010 0x7f8324153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:39.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.970+0000 7f832c5bf700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8324158ec0 0x7f8324154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:39.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.970+0000 7f832c5bf700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832406d330 con 0x7f83240cc010 2023-07-24T05:46:39.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.970+0000 7f832c5bf700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83240c40c0 con 0x7f832406a050 2023-07-24T05:46:39.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.970+0000 7f832c5bf700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83240c3970 con 0x7f8324158ec0 2023-07-24T05:46:39.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.970+0000 7f8329b5a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83240cc010 0x7f8324153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:39.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.970+0000 7f8329b5a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83240cc010 0x7f8324153f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42692/0 (socket says 172.21.15.77:42692) 2023-07-24T05:46:39.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.970+0000 7f8329b5a700 1 -- 172.21.15.77:0/2491740352 learned_addr learned my addr 172.21.15.77:0/2491740352 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:39.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.970+0000 7f832a35b700 1 --2- 172.21.15.77:0/2491740352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f832406a050 0x7f83240abd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:39.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.970+0000 7f832ab5c700 1 --2- 172.21.15.77:0/2491740352 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8324158ec0 0x7f8324154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:39.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.970+0000 7f8329b5a700 1 -- 172.21.15.77:0/2491740352 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8324158ec0 msgr2=0x7f8324154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:39.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.970+0000 7f8329b5a700 1 --2- 172.21.15.77:0/2491740352 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8324158ec0 0x7f8324154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:39.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.970+0000 7f8329b5a700 1 -- 172.21.15.77:0/2491740352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f832406a050 msgr2=0x7f83240abd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:39.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.970+0000 7f8329b5a700 1 --2- 172.21.15.77:0/2491740352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f832406a050 0x7f83240abd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:39.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.970+0000 7f8329b5a700 1 -- 172.21.15.77:0/2491740352 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83140094b0 con 0x7f83240cc010 2023-07-24T05:46:39.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.970+0000 7f832ab5c700 1 --2- 172.21.15.77:0/2491740352 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8324158ec0 0x7f8324154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:46:39.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.970+0000 7f8329b5a700 1 --2- 172.21.15.77:0/2491740352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83240cc010 0x7f8324153f00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8314009ba0 tx=0x7f8314004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:39.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.970+0000 7f831affd700 1 -- 172.21.15.77:0/2491740352 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83140045c0 con 0x7f83240cc010 2023-07-24T05:46:39.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.974+0000 7f832c5bf700 1 -- 172.21.15.77:0/2491740352 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8324154cc0 con 0x7f83240cc010 2023-07-24T05:46:39.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.974+0000 7f831affd700 1 -- 172.21.15.77:0/2491740352 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831401e070 con 0x7f83240cc010 2023-07-24T05:46:39.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.974+0000 7f831affd700 1 -- 172.21.15.77:0/2491740352 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8314003900 con 0x7f83240cc010 2023-07-24T05:46:39.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.974+0000 7f832c5bf700 1 -- 172.21.15.77:0/2491740352 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83240ac2a0 con 0x7f83240cc010 2023-07-24T05:46:39.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.974+0000 7f832c5bf700 1 -- 172.21.15.77:0/2491740352 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83241551e0 con 0x7f83240cc010 2023-07-24T05:46:39.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.978+0000 7f831affd700 1 -- 172.21.15.77:0/2491740352 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8314003a60 con 0x7f83240cc010 2023-07-24T05:46:39.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.978+0000 7f831affd700 1 --2- 172.21.15.77:0/2491740352 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f83080662f0 0x7f83080687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:39.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.978+0000 7f831affd700 1 -- 172.21.15.77:0/2491740352 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8314084f00 con 0x7f83240cc010 2023-07-24T05:46:39.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.978+0000 7f832a35b700 1 --2- 172.21.15.77:0/2491740352 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f83080662f0 0x7f83080687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:39.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.978+0000 7f832a35b700 1 --2- 172.21.15.77:0/2491740352 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f83080662f0 0x7f83080687b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8320001000 tx=0x7f8320009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:39.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:39.982+0000 7f831affd700 1 -- 172.21.15.77:0/2491740352 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f83241551e0 con 0x7f83240cc010 2023-07-24T05:46:40.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.154+0000 7f832c5bf700 1 -- 172.21.15.77:0/2491740352 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f83241551e0 con 0x7f83240cc010 2023-07-24T05:46:40.159 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.154+0000 7f831affd700 1 -- 172.21.15.77:0/2491740352 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f83241551e0 con 0x7f83240cc010 2023-07-24T05:46:40.159 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 8 2023-07-24T05:46:40.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.158+0000 7f832c5bf700 1 -- 172.21.15.77:0/2491740352 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f83080662f0 msgr2=0x7f83080687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:40.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.158+0000 7f832c5bf700 1 --2- 172.21.15.77:0/2491740352 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f83080662f0 0x7f83080687b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8320001000 tx=0x7f8320009040 comp rx=0 tx=0).stop 2023-07-24T05:46:40.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.158+0000 7f832c5bf700 1 -- 172.21.15.77:0/2491740352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83240cc010 msgr2=0x7f8324153f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:40.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.158+0000 7f832c5bf700 1 --2- 172.21.15.77:0/2491740352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83240cc010 0x7f8324153f00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8314009ba0 tx=0x7f8314004770 comp rx=0 tx=0).stop 2023-07-24T05:46:40.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.158+0000 7f832c5bf700 1 -- 172.21.15.77:0/2491740352 shutdown_connections 2023-07-24T05:46:40.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.158+0000 7f832c5bf700 1 --2- 172.21.15.77:0/2491740352 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f83080662f0 0x7f83080687b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:40.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.158+0000 7f832c5bf700 1 --2- 172.21.15.77:0/2491740352 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8324158ec0 0x7f8324154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:40.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.158+0000 7f832c5bf700 1 --2- 172.21.15.77:0/2491740352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f83240cc010 0x7f8324153f00 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:40.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.158+0000 7f832c5bf700 1 --2- 172.21.15.77:0/2491740352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f832406a050 0x7f83240abd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:40.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.158+0000 7f832c5bf700 1 -- 172.21.15.77:0/2491740352 >> 172.21.15.77:0/2491740352 conn(0x7f83240ce440 msgr2=0x7f832406ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:40.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.158+0000 7f832c5bf700 1 -- 172.21.15.77:0/2491740352 shutdown_connections 2023-07-24T05:46:40.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.158+0000 7f832c5bf700 1 -- 172.21.15.77:0/2491740352 wait complete. 2023-07-24T05:46:40.185 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-24T05:46:40.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.358+0000 7f9f9dafb700 1 Processor -- start 2023-07-24T05:46:40.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.358+0000 7f9f9dafb700 1 -- start start 2023-07-24T05:46:40.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.358+0000 7f9f9dafb700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9f980c4e70 0x7f9f9806d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:40.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.358+0000 7f9f9dafb700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f980b2620 con 0x7f9f9815a950 2023-07-24T05:46:40.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.358+0000 7f9f9dafb700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f9806b000 con 0x7f9f98069b10 2023-07-24T05:46:40.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.358+0000 7f9f9dafb700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f980b1ac0 con 0x7f9f980c4e70 2023-07-24T05:46:40.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.358+0000 7f9f9caf9700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f9f9815a950 0x7f9f980b1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:53702/0 (socket says 172.21.15.77:53702) 2023-07-24T05:46:40.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.358+0000 7f9f9caf9700 1 -- 172.21.15.77:0/1862657561 learned_addr learned my addr 172.21.15.77:0/1862657561 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:40.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.358+0000 7f9f8ffff700 1 --2- 172.21.15.77:0/1862657561 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9f980c4e70 0x7f9f9806d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:40.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.358+0000 7f9f8f7fe700 1 -- 172.21.15.77:0/1862657561 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4176461248 0 0) 0x7f9f980b2620 con 0x7f9f9815a950 2023-07-24T05:46:40.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.358+0000 7f9f8f7fe700 1 -- 172.21.15.77:0/1862657561 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f800035d0 con 0x7f9f9815a950 2023-07-24T05:46:40.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.362+0000 7f9f8f7fe700 1 -- 172.21.15.77:0/1862657561 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4121268024 0 0) 0x7f9f9806b000 con 0x7f9f98069b10 2023-07-24T05:46:40.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.362+0000 7f9f8f7fe700 1 -- 172.21.15.77:0/1862657561 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f980b2620 con 0x7f9f98069b10 2023-07-24T05:46:40.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.362+0000 7f9f8f7fe700 1 -- 172.21.15.77:0/1862657561 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3753867191 0 0) 0x7f9f800035d0 con 0x7f9f9815a950 2023-07-24T05:46:40.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.362+0000 7f9f8ffff700 1 -- 172.21.15.77:0/1862657561 >> v1:172.21.15.103:6789/0 conn(0x7f9f98069b10 legacy=0x7f9f98069f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:40.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.362+0000 7f9f8ffff700 1 -- 172.21.15.77:0/1862657561 >> v1:172.21.15.77:6789/0 conn(0x7f9f9815a950 legacy=0x7f9f980b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:40.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.362+0000 7f9f8ffff700 1 -- 172.21.15.77:0/1862657561 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f9806a7c0 con 0x7f9f980c4e70 2023-07-24T05:46:40.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.362+0000 7f9f8ffff700 1 --2- 172.21.15.77:0/1862657561 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9f980c4e70 0x7f9f9806d3a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9f88009880 tx=0x7f9f88009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbda3beef9c36df7 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:40.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.362+0000 7f9f8f7fe700 1 -- 172.21.15.77:0/1862657561 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f94001670 con 0x7f9f980c4e70 2023-07-24T05:46:40.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.362+0000 7f9f8f7fe700 1 -- 172.21.15.77:0/1862657561 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f88004030 con 0x7f9f980c4e70 2023-07-24T05:46:40.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.362+0000 7f9f8f7fe700 1 -- 172.21.15.77:0/1862657561 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f880043c0 con 0x7f9f980c4e70 2023-07-24T05:46:40.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.362+0000 7f9f9dafb700 1 -- 172.21.15.77:0/1862657561 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9f980c4e70 msgr2=0x7f9f9806d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:40.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.362+0000 7f9f9dafb700 1 --2- 172.21.15.77:0/1862657561 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9f980c4e70 0x7f9f9806d3a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9f88009880 tx=0x7f9f88009b90 comp rx=0 tx=0).stop 2023-07-24T05:46:40.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.362+0000 7f9f9dafb700 1 -- 172.21.15.77:0/1862657561 shutdown_connections 2023-07-24T05:46:40.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.362+0000 7f9f9dafb700 1 --2- 172.21.15.77:0/1862657561 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9f980c4e70 0x7f9f9806d3a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:40.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.362+0000 7f9f9dafb700 1 -- 172.21.15.77:0/1862657561 >> 172.21.15.77:0/1862657561 conn(0x7f9f980ce260 msgr2=0x7f9f980ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:40.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.362+0000 7f9f9dafb700 1 -- 172.21.15.77:0/1862657561 shutdown_connections 2023-07-24T05:46:40.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.362+0000 7f9f9dafb700 1 -- 172.21.15.77:0/1862657561 wait complete. 2023-07-24T05:46:40.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.366+0000 7f9f9dafb700 1 Processor -- start 2023-07-24T05:46:40.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.366+0000 7f9f9dafb700 1 -- start start 2023-07-24T05:46:40.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.366+0000 7f9f9dafb700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9f98069b10 0x7f9f980adcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:40.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.366+0000 7f9f9dafb700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f980c4e70 0x7f9f981540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:40.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.366+0000 7f9f9dafb700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f9815a950 0x7f9f981572f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:40.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.366+0000 7f9f9dafb700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9815b260 con 0x7f9f980c4e70 2023-07-24T05:46:40.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.366+0000 7f9f9dafb700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f981554b0 con 0x7f9f9815a950 2023-07-24T05:46:40.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.366+0000 7f9f9dafb700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f98155790 con 0x7f9f98069b10 2023-07-24T05:46:40.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.366+0000 7f9f8ffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f980c4e70 0x7f9f981540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:40.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.366+0000 7f9f8ffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f980c4e70 0x7f9f981540e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42702/0 (socket says 172.21.15.77:42702) 2023-07-24T05:46:40.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.366+0000 7f9f8ffff700 1 -- 172.21.15.77:0/444016330 learned_addr learned my addr 172.21.15.77:0/444016330 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:40.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.366+0000 7f9f9caf9700 1 --2- 172.21.15.77:0/444016330 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9f98069b10 0x7f9f980adcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:40.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.366+0000 7f9f9d2fa700 1 --2- 172.21.15.77:0/444016330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f9815a950 0x7f9f981572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:40.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.366+0000 7f9f8ffff700 1 -- 172.21.15.77:0/444016330 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9f98069b10 msgr2=0x7f9f980adcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:40.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.366+0000 7f9f8ffff700 1 --2- 172.21.15.77:0/444016330 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9f98069b10 0x7f9f980adcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:40.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.366+0000 7f9f8ffff700 1 -- 172.21.15.77:0/444016330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f9815a950 msgr2=0x7f9f981572f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:40.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.366+0000 7f9f8ffff700 1 --2- 172.21.15.77:0/444016330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f9815a950 0x7f9f981572f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:40.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.366+0000 7f9f8ffff700 1 -- 172.21.15.77:0/444016330 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f880094b0 con 0x7f9f980c4e70 2023-07-24T05:46:40.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.370+0000 7f9f8ffff700 1 --2- 172.21.15.77:0/444016330 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f980c4e70 0x7f9f981540e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9f880097d0 tx=0x7f9f88004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:40.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.370+0000 7f9f8d7fa700 1 -- 172.21.15.77:0/444016330 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f88003d40 con 0x7f9f980c4e70 2023-07-24T05:46:40.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.370+0000 7f9f8d7fa700 1 -- 172.21.15.77:0/444016330 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f88011630 con 0x7f9f980c4e70 2023-07-24T05:46:40.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.370+0000 7f9f8d7fa700 1 -- 172.21.15.77:0/444016330 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f88003ea0 con 0x7f9f980c4e70 2023-07-24T05:46:40.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.370+0000 7f9f9dafb700 1 -- 172.21.15.77:0/444016330 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f98155a70 con 0x7f9f980c4e70 2023-07-24T05:46:40.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.370+0000 7f9f9dafb700 1 -- 172.21.15.77:0/444016330 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f98154620 con 0x7f9f980c4e70 2023-07-24T05:46:40.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.370+0000 7f9f9dafb700 1 -- 172.21.15.77:0/444016330 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f9815ce10 con 0x7f9f980c4e70 2023-07-24T05:46:40.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.370+0000 7f9f8d7fa700 1 -- 172.21.15.77:0/444016330 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9f88018050 con 0x7f9f980c4e70 2023-07-24T05:46:40.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.374+0000 7f9f8d7fa700 1 --2- 172.21.15.77:0/444016330 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f9f84066320 0x7f9f840687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:40.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.374+0000 7f9f8d7fa700 1 -- 172.21.15.77:0/444016330 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9f88084ae0 con 0x7f9f980c4e70 2023-07-24T05:46:40.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.374+0000 7f9f9caf9700 1 --2- 172.21.15.77:0/444016330 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f9f84066320 0x7f9f840687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:40.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.374+0000 7f9f9caf9700 1 --2- 172.21.15.77:0/444016330 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f9f84066320 0x7f9f840687e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9f94000f60 tx=0x7f9f940014b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:40.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.378+0000 7f9f8d7fa700 1 -- 172.21.15.77:0/444016330 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9f9815ce10 con 0x7f9f980c4e70 2023-07-24T05:46:40.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.550+0000 7f9f9dafb700 1 -- 172.21.15.77:0/444016330 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9f9815ce10 con 0x7f9f980c4e70 2023-07-24T05:46:40.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.554+0000 7f9f8d7fa700 1 -- 172.21.15.77:0/444016330 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9f9815ce10 con 0x7f9f980c4e70 2023-07-24T05:46:40.558 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-07-24T05:46:40.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.558+0000 7f9f9dafb700 1 -- 172.21.15.77:0/444016330 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f9f84066320 msgr2=0x7f9f840687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:40.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.558+0000 7f9f9dafb700 1 --2- 172.21.15.77:0/444016330 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f9f84066320 0x7f9f840687e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9f94000f60 tx=0x7f9f940014b0 comp rx=0 tx=0).stop 2023-07-24T05:46:40.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.558+0000 7f9f9dafb700 1 -- 172.21.15.77:0/444016330 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f980c4e70 msgr2=0x7f9f981540e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:40.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.558+0000 7f9f9dafb700 1 --2- 172.21.15.77:0/444016330 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f980c4e70 0x7f9f981540e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9f880097d0 tx=0x7f9f88004770 comp rx=0 tx=0).stop 2023-07-24T05:46:40.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.558+0000 7f9f9dafb700 1 -- 172.21.15.77:0/444016330 shutdown_connections 2023-07-24T05:46:40.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.558+0000 7f9f9dafb700 1 --2- 172.21.15.77:0/444016330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f9815a950 0x7f9f981572f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:40.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.558+0000 7f9f9dafb700 1 --2- 172.21.15.77:0/444016330 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f980c4e70 0x7f9f981540e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:40.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.558+0000 7f9f9dafb700 1 --2- 172.21.15.77:0/444016330 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f9f84066320 0x7f9f840687e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:40.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.558+0000 7f9f9dafb700 1 --2- 172.21.15.77:0/444016330 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9f98069b10 0x7f9f980adcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:40.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.558+0000 7f9f9dafb700 1 -- 172.21.15.77:0/444016330 >> 172.21.15.77:0/444016330 conn(0x7f9f980ce260 msgr2=0x7f9f981587e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:40.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.558+0000 7f9f9dafb700 1 -- 172.21.15.77:0/444016330 shutdown_connections 2023-07-24T05:46:40.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.558+0000 7f9f9dafb700 1 -- 172.21.15.77:0/444016330 wait complete. 2023-07-24T05:46:40.584 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-24T05:46:40.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.758+0000 7f471981e700 1 Processor -- start 2023-07-24T05:46:40.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.758+0000 7f471981e700 1 -- start start 2023-07-24T05:46:40.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.758+0000 7f471981e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f471415c870 0x7f47140cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:40.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.758+0000 7f471981e700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47140cf520 con 0x7f471415cc50 2023-07-24T05:46:40.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.758+0000 7f471981e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f471406aaa0 con 0x7f47140b2230 2023-07-24T05:46:40.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.758+0000 7f471981e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f471406ad80 con 0x7f471415c870 2023-07-24T05:46:40.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.758+0000 7f470bfff700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f471415cc50 0x7f47140b1b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:53710/0 (socket says 172.21.15.77:53710) 2023-07-24T05:46:40.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.758+0000 7f470bfff700 1 -- 172.21.15.77:0/3004046130 learned_addr learned my addr 172.21.15.77:0/3004046130 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:40.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.758+0000 7f4712ffd700 1 --2- 172.21.15.77:0/3004046130 >> v2:172.21.15.103:3300/0 conn(0x7f471415c870 0x7f47140cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:40.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.758+0000 7f47127fc700 1 -- 172.21.15.77:0/3004046130 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 861014571 0 0) 0x7f47140cf520 con 0x7f471415cc50 2023-07-24T05:46:40.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.762+0000 7f47127fc700 1 -- 172.21.15.77:0/3004046130 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47000035d0 con 0x7f471415cc50 2023-07-24T05:46:40.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.762+0000 7f4712ffd700 1 -- 172.21.15.77:0/3004046130 >> v1:172.21.15.103:6789/0 conn(0x7f47140b2230 legacy=0x7f47140cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:40.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.762+0000 7f4712ffd700 1 -- 172.21.15.77:0/3004046130 >> v1:172.21.15.77:6789/0 conn(0x7f471415cc50 legacy=0x7f47140b1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:40.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.762+0000 7f4712ffd700 1 -- 172.21.15.77:0/3004046130 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f471406b060 con 0x7f471415c870 2023-07-24T05:46:40.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.762+0000 7f4712ffd700 1 --2- 172.21.15.77:0/3004046130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f471415c870 0x7f47140cefe0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4704009840 tx=0x7f4704009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63e99aa66bab54b6 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:40.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.762+0000 7f47127fc700 1 -- 172.21.15.77:0/3004046130 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4704005e50 con 0x7f471415c870 2023-07-24T05:46:40.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.762+0000 7f47127fc700 1 -- 172.21.15.77:0/3004046130 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4704006030 con 0x7f471415c870 2023-07-24T05:46:40.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.762+0000 7f47127fc700 1 -- 172.21.15.77:0/3004046130 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47040063c0 con 0x7f471415c870 2023-07-24T05:46:40.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.762+0000 7f471981e700 1 -- 172.21.15.77:0/3004046130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f471415c870 msgr2=0x7f47140cefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:40.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.762+0000 7f471981e700 1 --2- 172.21.15.77:0/3004046130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f471415c870 0x7f47140cefe0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4704009840 tx=0x7f4704009b50 comp rx=0 tx=0).stop 2023-07-24T05:46:40.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.762+0000 7f471981e700 1 -- 172.21.15.77:0/3004046130 shutdown_connections 2023-07-24T05:46:40.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.762+0000 7f471981e700 1 --2- 172.21.15.77:0/3004046130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f471415c870 0x7f47140cefe0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:40.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.762+0000 7f471981e700 1 -- 172.21.15.77:0/3004046130 >> 172.21.15.77:0/3004046130 conn(0x7f4714089f80 msgr2=0x7f471409b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:40.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.762+0000 7f471981e700 1 -- 172.21.15.77:0/3004046130 shutdown_connections 2023-07-24T05:46:40.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.762+0000 7f471981e700 1 -- 172.21.15.77:0/3004046130 wait complete. 2023-07-24T05:46:40.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.766+0000 7f471981e700 1 Processor -- start 2023-07-24T05:46:40.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.766+0000 7f471981e700 1 -- start start 2023-07-24T05:46:40.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.766+0000 7f471981e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47140b2230 0x7f4714159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:40.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.766+0000 7f471981e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f471415c870 0x7f47140d2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:40.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.766+0000 7f471981e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f471415cc50 0x7f47140c9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:40.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.766+0000 7f471981e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4714159eb0 con 0x7f47140b2230 2023-07-24T05:46:40.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.766+0000 7f471981e700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4714158ed0 con 0x7f471415c870 2023-07-24T05:46:40.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.766+0000 7f471981e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47140ca0f0 con 0x7f471415cc50 2023-07-24T05:46:40.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.766+0000 7f4712ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47140b2230 0x7f4714159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:40.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.766+0000 7f4712ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47140b2230 0x7f4714159970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42710/0 (socket says 172.21.15.77:42710) 2023-07-24T05:46:40.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.766+0000 7f4712ffd700 1 -- 172.21.15.77:0/4037545875 learned_addr learned my addr 172.21.15.77:0/4037545875 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:40.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.766+0000 7f470bfff700 1 --2- 172.21.15.77:0/4037545875 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f471415c870 0x7f47140d2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:40.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.766+0000 7f47137fe700 1 --2- 172.21.15.77:0/4037545875 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f471415cc50 0x7f47140c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:40.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.766+0000 7f4712ffd700 1 -- 172.21.15.77:0/4037545875 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f471415cc50 msgr2=0x7f47140c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:40.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.766+0000 7f4712ffd700 1 --2- 172.21.15.77:0/4037545875 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f471415cc50 0x7f47140c9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:40.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.766+0000 7f4712ffd700 1 -- 172.21.15.77:0/4037545875 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f471415c870 msgr2=0x7f47140d2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:40.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.766+0000 7f4712ffd700 1 --2- 172.21.15.77:0/4037545875 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f471415c870 0x7f47140d2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:40.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.766+0000 7f4712ffd700 1 -- 172.21.15.77:0/4037545875 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4704009450 con 0x7f47140b2230 2023-07-24T05:46:40.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.766+0000 7f47137fe700 1 --2- 172.21.15.77:0/4037545875 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f471415cc50 0x7f47140c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:46:40.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.766+0000 7f4712ffd700 1 --2- 172.21.15.77:0/4037545875 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47140b2230 0x7f4714159970 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4704013040 tx=0x7f4704004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:40.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.766+0000 7f4710ff9700 1 -- 172.21.15.77:0/4037545875 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4704003ad0 con 0x7f47140b2230 2023-07-24T05:46:40.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.770+0000 7f4710ff9700 1 -- 172.21.15.77:0/4037545875 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4704003c50 con 0x7f47140b2230 2023-07-24T05:46:40.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.770+0000 7f4710ff9700 1 -- 172.21.15.77:0/4037545875 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47040045e0 con 0x7f47140b2230 2023-07-24T05:46:40.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.770+0000 7f471981e700 1 -- 172.21.15.77:0/4037545875 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4714159170 con 0x7f47140b2230 2023-07-24T05:46:40.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.770+0000 7f471981e700 1 -- 172.21.15.77:0/4037545875 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47140ca3d0 con 0x7f47140b2230 2023-07-24T05:46:40.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.770+0000 7f471981e700 1 -- 172.21.15.77:0/4037545875 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4714072ab0 con 0x7f47140b2230 2023-07-24T05:46:40.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.770+0000 7f4710ff9700 1 -- 172.21.15.77:0/4037545875 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4704022070 con 0x7f47140b2230 2023-07-24T05:46:40.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.774+0000 7f4710ff9700 1 --2- 172.21.15.77:0/4037545875 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f46f40662f0 0x7f46f40687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:40.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.774+0000 7f4710ff9700 1 -- 172.21.15.77:0/4037545875 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4704085840 con 0x7f47140b2230 2023-07-24T05:46:40.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.774+0000 7f470bfff700 1 --2- 172.21.15.77:0/4037545875 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f46f40662f0 0x7f46f40687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:40.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.774+0000 7f470bfff700 1 --2- 172.21.15.77:0/4037545875 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f46f40662f0 0x7f46f40687b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4714151040 tx=0x7f46fc007de0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:40.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.778+0000 7f4710ff9700 1 -- 172.21.15.77:0/4037545875 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4704052a60 con 0x7f47140b2230 2023-07-24T05:46:40.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.954+0000 7f471981e700 1 -- 172.21.15.77:0/4037545875 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4714159690 con 0x7f47140b2230 2023-07-24T05:46:40.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.958+0000 7f4710ff9700 1 -- 172.21.15.77:0/4037545875 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f470402a020 con 0x7f47140b2230 2023-07-24T05:46:40.961 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-07-24T05:46:40.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.958+0000 7f471981e700 1 -- 172.21.15.77:0/4037545875 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f46f40662f0 msgr2=0x7f46f40687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:40.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.958+0000 7f471981e700 1 --2- 172.21.15.77:0/4037545875 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f46f40662f0 0x7f46f40687b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4714151040 tx=0x7f46fc007de0 comp rx=0 tx=0).stop 2023-07-24T05:46:40.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.958+0000 7f471981e700 1 -- 172.21.15.77:0/4037545875 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47140b2230 msgr2=0x7f4714159970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:40.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.958+0000 7f471981e700 1 --2- 172.21.15.77:0/4037545875 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47140b2230 0x7f4714159970 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4704013040 tx=0x7f4704004770 comp rx=0 tx=0).stop 2023-07-24T05:46:40.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.958+0000 7f471981e700 1 -- 172.21.15.77:0/4037545875 shutdown_connections 2023-07-24T05:46:40.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.958+0000 7f471981e700 1 --2- 172.21.15.77:0/4037545875 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f46f40662f0 0x7f46f40687b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:40.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.958+0000 7f471981e700 1 --2- 172.21.15.77:0/4037545875 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f471415cc50 0x7f47140c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:40.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.958+0000 7f471981e700 1 --2- 172.21.15.77:0/4037545875 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f471415c870 0x7f47140d2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:40.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.958+0000 7f471981e700 1 --2- 172.21.15.77:0/4037545875 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f47140b2230 0x7f4714159970 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:40.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.958+0000 7f471981e700 1 -- 172.21.15.77:0/4037545875 >> 172.21.15.77:0/4037545875 conn(0x7f4714089f80 msgr2=0x7f471409b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:40.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.958+0000 7f471981e700 1 -- 172.21.15.77:0/4037545875 shutdown_connections 2023-07-24T05:46:40.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:40.958+0000 7f471981e700 1 -- 172.21.15.77:0/4037545875 wait complete. 2023-07-24T05:46:40.984 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-24T05:46:41.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.158+0000 7f77c8ee9700 1 Processor -- start 2023-07-24T05:46:41.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.158+0000 7f77c8ee9700 1 -- start start 2023-07-24T05:46:41.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.158+0000 7f77c8ee9700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f77c40cc570 0x7f77c40b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:41.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.158+0000 7f77c8ee9700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77c40cadc0 con 0x7f77c415c820 2023-07-24T05:46:41.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.158+0000 7f77c8ee9700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77c40cb0a0 con 0x7f77c40b19d0 2023-07-24T05:46:41.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.158+0000 7f77c8ee9700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77c40cabb0 con 0x7f77c40cc570 2023-07-24T05:46:41.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.158+0000 7f77c37fe700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f77c415c820 0x7f77c406b4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:53718/0 (socket says 172.21.15.77:53718) 2023-07-24T05:46:41.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.158+0000 7f77c37fe700 1 -- 172.21.15.77:0/3870464069 learned_addr learned my addr 172.21.15.77:0/3870464069 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:41.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.158+0000 7f77c3fff700 1 --2- 172.21.15.77:0/3870464069 >> v2:172.21.15.77:3300/0 conn(0x7f77c40cc570 0x7f77c40b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:41.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.158+0000 7f77c3fff700 1 -- 172.21.15.77:0/3870464069 >> v1:172.21.15.103:6789/0 conn(0x7f77c40b19d0 legacy=0x7f77c40cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:41.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.158+0000 7f77c3fff700 1 -- 172.21.15.77:0/3870464069 >> v1:172.21.15.77:6789/0 conn(0x7f77c415c820 legacy=0x7f77c406b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:41.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.158+0000 7f77c3fff700 1 -- 172.21.15.77:0/3870464069 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c40cb380 con 0x7f77c40cc570 2023-07-24T05:46:41.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.158+0000 7f77c3fff700 1 --2- 172.21.15.77:0/3870464069 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77c40cc570 0x7f77c40b1e80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f77bc009d90 tx=0x7f77bc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d276e1f92c032559 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:41.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.162+0000 7f77c2ffd700 1 -- 172.21.15.77:0/3870464069 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77bc00e070 con 0x7f77c40cc570 2023-07-24T05:46:41.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.162+0000 7f77c2ffd700 1 -- 172.21.15.77:0/3870464069 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77bc00bb90 con 0x7f77c40cc570 2023-07-24T05:46:41.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.162+0000 7f77c2ffd700 1 -- 172.21.15.77:0/3870464069 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77bc003a40 con 0x7f77c40cc570 2023-07-24T05:46:41.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.162+0000 7f77c8ee9700 1 -- 172.21.15.77:0/3870464069 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77c40cc570 msgr2=0x7f77c40b1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:41.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.162+0000 7f77c8ee9700 1 --2- 172.21.15.77:0/3870464069 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77c40cc570 0x7f77c40b1e80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f77bc009d90 tx=0x7f77bc00b330 comp rx=0 tx=0).stop 2023-07-24T05:46:41.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.162+0000 7f77c8ee9700 1 -- 172.21.15.77:0/3870464069 shutdown_connections 2023-07-24T05:46:41.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.162+0000 7f77c8ee9700 1 --2- 172.21.15.77:0/3870464069 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77c40cc570 0x7f77c40b1e80 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:41.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.162+0000 7f77c8ee9700 1 -- 172.21.15.77:0/3870464069 >> 172.21.15.77:0/3870464069 conn(0x7f77c4069cf0 msgr2=0x7f77c40d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:41.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.162+0000 7f77c8ee9700 1 -- 172.21.15.77:0/3870464069 shutdown_connections 2023-07-24T05:46:41.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.162+0000 7f77c8ee9700 1 -- 172.21.15.77:0/3870464069 wait complete. 2023-07-24T05:46:41.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.166+0000 7f77c8ee9700 1 Processor -- start 2023-07-24T05:46:41.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.166+0000 7f77c8ee9700 1 -- start start 2023-07-24T05:46:41.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.166+0000 7f77c8ee9700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f77c40b19d0 0x7f77c40c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:41.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.166+0000 7f77c8ee9700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77c40cc570 0x7f77c40c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:41.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.166+0000 7f77c8ee9700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77c415c820 0x7f77c414cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:41.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.166+0000 7f77c8ee9700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c40c4d90 con 0x7f77c40cc570 2023-07-24T05:46:41.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.166+0000 7f77c8ee9700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c40c47d0 con 0x7f77c415c820 2023-07-24T05:46:41.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.166+0000 7f77c8ee9700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c40c4ab0 con 0x7f77c40b19d0 2023-07-24T05:46:41.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.166+0000 7f77baffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77c40cc570 0x7f77c40c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:41.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.166+0000 7f77baffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77c40cc570 0x7f77c40c3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42722/0 (socket says 172.21.15.77:42722) 2023-07-24T05:46:41.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.166+0000 7f77baffd700 1 -- 172.21.15.77:0/2936495742 learned_addr learned my addr 172.21.15.77:0/2936495742 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:41.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.170+0000 7f77c37fe700 1 --2- 172.21.15.77:0/2936495742 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f77c40b19d0 0x7f77c40c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:41.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.170+0000 7f77c3fff700 1 --2- 172.21.15.77:0/2936495742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77c415c820 0x7f77c414cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:41.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.170+0000 7f77baffd700 1 -- 172.21.15.77:0/2936495742 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f77c40b19d0 msgr2=0x7f77c40c9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:41.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.170+0000 7f77baffd700 1 --2- 172.21.15.77:0/2936495742 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f77c40b19d0 0x7f77c40c9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:41.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.170+0000 7f77baffd700 1 -- 172.21.15.77:0/2936495742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77c415c820 msgr2=0x7f77c414cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:41.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.170+0000 7f77baffd700 1 --2- 172.21.15.77:0/2936495742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77c415c820 0x7f77c414cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:41.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.170+0000 7f77baffd700 1 -- 172.21.15.77:0/2936495742 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77bc009a70 con 0x7f77c40cc570 2023-07-24T05:46:41.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.170+0000 7f77c3fff700 1 --2- 172.21.15.77:0/2936495742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77c415c820 0x7f77c414cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:46:41.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.170+0000 7f77baffd700 1 --2- 172.21.15.77:0/2936495742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77c40cc570 0x7f77c40c3e10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f77ac00c4e0 tx=0x7f77ac00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:41.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.170+0000 7f77c0ff9700 1 -- 172.21.15.77:0/2936495742 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ac011790 con 0x7f77c40cc570 2023-07-24T05:46:41.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.170+0000 7f77c0ff9700 1 -- 172.21.15.77:0/2936495742 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ac011910 con 0x7f77c40cc570 2023-07-24T05:46:41.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.170+0000 7f77c0ff9700 1 -- 172.21.15.77:0/2936495742 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ac011cc0 con 0x7f77c40cc570 2023-07-24T05:46:41.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.170+0000 7f77c8ee9700 1 -- 172.21.15.77:0/2936495742 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77c40c5500 con 0x7f77c40cc570 2023-07-24T05:46:41.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.170+0000 7f77c8ee9700 1 -- 172.21.15.77:0/2936495742 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77c40c9fb0 con 0x7f77c40cc570 2023-07-24T05:46:41.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.170+0000 7f77c8ee9700 1 -- 172.21.15.77:0/2936495742 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77c40ca1d0 con 0x7f77c40cc570 2023-07-24T05:46:41.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.174+0000 7f77c0ff9700 1 -- 172.21.15.77:0/2936495742 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f77ac01c460 con 0x7f77c40cc570 2023-07-24T05:46:41.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.174+0000 7f77c0ff9700 1 --2- 172.21.15.77:0/2936495742 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f77a4066320 0x7f77a40687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:41.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.174+0000 7f77c0ff9700 1 -- 172.21.15.77:0/2936495742 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f77ac083d70 con 0x7f77c40cc570 2023-07-24T05:46:41.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.174+0000 7f77c37fe700 1 --2- 172.21.15.77:0/2936495742 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f77a4066320 0x7f77a40687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:41.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.174+0000 7f77c37fe700 1 --2- 172.21.15.77:0/2936495742 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f77a4066320 0x7f77a40687e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f77b4000f60 tx=0x7f77b4007f30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:41.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.178+0000 7f77c0ff9700 1 -- 172.21.15.77:0/2936495742 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f77ac050ef0 con 0x7f77c40cc570 2023-07-24T05:46:41.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.350+0000 7f77c8ee9700 1 -- 172.21.15.77:0/2936495742 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f77c4072490 con 0x7f77c40cc570 2023-07-24T05:46:41.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.350+0000 7f77c0ff9700 1 -- 172.21.15.77:0/2936495742 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f77ac054510 con 0x7f77c40cc570 2023-07-24T05:46:41.355 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-07-24T05:46:41.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.354+0000 7f77c8ee9700 1 -- 172.21.15.77:0/2936495742 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f77a4066320 msgr2=0x7f77a40687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:41.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.354+0000 7f77c8ee9700 1 --2- 172.21.15.77:0/2936495742 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f77a4066320 0x7f77a40687e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f77b4000f60 tx=0x7f77b4007f30 comp rx=0 tx=0).stop 2023-07-24T05:46:41.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.354+0000 7f77c8ee9700 1 -- 172.21.15.77:0/2936495742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77c40cc570 msgr2=0x7f77c40c3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:41.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.354+0000 7f77c8ee9700 1 --2- 172.21.15.77:0/2936495742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77c40cc570 0x7f77c40c3e10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f77ac00c4e0 tx=0x7f77ac00c7f0 comp rx=0 tx=0).stop 2023-07-24T05:46:41.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.354+0000 7f77c8ee9700 1 -- 172.21.15.77:0/2936495742 shutdown_connections 2023-07-24T05:46:41.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.354+0000 7f77c8ee9700 1 --2- 172.21.15.77:0/2936495742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f77c415c820 0x7f77c414cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:41.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.354+0000 7f77c8ee9700 1 --2- 172.21.15.77:0/2936495742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f77c40cc570 0x7f77c40c3e10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:41.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.354+0000 7f77c8ee9700 1 --2- 172.21.15.77:0/2936495742 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f77a4066320 0x7f77a40687e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:41.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.354+0000 7f77c8ee9700 1 --2- 172.21.15.77:0/2936495742 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f77c40b19d0 0x7f77c40c9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:41.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.354+0000 7f77c8ee9700 1 -- 172.21.15.77:0/2936495742 >> 172.21.15.77:0/2936495742 conn(0x7f77c4069cf0 msgr2=0x7f77c40cf650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:41.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.354+0000 7f77c8ee9700 1 -- 172.21.15.77:0/2936495742 shutdown_connections 2023-07-24T05:46:41.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.354+0000 7f77c8ee9700 1 -- 172.21.15.77:0/2936495742 wait complete. 2023-07-24T05:46:41.379 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-24T05:46:41.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.542+0000 7fbe8a22c700 1 Processor -- start 2023-07-24T05:46:41.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.542+0000 7fbe8a22c700 1 -- start start 2023-07-24T05:46:41.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.546+0000 7fbe8a22c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fbe840ad320 0x7fbe840ad870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:41.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.546+0000 7fbe8a22c700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe840cb870 con 0x7fbe8406d400 2023-07-24T05:46:41.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.546+0000 7fbe8a22c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe840cac60 con 0x7fbe84160350 2023-07-24T05:46:41.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.546+0000 7fbe8a22c700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe840ccc20 con 0x7fbe840ad320 2023-07-24T05:46:41.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.546+0000 7fbe82ffd700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fbe8406d400 0x7fbe84069cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:53722/0 (socket says 172.21.15.77:53722) 2023-07-24T05:46:41.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.546+0000 7fbe837fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fbe84160350 0x7fbe8406ccf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.77:57588/0 (socket says 172.21.15.77:57588) 2023-07-24T05:46:41.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.546+0000 7fbe82ffd700 1 -- 172.21.15.77:0/3781393019 learned_addr learned my addr 172.21.15.77:0/3781393019 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:41.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.546+0000 7fbe83fff700 1 --2- 172.21.15.77:0/3781393019 >> v2:172.21.15.103:3300/0 conn(0x7fbe840ad320 0x7fbe840ad870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:41.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.546+0000 7fbe827fc700 1 -- 172.21.15.77:0/3781393019 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3687751071 0 0) 0x7fbe840cb870 con 0x7fbe8406d400 2023-07-24T05:46:41.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.546+0000 7fbe827fc700 1 -- 172.21.15.77:0/3781393019 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe6c0035d0 con 0x7fbe8406d400 2023-07-24T05:46:41.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.546+0000 7fbe83fff700 1 -- 172.21.15.77:0/3781393019 >> v1:172.21.15.103:6789/0 conn(0x7fbe84160350 legacy=0x7fbe8406ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:41.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.546+0000 7fbe83fff700 1 -- 172.21.15.77:0/3781393019 >> v1:172.21.15.77:6789/0 conn(0x7fbe8406d400 legacy=0x7fbe84069cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:41.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.546+0000 7fbe83fff700 1 -- 172.21.15.77:0/3781393019 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe840caf40 con 0x7fbe840ad320 2023-07-24T05:46:41.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.546+0000 7fbe83fff700 1 --2- 172.21.15.77:0/3781393019 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe840ad320 0x7fbe840ad870 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c009d90 tx=0x7fbe7c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fa20c9a914c5e80 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:41.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.546+0000 7fbe827fc700 1 -- 172.21.15.77:0/3781393019 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c00e070 con 0x7fbe840ad320 2023-07-24T05:46:41.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.546+0000 7fbe827fc700 1 -- 172.21.15.77:0/3781393019 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe7c00bb20 con 0x7fbe840ad320 2023-07-24T05:46:41.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.546+0000 7fbe827fc700 1 -- 172.21.15.77:0/3781393019 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c00be90 con 0x7fbe840ad320 2023-07-24T05:46:41.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.550+0000 7fbe8a22c700 1 -- 172.21.15.77:0/3781393019 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe840ad320 msgr2=0x7fbe840ad870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:41.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.550+0000 7fbe8a22c700 1 --2- 172.21.15.77:0/3781393019 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe840ad320 0x7fbe840ad870 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c009d90 tx=0x7fbe7c00b330 comp rx=0 tx=0).stop 2023-07-24T05:46:41.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.550+0000 7fbe8a22c700 1 -- 172.21.15.77:0/3781393019 shutdown_connections 2023-07-24T05:46:41.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.550+0000 7fbe8a22c700 1 --2- 172.21.15.77:0/3781393019 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe840ad320 0x7fbe840ad870 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:41.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.550+0000 7fbe8a22c700 1 -- 172.21.15.77:0/3781393019 >> 172.21.15.77:0/3781393019 conn(0x7fbe840ce410 msgr2=0x7fbe840ce7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:41.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.550+0000 7fbe8a22c700 1 -- 172.21.15.77:0/3781393019 shutdown_connections 2023-07-24T05:46:41.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.550+0000 7fbe8a22c700 1 -- 172.21.15.77:0/3781393019 wait complete. 2023-07-24T05:46:41.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.550+0000 7fbe8a22c700 1 Processor -- start 2023-07-24T05:46:41.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.554+0000 7fbe8a22c700 1 -- start start 2023-07-24T05:46:41.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.554+0000 7fbe8a22c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe8406d400 0x7fbe840aeac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:41.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.554+0000 7fbe8a22c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbe840ad320 0x7fbe840979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:41.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.554+0000 7fbe8a22c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe84160350 0x7fbe840705d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:41.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.554+0000 7fbe8a22c700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe841578e0 con 0x7fbe84160350 2023-07-24T05:46:41.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.554+0000 7fbe8a22c700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe841588b0 con 0x7fbe8406d400 2023-07-24T05:46:41.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.554+0000 7fbe8a22c700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe84070b10 con 0x7fbe840ad320 2023-07-24T05:46:41.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.554+0000 7fbe83fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe84160350 0x7fbe840705d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:41.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.554+0000 7fbe83fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe84160350 0x7fbe840705d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42734/0 (socket says 172.21.15.77:42734) 2023-07-24T05:46:41.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.554+0000 7fbe83fff700 1 -- 172.21.15.77:0/955894608 learned_addr learned my addr 172.21.15.77:0/955894608 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:41.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.554+0000 7fbe837fe700 1 --2- 172.21.15.77:0/955894608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe8406d400 0x7fbe840aeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:41.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.554+0000 7fbe82ffd700 1 --2- 172.21.15.77:0/955894608 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbe840ad320 0x7fbe840979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:41.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.554+0000 7fbe83fff700 1 -- 172.21.15.77:0/955894608 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbe840ad320 msgr2=0x7fbe840979d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:41.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.554+0000 7fbe83fff700 1 --2- 172.21.15.77:0/955894608 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbe840ad320 0x7fbe840979d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:41.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.554+0000 7fbe83fff700 1 -- 172.21.15.77:0/955894608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe8406d400 msgr2=0x7fbe840aeac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:41.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.554+0000 7fbe83fff700 1 --2- 172.21.15.77:0/955894608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe8406d400 0x7fbe840aeac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:41.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.554+0000 7fbe83fff700 1 -- 172.21.15.77:0/955894608 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe7c009a70 con 0x7fbe84160350 2023-07-24T05:46:41.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.554+0000 7fbe83fff700 1 --2- 172.21.15.77:0/955894608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe84160350 0x7fbe840705d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c00b370 tx=0x7fbe7c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:41.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.554+0000 7fbe6bfff700 1 -- 172.21.15.77:0/955894608 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c004880 con 0x7fbe84160350 2023-07-24T05:46:41.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.554+0000 7fbe6bfff700 1 -- 172.21.15.77:0/955894608 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe7c020070 con 0x7fbe84160350 2023-07-24T05:46:41.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.554+0000 7fbe8a22c700 1 -- 172.21.15.77:0/955894608 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe84157af0 con 0x7fbe84160350 2023-07-24T05:46:41.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.554+0000 7fbe6bfff700 1 -- 172.21.15.77:0/955894608 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c0276c0 con 0x7fbe84160350 2023-07-24T05:46:41.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.558+0000 7fbe8a22c700 1 -- 172.21.15.77:0/955894608 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe841580b0 con 0x7fbe84160350 2023-07-24T05:46:41.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.558+0000 7fbe8a22c700 1 -- 172.21.15.77:0/955894608 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe8404df10 con 0x7fbe84160350 2023-07-24T05:46:41.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.558+0000 7fbe6bfff700 1 -- 172.21.15.77:0/955894608 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbe7c012430 con 0x7fbe84160350 2023-07-24T05:46:41.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.562+0000 7fbe6bfff700 1 --2- 172.21.15.77:0/955894608 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fbe70066320 0x7fbe700687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:41.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.562+0000 7fbe6bfff700 1 -- 172.21.15.77:0/955894608 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbe7c022070 con 0x7fbe84160350 2023-07-24T05:46:41.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.562+0000 7fbe837fe700 1 --2- 172.21.15.77:0/955894608 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fbe70066320 0x7fbe700687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:41.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.562+0000 7fbe837fe700 1 --2- 172.21.15.77:0/955894608 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fbe70066320 0x7fbe700687e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbe74000fb0 tx=0x7fbe74000f20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:41.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.566+0000 7fbe6bfff700 1 -- 172.21.15.77:0/955894608 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbe7c052e20 con 0x7fbe84160350 2023-07-24T05:46:41.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.770+0000 7fbe8a22c700 1 -- 172.21.15.77:0/955894608 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe8415f6c0 con 0x7fbe84160350 2023-07-24T05:46:41.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.774+0000 7fbe6bfff700 1 -- 172.21.15.77:0/955894608 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7fbe7c056440 con 0x7fbe84160350 2023-07-24T05:46:41.778 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:46:41.778 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/4201639271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4201639271},{"type":"v1","addr":"172.21.15.77:6834","nonce":4201639271}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/993116623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":993116623},{"type":"v1","addr":"172.21.15.103:6835","nonce":993116623}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/1196529067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":1196529067},{"type":"v1","addr":"172.21.15.103:6837","nonce":1196529067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-24T05:46:00.395327+0000","modified":"2023-07-24T05:46:27.438873+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6835/2428690206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2428690206},{"type":"v1","addr":"172.21.15.77:6835","nonce":2428690206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-24T05:46:41.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.778+0000 7fbe8a22c700 1 -- 172.21.15.77:0/955894608 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fbe70066320 msgr2=0x7fbe700687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:41.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.778+0000 7fbe8a22c700 1 --2- 172.21.15.77:0/955894608 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fbe70066320 0x7fbe700687e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbe74000fb0 tx=0x7fbe74000f20 comp rx=0 tx=0).stop 2023-07-24T05:46:41.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.778+0000 7fbe8a22c700 1 -- 172.21.15.77:0/955894608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe84160350 msgr2=0x7fbe840705d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:41.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.778+0000 7fbe8a22c700 1 --2- 172.21.15.77:0/955894608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe84160350 0x7fbe840705d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c00b370 tx=0x7fbe7c004af0 comp rx=0 tx=0).stop 2023-07-24T05:46:41.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.778+0000 7fbe8a22c700 1 -- 172.21.15.77:0/955894608 shutdown_connections 2023-07-24T05:46:41.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.778+0000 7fbe8a22c700 1 --2- 172.21.15.77:0/955894608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe84160350 0x7fbe840705d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:41.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.778+0000 7fbe8a22c700 1 --2- 172.21.15.77:0/955894608 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fbe70066320 0x7fbe700687e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:41.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.778+0000 7fbe8a22c700 1 --2- 172.21.15.77:0/955894608 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbe840ad320 0x7fbe840979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:41.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.778+0000 7fbe8a22c700 1 --2- 172.21.15.77:0/955894608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe8406d400 0x7fbe840aeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:41.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.778+0000 7fbe8a22c700 1 -- 172.21.15.77:0/955894608 >> 172.21.15.77:0/955894608 conn(0x7fbe840ce410 msgr2=0x7fbe840cd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:41.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.778+0000 7fbe8a22c700 1 -- 172.21.15.77:0/955894608 shutdown_connections 2023-07-24T05:46:41.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.778+0000 7fbe8a22c700 1 -- 172.21.15.77:0/955894608 wait complete. 2023-07-24T05:46:41.784 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 9 2023-07-24T05:46:41.804 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-24T05:46:41.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.970+0000 7efc056ca700 1 Processor -- start 2023-07-24T05:46:41.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.970+0000 7efc056ca700 1 -- start start 2023-07-24T05:46:41.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.970+0000 7efc056ca700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efc00069b10 0x7efc000b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:41.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.970+0000 7efc056ca700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efc0006eea0 0x7efc000cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:41.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.970+0000 7efc056ca700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc000b24e0 con 0x7efc0015a880 2023-07-24T05:46:41.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.970+0000 7efc056ca700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc000b2300 con 0x7efc0006eea0 2023-07-24T05:46:41.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.970+0000 7efc056ca700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc000cfb20 con 0x7efc00069b10 2023-07-24T05:46:41.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.974+0000 7efbf67fc700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efc00069b10 0x7efc000b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:41.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.974+0000 7efbf67fc700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efc00069b10 0x7efc000b3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.77:52026/0 (socket says 172.21.15.77:52026) 2023-07-24T05:46:41.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.974+0000 7efbf67fc700 1 -- 172.21.15.77:0/557357765 learned_addr learned my addr 172.21.15.77:0/557357765 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:41.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.974+0000 7efbfffff700 1 --2- 172.21.15.77:0/557357765 >> v2:172.21.15.77:3300/0 conn(0x7efc0006eea0 0x7efc000cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:41.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.974+0000 7efbf67fc700 1 -- 172.21.15.77:0/557357765 >> v2:172.21.15.77:3300/0 conn(0x7efc0006eea0 msgr2=0x7efc000cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:41.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.974+0000 7efbf67fc700 1 --2- 172.21.15.77:0/557357765 >> v2:172.21.15.77:3300/0 conn(0x7efc0006eea0 0x7efc000cdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:41.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.974+0000 7efbf67fc700 1 -- 172.21.15.77:0/557357765 >> v1:172.21.15.103:6789/0 conn(0x7efc0015a880 legacy=0x7efc000cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:41.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.974+0000 7efbf67fc700 1 -- 172.21.15.77:0/557357765 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc000cf7b0 con 0x7efc00069b10 2023-07-24T05:46:41.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.974+0000 7efbf67fc700 1 --2- 172.21.15.77:0/557357765 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efc00069b10 0x7efc000b3b50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efbe8009910 tx=0x7efbe8009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cccfee299afe3c1 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:41.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.974+0000 7efbfe7fc700 1 -- 172.21.15.77:0/557357765 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe8011830 con 0x7efc00069b10 2023-07-24T05:46:41.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.974+0000 7efbfe7fc700 1 -- 172.21.15.77:0/557357765 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbe8011990 con 0x7efc00069b10 2023-07-24T05:46:41.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.974+0000 7efbfe7fc700 1 -- 172.21.15.77:0/557357765 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe8011d40 con 0x7efc00069b10 2023-07-24T05:46:41.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.974+0000 7efc056ca700 1 -- 172.21.15.77:0/557357765 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efc00069b10 msgr2=0x7efc000b3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:41.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.974+0000 7efc056ca700 1 --2- 172.21.15.77:0/557357765 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efc00069b10 0x7efc000b3b50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efbe8009910 tx=0x7efbe8009c20 comp rx=0 tx=0).stop 2023-07-24T05:46:41.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.974+0000 7efc056ca700 1 -- 172.21.15.77:0/557357765 shutdown_connections 2023-07-24T05:46:41.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.974+0000 7efc056ca700 1 --2- 172.21.15.77:0/557357765 >> v2:172.21.15.77:3300/0 conn(0x7efc0006eea0 0x7efc000cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:41.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.974+0000 7efc056ca700 1 --2- 172.21.15.77:0/557357765 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efc00069b10 0x7efc000b3b50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:41.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.974+0000 7efc056ca700 1 -- 172.21.15.77:0/557357765 >> 172.21.15.77:0/557357765 conn(0x7efc000b17e0 msgr2=0x7efc000b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:41.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.974+0000 7efc056ca700 1 -- 172.21.15.77:0/557357765 shutdown_connections 2023-07-24T05:46:41.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.974+0000 7efc056ca700 1 -- 172.21.15.77:0/557357765 wait complete. 2023-07-24T05:46:41.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.978+0000 7efc056ca700 1 Processor -- start 2023-07-24T05:46:41.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.978+0000 7efc056ca700 1 -- start start 2023-07-24T05:46:41.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.982+0000 7efc056ca700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc00069b10 0x7efc0014a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:41.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.982+0000 7efc056ca700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efc0006eea0 0x7efc000c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:41.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.982+0000 7efc056ca700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc0015a880 0x7efc001f3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:41.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.982+0000 7efc056ca700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc000c7a80 con 0x7efc0015a880 2023-07-24T05:46:41.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.982+0000 7efc056ca700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc000c74c0 con 0x7efc00069b10 2023-07-24T05:46:41.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.982+0000 7efc056ca700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc000c77a0 con 0x7efc0006eea0 2023-07-24T05:46:41.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.982+0000 7efbfffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc0015a880 0x7efc001f3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:41.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.982+0000 7efbfffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc0015a880 0x7efc001f3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42750/0 (socket says 172.21.15.77:42750) 2023-07-24T05:46:41.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.982+0000 7efbfffff700 1 -- 172.21.15.77:0/1682117362 learned_addr learned my addr 172.21.15.77:0/1682117362 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:41.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.982+0000 7efbf67fc700 1 --2- 172.21.15.77:0/1682117362 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efc0006eea0 0x7efc000c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:41.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.982+0000 7efbfeffd700 1 --2- 172.21.15.77:0/1682117362 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc00069b10 0x7efc0014a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:41.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.982+0000 7efbfffff700 1 -- 172.21.15.77:0/1682117362 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efc0006eea0 msgr2=0x7efc000c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:41.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.982+0000 7efbfffff700 1 --2- 172.21.15.77:0/1682117362 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efc0006eea0 0x7efc000c6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:41.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.982+0000 7efbfffff700 1 -- 172.21.15.77:0/1682117362 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc00069b10 msgr2=0x7efc0014a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:41.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.982+0000 7efbfffff700 1 --2- 172.21.15.77:0/1682117362 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc00069b10 0x7efc0014a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:41.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.982+0000 7efbfffff700 1 -- 172.21.15.77:0/1682117362 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbe8009570 con 0x7efc0015a880 2023-07-24T05:46:41.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.982+0000 7efbf67fc700 1 --2- 172.21.15.77:0/1682117362 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efc0006eea0 0x7efc000c6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:46:41.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.982+0000 7efbfeffd700 1 --2- 172.21.15.77:0/1682117362 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc00069b10 0x7efc0014a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:46:41.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.982+0000 7efbfffff700 1 --2- 172.21.15.77:0/1682117362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc0015a880 0x7efc001f3fc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7efbf800efc0 tx=0x7efbf800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:41.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.982+0000 7efbf7fff700 1 -- 172.21.15.77:0/1682117362 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf800cd40 con 0x7efc0015a880 2023-07-24T05:46:41.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.982+0000 7efbf7fff700 1 -- 172.21.15.77:0/1682117362 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf800f040 con 0x7efc0015a880 2023-07-24T05:46:41.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.982+0000 7efbf7fff700 1 -- 172.21.15.77:0/1682117362 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf80146c0 con 0x7efc0015a880 2023-07-24T05:46:41.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.982+0000 7efc056ca700 1 -- 172.21.15.77:0/1682117362 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc001f37c0 con 0x7efc0015a880 2023-07-24T05:46:41.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.982+0000 7efc056ca700 1 -- 172.21.15.77:0/1682117362 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc001f4500 con 0x7efc0015a880 2023-07-24T05:46:41.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.986+0000 7efc056ca700 1 -- 172.21.15.77:0/1682117362 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc0004df10 con 0x7efc0015a880 2023-07-24T05:46:41.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.986+0000 7efbf7fff700 1 -- 172.21.15.77:0/1682117362 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efbf8014820 con 0x7efc0015a880 2023-07-24T05:46:41.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.986+0000 7efbf7fff700 1 --2- 172.21.15.77:0/1682117362 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7efbe40662f0 0x7efbe40687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:41.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.986+0000 7efbf7fff700 1 -- 172.21.15.77:0/1682117362 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7efbf8084ce0 con 0x7efc0015a880 2023-07-24T05:46:41.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.990+0000 7efbfeffd700 1 --2- 172.21.15.77:0/1682117362 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7efbe40662f0 0x7efbe40687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:41.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.990+0000 7efbfeffd700 1 --2- 172.21.15.77:0/1682117362 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7efbe40662f0 0x7efbe40687b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efbf0000f60 tx=0x7efbf0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:41.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:41.994+0000 7efbf7fff700 1 -- 172.21.15.77:0/1682117362 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efbf8051e60 con 0x7efc0015a880 2023-07-24T05:46:42.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.166+0000 7efc056ca700 1 -- 172.21.15.77:0/1682117362 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc000cc550 con 0x7efc0015a880 2023-07-24T05:46:42.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.166+0000 7efbf7fff700 1 -- 172.21.15.77:0/1682117362 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+20108 (secure 0 0 0) 0x7efbf8018090 con 0x7efc0015a880 2023-07-24T05:46:42.173 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:46:42.174 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":25,"fsid":"5aed5f7b-fb55-4d95-9c02-c6adbb1677b4","created":"2023-07-24T05:45:39.639731+0000","modified":"2023-07-24T05:46:05.445306+0000","last_up_change":"2023-07-24T05:45:52.319670+0000","last_in_change":"2023-07-24T05:45:43.643277+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-24T05:45:52.610430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-24T05:45:52.773787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-24T05:45:58.121732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-24T05:45:59.368726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-24T05:46:03.032057+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ffa0d496-461a-4053-b764-0627d969521b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6812","nonce":825987196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6817","nonce":825987196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6831","nonce":825987196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6824","nonce":825987196}]},"public_addr":"172.21.15.77:6812/825987196","cluster_addr":"172.21.15.77:6817/825987196","heartbeat_back_addr":"172.21.15.77:6831/825987196","heartbeat_front_addr":"172.21.15.77:6824/825987196","state":["exists","up"]},{"osd":1,"uuid":"9f595e5e-5c43-49bc-8ce4-ee70575c90da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6801","nonce":4133026815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6803","nonce":4133026815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6807","nonce":4133026815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6805","nonce":4133026815}]},"public_addr":"172.21.15.77:6801/4133026815","cluster_addr":"172.21.15.77:6803/4133026815","heartbeat_back_addr":"172.21.15.77:6807/4133026815","heartbeat_front_addr":"172.21.15.77:6805/4133026815","state":["exists","up"]},{"osd":2,"uuid":"2ac177aa-4d7d-4262-bd54-d2b9f29f4c3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6811","nonce":2394142159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6819","nonce":2394142159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6830","nonce":2394142159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6825","nonce":2394142159}]},"public_addr":"172.21.15.77:6811/2394142159","cluster_addr":"172.21.15.77:6819/2394142159","heartbeat_back_addr":"172.21.15.77:6830/2394142159","heartbeat_front_addr":"172.21.15.77:6825/2394142159","state":["exists","up"]},{"osd":3,"uuid":"17d7a251-19e8-484c-8172-a578ab3da153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6813","nonce":1492113982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6818","nonce":1492113982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6829","nonce":1492113982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6823","nonce":1492113982}]},"public_addr":"172.21.15.77:6813/1492113982","cluster_addr":"172.21.15.77:6818/1492113982","heartbeat_back_addr":"172.21.15.77:6829/1492113982","heartbeat_front_addr":"172.21.15.77:6823/1492113982","state":["exists","up"]},{"osd":4,"uuid":"bf63ca05-f06d-4e0f-ac44-2a416c70b919","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6825","nonce":1080481057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6827","nonce":1080481057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6831","nonce":1080481057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6829","nonce":1080481057}]},"public_addr":"172.21.15.103:6825/1080481057","cluster_addr":"172.21.15.103:6827/1080481057","heartbeat_back_addr":"172.21.15.103:6831/1080481057","heartbeat_front_addr":"172.21.15.103:6829/1080481057","state":["exists","up"]},{"osd":5,"uuid":"65a11a35-9e9f-4b3c-9fe3-b658d62b9318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6811","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6813","nonce":2756677504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6818","nonce":2756677504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6823","nonce":2756677504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6821","nonce":2756677504}]},"public_addr":"172.21.15.103:6813/2756677504","cluster_addr":"172.21.15.103:6818/2756677504","heartbeat_back_addr":"172.21.15.103:6823/2756677504","heartbeat_front_addr":"172.21.15.103:6821/2756677504","state":["exists","up"]},{"osd":6,"uuid":"750c1f87-686c-40b4-94a1-1a299dc78f3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6809","nonce":568977764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6812","nonce":568977764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6819","nonce":568977764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6815","nonce":568977764}]},"public_addr":"172.21.15.103:6809/568977764","cluster_addr":"172.21.15.103:6812/568977764","heartbeat_back_addr":"172.21.15.103:6819/568977764","heartbeat_front_addr":"172.21.15.103:6815/568977764","state":["exists","up"]},{"osd":7,"uuid":"d5fe4fb6-2e09-4158-885b-403803c85822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6801","nonce":1074557176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6803","nonce":1074557176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6807","nonce":1074557176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6805","nonce":1074557176}]},"public_addr":"172.21.15.103:6801/1074557176","cluster_addr":"172.21.15.103:6803/1074557176","heartbeat_back_addr":"172.21.15.103:6807/1074557176","heartbeat_front_addr":"172.21.15.103:6805/1074557176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.631032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.154109+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.398587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.679089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.311218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.353726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.314372+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.126212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-24T05:46:42.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.170+0000 7efc056ca700 1 -- 172.21.15.77:0/1682117362 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7efbe40662f0 msgr2=0x7efbe40687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:42.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.170+0000 7efc056ca700 1 --2- 172.21.15.77:0/1682117362 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7efbe40662f0 0x7efbe40687b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7efbf0000f60 tx=0x7efbf0009040 comp rx=0 tx=0).stop 2023-07-24T05:46:42.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.174+0000 7efc056ca700 1 -- 172.21.15.77:0/1682117362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc0015a880 msgr2=0x7efc001f3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:42.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.174+0000 7efc056ca700 1 --2- 172.21.15.77:0/1682117362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc0015a880 0x7efc001f3fc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7efbf800efc0 tx=0x7efbf800c3a0 comp rx=0 tx=0).stop 2023-07-24T05:46:42.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.174+0000 7efc056ca700 1 -- 172.21.15.77:0/1682117362 shutdown_connections 2023-07-24T05:46:42.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.174+0000 7efc056ca700 1 --2- 172.21.15.77:0/1682117362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc0015a880 0x7efc001f3fc0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:42.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.174+0000 7efc056ca700 1 --2- 172.21.15.77:0/1682117362 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7efbe40662f0 0x7efbe40687b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:42.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.174+0000 7efc056ca700 1 --2- 172.21.15.77:0/1682117362 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efc0006eea0 0x7efc000c6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:42.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.174+0000 7efc056ca700 1 --2- 172.21.15.77:0/1682117362 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc00069b10 0x7efc0014a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:42.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.174+0000 7efc056ca700 1 -- 172.21.15.77:0/1682117362 >> 172.21.15.77:0/1682117362 conn(0x7efc000b17e0 msgr2=0x7efc000b1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:42.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.174+0000 7efc056ca700 1 -- 172.21.15.77:0/1682117362 shutdown_connections 2023-07-24T05:46:42.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.174+0000 7efc056ca700 1 -- 172.21.15.77:0/1682117362 wait complete. 2023-07-24T05:46:42.202 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-24T05:46:42.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.370+0000 7f919e164700 1 Processor -- start 2023-07-24T05:46:42.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.370+0000 7f919e164700 1 -- start start 2023-07-24T05:46:42.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.370+0000 7f919e164700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9198160d20 0x7f91980adba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:42.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.370+0000 7f919e164700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f91980b17a0 0x7f91980af700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:42.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.370+0000 7f919e164700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91980af170 con 0x7f91980ae0e0 2023-07-24T05:46:42.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.370+0000 7f919e164700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91980ae5f0 con 0x7f9198160d20 2023-07-24T05:46:42.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.370+0000 7f919e164700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91980ae8d0 con 0x7f91980b17a0 2023-07-24T05:46:42.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.370+0000 7f919d162700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9198160d20 0x7f91980adba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:42.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.370+0000 7f919d963700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f91980b17a0 0x7f91980af700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:42.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.370+0000 7f919d162700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9198160d20 0x7f91980adba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42764/0 (socket says 172.21.15.77:42764) 2023-07-24T05:46:42.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.370+0000 7f919d162700 1 -- 172.21.15.77:0/3104625309 learned_addr learned my addr 172.21.15.77:0/3104625309 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:42.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.374+0000 7f919d162700 1 -- 172.21.15.77:0/3104625309 >> v2:172.21.15.103:3300/0 conn(0x7f91980b17a0 msgr2=0x7f91980af700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:42.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.374+0000 7f919d162700 1 --2- 172.21.15.77:0/3104625309 >> v2:172.21.15.103:3300/0 conn(0x7f91980b17a0 0x7f91980af700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:42.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.374+0000 7f919d162700 1 -- 172.21.15.77:0/3104625309 >> v1:172.21.15.103:6789/0 conn(0x7f91980ae0e0 legacy=0x7f91980b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:42.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.374+0000 7f919d162700 1 -- 172.21.15.77:0/3104625309 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91980aebb0 con 0x7f9198160d20 2023-07-24T05:46:42.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.374+0000 7f919d162700 1 --2- 172.21.15.77:0/3104625309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9198160d20 0x7f91980adba0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f919806b770 tx=0x7f9194009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee7c606a9564b62 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:42.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.374+0000 7f918ffff700 1 -- 172.21.15.77:0/3104625309 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9194011830 con 0x7f9198160d20 2023-07-24T05:46:42.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.374+0000 7f918ffff700 1 -- 172.21.15.77:0/3104625309 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9194011990 con 0x7f9198160d20 2023-07-24T05:46:42.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.374+0000 7f918ffff700 1 -- 172.21.15.77:0/3104625309 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9194011d20 con 0x7f9198160d20 2023-07-24T05:46:42.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.374+0000 7f919e164700 1 -- 172.21.15.77:0/3104625309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9198160d20 msgr2=0x7f91980adba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:42.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.374+0000 7f919e164700 1 --2- 172.21.15.77:0/3104625309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9198160d20 0x7f91980adba0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f919806b770 tx=0x7f9194009bf0 comp rx=0 tx=0).stop 2023-07-24T05:46:42.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.374+0000 7f919e164700 1 -- 172.21.15.77:0/3104625309 shutdown_connections 2023-07-24T05:46:42.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.374+0000 7f919e164700 1 --2- 172.21.15.77:0/3104625309 >> v2:172.21.15.103:3300/0 conn(0x7f91980b17a0 0x7f91980af700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:42.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.374+0000 7f919e164700 1 --2- 172.21.15.77:0/3104625309 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9198160d20 0x7f91980adba0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:42.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.374+0000 7f919e164700 1 -- 172.21.15.77:0/3104625309 >> 172.21.15.77:0/3104625309 conn(0x7f91980cacc0 msgr2=0x7f91980cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:42.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.374+0000 7f919e164700 1 -- 172.21.15.77:0/3104625309 shutdown_connections 2023-07-24T05:46:42.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.374+0000 7f919e164700 1 -- 172.21.15.77:0/3104625309 wait complete. 2023-07-24T05:46:42.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.378+0000 7f919e164700 1 Processor -- start 2023-07-24T05:46:42.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.378+0000 7f919e164700 1 -- start start 2023-07-24T05:46:42.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.382+0000 7f919e164700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f91980ae0e0 0x7f919809a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:42.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.382+0000 7f919e164700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91980b17a0 0x7f9198099630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:42.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.382+0000 7f919e164700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9198160110 0x7f9198163790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:42.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.382+0000 7f919e164700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919809af60 con 0x7f91980b17a0 2023-07-24T05:46:42.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.382+0000 7f919e164700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91981f6400 con 0x7f9198160110 2023-07-24T05:46:42.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.382+0000 7f919e164700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9198099b70 con 0x7f91980ae0e0 2023-07-24T05:46:42.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.382+0000 7f919c961700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91980b17a0 0x7f9198099630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:42.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.382+0000 7f919c961700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91980b17a0 0x7f9198099630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42778/0 (socket says 172.21.15.77:42778) 2023-07-24T05:46:42.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.382+0000 7f919c961700 1 -- 172.21.15.77:0/3366652559 learned_addr learned my addr 172.21.15.77:0/3366652559 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:42.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.382+0000 7f919d963700 1 --2- 172.21.15.77:0/3366652559 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9198160110 0x7f9198163790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:42.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.382+0000 7f919d162700 1 --2- 172.21.15.77:0/3366652559 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f91980ae0e0 0x7f919809a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:42.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.382+0000 7f919c961700 1 -- 172.21.15.77:0/3366652559 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f91980ae0e0 msgr2=0x7f919809a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:42.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.382+0000 7f919c961700 1 --2- 172.21.15.77:0/3366652559 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f91980ae0e0 0x7f919809a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:42.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.382+0000 7f919c961700 1 -- 172.21.15.77:0/3366652559 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9198160110 msgr2=0x7f9198163790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:42.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.382+0000 7f919c961700 1 --2- 172.21.15.77:0/3366652559 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9198160110 0x7f9198163790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:42.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.382+0000 7f919c961700 1 -- 172.21.15.77:0/3366652559 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9194009570 con 0x7f91980b17a0 2023-07-24T05:46:42.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.382+0000 7f919c961700 1 --2- 172.21.15.77:0/3366652559 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91980b17a0 0x7f9198099630 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f918800c500 tx=0x7f918800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:42.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.382+0000 7f918dffb700 1 -- 172.21.15.77:0/3366652559 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91880052d0 con 0x7f91980b17a0 2023-07-24T05:46:42.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.382+0000 7f918dffb700 1 -- 172.21.15.77:0/3366652559 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9188005430 con 0x7f91980b17a0 2023-07-24T05:46:42.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.382+0000 7f919e164700 1 -- 172.21.15.77:0/3366652559 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f919809a9a0 con 0x7f91980b17a0 2023-07-24T05:46:42.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.382+0000 7f918dffb700 1 -- 172.21.15.77:0/3366652559 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91880055a0 con 0x7f91980b17a0 2023-07-24T05:46:42.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.382+0000 7f919e164700 1 -- 172.21.15.77:0/3366652559 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91981612a0 con 0x7f91980b17a0 2023-07-24T05:46:42.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.382+0000 7f919e164700 1 -- 172.21.15.77:0/3366652559 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9198161100 con 0x7f91980b17a0 2023-07-24T05:46:42.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.386+0000 7f918dffb700 1 -- 172.21.15.77:0/3366652559 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f91880036a0 con 0x7f91980b17a0 2023-07-24T05:46:42.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.386+0000 7f918dffb700 1 --2- 172.21.15.77:0/3366652559 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f917c0662f0 0x7f917c0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:42.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.386+0000 7f918dffb700 1 -- 172.21.15.77:0/3366652559 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9188083150 con 0x7f91980b17a0 2023-07-24T05:46:42.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.386+0000 7f919d162700 1 --2- 172.21.15.77:0/3366652559 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f917c0662f0 0x7f917c0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:42.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.390+0000 7f919d162700 1 --2- 172.21.15.77:0/3366652559 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f917c0662f0 0x7f917c0687b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f919806f2b0 tx=0x7f9194008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:42.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.394+0000 7f918dffb700 1 -- 172.21.15.77:0/3366652559 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9198161100 con 0x7f91980b17a0 2023-07-24T05:46:42.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.606+0000 7f919e164700 1 -- 172.21.15.77:0/3366652559 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9198161100 con 0x7f91980b17a0 2023-07-24T05:46:42.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.606+0000 7f918dffb700 1 -- 172.21.15.77:0/3366652559 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f9198161100 con 0x7f91980b17a0 2023-07-24T05:46:42.611 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:46:42.611 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/4201639271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4201639271},{"type":"v1","addr":"172.21.15.77:6834","nonce":4201639271}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/993116623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":993116623},{"type":"v1","addr":"172.21.15.103:6835","nonce":993116623}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/1196529067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":1196529067},{"type":"v1","addr":"172.21.15.103:6837","nonce":1196529067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-24T05:46:00.395327+0000","modified":"2023-07-24T05:46:27.438873+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6835/2428690206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2428690206},{"type":"v1","addr":"172.21.15.77:6835","nonce":2428690206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-24T05:46:42.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.610+0000 7f919e164700 1 -- 172.21.15.77:0/3366652559 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f917c0662f0 msgr2=0x7f917c0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:42.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.610+0000 7f919e164700 1 --2- 172.21.15.77:0/3366652559 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f917c0662f0 0x7f917c0687b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f919806f2b0 tx=0x7f9194008030 comp rx=0 tx=0).stop 2023-07-24T05:46:42.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.610+0000 7f919e164700 1 -- 172.21.15.77:0/3366652559 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91980b17a0 msgr2=0x7f9198099630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:42.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.610+0000 7f919e164700 1 --2- 172.21.15.77:0/3366652559 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91980b17a0 0x7f9198099630 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f918800c500 tx=0x7f918800c810 comp rx=0 tx=0).stop 2023-07-24T05:46:42.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.610+0000 7f919e164700 1 -- 172.21.15.77:0/3366652559 shutdown_connections 2023-07-24T05:46:42.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.610+0000 7f919e164700 1 --2- 172.21.15.77:0/3366652559 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9198160110 0x7f9198163790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:42.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.610+0000 7f919e164700 1 --2- 172.21.15.77:0/3366652559 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91980b17a0 0x7f9198099630 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:42.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.610+0000 7f919e164700 1 --2- 172.21.15.77:0/3366652559 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f917c0662f0 0x7f917c0687b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:42.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.610+0000 7f919e164700 1 --2- 172.21.15.77:0/3366652559 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f91980ae0e0 0x7f919809a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:42.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.610+0000 7f919e164700 1 -- 172.21.15.77:0/3366652559 >> 172.21.15.77:0/3366652559 conn(0x7f91980cacc0 msgr2=0x7f91980cbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:42.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.610+0000 7f919e164700 1 -- 172.21.15.77:0/3366652559 shutdown_connections 2023-07-24T05:46:42.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:42.610+0000 7f919e164700 1 -- 172.21.15.77:0/3366652559 wait complete. 2023-07-24T05:46:42.616 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 9 2023-07-24T05:46:43.035 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-24T05:46:00.395327+0000', 'modified': '2023-07-24T05:46:27.438873+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4284}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4284': {'gid': 4284, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.77:6835/2428690206', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.77:6833', 'nonce': 2428690206}, {'type': 'v1', 'addr': '172.21.15.77:6835', 'nonce': 2428690206}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-24T05:46:43.036 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-24T05:46:43.036 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-24T05:46:43.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.210+0000 7fe82c915700 1 Processor -- start 2023-07-24T05:46:43.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.210+0000 7fe82c915700 1 -- start start 2023-07-24T05:46:43.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.210+0000 7fe82c915700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8280b13c0 0x7fe82806adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:43.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.210+0000 7fe82c915700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe828069b10 0x7fe828069fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:43.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.210+0000 7fe82c915700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8280702f0 con 0x7fe8280a4580 2023-07-24T05:46:43.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.210+0000 7fe82c915700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe82806a4e0 con 0x7fe828069b10 2023-07-24T05:46:43.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.210+0000 7fe82c915700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8280adc40 con 0x7fe8280b13c0 2023-07-24T05:46:43.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.214+0000 7fe827fff700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe828069b10 0x7fe828069fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:43.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.214+0000 7fe826ffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe8280a4580 0x7fe82806fbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.77:43738/0 (socket says 172.21.15.77:43738) 2023-07-24T05:46:43.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.214+0000 7fe826ffd700 1 -- 172.21.15.77:0/1677884827 learned_addr learned my addr 172.21.15.77:0/1677884827 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:43.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.214+0000 7fe8277fe700 1 --2- 172.21.15.77:0/1677884827 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8280b13c0 0x7fe82806adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:43.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.214+0000 7fe8267fc700 1 -- 172.21.15.77:0/1677884827 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1518526546 0 0) 0x7fe8280702f0 con 0x7fe8280a4580 2023-07-24T05:46:43.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.214+0000 7fe8267fc700 1 -- 172.21.15.77:0/1677884827 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8100035d0 con 0x7fe8280a4580 2023-07-24T05:46:43.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.214+0000 7fe827fff700 1 -- 172.21.15.77:0/1677884827 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8280b13c0 msgr2=0x7fe82806adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:43.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.214+0000 7fe827fff700 1 --2- 172.21.15.77:0/1677884827 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8280b13c0 0x7fe82806adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:43.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.214+0000 7fe827fff700 1 -- 172.21.15.77:0/1677884827 >> v1:172.21.15.103:6789/0 conn(0x7fe8280a4580 legacy=0x7fe82806fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:43.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.214+0000 7fe827fff700 1 -- 172.21.15.77:0/1677884827 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe82806b330 con 0x7fe828069b10 2023-07-24T05:46:43.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.214+0000 7fe827fff700 1 --2- 172.21.15.77:0/1677884827 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe828069b10 0x7fe828069fa0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe820009d90 tx=0x7fe82000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e4f3548cb2a22d8 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:43.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.214+0000 7fe8267fc700 1 -- 172.21.15.77:0/1677884827 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82000e070 con 0x7fe828069b10 2023-07-24T05:46:43.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.214+0000 7fe8267fc700 1 -- 172.21.15.77:0/1677884827 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82000bb20 con 0x7fe828069b10 2023-07-24T05:46:43.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.214+0000 7fe8267fc700 1 -- 172.21.15.77:0/1677884827 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82000be90 con 0x7fe828069b10 2023-07-24T05:46:43.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.218+0000 7fe82c915700 1 -- 172.21.15.77:0/1677884827 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe828069b10 msgr2=0x7fe828069fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:43.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.218+0000 7fe82c915700 1 --2- 172.21.15.77:0/1677884827 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe828069b10 0x7fe828069fa0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe820009d90 tx=0x7fe82000b330 comp rx=0 tx=0).stop 2023-07-24T05:46:43.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.218+0000 7fe82c915700 1 -- 172.21.15.77:0/1677884827 shutdown_connections 2023-07-24T05:46:43.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.218+0000 7fe82c915700 1 --2- 172.21.15.77:0/1677884827 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe828069b10 0x7fe828069fa0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:43.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.218+0000 7fe82c915700 1 --2- 172.21.15.77:0/1677884827 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8280b13c0 0x7fe82806adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:43.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.218+0000 7fe82c915700 1 -- 172.21.15.77:0/1677884827 >> 172.21.15.77:0/1677884827 conn(0x7fe8280cacc0 msgr2=0x7fe8280cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:43.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.218+0000 7fe82c915700 1 -- 172.21.15.77:0/1677884827 shutdown_connections 2023-07-24T05:46:43.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.218+0000 7fe82c915700 1 -- 172.21.15.77:0/1677884827 wait complete. 2023-07-24T05:46:43.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.222+0000 7fe82c915700 1 Processor -- start 2023-07-24T05:46:43.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.222+0000 7fe82c915700 1 -- start start 2023-07-24T05:46:43.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.222+0000 7fe82c915700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe828069b10 0x7fe8281f6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:43.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.222+0000 7fe82c915700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8280a4580 0x7fe828156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:43.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.222+0000 7fe82c915700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8280b13c0 0x7fe82809ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:43.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.222+0000 7fe82c915700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8281f66d0 con 0x7fe8280b13c0 2023-07-24T05:46:43.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.222+0000 7fe82c915700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe828156fb0 con 0x7fe828069b10 2023-07-24T05:46:43.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.222+0000 7fe82c915700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe82809b6c0 con 0x7fe8280a4580 2023-07-24T05:46:43.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.222+0000 7fe827fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8280b13c0 0x7fe82809ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:43.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.222+0000 7fe827fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8280b13c0 0x7fe82809ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35970/0 (socket says 172.21.15.77:35970) 2023-07-24T05:46:43.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.222+0000 7fe827fff700 1 -- 172.21.15.77:0/1622293687 learned_addr learned my addr 172.21.15.77:0/1622293687 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:43.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.222+0000 7fe8277fe700 1 --2- 172.21.15.77:0/1622293687 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe828069b10 0x7fe8281f6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:43.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.222+0000 7fe826ffd700 1 --2- 172.21.15.77:0/1622293687 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8280a4580 0x7fe828156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:43.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.222+0000 7fe827fff700 1 -- 172.21.15.77:0/1622293687 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8280a4580 msgr2=0x7fe828156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:43.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.222+0000 7fe827fff700 1 --2- 172.21.15.77:0/1622293687 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8280a4580 0x7fe828156a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:43.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.222+0000 7fe827fff700 1 -- 172.21.15.77:0/1622293687 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe828069b10 msgr2=0x7fe8281f6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:43.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.222+0000 7fe827fff700 1 --2- 172.21.15.77:0/1622293687 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe828069b10 0x7fe8281f6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:43.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.222+0000 7fe827fff700 1 -- 172.21.15.77:0/1622293687 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe820009a70 con 0x7fe8280b13c0 2023-07-24T05:46:43.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.226+0000 7fe827fff700 1 --2- 172.21.15.77:0/1622293687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8280b13c0 0x7fe82809ae90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe82806e0c0 tx=0x7fe820004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:43.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.226+0000 7fe80ffff700 1 -- 172.21.15.77:0/1622293687 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe820004800 con 0x7fe8280b13c0 2023-07-24T05:46:43.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.226+0000 7fe80ffff700 1 -- 172.21.15.77:0/1622293687 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe820020070 con 0x7fe8280b13c0 2023-07-24T05:46:43.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.226+0000 7fe82c915700 1 -- 172.21.15.77:0/1622293687 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8281f6080 con 0x7fe8280b13c0 2023-07-24T05:46:43.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.226+0000 7fe80ffff700 1 -- 172.21.15.77:0/1622293687 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8200276c0 con 0x7fe8280b13c0 2023-07-24T05:46:43.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.226+0000 7fe82c915700 1 -- 172.21.15.77:0/1622293687 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe82809b3d0 con 0x7fe8280b13c0 2023-07-24T05:46:43.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.226+0000 7fe80ffff700 1 -- 172.21.15.77:0/1622293687 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe820012430 con 0x7fe8280b13c0 2023-07-24T05:46:43.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.230+0000 7fe80ffff700 1 --2- 172.21.15.77:0/1622293687 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe8140662f0 0x7fe8140687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:43.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.230+0000 7fe80ffff700 1 -- 172.21.15.77:0/1622293687 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe820022070 con 0x7fe8280b13c0 2023-07-24T05:46:43.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.230+0000 7fe8277fe700 1 --2- 172.21.15.77:0/1622293687 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe8140662f0 0x7fe8140687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:43.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.230+0000 7fe8277fe700 1 --2- 172.21.15.77:0/1622293687 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe8140662f0 0x7fe8140687b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe82806b300 tx=0x7fe818009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:43.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.234+0000 7fe830e0b740 1 Processor -- start 2023-07-24T05:46:43.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.234+0000 7fe830e0b740 1 -- start start 2023-07-24T05:46:43.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.234+0000 7fe830e0b740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2a42fd0 0x2a433b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:43.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.234+0000 7fe830e0b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2a18dd0 0x2a191b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:43.240 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.234+0000 7fe830e0b740 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x2a196f0 0x2a19ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:43.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.234+0000 7fe830e0b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x298aef0 con 0x2a18dd0 2023-07-24T05:46:43.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.234+0000 7fe830e0b740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x29885e0 con 0x2a42fd0 2023-07-24T05:46:43.241 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.234+0000 7fe830e0b740 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x2983ed0 con 0x2a196f0 2023-07-24T05:46:43.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.234+0000 7fe826ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2a18dd0 0x2a191b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:43.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.238+0000 7fe826ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2a18dd0 0x2a191b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35986/0 (socket says 172.21.15.77:35986) 2023-07-24T05:46:43.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.238+0000 7fe826ffd700 1 -- 172.21.15.77:0/3928046160 learned_addr learned my addr 172.21.15.77:0/3928046160 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:43.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.238+0000 7fe827fff700 1 --2- 172.21.15.77:0/3928046160 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x2a196f0 0x2a19ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:43.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.238+0000 7fe8277fe700 1 --2- 172.21.15.77:0/3928046160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2a42fd0 0x2a433b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:43.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.238+0000 7fe826ffd700 1 -- 172.21.15.77:0/3928046160 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x2a196f0 msgr2=0x2a19ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:43.242 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.238+0000 7fe826ffd700 1 --2- 172.21.15.77:0/3928046160 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x2a196f0 0x2a19ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:43.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.238+0000 7fe826ffd700 1 -- 172.21.15.77:0/3928046160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2a42fd0 msgr2=0x2a433b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:43.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.238+0000 7fe826ffd700 1 --2- 172.21.15.77:0/3928046160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2a42fd0 0x2a433b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:43.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.238+0000 7fe826ffd700 1 -- 172.21.15.77:0/3928046160 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2935580 con 0x2a18dd0 2023-07-24T05:46:43.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.238+0000 7fe826ffd700 1 --2- 172.21.15.77:0/3928046160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2a18dd0 0x2a191b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe81c006df0 tx=0x7fe81c007320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73900f911f9d71b2 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:43.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.238+0000 7fe80d7fa700 1 -- 172.21.15.77:0/3928046160 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81c006e20 con 0x2a18dd0 2023-07-24T05:46:43.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.238+0000 7fe80d7fa700 1 -- 172.21.15.77:0/3928046160 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe81c0015a0 con 0x2a18dd0 2023-07-24T05:46:43.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.238+0000 7fe80d7fa700 1 -- 172.21.15.77:0/3928046160 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe81c001910 con 0x2a18dd0 2023-07-24T05:46:43.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.238+0000 7fe830e0b740 1 -- 172.21.15.77:0/3928046160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2a18dd0 msgr2=0x2a191b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:43.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.238+0000 7fe830e0b740 1 --2- 172.21.15.77:0/3928046160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2a18dd0 0x2a191b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe81c006df0 tx=0x7fe81c007320 comp rx=0 tx=0).stop 2023-07-24T05:46:43.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.238+0000 7fe830e0b740 1 -- 172.21.15.77:0/3928046160 shutdown_connections 2023-07-24T05:46:43.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.238+0000 7fe830e0b740 1 --2- 172.21.15.77:0/3928046160 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x2a196f0 0x2a19ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:43.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.238+0000 7fe830e0b740 1 --2- 172.21.15.77:0/3928046160 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2a18dd0 0x2a191b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:43.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.238+0000 7fe830e0b740 1 --2- 172.21.15.77:0/3928046160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2a42fd0 0x2a433b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:43.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.238+0000 7fe830e0b740 1 -- 172.21.15.77:0/3928046160 >> 172.21.15.77:0/3928046160 conn(0x27ab550 msgr2=0x2a1f210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:43.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.238+0000 7fe830e0b740 1 -- 172.21.15.77:0/3928046160 shutdown_connections 2023-07-24T05:46:43.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.238+0000 7fe830e0b740 1 -- 172.21.15.77:0/3928046160 wait complete. 2023-07-24T05:46:43.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.242+0000 7fe830e0b740 1 -- start start 2023-07-24T05:46:43.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.242+0000 7fe830e0b740 1 Processor -- start 2023-07-24T05:46:43.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.242+0000 7fe830e0b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2a18dd0 0x2a1ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:43.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.242+0000 7fe830e0b740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2a196f0 0x2a1e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:43.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.242+0000 7fe830e0b740 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x2a42fd0 0x2a62fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:43.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.242+0000 7fe830e0b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x2945b00 con 0x2a18dd0 2023-07-24T05:46:43.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.242+0000 7fe830e0b740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x2944470 con 0x2a196f0 2023-07-24T05:46:43.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.242+0000 7fe830e0b740 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x282fb20 con 0x2a42fd0 2023-07-24T05:46:43.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.242+0000 7fe830e0b740 10 client.0 _ll_register_callbacks cb 0x29d6bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-24T05:46:43.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.242+0000 7fe8277fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2a18dd0 0x2a1ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:43.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.242+0000 7fe8277fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2a18dd0 0x2a1ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35988/0 (socket says 172.21.15.77:35988) 2023-07-24T05:46:43.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.242+0000 7fe8277fe700 1 -- 172.21.15.77:0/2923388786 learned_addr learned my addr 172.21.15.77:0/2923388786 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:43.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.242+0000 7fe826ffd700 1 --2- 172.21.15.77:0/2923388786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2a196f0 0x2a1e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:43.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.242+0000 7fe827fff700 1 --2- 172.21.15.77:0/2923388786 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x2a42fd0 0x2a62fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:43.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.242+0000 7fe8277fe700 1 -- 172.21.15.77:0/2923388786 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x2a42fd0 msgr2=0x2a62fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:43.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.242+0000 7fe8277fe700 1 --2- 172.21.15.77:0/2923388786 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x2a42fd0 0x2a62fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:43.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.242+0000 7fe8277fe700 1 -- 172.21.15.77:0/2923388786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2a196f0 msgr2=0x2a1e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:43.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.242+0000 7fe8277fe700 1 --2- 172.21.15.77:0/2923388786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2a196f0 0x2a1e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:43.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.242+0000 7fe8277fe700 1 -- 172.21.15.77:0/2923388786 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8100035d0 con 0x2a18dd0 2023-07-24T05:46:43.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.242+0000 7fe826ffd700 1 --2- 172.21.15.77:0/2923388786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2a196f0 0x2a1e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:46:43.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.242+0000 7fe8277fe700 1 --2- 172.21.15.77:0/2923388786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2a18dd0 0x2a1ee10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe818014a50 tx=0x7fe818004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4bba73844d30669 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:43.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.242+0000 7fe8067fc700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-07-24T05:46:43.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.246+0000 7fe8067fc700 1 -- 172.21.15.77:0/2923388786 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8180119d0 con 0x2a18dd0 2023-07-24T05:46:43.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.246+0000 7fe8067fc700 1 -- 172.21.15.77:0/2923388786 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe81801c040 con 0x2a18dd0 2023-07-24T05:46:43.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.246+0000 7fe830e0b740 1 -- 172.21.15.77:0/2923388786 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x297bbe0 con 0x2a18dd0 2023-07-24T05:46:43.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.246+0000 7fe8067fc700 1 -- 172.21.15.77:0/2923388786 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe818014e10 con 0x2a18dd0 2023-07-24T05:46:43.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.246+0000 7fe830e0b740 10 client.4935 fetch_fsmap learned FSMap version 9 2023-07-24T05:46:43.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.246+0000 7fe830e0b740 1 -- 172.21.15.77:0/2923388786 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x27f69e0 con 0x2a18dd0 2023-07-24T05:46:43.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.246+0000 7fe8067fc700 1 -- 172.21.15.77:0/2923388786 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x297bbe0 con 0x2a18dd0 2023-07-24T05:46:43.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.246+0000 7fe8067fc700 1 -- 172.21.15.77:0/2923388786 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fe818013a40 con 0x2a18dd0 2023-07-24T05:46:43.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.246+0000 7fe830e0b740 10 client.4935 fetch_fsmap finished waiting for FSMap version 9 2023-07-24T05:46:43.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.246+0000 7fe830e0b740 10 client.4935 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-24T05:46:43.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.246+0000 7fe830e0b740 20 client.4935 populate_metadata read hostname 'smithi077' 2023-07-24T05:46:43.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.246+0000 7fe830e0b740 1 --2- 172.21.15.77:0/2923388786 >> [v2:172.21.15.77:6833/2428690206,v1:172.21.15.77:6835/2428690206] conn(0x2a1cf30 0x2a1d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:43.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.246+0000 7fe830e0b740 4 client.4935 mds_command: new command op to 4284 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-24T05:46:43.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.246+0000 7fe830e0b740 1 -- 172.21.15.77:0/2923388786 --> [v2:172.21.15.77:6833/2428690206,v1:172.21.15.77:6835/2428690206] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x297ceb0 con 0x2a1cf30 2023-07-24T05:46:43.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.246+0000 7fe826ffd700 1 --2- 172.21.15.77:0/2923388786 >> [v2:172.21.15.77:6833/2428690206,v1:172.21.15.77:6835/2428690206] conn(0x2a1cf30 0x2a1d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:43.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.246+0000 7fe826ffd700 1 --2- 172.21.15.77:0/2923388786 >> [v2:172.21.15.77:6833/2428690206,v1:172.21.15.77:6835/2428690206] conn(0x2a1cf30 0x2a1d310 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9117447c58c7e1dc server_cookie=8eddfc4a64476b20 in_seq=0 out_seq=0 2023-07-24T05:46:43.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.246+0000 7fe8067fc700 10 client.4935 ms_handle_connect on v2:172.21.15.77:6833/2428690206 2023-07-24T05:46:43.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.246+0000 7fe8067fc700 1 -- 172.21.15.77:0/2923388786 <== mds.0 v2:172.21.15.77:6833/2428690206 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x297ceb0 con 0x2a1cf30 2023-07-24T05:46:43.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.246+0000 7fe8067fc700 10 client.4935 handle_command_reply: tid=0 2023-07-24T05:46:43.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.250+0000 7fe830e0b740 1 client.4935 shutdown 2023-07-24T05:46:43.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.250+0000 7fe830e0b740 1 -- 172.21.15.77:0/2923388786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2a18dd0 msgr2=0x2a1ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:43.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.250+0000 7fe830e0b740 1 --2- 172.21.15.77:0/2923388786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2a18dd0 0x2a1ee10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe818014a50 tx=0x7fe818004770 comp rx=0 tx=0).stop 2023-07-24T05:46:43.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.250+0000 7fe830e0b740 1 -- 172.21.15.77:0/2923388786 shutdown_connections 2023-07-24T05:46:43.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.250+0000 7fe830e0b740 1 --2- 172.21.15.77:0/2923388786 >> [v2:172.21.15.77:6833/2428690206,v1:172.21.15.77:6835/2428690206] conn(0x2a1cf30 0x2a1d310 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:43.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.250+0000 7fe830e0b740 1 --2- 172.21.15.77:0/2923388786 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x2a42fd0 0x2a62fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:43.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.250+0000 7fe830e0b740 1 --2- 172.21.15.77:0/2923388786 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2a196f0 0x2a1e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:43.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.250+0000 7fe830e0b740 1 --2- 172.21.15.77:0/2923388786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2a18dd0 0x2a1ee10 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:43.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.250+0000 7fe8067fc700 0 client.4935 ms_handle_reset on v2:172.21.15.77:6833/2428690206 2023-07-24T05:46:43.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.250+0000 7fe830e0b740 1 -- 172.21.15.77:0/2923388786 >> 172.21.15.77:0/2923388786 conn(0x27ab550 msgr2=0x2a19ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:43.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.250+0000 7fe830e0b740 1 -- 172.21.15.77:0/2923388786 shutdown_connections 2023-07-24T05:46:43.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.250+0000 7fe830e0b740 1 -- 172.21.15.77:0/2923388786 wait complete. 2023-07-24T05:46:43.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.250+0000 7fe830e0b740 20 client.4935 trim_cache size 0 max 16384 2023-07-24T05:46:43.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.270+0000 7fe830e0b740 1 Processor -- start 2023-07-24T05:46:43.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.270+0000 7fe830e0b740 1 -- start start 2023-07-24T05:46:43.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.270+0000 7fe830e0b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2a18dd0 0x2a1bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:43.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.270+0000 7fe830e0b740 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x2a196f0 0x2a61a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:43.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.270+0000 7fe830e0b740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2a42fd0 0x2a61f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:43.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.270+0000 7fe830e0b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x2929330 con 0x2a18dd0 2023-07-24T05:46:43.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.270+0000 7fe830e0b740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x297f840 con 0x2a42fd0 2023-07-24T05:46:43.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.270+0000 7fe830e0b740 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x2987ed0 con 0x2a196f0 2023-07-24T05:46:43.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.270+0000 7fe8277fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2a18dd0 0x2a1bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:43.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.270+0000 7fe8277fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2a18dd0 0x2a1bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36000/0 (socket says 172.21.15.77:36000) 2023-07-24T05:46:43.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.270+0000 7fe8277fe700 1 -- 172.21.15.77:0/3225594450 learned_addr learned my addr 172.21.15.77:0/3225594450 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:43.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.270+0000 7fe826ffd700 1 --2- 172.21.15.77:0/3225594450 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x2a196f0 0x2a61a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:43.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.270+0000 7fe827fff700 1 --2- 172.21.15.77:0/3225594450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2a42fd0 0x2a61f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:43.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.270+0000 7fe8277fe700 1 -- 172.21.15.77:0/3225594450 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x2a196f0 msgr2=0x2a61a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:43.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.270+0000 7fe8277fe700 1 --2- 172.21.15.77:0/3225594450 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x2a196f0 0x2a61a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:43.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.270+0000 7fe8277fe700 1 -- 172.21.15.77:0/3225594450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2a42fd0 msgr2=0x2a61f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:43.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.270+0000 7fe8277fe700 1 --2- 172.21.15.77:0/3225594450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2a42fd0 0x2a61f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:43.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.270+0000 7fe8277fe700 1 -- 172.21.15.77:0/3225594450 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8280cda30 con 0x2a18dd0 2023-07-24T05:46:43.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.270+0000 7fe826ffd700 1 --2- 172.21.15.77:0/3225594450 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x2a196f0 0x2a61a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:46:43.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.270+0000 7fe827fff700 1 --2- 172.21.15.77:0/3225594450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2a42fd0 0x2a61f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:46:43.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.274+0000 7fe8277fe700 1 --2- 172.21.15.77:0/3225594450 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2a18dd0 0x2a1bdc0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe818007010 tx=0x7fe81801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b001e689d988039f server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:43.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.274+0000 7fe80dffb700 1 -- 172.21.15.77:0/3225594450 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe818014e10 con 0x2a18dd0 2023-07-24T05:46:43.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.274+0000 7fe80dffb700 1 -- 172.21.15.77:0/3225594450 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe818013a40 con 0x2a18dd0 2023-07-24T05:46:43.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.274+0000 7fe80dffb700 1 -- 172.21.15.77:0/3225594450 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe818011840 con 0x2a18dd0 2023-07-24T05:46:43.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.274+0000 7fe830e0b740 1 -- 172.21.15.77:0/3225594450 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2a18dd0 msgr2=0x2a1bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:43.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.274+0000 7fe830e0b740 1 --2- 172.21.15.77:0/3225594450 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2a18dd0 0x2a1bdc0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe818007010 tx=0x7fe81801b000 comp rx=0 tx=0).stop 2023-07-24T05:46:43.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.274+0000 7fe830e0b740 1 -- 172.21.15.77:0/3225594450 shutdown_connections 2023-07-24T05:46:43.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.274+0000 7fe830e0b740 1 --2- 172.21.15.77:0/3225594450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2a42fd0 0x2a61f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:43.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.274+0000 7fe830e0b740 1 --2- 172.21.15.77:0/3225594450 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x2a196f0 0x2a61a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:43.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.274+0000 7fe830e0b740 1 --2- 172.21.15.77:0/3225594450 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2a18dd0 0x2a1bdc0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:43.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.274+0000 7fe830e0b740 1 -- 172.21.15.77:0/3225594450 >> 172.21.15.77:0/3225594450 conn(0x27ab550 msgr2=0x2a1d310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:43.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.274+0000 7fe830e0b740 1 -- 172.21.15.77:0/3225594450 shutdown_connections 2023-07-24T05:46:43.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.274+0000 7fe830e0b740 1 -- 172.21.15.77:0/3225594450 wait complete. 2023-07-24T05:46:43.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.278+0000 7fe830e0b740 1 -- start start 2023-07-24T05:46:43.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.278+0000 7fe830e0b740 1 Processor -- start 2023-07-24T05:46:43.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.278+0000 7fe830e0b740 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x2a18dd0 0x2aac4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:43.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.278+0000 7fe830e0b740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2a196f0 0x2a65990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:43.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.278+0000 7fe830e0b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2a42fd0 0x2a65ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:43.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.278+0000 7fe830e0b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a677a0 con 0x2a42fd0 2023-07-24T05:46:43.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.278+0000 7fe830e0b740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a5f620 con 0x2a196f0 2023-07-24T05:46:43.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.278+0000 7fe830e0b740 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x2aac9e0 con 0x2a18dd0 2023-07-24T05:46:43.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.278+0000 7fe830e0b740 10 client.0 _ll_register_callbacks cb 0x293b800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-24T05:46:43.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.278+0000 7fe827fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2a42fd0 0x2a65ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:43.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.278+0000 7fe827fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2a42fd0 0x2a65ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36006/0 (socket says 172.21.15.77:36006) 2023-07-24T05:46:43.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.278+0000 7fe827fff700 1 -- 172.21.15.77:0/325451901 learned_addr learned my addr 172.21.15.77:0/325451901 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:43.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.278+0000 7fe8277fe700 1 --2- 172.21.15.77:0/325451901 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x2a18dd0 0x2aac4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:43.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.278+0000 7fe826ffd700 1 --2- 172.21.15.77:0/325451901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2a196f0 0x2a65990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:43.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.278+0000 7fe827fff700 1 -- 172.21.15.77:0/325451901 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x2a18dd0 msgr2=0x2aac4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:43.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.278+0000 7fe827fff700 1 --2- 172.21.15.77:0/325451901 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x2a18dd0 0x2aac4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:43.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.278+0000 7fe827fff700 1 -- 172.21.15.77:0/325451901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2a196f0 msgr2=0x2a65990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:43.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.278+0000 7fe827fff700 1 --2- 172.21.15.77:0/325451901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2a196f0 0x2a65990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:43.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.278+0000 7fe827fff700 1 -- 172.21.15.77:0/325451901 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x27f69e0 con 0x2a42fd0 2023-07-24T05:46:43.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.278+0000 7fe827fff700 1 --2- 172.21.15.77:0/325451901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2a42fd0 0x2a65ed0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe820056670 tx=0x7fe820056140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a26ebd8d9f04e735 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:43.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.278+0000 7fe8067fc700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-07-24T05:46:43.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.278+0000 7fe8067fc700 1 -- 172.21.15.77:0/325451901 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82005ecc0 con 0x2a42fd0 2023-07-24T05:46:43.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.278+0000 7fe8067fc700 1 -- 172.21.15.77:0/325451901 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe82005ab90 con 0x2a42fd0 2023-07-24T05:46:43.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.278+0000 7fe830e0b740 1 -- 172.21.15.77:0/325451901 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2a18ad0 con 0x2a42fd0 2023-07-24T05:46:43.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.282+0000 7fe8067fc700 1 -- 172.21.15.77:0/325451901 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe82005ad50 con 0x2a42fd0 2023-07-24T05:46:43.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.282+0000 7fe830e0b740 10 client.4941 fetch_fsmap learned FSMap version 9 2023-07-24T05:46:43.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.282+0000 7fe830e0b740 1 -- 172.21.15.77:0/325451901 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x2949250 con 0x2a42fd0 2023-07-24T05:46:43.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.282+0000 7fe8067fc700 1 -- 172.21.15.77:0/325451901 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2a18ad0 con 0x2a42fd0 2023-07-24T05:46:43.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.282+0000 7fe8067fc700 1 -- 172.21.15.77:0/325451901 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fe820052760 con 0x2a42fd0 2023-07-24T05:46:43.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.282+0000 7fe830e0b740 10 client.4941 fetch_fsmap finished waiting for FSMap version 9 2023-07-24T05:46:43.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.282+0000 7fe830e0b740 10 client.4941 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-24T05:46:43.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.282+0000 7fe830e0b740 20 client.4941 populate_metadata read hostname 'smithi077' 2023-07-24T05:46:43.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.282+0000 7fe830e0b740 1 --2- 172.21.15.77:0/325451901 >> [v2:172.21.15.77:6833/2428690206,v1:172.21.15.77:6835/2428690206] conn(0x2a66410 0x2a68460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:43.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.282+0000 7fe830e0b740 4 client.4941 mds_command: new command op to 4284 tid=0[{"prefix": "status"}] 2023-07-24T05:46:43.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.282+0000 7fe830e0b740 1 -- 172.21.15.77:0/325451901 --> [v2:172.21.15.77:6833/2428690206,v1:172.21.15.77:6835/2428690206] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7fe81c0015a0 con 0x2a66410 2023-07-24T05:46:43.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.282+0000 7fe8277fe700 1 --2- 172.21.15.77:0/325451901 >> [v2:172.21.15.77:6833/2428690206,v1:172.21.15.77:6835/2428690206] conn(0x2a66410 0x2a68460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:43.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.282+0000 7fe8277fe700 1 --2- 172.21.15.77:0/325451901 >> [v2:172.21.15.77:6833/2428690206,v1:172.21.15.77:6835/2428690206] conn(0x2a66410 0x2a68460 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d03d3abb86d47ab server_cookie=8764c5a0344456ac in_seq=0 out_seq=0 2023-07-24T05:46:43.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.282+0000 7fe8067fc700 10 client.4941 ms_handle_connect on v2:172.21.15.77:6833/2428690206 2023-07-24T05:46:43.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.282+0000 7fe8067fc700 1 -- 172.21.15.77:0/325451901 <== mds.0 v2:172.21.15.77:6833/2428690206 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x7fe81c0015a0 con 0x2a66410 2023-07-24T05:46:43.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.282+0000 7fe8067fc700 10 client.4941 handle_command_reply: tid=0 2023-07-24T05:46:43.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.282+0000 7fe830e0b740 1 client.4941 shutdown 2023-07-24T05:46:43.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.282+0000 7fe830e0b740 1 -- 172.21.15.77:0/325451901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2a42fd0 msgr2=0x2a65ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:43.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.282+0000 7fe830e0b740 1 --2- 172.21.15.77:0/325451901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2a42fd0 0x2a65ed0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe820056670 tx=0x7fe820056140 comp rx=0 tx=0).stop 2023-07-24T05:46:43.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.282+0000 7fe830e0b740 1 -- 172.21.15.77:0/325451901 shutdown_connections 2023-07-24T05:46:43.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.282+0000 7fe830e0b740 1 --2- 172.21.15.77:0/325451901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2a42fd0 0x2a65ed0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:43.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.282+0000 7fe830e0b740 1 --2- 172.21.15.77:0/325451901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2a196f0 0x2a65990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:43.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.282+0000 7fe830e0b740 1 --2- 172.21.15.77:0/325451901 >> [v2:172.21.15.77:6833/2428690206,v1:172.21.15.77:6835/2428690206] conn(0x2a66410 0x2a68460 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:43.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.282+0000 7fe830e0b740 1 --2- 172.21.15.77:0/325451901 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x2a18dd0 0x2aac4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:43.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.282+0000 7fe8067fc700 0 client.4941 ms_handle_reset on v2:172.21.15.77:6833/2428690206 2023-07-24T05:46:43.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.282+0000 7fe830e0b740 1 -- 172.21.15.77:0/325451901 >> 172.21.15.77:0/325451901 conn(0x27ab550 msgr2=0x2a1d310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:43.292 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.282+0000 7fe830e0b740 1 -- 172.21.15.77:0/325451901 shutdown_connections 2023-07-24T05:46:43.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.282+0000 7fe830e0b740 1 -- 172.21.15.77:0/325451901 wait complete. 2023-07-24T05:46:43.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.286+0000 7fe830e0b740 20 client.4941 trim_cache size 0 max 16384 2023-07-24T05:46:43.293 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-07-24T05:46:43.293 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "5aed5f7b-fb55-4d95-9c02-c6adbb1677b4", 2023-07-24T05:46:43.293 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 0, 2023-07-24T05:46:43.294 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 4284, 2023-07-24T05:46:43.294 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2023-07-24T05:46:43.294 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2023-07-24T05:46:43.294 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs", 2023-07-24T05:46:43.294 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 42.349699845000004, 2023-07-24T05:46:43.294 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 9, 2023-07-24T05:46:43.294 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 25, 2023-07-24T05:46:43.294 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 25, 2023-07-24T05:46:43.295 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 48.786345543000003 2023-07-24T05:46:43.295 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-07-24T05:46:43.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.286+0000 7fe82c915700 1 -- 172.21.15.77:0/1622293687 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe8140662f0 msgr2=0x7fe8140687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:43.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.286+0000 7fe82c915700 1 --2- 172.21.15.77:0/1622293687 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe8140662f0 0x7fe8140687b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe82806b300 tx=0x7fe818009240 comp rx=0 tx=0).stop 2023-07-24T05:46:43.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.286+0000 7fe82c915700 1 -- 172.21.15.77:0/1622293687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8280b13c0 msgr2=0x7fe82809ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:43.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.286+0000 7fe82c915700 1 --2- 172.21.15.77:0/1622293687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8280b13c0 0x7fe82809ae90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe82806e0c0 tx=0x7fe820004af0 comp rx=0 tx=0).stop 2023-07-24T05:46:43.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.286+0000 7fe82c915700 1 -- 172.21.15.77:0/1622293687 shutdown_connections 2023-07-24T05:46:43.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.286+0000 7fe82c915700 1 --2- 172.21.15.77:0/1622293687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe8280b13c0 0x7fe82809ae90 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:43.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.286+0000 7fe82c915700 1 --2- 172.21.15.77:0/1622293687 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe8140662f0 0x7fe8140687b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:43.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.286+0000 7fe82c915700 1 --2- 172.21.15.77:0/1622293687 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe8280a4580 0x7fe828156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:43.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.286+0000 7fe82c915700 1 --2- 172.21.15.77:0/1622293687 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe828069b10 0x7fe8281f6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:43.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.286+0000 7fe82c915700 1 -- 172.21.15.77:0/1622293687 >> 172.21.15.77:0/1622293687 conn(0x7fe8280cacc0 msgr2=0x7fe828159fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:43.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.286+0000 7fe82c915700 1 -- 172.21.15.77:0/1622293687 shutdown_connections 2023-07-24T05:46:43.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.286+0000 7fe82c915700 1 -- 172.21.15.77:0/1622293687 wait complete. 2023-07-24T05:46:43.312 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-07-24T05:46:43.322 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-07-24T05:46:43.323 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-07-24T05:46:43.323 INFO:tasks.ceph_fuse:client.0 config is {} 2023-07-24T05:46:43.323 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-24T05:46:43.323 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-24T05:46:43.324 INFO:tasks.ceph_fuse:client.2 config is {} 2023-07-24T05:46:43.324 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-24T05:46:43.324 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-07-24T05:46:43.324 INFO:tasks.ceph_fuse:client.1 config is {} 2023-07-24T05:46:43.325 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-24T05:46:43.325 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-24T05:46:43.325 INFO:tasks.ceph_fuse:client.3 config is {} 2023-07-24T05:46:43.325 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-24T05:46:43.325 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-07-24T05:46:43.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:43.326 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2023-07-24T05:46:43.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:43.344 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link delete ceph-brx 2023-07-24T05:46:43.427 INFO:teuthology.orchestra.run.smithi103.stderr:Cannot find device "ceph-brx" 2023-07-24T05:46:43.430 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-24T05:46:43.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:43.431 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2023-07-24T05:46:43.449 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-07-24T05:46:43.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:43.450 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-07-24T05:46:43.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:43.529 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link delete ceph-brx 2023-07-24T05:46:43.741 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-07-24T05:46:43.741 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-24T05:46:43.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.906+0000 7fb3ad42c700 1 Processor -- start 2023-07-24T05:46:43.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.906+0000 7fb3ad42c700 1 -- start start 2023-07-24T05:46:43.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.910+0000 7fb3ad42c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb3a80b2300 0x7fb3a80cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:43.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.910+0000 7fb3ad42c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb3a80b3900 0x7fb3a80b3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:43.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.910+0000 7fb3ad42c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3a806f030 con 0x7fb3a815cba0 2023-07-24T05:46:43.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.910+0000 7fb3ad42c700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3a815cf80 con 0x7fb3a80b3900 2023-07-24T05:46:43.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.910+0000 7fb3ad42c700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a80ce6d0 con 0x7fb3a80b2300 2023-07-24T05:46:43.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.910+0000 7fb3a7fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb3a80b3900 0x7fb3a80b3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:43.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.910+0000 7fb3a6ffd700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fb3a815cba0 0x7fb3a80cd8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.77:43746/0 (socket says 172.21.15.77:43746) 2023-07-24T05:46:43.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.910+0000 7fb3a6ffd700 1 -- 172.21.15.77:0/3455700300 learned_addr learned my addr 172.21.15.77:0/3455700300 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:43.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.910+0000 7fb39e7fc700 1 --2- 172.21.15.77:0/3455700300 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb3a80b2300 0x7fb3a80cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:43.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.910+0000 7fb3a7fff700 1 -- 172.21.15.77:0/3455700300 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb3a80b2300 msgr2=0x7fb3a80cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:43.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.910+0000 7fb3a7fff700 1 --2- 172.21.15.77:0/3455700300 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb3a80b2300 0x7fb3a80cdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:43.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.910+0000 7fb3a7fff700 1 -- 172.21.15.77:0/3455700300 >> v1:172.21.15.103:6789/0 conn(0x7fb3a815cba0 legacy=0x7fb3a80cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:43.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.910+0000 7fb3a7fff700 1 -- 172.21.15.77:0/3455700300 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a80ce9b0 con 0x7fb3a80b3900 2023-07-24T05:46:43.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.910+0000 7fb3a67fc700 1 -- 172.21.15.77:0/3455700300 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3641863810 0 0) 0x7fb3a806f030 con 0x7fb3a815cba0 2023-07-24T05:46:43.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.910+0000 7fb3a7fff700 1 --2- 172.21.15.77:0/3455700300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3a80b3900 0x7fb3a80b3d90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0009850 tx=0x7fb3a0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d37420360c105aff server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:43.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.914+0000 7fb3a67fc700 1 -- 172.21.15.77:0/3455700300 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a0011830 con 0x7fb3a80b3900 2023-07-24T05:46:43.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.914+0000 7fb3a67fc700 1 -- 172.21.15.77:0/3455700300 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3a0011990 con 0x7fb3a80b3900 2023-07-24T05:46:43.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.914+0000 7fb3a67fc700 1 -- 172.21.15.77:0/3455700300 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a0011d20 con 0x7fb3a80b3900 2023-07-24T05:46:43.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.914+0000 7fb3ad42c700 1 -- 172.21.15.77:0/3455700300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3a80b3900 msgr2=0x7fb3a80b3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:43.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.914+0000 7fb3ad42c700 1 --2- 172.21.15.77:0/3455700300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3a80b3900 0x7fb3a80b3d90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0009850 tx=0x7fb3a0009b60 comp rx=0 tx=0).stop 2023-07-24T05:46:43.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.914+0000 7fb3ad42c700 1 -- 172.21.15.77:0/3455700300 shutdown_connections 2023-07-24T05:46:43.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.914+0000 7fb3ad42c700 1 --2- 172.21.15.77:0/3455700300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3a80b3900 0x7fb3a80b3d90 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:43.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.914+0000 7fb3ad42c700 1 --2- 172.21.15.77:0/3455700300 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb3a80b2300 0x7fb3a80cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:43.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.914+0000 7fb3ad42c700 1 -- 172.21.15.77:0/3455700300 >> 172.21.15.77:0/3455700300 conn(0x7fb3a80b17e0 msgr2=0x7fb3a80b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:43.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.914+0000 7fb3ad42c700 1 -- 172.21.15.77:0/3455700300 shutdown_connections 2023-07-24T05:46:43.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.914+0000 7fb3ad42c700 1 -- 172.21.15.77:0/3455700300 wait complete. 2023-07-24T05:46:43.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.918+0000 7fb3ad42c700 1 Processor -- start 2023-07-24T05:46:43.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.918+0000 7fb3ad42c700 1 -- start start 2023-07-24T05:46:43.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.918+0000 7fb3ad42c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3a80b2300 0x7fb3a81522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:43.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.918+0000 7fb3ad42c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb3a80b3900 0x7fb3a80c3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:43.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.918+0000 7fb3ad42c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3a815cba0 0x7fb3a81f56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:43.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.918+0000 7fb3ad42c700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a806b5c0 con 0x7fb3a815cba0 2023-07-24T05:46:43.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.918+0000 7fb3ad42c700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a81f6170 con 0x7fb3a80b2300 2023-07-24T05:46:43.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.918+0000 7fb3ad42c700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a81f6450 con 0x7fb3a80b3900 2023-07-24T05:46:43.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.918+0000 7fb3a7fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3a815cba0 0x7fb3a81f56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:43.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.918+0000 7fb3a7fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3a815cba0 0x7fb3a81f56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36012/0 (socket says 172.21.15.77:36012) 2023-07-24T05:46:43.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.918+0000 7fb3a7fff700 1 -- 172.21.15.77:0/1196368917 learned_addr learned my addr 172.21.15.77:0/1196368917 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:43.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.918+0000 7fb3a6ffd700 1 --2- 172.21.15.77:0/1196368917 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3a80b2300 0x7fb3a81522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:43.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.918+0000 7fb39e7fc700 1 --2- 172.21.15.77:0/1196368917 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb3a80b3900 0x7fb3a80c3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:43.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.918+0000 7fb3a7fff700 1 -- 172.21.15.77:0/1196368917 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb3a80b3900 msgr2=0x7fb3a80c3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:43.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.918+0000 7fb3a7fff700 1 --2- 172.21.15.77:0/1196368917 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb3a80b3900 0x7fb3a80c3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:43.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.918+0000 7fb3a7fff700 1 -- 172.21.15.77:0/1196368917 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3a80b2300 msgr2=0x7fb3a81522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:43.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.918+0000 7fb3a7fff700 1 --2- 172.21.15.77:0/1196368917 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3a80b2300 0x7fb3a81522b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:43.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.918+0000 7fb3a7fff700 1 -- 172.21.15.77:0/1196368917 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a00094b0 con 0x7fb3a815cba0 2023-07-24T05:46:43.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.918+0000 7fb39e7fc700 1 --2- 172.21.15.77:0/1196368917 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb3a80b3900 0x7fb3a80c3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:46:43.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.922+0000 7fb3a7fff700 1 --2- 172.21.15.77:0/1196368917 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3a815cba0 0x7fb3a81f56d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0009fd0 tx=0x7fb3a0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:43.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.922+0000 7fb39ffff700 1 -- 172.21.15.77:0/1196368917 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a00045d0 con 0x7fb3a815cba0 2023-07-24T05:46:43.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.922+0000 7fb39ffff700 1 -- 172.21.15.77:0/1196368917 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3a001f070 con 0x7fb3a815cba0 2023-07-24T05:46:43.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.922+0000 7fb3ad42c700 1 -- 172.21.15.77:0/1196368917 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3a806b7f0 con 0x7fb3a815cba0 2023-07-24T05:46:43.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.922+0000 7fb39ffff700 1 -- 172.21.15.77:0/1196368917 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a00038e0 con 0x7fb3a815cba0 2023-07-24T05:46:43.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.922+0000 7fb3ad42c700 1 -- 172.21.15.77:0/1196368917 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3a80c3a40 con 0x7fb3a815cba0 2023-07-24T05:46:43.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.922+0000 7fb3ad42c700 1 -- 172.21.15.77:0/1196368917 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3a806bd10 con 0x7fb3a815cba0 2023-07-24T05:46:43.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.926+0000 7fb39ffff700 1 -- 172.21.15.77:0/1196368917 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb3a0003a40 con 0x7fb3a815cba0 2023-07-24T05:46:43.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.926+0000 7fb39ffff700 1 --2- 172.21.15.77:0/1196368917 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb3880662f0 0x7fb3880687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:43.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.926+0000 7fb39ffff700 1 -- 172.21.15.77:0/1196368917 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb3a0021070 con 0x7fb3a815cba0 2023-07-24T05:46:43.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.926+0000 7fb3a6ffd700 1 --2- 172.21.15.77:0/1196368917 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb3880662f0 0x7fb3880687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:43.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.930+0000 7fb3a6ffd700 1 --2- 172.21.15.77:0/1196368917 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb3880662f0 0x7fb3880687b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb398000f60 tx=0x7fb398007e00 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:43.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:43.930+0000 7fb39ffff700 1 -- 172.21.15.77:0/1196368917 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb3a806bd10 con 0x7fb3a815cba0 2023-07-24T05:46:44.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:44.138+0000 7fb3ad42c700 1 -- 172.21.15.77:0/1196368917 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb3a806bd10 con 0x7fb3a815cba0 2023-07-24T05:46:44.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:44.138+0000 7fb39ffff700 1 -- 172.21.15.77:0/1196368917 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fb3a806bd10 con 0x7fb3a815cba0 2023-07-24T05:46:44.144 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-24T05:46:44.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:44.142+0000 7fb3ad42c700 1 -- 172.21.15.77:0/1196368917 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb3880662f0 msgr2=0x7fb3880687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:44.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:44.142+0000 7fb3ad42c700 1 --2- 172.21.15.77:0/1196368917 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb3880662f0 0x7fb3880687b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb398000f60 tx=0x7fb398007e00 comp rx=0 tx=0).stop 2023-07-24T05:46:44.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:44.142+0000 7fb3ad42c700 1 -- 172.21.15.77:0/1196368917 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3a815cba0 msgr2=0x7fb3a81f56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:44.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:44.142+0000 7fb3ad42c700 1 --2- 172.21.15.77:0/1196368917 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3a815cba0 0x7fb3a81f56d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0009fd0 tx=0x7fb3a0004770 comp rx=0 tx=0).stop 2023-07-24T05:46:44.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:44.142+0000 7fb3ad42c700 1 -- 172.21.15.77:0/1196368917 shutdown_connections 2023-07-24T05:46:44.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:44.142+0000 7fb3ad42c700 1 --2- 172.21.15.77:0/1196368917 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3a815cba0 0x7fb3a81f56d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:44.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:44.142+0000 7fb3ad42c700 1 --2- 172.21.15.77:0/1196368917 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb3880662f0 0x7fb3880687b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:44.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:44.142+0000 7fb3ad42c700 1 --2- 172.21.15.77:0/1196368917 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb3a80b3900 0x7fb3a80c3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:44.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:44.142+0000 7fb3ad42c700 1 --2- 172.21.15.77:0/1196368917 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3a80b2300 0x7fb3a81522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:44.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:44.142+0000 7fb3ad42c700 1 -- 172.21.15.77:0/1196368917 >> 172.21.15.77:0/1196368917 conn(0x7fb3a80b17e0 msgr2=0x7fb3a80b1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:44.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:44.142+0000 7fb3ad42c700 1 -- 172.21.15.77:0/1196368917 shutdown_connections 2023-07-24T05:46:44.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:44.142+0000 7fb3ad42c700 1 -- 172.21.15.77:0/1196368917 wait complete. 2023-07-24T05:46:44.168 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-24T05:46:44.168 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-24T05:46:44.168 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi077.front.sepia.ceph.com 2023-07-24T05:46:44.169 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-24T05:46:44.169 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-24T05:46:44.169 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-24T05:46:44.169 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-24T05:46:44.169 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-24T05:46:44.170 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-24T05:46:44.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:44.170 DEBUG:teuthology.orchestra.run.smithi077:> ip addr 2023-07-24T05:46:44.186 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-24T05:46:44.186 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-24T05:46:44.186 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2023-07-24T05:46:44.186 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:46:44.186 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2023-07-24T05:46:44.186 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:46:44.186 INFO:teuthology.orchestra.run.smithi077.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-24T05:46:44.187 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d8 brd ff:ff:ff:ff:ff:ff 2023-07-24T05:46:44.187 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f0 2023-07-24T05:46:44.187 INFO:teuthology.orchestra.run.smithi077.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-24T05:46:44.187 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d9 brd ff:ff:ff:ff:ff:ff 2023-07-24T05:46:44.187 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f1 2023-07-24T05:46:44.187 INFO:teuthology.orchestra.run.smithi077.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-24T05:46:44.187 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d2 brd ff:ff:ff:ff:ff:ff 2023-07-24T05:46:44.188 INFO:teuthology.orchestra.run.smithi077.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-24T05:46:44.188 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d3 brd ff:ff:ff:ff:ff:ff 2023-07-24T05:46:44.188 INFO:teuthology.orchestra.run.smithi077.stdout: inet 172.21.15.77/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-24T05:46:44.188 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft 42365sec preferred_lft 42365sec 2023-07-24T05:46:44.188 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::ec4:7aff:fe8f:d3d3/64 scope link 2023-07-24T05:46:44.188 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:46:44.188 INFO:teuthology.orchestra.run.smithi077.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-24T05:46:44.188 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 02:42:ca:23:89:0f brd ff:ff:ff:ff:ff:ff 2023-07-24T05:46:44.189 INFO:teuthology.orchestra.run.smithi077.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-24T05:46:44.189 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:46:44.189 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-24T05:46:44.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:44.190 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-07-24T05:46:44.190 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-07-24T05:46:44.190 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link add name ceph-brx type bridge 2023-07-24T05:46:44.191 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip addr flush dev ceph-brx 2023-07-24T05:46:44.191 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set ceph-brx up 2023-07-24T05:46:44.191 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-24T05:46:44.191 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-07-24T05:46:44.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:44.353 DEBUG:teuthology.orchestra.run.smithi077:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-24T05:46:44.386 INFO:teuthology.orchestra.run.smithi077.stdout:1 2023-07-24T05:46:44.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:44.390 DEBUG:teuthology.orchestra.run.smithi077:> route 2023-07-24T05:46:44.452 INFO:teuthology.orchestra.run.smithi077.stdout:Kernel IP routing table 2023-07-24T05:46:44.452 INFO:teuthology.orchestra.run.smithi077.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-24T05:46:44.452 INFO:teuthology.orchestra.run.smithi077.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-24T05:46:44.452 INFO:teuthology.orchestra.run.smithi077.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-24T05:46:44.452 INFO:teuthology.orchestra.run.smithi077.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-24T05:46:44.453 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-07-24T05:46:44.453 INFO:teuthology.orchestra.run.smithi077.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-24T05:46:44.453 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-24T05:46:44.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:44.454 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-07-24T05:46:44.454 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-07-24T05:46:44.454 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-24T05:46:44.455 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-24T05:46:44.455 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-24T05:46:44.455 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-07-24T05:46:44.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:44.586 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2023-07-24T05:46:44.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:44.602 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list-id 2023-07-24T05:46:44.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:44.667 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-07-24T05:46:44.668 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-07-24T05:46:44.668 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-24T05:46:44.668 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-07-24T05:46:44.668 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-07-24T05:46:44.778 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-07-24T05:46:44.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:44.779 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-07-24T05:46:44.779 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-07-24T05:46:44.779 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-07-24T05:46:44.779 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-24T05:46:44.779 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-07-24T05:46:44.780 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-07-24T05:46:44.780 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-07-24T05:46:44.780 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-07-24T05:46:44.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:44.928 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-07-24T05:46:44.928 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-07-24T05:46:44.929 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set brx.0 up 2023-07-24T05:46:44.929 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set dev brx.0 master ceph-brx 2023-07-24T05:46:44.929 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-07-24T05:46:44.995 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-07-24T05:46:44.995 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-24T05:46:44.995 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-24T05:46:45.010 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-24T05:46:45.011 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-24T05:46:45.011 DEBUG:teuthology.orchestra.run.smithi077:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-24T05:46:45.070 DEBUG:teuthology.orchestra.run.smithi077:> sudo modprobe fuse 2023-07-24T05:46:45.150 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-24T05:46:45.150 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-24T05:46:45.226 INFO:teuthology.orchestra.run.smithi077.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-24T05:46:45.229 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-24T05:46:45.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:45.230 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-07-24T05:46:45.295 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-24T05:46:45.295 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-07-24T05:46:45.343 DEBUG:teuthology.orchestra.run.smithi077:> sudo modprobe fuse 2023-07-24T05:46:45.374 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-24T05:46:45.375 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-24T05:46:45.447 INFO:teuthology.orchestra.run.smithi077.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-24T05:46:45.450 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-24T05:46:45.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:45.451 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-07-24T05:46:45.479 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:2023-07-24T05:46:45.474+0000 7fd93f5df640 -1 init, newargv = 0x563f96b395e0 newargc=15 2023-07-24T05:46:45.479 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:ceph-fuse[42192]: starting ceph client 2023-07-24T05:46:45.491 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:ceph-fuse[42192]: starting fuse 2023-07-24T05:46:45.492 INFO:teuthology.orchestra.run.smithi077.stdout:49 2023-07-24T05:46:45.492 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-07-24T05:46:45.493 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-24T05:46:45.493 DEBUG:teuthology.orchestra.run.smithi077:> import glob 2023-07-24T05:46:45.493 DEBUG:teuthology.orchestra.run.smithi077:> import re 2023-07-24T05:46:45.494 DEBUG:teuthology.orchestra.run.smithi077:> import os 2023-07-24T05:46:45.494 DEBUG:teuthology.orchestra.run.smithi077:> import subprocess 2023-07-24T05:46:45.494 DEBUG:teuthology.orchestra.run.smithi077:> 2023-07-24T05:46:45.494 DEBUG:teuthology.orchestra.run.smithi077:> def _find_admin_socket(client_name): 2023-07-24T05:46:45.494 DEBUG:teuthology.orchestra.run.smithi077:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-07-24T05:46:45.495 DEBUG:teuthology.orchestra.run.smithi077:> files = glob.glob(asok_path) 2023-07-24T05:46:45.495 DEBUG:teuthology.orchestra.run.smithi077:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-07-24T05:46:45.495 DEBUG:teuthology.orchestra.run.smithi077:> 2023-07-24T05:46:45.495 DEBUG:teuthology.orchestra.run.smithi077:> # Given a non-glob path, it better be there 2023-07-24T05:46:45.496 DEBUG:teuthology.orchestra.run.smithi077:> if "*" not in asok_path: 2023-07-24T05:46:45.496 DEBUG:teuthology.orchestra.run.smithi077:> assert(len(files) == 1) 2023-07-24T05:46:45.496 DEBUG:teuthology.orchestra.run.smithi077:> return files[0] 2023-07-24T05:46:45.496 DEBUG:teuthology.orchestra.run.smithi077:> 2023-07-24T05:46:45.496 DEBUG:teuthology.orchestra.run.smithi077:> for f in files: 2023-07-24T05:46:45.497 DEBUG:teuthology.orchestra.run.smithi077:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-24T05:46:45.497 DEBUG:teuthology.orchestra.run.smithi077:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-24T05:46:45.497 DEBUG:teuthology.orchestra.run.smithi077:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-24T05:46:45.497 DEBUG:teuthology.orchestra.run.smithi077:> contents = proc_f.read() 2023-07-24T05:46:45.498 DEBUG:teuthology.orchestra.run.smithi077:> if mountpoint in contents: 2023-07-24T05:46:45.498 DEBUG:teuthology.orchestra.run.smithi077:> return f 2023-07-24T05:46:45.498 DEBUG:teuthology.orchestra.run.smithi077:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-24T05:46:45.498 DEBUG:teuthology.orchestra.run.smithi077:> 2023-07-24T05:46:45.498 DEBUG:teuthology.orchestra.run.smithi077:> print(_find_admin_socket("client.0")) 2023-07-24T05:46:45.499 DEBUG:teuthology.orchestra.run.smithi077:> ' 2023-07-24T05:46:45.656 INFO:teuthology.orchestra.run.smithi077.stdout:/var/run/ceph/ceph-client.0.42192.asok 2023-07-24T05:46:45.840 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.42192.asok 2023-07-24T05:46:45.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:45.840 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.42192.asok status 2023-07-24T05:46:46.032 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-07-24T05:46:46.032 INFO:teuthology.orchestra.run.smithi077.stdout: "metadata": { 2023-07-24T05:46:46.032 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_sha1": "e2c50893bf78471cc8ee960317cc10390300dfd5", 2023-07-24T05:46:46.032 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_version": "ceph version 18.0.0-5042-ge2c50893 (e2c50893bf78471cc8ee960317cc10390300dfd5) reef (dev)", 2023-07-24T05:46:46.032 INFO:teuthology.orchestra.run.smithi077.stdout: "entity_id": "0", 2023-07-24T05:46:46.033 INFO:teuthology.orchestra.run.smithi077.stdout: "hostname": "smithi077", 2023-07-24T05:46:46.033 INFO:teuthology.orchestra.run.smithi077.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-07-24T05:46:46.033 INFO:teuthology.orchestra.run.smithi077.stdout: "pid": "42192", 2023-07-24T05:46:46.033 INFO:teuthology.orchestra.run.smithi077.stdout: "root": "/" 2023-07-24T05:46:46.033 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-07-24T05:46:46.033 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_count": 0, 2023-07-24T05:46:46.033 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_pinned_count": 0, 2023-07-24T05:46:46.033 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 4950, 2023-07-24T05:46:46.034 INFO:teuthology.orchestra.run.smithi077.stdout: "inst": { 2023-07-24T05:46:46.034 INFO:teuthology.orchestra.run.smithi077.stdout: "name": { 2023-07-24T05:46:46.034 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "client", 2023-07-24T05:46:46.034 INFO:teuthology.orchestra.run.smithi077.stdout: "num": 4950 2023-07-24T05:46:46.034 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-07-24T05:46:46.034 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2023-07-24T05:46:46.034 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2023-07-24T05:46:46.035 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.1:0", 2023-07-24T05:46:46.035 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 3789139110 2023-07-24T05:46:46.035 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-07-24T05:46:46.035 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-07-24T05:46:46.035 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2023-07-24T05:46:46.035 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2023-07-24T05:46:46.035 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.1:0", 2023-07-24T05:46:46.035 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 3789139110 2023-07-24T05:46:46.036 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-07-24T05:46:46.036 INFO:teuthology.orchestra.run.smithi077.stdout: "inst_str": "client.4950 192.168.0.1:0/3789139110", 2023-07-24T05:46:46.036 INFO:teuthology.orchestra.run.smithi077.stdout: "addr_str": "192.168.0.1:0/3789139110", 2023-07-24T05:46:46.036 INFO:teuthology.orchestra.run.smithi077.stdout: "inode_count": 1, 2023-07-24T05:46:46.036 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_epoch": 9, 2023-07-24T05:46:46.036 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch": 25, 2023-07-24T05:46:46.036 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch_barrier": 0, 2023-07-24T05:46:46.036 INFO:teuthology.orchestra.run.smithi077.stdout: "blocklisted": false, 2023-07-24T05:46:46.037 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs" 2023-07-24T05:46:46.037 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-07-24T05:46:46.047 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-24T05:46:46.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.210+0000 7f05cc3fc700 1 Processor -- start 2023-07-24T05:46:46.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.210+0000 7f05cc3fc700 1 -- start start 2023-07-24T05:46:46.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.214+0000 7f05cc3fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f05c406cac0 0x7f05c406cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:46.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.214+0000 7f05cc3fc700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05c406bb60 con 0x7f05c415e950 2023-07-24T05:46:46.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.214+0000 7f05cc3fc700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05c415f380 con 0x7f05c415e4c0 2023-07-24T05:46:46.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.214+0000 7f05cc3fc700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c406a930 con 0x7f05c406cac0 2023-07-24T05:46:46.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.214+0000 7f05ca999700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f05c415e950 0x7f05c406a220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55464/0 (socket says 172.21.15.77:55464) 2023-07-24T05:46:46.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.214+0000 7f05ca999700 1 -- 172.21.15.77:0/1983828721 learned_addr learned my addr 172.21.15.77:0/1983828721 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:46.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.214+0000 7f05ca198700 1 --2- 172.21.15.77:0/1983828721 >> v2:172.21.15.103:3300/0 conn(0x7f05c406cac0 0x7f05c406cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:46.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.214+0000 7f05c9196700 1 -- 172.21.15.77:0/1983828721 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2750024754 0 0) 0x7f05c406bb60 con 0x7f05c415e950 2023-07-24T05:46:46.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.214+0000 7f05c9196700 1 -- 172.21.15.77:0/1983828721 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05b00035d0 con 0x7f05c415e950 2023-07-24T05:46:46.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.214+0000 7f05ca198700 1 -- 172.21.15.77:0/1983828721 >> v1:172.21.15.103:6789/0 conn(0x7f05c415e4c0 legacy=0x7f05c4069b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:46.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.214+0000 7f05ca198700 1 -- 172.21.15.77:0/1983828721 >> v1:172.21.15.77:6789/0 conn(0x7f05c415e950 legacy=0x7f05c406a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:46.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.214+0000 7f05ca198700 1 -- 172.21.15.77:0/1983828721 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c40cb950 con 0x7f05c406cac0 2023-07-24T05:46:46.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.218+0000 7f05ca198700 1 --2- 172.21.15.77:0/1983828721 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05c406cac0 0x7f05c406cea0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f05c0009de0 tx=0x7f05c000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=257b5ba2758d4e38 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:46.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.218+0000 7f05c9196700 1 -- 172.21.15.77:0/1983828721 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c000e070 con 0x7f05c406cac0 2023-07-24T05:46:46.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.218+0000 7f05c9196700 1 -- 172.21.15.77:0/1983828721 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c000b910 con 0x7f05c406cac0 2023-07-24T05:46:46.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.218+0000 7f05c9196700 1 -- 172.21.15.77:0/1983828721 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c000bc80 con 0x7f05c406cac0 2023-07-24T05:46:46.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.218+0000 7f05cc3fc700 1 -- 172.21.15.77:0/1983828721 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05c406cac0 msgr2=0x7f05c406cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:46.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.218+0000 7f05cc3fc700 1 --2- 172.21.15.77:0/1983828721 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05c406cac0 0x7f05c406cea0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f05c0009de0 tx=0x7f05c000b330 comp rx=0 tx=0).stop 2023-07-24T05:46:46.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.218+0000 7f05cc3fc700 1 -- 172.21.15.77:0/1983828721 shutdown_connections 2023-07-24T05:46:46.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.218+0000 7f05cc3fc700 1 --2- 172.21.15.77:0/1983828721 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05c406cac0 0x7f05c406cea0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:46.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.218+0000 7f05cc3fc700 1 -- 172.21.15.77:0/1983828721 >> 172.21.15.77:0/1983828721 conn(0x7f05c40ce410 msgr2=0x7f05c40ce7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:46.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.218+0000 7f05cc3fc700 1 -- 172.21.15.77:0/1983828721 shutdown_connections 2023-07-24T05:46:46.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.218+0000 7f05cc3fc700 1 -- 172.21.15.77:0/1983828721 wait complete. 2023-07-24T05:46:46.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.222+0000 7f05cc3fc700 1 Processor -- start 2023-07-24T05:46:46.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.222+0000 7f05cc3fc700 1 -- start start 2023-07-24T05:46:46.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.222+0000 7f05cc3fc700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05c406cac0 0x7f05c4152140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:46.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.222+0000 7f05cc3fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05c415e4c0 0x7f05c40ac030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:46.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.222+0000 7f05cc3fc700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f05c415e950 0x7f05c40c3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:46.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.222+0000 7f05cc3fc700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c40cc9f0 con 0x7f05c415e4c0 2023-07-24T05:46:46.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.222+0000 7f05cc3fc700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c4152680 con 0x7f05c406cac0 2023-07-24T05:46:46.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.222+0000 7f05cc3fc700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c40ccc40 con 0x7f05c415e950 2023-07-24T05:46:46.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.222+0000 7f05ca198700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05c406cac0 0x7f05c4152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:46.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.226+0000 7f05ca198700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05c406cac0 0x7f05c4152140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:48190/0 (socket says 172.21.15.77:48190) 2023-07-24T05:46:46.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.226+0000 7f05ca198700 1 -- 172.21.15.77:0/714019362 learned_addr learned my addr 172.21.15.77:0/714019362 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:46.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.226+0000 7f05ca999700 1 --2- 172.21.15.77:0/714019362 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f05c415e950 0x7f05c40c3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:46.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.226+0000 7f05c9997700 1 --2- 172.21.15.77:0/714019362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05c415e4c0 0x7f05c40ac030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:46.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.226+0000 7f05ca198700 1 -- 172.21.15.77:0/714019362 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f05c415e950 msgr2=0x7f05c40c3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:46.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.226+0000 7f05ca198700 1 --2- 172.21.15.77:0/714019362 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f05c415e950 0x7f05c40c3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:46.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.226+0000 7f05ca198700 1 -- 172.21.15.77:0/714019362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05c415e4c0 msgr2=0x7f05c40ac030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:46.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.226+0000 7f05ca198700 1 --2- 172.21.15.77:0/714019362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05c415e4c0 0x7f05c40ac030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:46.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.226+0000 7f05ca198700 1 -- 172.21.15.77:0/714019362 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c0009a70 con 0x7f05c406cac0 2023-07-24T05:46:46.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.226+0000 7f05ca198700 1 --2- 172.21.15.77:0/714019362 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05c406cac0 0x7f05c4152140 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f05c0014040 tx=0x7f05c0004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:46.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.226+0000 7f05baffd700 1 -- 172.21.15.77:0/714019362 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c0004840 con 0x7f05c406cac0 2023-07-24T05:46:46.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.226+0000 7f05baffd700 1 -- 172.21.15.77:0/714019362 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c00098f0 con 0x7f05c406cac0 2023-07-24T05:46:46.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.226+0000 7f05baffd700 1 -- 172.21.15.77:0/714019362 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c0012670 con 0x7f05c406cac0 2023-07-24T05:46:46.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.226+0000 7f05cc3fc700 1 -- 172.21.15.77:0/714019362 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05c40ccf20 con 0x7f05c406cac0 2023-07-24T05:46:46.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.226+0000 7f05cc3fc700 1 -- 172.21.15.77:0/714019362 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c40cd4e0 con 0x7f05c406cac0 2023-07-24T05:46:46.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.226+0000 7f05cc3fc700 1 -- 172.21.15.77:0/714019362 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05c404df10 con 0x7f05c406cac0 2023-07-24T05:46:46.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.230+0000 7f05baffd700 1 -- 172.21.15.77:0/714019362 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f05c00127d0 con 0x7f05c406cac0 2023-07-24T05:46:46.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.230+0000 7f05baffd700 1 --2- 172.21.15.77:0/714019362 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f05a8066340 0x7f05a8068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:46.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.230+0000 7f05baffd700 1 -- 172.21.15.77:0/714019362 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f05c0085d70 con 0x7f05c406cac0 2023-07-24T05:46:46.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.234+0000 7f05c9997700 1 --2- 172.21.15.77:0/714019362 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f05a8066340 0x7f05a8068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:46.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.234+0000 7f05c9997700 1 --2- 172.21.15.77:0/714019362 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f05a8066340 0x7f05a8068800 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f05c40ca470 tx=0x7f05b4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:46.244 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.238+0000 7f05baffd700 1 -- 172.21.15.77:0/714019362 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f05c0052f70 con 0x7f05c406cac0 2023-07-24T05:46:46.453 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.450+0000 7f05cc3fc700 1 -- 172.21.15.77:0/714019362 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f05c40c8740 con 0x7f05c406cac0 2023-07-24T05:46:46.454 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.450+0000 7f05baffd700 1 -- 172.21.15.77:0/714019362 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f05c0056590 con 0x7f05c406cac0 2023-07-24T05:46:46.455 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-24T05:46:46.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.454+0000 7f05cc3fc700 1 -- 172.21.15.77:0/714019362 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f05a8066340 msgr2=0x7f05a8068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:46.457 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.454+0000 7f05cc3fc700 1 --2- 172.21.15.77:0/714019362 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f05a8066340 0x7f05a8068800 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f05c40ca470 tx=0x7f05b4009040 comp rx=0 tx=0).stop 2023-07-24T05:46:46.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.454+0000 7f05cc3fc700 1 -- 172.21.15.77:0/714019362 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05c406cac0 msgr2=0x7f05c4152140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:46.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.454+0000 7f05cc3fc700 1 --2- 172.21.15.77:0/714019362 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05c406cac0 0x7f05c4152140 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f05c0014040 tx=0x7f05c0004af0 comp rx=0 tx=0).stop 2023-07-24T05:46:46.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.454+0000 7f05cc3fc700 1 -- 172.21.15.77:0/714019362 shutdown_connections 2023-07-24T05:46:46.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.454+0000 7f05cc3fc700 1 --2- 172.21.15.77:0/714019362 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f05a8066340 0x7f05a8068800 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:46.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.454+0000 7f05cc3fc700 1 --2- 172.21.15.77:0/714019362 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f05c415e950 0x7f05c40c3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:46.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.454+0000 7f05cc3fc700 1 --2- 172.21.15.77:0/714019362 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05c415e4c0 0x7f05c40ac030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:46.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.454+0000 7f05cc3fc700 1 --2- 172.21.15.77:0/714019362 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05c406cac0 0x7f05c4152140 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:46.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.454+0000 7f05cc3fc700 1 -- 172.21.15.77:0/714019362 >> 172.21.15.77:0/714019362 conn(0x7f05c40ce410 msgr2=0x7f05c4070510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:46.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.454+0000 7f05cc3fc700 1 -- 172.21.15.77:0/714019362 shutdown_connections 2023-07-24T05:46:46.459 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:46.454+0000 7f05cc3fc700 1 -- 172.21.15.77:0/714019362 wait complete. 2023-07-24T05:46:46.478 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-24T05:46:46.478 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-24T05:46:46.478 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi077.front.sepia.ceph.com 2023-07-24T05:46:46.478 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-07-24T05:46:46.479 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-07-24T05:46:46.479 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-24T05:46:46.479 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-24T05:46:46.479 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-24T05:46:46.479 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-07-24T05:46:46.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:46.480 DEBUG:teuthology.orchestra.run.smithi077:> ip addr 2023-07-24T05:46:46.498 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-24T05:46:46.498 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-24T05:46:46.499 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2023-07-24T05:46:46.499 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:46:46.499 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2023-07-24T05:46:46.499 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:46:46.499 INFO:teuthology.orchestra.run.smithi077.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-24T05:46:46.499 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d8 brd ff:ff:ff:ff:ff:ff 2023-07-24T05:46:46.499 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f0 2023-07-24T05:46:46.500 INFO:teuthology.orchestra.run.smithi077.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-24T05:46:46.500 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d9 brd ff:ff:ff:ff:ff:ff 2023-07-24T05:46:46.500 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f1 2023-07-24T05:46:46.500 INFO:teuthology.orchestra.run.smithi077.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-24T05:46:46.500 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d2 brd ff:ff:ff:ff:ff:ff 2023-07-24T05:46:46.500 INFO:teuthology.orchestra.run.smithi077.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-24T05:46:46.500 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d3 brd ff:ff:ff:ff:ff:ff 2023-07-24T05:46:46.500 INFO:teuthology.orchestra.run.smithi077.stdout: inet 172.21.15.77/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-24T05:46:46.501 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft 42363sec preferred_lft 42363sec 2023-07-24T05:46:46.501 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::ec4:7aff:fe8f:d3d3/64 scope link 2023-07-24T05:46:46.501 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:46:46.501 INFO:teuthology.orchestra.run.smithi077.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-24T05:46:46.501 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 02:42:ca:23:89:0f brd ff:ff:ff:ff:ff:ff 2023-07-24T05:46:46.501 INFO:teuthology.orchestra.run.smithi077.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-24T05:46:46.501 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:46:46.501 INFO:teuthology.orchestra.run.smithi077.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-24T05:46:46.502 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 7a:8b:65:ea:da:cc brd ff:ff:ff:ff:ff:ff 2023-07-24T05:46:46.502 INFO:teuthology.orchestra.run.smithi077.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-24T05:46:46.502 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:46:46.502 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::38d3:54ff:fe8d:401a/64 scope link 2023-07-24T05:46:46.502 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:46:46.503 INFO:teuthology.orchestra.run.smithi077.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-24T05:46:46.503 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 7a:8b:65:ea:da:cc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-24T05:46:46.503 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::788b:65ff:feea:dacc/64 scope link tentative 2023-07-24T05:46:46.503 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:46:46.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:46.504 DEBUG:teuthology.orchestra.run.smithi077:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-24T05:46:46.580 INFO:teuthology.orchestra.run.smithi077.stdout:1 2023-07-24T05:46:46.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:46.583 DEBUG:teuthology.orchestra.run.smithi077:> route 2023-07-24T05:46:46.643 INFO:teuthology.orchestra.run.smithi077.stdout:Kernel IP routing table 2023-07-24T05:46:46.643 INFO:teuthology.orchestra.run.smithi077.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-24T05:46:46.643 INFO:teuthology.orchestra.run.smithi077.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-24T05:46:46.643 INFO:teuthology.orchestra.run.smithi077.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-24T05:46:46.643 INFO:teuthology.orchestra.run.smithi077.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-24T05:46:46.644 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-07-24T05:46:46.644 INFO:teuthology.orchestra.run.smithi077.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-24T05:46:46.644 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-24T05:46:46.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:46.645 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-07-24T05:46:46.645 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-07-24T05:46:46.645 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-24T05:46:46.646 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-24T05:46:46.646 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-24T05:46:46.646 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-07-24T05:46:46.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:46.785 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2023-07-24T05:46:46.802 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-24T05:46:46.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:46.804 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list-id 2023-07-24T05:46:46.862 INFO:teuthology.orchestra.run.smithi077.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-07-24T05:46:46.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:46.864 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-07-24T05:46:46.864 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-07-24T05:46:46.864 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-24T05:46:46.864 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-07-24T05:46:46.865 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-07-24T05:46:46.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:46.977 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-07-24T05:46:47.013 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-24T05:46:47.013 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-24T05:46:47.013 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2023-07-24T05:46:47.014 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:46:47.014 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2023-07-24T05:46:47.014 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:46:47.014 INFO:teuthology.orchestra.run.smithi077.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-24T05:46:47.014 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether f6:93:02:1e:cc:3e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-24T05:46:47.014 INFO:teuthology.orchestra.run.smithi077.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-24T05:46:47.014 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:46:47.014 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::f493:2ff:fe1e:cc3e/64 scope link 2023-07-24T05:46:47.015 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:46:47.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:47.017 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-07-24T05:46:47.096 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-24T05:46:47.096 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-24T05:46:47.096 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2023-07-24T05:46:47.096 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:46:47.096 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2023-07-24T05:46:47.097 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:46:47.097 INFO:teuthology.orchestra.run.smithi077.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-24T05:46:47.097 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether f6:93:02:1e:cc:3e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-24T05:46:47.097 INFO:teuthology.orchestra.run.smithi077.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-24T05:46:47.097 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:46:47.097 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::f493:2ff:fe1e:cc3e/64 scope link 2023-07-24T05:46:47.097 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:46:47.099 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-07-24T05:46:47.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:47.100 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-07-24T05:46:47.100 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-07-24T05:46:47.100 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-07-24T05:46:47.100 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-07-24T05:46:47.101 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-07-24T05:46:47.101 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-07-24T05:46:47.101 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-07-24T05:46:47.101 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-07-24T05:46:47.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:47.286 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-07-24T05:46:47.286 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-07-24T05:46:47.286 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set brx.1 up 2023-07-24T05:46:47.286 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set dev brx.1 master ceph-brx 2023-07-24T05:46:47.287 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-07-24T05:46:47.360 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-07-24T05:46:47.360 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-24T05:46:47.360 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-07-24T05:46:47.376 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-07-24T05:46:47.376 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-24T05:46:47.376 DEBUG:teuthology.orchestra.run.smithi077:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-07-24T05:46:47.436 DEBUG:teuthology.orchestra.run.smithi077:> sudo modprobe fuse 2023-07-24T05:46:47.521 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-24T05:46:47.521 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-24T05:46:47.596 INFO:teuthology.orchestra.run.smithi077.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-24T05:46:47.599 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-24T05:46:47.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:47.600 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-07-24T05:46:47.656 INFO:teuthology.orchestra.run.smithi077.stdout:49 2023-07-24T05:46:47.657 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [49] 2023-07-24T05:46:47.657 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-07-24T05:46:47.710 DEBUG:teuthology.orchestra.run.smithi077:> sudo modprobe fuse 2023-07-24T05:46:47.739 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-24T05:46:47.740 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-24T05:46:47.814 INFO:teuthology.orchestra.run.smithi077.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-24T05:46:47.816 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-24T05:46:47.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:47.817 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-07-24T05:46:47.846 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi077.stderr:2023-07-24T05:46:47.842+0000 7f7d273a5640 -1 init, newargv = 0x55e689f66770 newargc=15 2023-07-24T05:46:47.846 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi077.stderr:ceph-fuse[42328]: starting ceph client 2023-07-24T05:46:47.858 INFO:teuthology.orchestra.run.smithi077.stdout:49 2023-07-24T05:46:47.860 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi077.stderr:ceph-fuse[42328]: starting fuse 2023-07-24T05:46:48.960 DEBUG:teuthology.orchestra.run.smithi077:> sudo modprobe fuse 2023-07-24T05:46:48.994 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-24T05:46:48.995 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-24T05:46:49.074 INFO:teuthology.orchestra.run.smithi077.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-24T05:46:49.077 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-24T05:46:49.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:49.078 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-07-24T05:46:49.141 INFO:teuthology.orchestra.run.smithi077.stdout:49 2023-07-24T05:46:49.142 INFO:teuthology.orchestra.run.smithi077.stdout:50 2023-07-24T05:46:49.142 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49, 50] 2023-07-24T05:46:49.142 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-24T05:46:49.142 DEBUG:teuthology.orchestra.run.smithi077:> import glob 2023-07-24T05:46:49.143 DEBUG:teuthology.orchestra.run.smithi077:> import re 2023-07-24T05:46:49.143 DEBUG:teuthology.orchestra.run.smithi077:> import os 2023-07-24T05:46:49.143 DEBUG:teuthology.orchestra.run.smithi077:> import subprocess 2023-07-24T05:46:49.143 DEBUG:teuthology.orchestra.run.smithi077:> 2023-07-24T05:46:49.144 DEBUG:teuthology.orchestra.run.smithi077:> def _find_admin_socket(client_name): 2023-07-24T05:46:49.144 DEBUG:teuthology.orchestra.run.smithi077:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-07-24T05:46:49.144 DEBUG:teuthology.orchestra.run.smithi077:> files = glob.glob(asok_path) 2023-07-24T05:46:49.144 DEBUG:teuthology.orchestra.run.smithi077:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-07-24T05:46:49.145 DEBUG:teuthology.orchestra.run.smithi077:> 2023-07-24T05:46:49.145 DEBUG:teuthology.orchestra.run.smithi077:> # Given a non-glob path, it better be there 2023-07-24T05:46:49.145 DEBUG:teuthology.orchestra.run.smithi077:> if "*" not in asok_path: 2023-07-24T05:46:49.145 DEBUG:teuthology.orchestra.run.smithi077:> assert(len(files) == 1) 2023-07-24T05:46:49.145 DEBUG:teuthology.orchestra.run.smithi077:> return files[0] 2023-07-24T05:46:49.146 DEBUG:teuthology.orchestra.run.smithi077:> 2023-07-24T05:46:49.146 DEBUG:teuthology.orchestra.run.smithi077:> for f in files: 2023-07-24T05:46:49.146 DEBUG:teuthology.orchestra.run.smithi077:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-24T05:46:49.146 DEBUG:teuthology.orchestra.run.smithi077:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-24T05:46:49.146 DEBUG:teuthology.orchestra.run.smithi077:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-24T05:46:49.147 DEBUG:teuthology.orchestra.run.smithi077:> contents = proc_f.read() 2023-07-24T05:46:49.147 DEBUG:teuthology.orchestra.run.smithi077:> if mountpoint in contents: 2023-07-24T05:46:49.147 DEBUG:teuthology.orchestra.run.smithi077:> return f 2023-07-24T05:46:49.147 DEBUG:teuthology.orchestra.run.smithi077:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-24T05:46:49.148 DEBUG:teuthology.orchestra.run.smithi077:> 2023-07-24T05:46:49.148 DEBUG:teuthology.orchestra.run.smithi077:> print(_find_admin_socket("client.2")) 2023-07-24T05:46:49.148 DEBUG:teuthology.orchestra.run.smithi077:> ' 2023-07-24T05:46:49.312 INFO:teuthology.orchestra.run.smithi077.stdout:/var/run/ceph/ceph-client.2.42328.asok 2023-07-24T05:46:49.495 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.42328.asok 2023-07-24T05:46:49.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:49.496 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.42328.asok status 2023-07-24T05:46:49.696 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-07-24T05:46:49.696 INFO:teuthology.orchestra.run.smithi077.stdout: "metadata": { 2023-07-24T05:46:49.697 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_sha1": "e2c50893bf78471cc8ee960317cc10390300dfd5", 2023-07-24T05:46:49.697 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_version": "ceph version 18.0.0-5042-ge2c50893 (e2c50893bf78471cc8ee960317cc10390300dfd5) reef (dev)", 2023-07-24T05:46:49.697 INFO:teuthology.orchestra.run.smithi077.stdout: "entity_id": "2", 2023-07-24T05:46:49.697 INFO:teuthology.orchestra.run.smithi077.stdout: "hostname": "smithi077", 2023-07-24T05:46:49.697 INFO:teuthology.orchestra.run.smithi077.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-07-24T05:46:49.697 INFO:teuthology.orchestra.run.smithi077.stdout: "pid": "42328", 2023-07-24T05:46:49.697 INFO:teuthology.orchestra.run.smithi077.stdout: "root": "/" 2023-07-24T05:46:49.697 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-07-24T05:46:49.698 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_count": 0, 2023-07-24T05:46:49.698 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_pinned_count": 0, 2023-07-24T05:46:49.698 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 4962, 2023-07-24T05:46:49.698 INFO:teuthology.orchestra.run.smithi077.stdout: "inst": { 2023-07-24T05:46:49.698 INFO:teuthology.orchestra.run.smithi077.stdout: "name": { 2023-07-24T05:46:49.698 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "client", 2023-07-24T05:46:49.698 INFO:teuthology.orchestra.run.smithi077.stdout: "num": 4962 2023-07-24T05:46:49.699 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-07-24T05:46:49.699 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2023-07-24T05:46:49.699 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2023-07-24T05:46:49.699 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.2:0", 2023-07-24T05:46:49.699 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 3105427980 2023-07-24T05:46:49.699 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-07-24T05:46:49.699 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-07-24T05:46:49.699 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2023-07-24T05:46:49.700 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2023-07-24T05:46:49.700 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.2:0", 2023-07-24T05:46:49.700 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 3105427980 2023-07-24T05:46:49.700 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-07-24T05:46:49.700 INFO:teuthology.orchestra.run.smithi077.stdout: "inst_str": "client.4962 192.168.0.2:0/3105427980", 2023-07-24T05:46:49.700 INFO:teuthology.orchestra.run.smithi077.stdout: "addr_str": "192.168.0.2:0/3105427980", 2023-07-24T05:46:49.700 INFO:teuthology.orchestra.run.smithi077.stdout: "inode_count": 1, 2023-07-24T05:46:49.700 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_epoch": 9, 2023-07-24T05:46:49.701 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch": 26, 2023-07-24T05:46:49.701 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch_barrier": 0, 2023-07-24T05:46:49.701 INFO:teuthology.orchestra.run.smithi077.stdout: "blocklisted": false, 2023-07-24T05:46:49.701 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs" 2023-07-24T05:46:49.701 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-07-24T05:46:49.711 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-24T05:46:49.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.886+0000 7fb17b39a700 1 Processor -- start 2023-07-24T05:46:49.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.886+0000 7fb17b39a700 1 -- start start 2023-07-24T05:46:49.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.886+0000 7fb17b39a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb1740b13c0 0x7fb17406adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:49.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.886+0000 7fb17b39a700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb1740a4580 0x7fb17406fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:49.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.886+0000 7fb17b39a700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb174069b10 0x7fb174069fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:49.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.886+0000 7fb17b39a700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb17406a500 con 0x7fb1740a4580 2023-07-24T05:46:49.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.886+0000 7fb17b39a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1740adc40 con 0x7fb1740b13c0 2023-07-24T05:46:49.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.886+0000 7fb17b39a700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb17406b330 con 0x7fb174069b10 2023-07-24T05:46:49.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.886+0000 7fb179b97700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb1740a4580 0x7fb17406fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:49.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.886+0000 7fb179b97700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb1740a4580 0x7fb17406fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36034/0 (socket says 172.21.15.77:36034) 2023-07-24T05:46:49.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.886+0000 7fb179b97700 1 -- 172.21.15.77:0/1377605076 learned_addr learned my addr 172.21.15.77:0/1377605076 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:49.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.886+0000 7fb17ab99700 1 --2- 172.21.15.77:0/1377605076 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb174069b10 0x7fb174069fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:49.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.886+0000 7fb17a398700 1 --2- 172.21.15.77:0/1377605076 >> v2:172.21.15.103:3300/0 conn(0x7fb1740b13c0 0x7fb17406adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:49.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.886+0000 7fb179b97700 1 -- 172.21.15.77:0/1377605076 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb174069b10 msgr2=0x7fb174069fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:49.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.886+0000 7fb179b97700 1 --2- 172.21.15.77:0/1377605076 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb174069b10 0x7fb174069fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:49.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.886+0000 7fb179b97700 1 -- 172.21.15.77:0/1377605076 >> v2:172.21.15.103:3300/0 conn(0x7fb1740b13c0 msgr2=0x7fb17406adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:49.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.886+0000 7fb179b97700 1 --2- 172.21.15.77:0/1377605076 >> v2:172.21.15.103:3300/0 conn(0x7fb1740b13c0 0x7fb17406adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:49.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.886+0000 7fb179b97700 1 -- 172.21.15.77:0/1377605076 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1740adee0 con 0x7fb1740a4580 2023-07-24T05:46:49.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.886+0000 7fb17ab99700 1 --2- 172.21.15.77:0/1377605076 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb174069b10 0x7fb174069fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:46:49.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.886+0000 7fb17a398700 1 --2- 172.21.15.77:0/1377605076 >> v2:172.21.15.103:3300/0 conn(0x7fb1740b13c0 0x7fb17406adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:46:49.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.886+0000 7fb179b97700 1 --2- 172.21.15.77:0/1377605076 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1740a4580 0x7fb17406fbe0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb17406f1a0 tx=0x7fb164009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2d4e6c483a4fd1c server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:49.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.890+0000 7fb179396700 1 -- 172.21.15.77:0/1377605076 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16400b8a0 con 0x7fb1740a4580 2023-07-24T05:46:49.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.890+0000 7fb179396700 1 -- 172.21.15.77:0/1377605076 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb16400ba00 con 0x7fb1740a4580 2023-07-24T05:46:49.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.890+0000 7fb179396700 1 -- 172.21.15.77:0/1377605076 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16400bd90 con 0x7fb1740a4580 2023-07-24T05:46:49.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.890+0000 7fb17b39a700 1 -- 172.21.15.77:0/1377605076 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1740a4580 msgr2=0x7fb17406fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:49.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.890+0000 7fb17b39a700 1 --2- 172.21.15.77:0/1377605076 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1740a4580 0x7fb17406fbe0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb17406f1a0 tx=0x7fb164009bf0 comp rx=0 tx=0).stop 2023-07-24T05:46:49.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.890+0000 7fb17b39a700 1 -- 172.21.15.77:0/1377605076 shutdown_connections 2023-07-24T05:46:49.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.890+0000 7fb17b39a700 1 --2- 172.21.15.77:0/1377605076 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb174069b10 0x7fb174069fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:49.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.890+0000 7fb17b39a700 1 --2- 172.21.15.77:0/1377605076 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1740a4580 0x7fb17406fbe0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:49.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.890+0000 7fb17b39a700 1 --2- 172.21.15.77:0/1377605076 >> v2:172.21.15.103:3300/0 conn(0x7fb1740b13c0 0x7fb17406adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:49.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.890+0000 7fb17b39a700 1 -- 172.21.15.77:0/1377605076 >> 172.21.15.77:0/1377605076 conn(0x7fb1740cacc0 msgr2=0x7fb1740cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:49.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.890+0000 7fb17b39a700 1 -- 172.21.15.77:0/1377605076 shutdown_connections 2023-07-24T05:46:49.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.890+0000 7fb17b39a700 1 -- 172.21.15.77:0/1377605076 wait complete. 2023-07-24T05:46:49.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.894+0000 7fb17b39a700 1 Processor -- start 2023-07-24T05:46:49.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.894+0000 7fb17b39a700 1 -- start start 2023-07-24T05:46:49.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.894+0000 7fb17b39a700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb174069b10 0x7fb174156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:49.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.894+0000 7fb17b39a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1740a4580 0x7fb1740c4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:49.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.894+0000 7fb17b39a700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1740b13c0 0x7fb17409add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:49.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.894+0000 7fb17b39a700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1740c4e40 con 0x7fb1740a4580 2023-07-24T05:46:49.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.894+0000 7fb17b39a700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1740c1d70 con 0x7fb1740b13c0 2023-07-24T05:46:49.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.894+0000 7fb17b39a700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb17409b310 con 0x7fb174069b10 2023-07-24T05:46:49.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.894+0000 7fb179b97700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1740a4580 0x7fb1740c4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:49.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.894+0000 7fb179b97700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1740a4580 0x7fb1740c4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36042/0 (socket says 172.21.15.77:36042) 2023-07-24T05:46:49.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.894+0000 7fb179b97700 1 -- 172.21.15.77:0/3238502709 learned_addr learned my addr 172.21.15.77:0/3238502709 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:49.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.894+0000 7fb17a398700 1 --2- 172.21.15.77:0/3238502709 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb174069b10 0x7fb174156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:49.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.894+0000 7fb17ab99700 1 --2- 172.21.15.77:0/3238502709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1740b13c0 0x7fb17409add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:49.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.894+0000 7fb179b97700 1 -- 172.21.15.77:0/3238502709 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb174069b10 msgr2=0x7fb174156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:49.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.894+0000 7fb179b97700 1 --2- 172.21.15.77:0/3238502709 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb174069b10 0x7fb174156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:49.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.894+0000 7fb179b97700 1 -- 172.21.15.77:0/3238502709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1740b13c0 msgr2=0x7fb17409add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:49.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.894+0000 7fb179b97700 1 --2- 172.21.15.77:0/3238502709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1740b13c0 0x7fb17409add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:49.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.894+0000 7fb179b97700 1 -- 172.21.15.77:0/3238502709 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb164009570 con 0x7fb1740a4580 2023-07-24T05:46:49.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.894+0000 7fb17ab99700 1 --2- 172.21.15.77:0/3238502709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1740b13c0 0x7fb17409add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:46:49.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.894+0000 7fb179b97700 1 --2- 172.21.15.77:0/3238502709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1740a4580 0x7fb1740c4900 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb164000c00 tx=0x7fb164004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:49.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.894+0000 7fb16affd700 1 -- 172.21.15.77:0/3238502709 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb164003ad0 con 0x7fb1740a4580 2023-07-24T05:46:49.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.894+0000 7fb16affd700 1 -- 172.21.15.77:0/3238502709 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb16401e070 con 0x7fb1740a4580 2023-07-24T05:46:49.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.894+0000 7fb16affd700 1 -- 172.21.15.77:0/3238502709 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb164003e90 con 0x7fb1740a4580 2023-07-24T05:46:49.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.894+0000 7fb17b39a700 1 -- 172.21.15.77:0/3238502709 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb17409b5b0 con 0x7fb1740a4580 2023-07-24T05:46:49.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.894+0000 7fb17b39a700 1 -- 172.21.15.77:0/3238502709 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1740c1fc0 con 0x7fb1740a4580 2023-07-24T05:46:49.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.898+0000 7fb17b39a700 1 -- 172.21.15.77:0/3238502709 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1740c5160 con 0x7fb1740a4580 2023-07-24T05:46:49.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.898+0000 7fb16affd700 1 -- 172.21.15.77:0/3238502709 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb164011420 con 0x7fb1740a4580 2023-07-24T05:46:49.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.898+0000 7fb16affd700 1 --2- 172.21.15.77:0/3238502709 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb1580662f0 0x7fb1580687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:49.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.902+0000 7fb16affd700 1 -- 172.21.15.77:0/3238502709 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb164020070 con 0x7fb1740a4580 2023-07-24T05:46:49.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.902+0000 7fb17a398700 1 --2- 172.21.15.77:0/3238502709 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb1580662f0 0x7fb1580687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:49.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.902+0000 7fb17a398700 1 --2- 172.21.15.77:0/3238502709 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb1580662f0 0x7fb1580687b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb17000a9a0 tx=0x7fb170008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:49.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:49.906+0000 7fb16affd700 1 -- 172.21.15.77:0/3238502709 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb164052a50 con 0x7fb1740a4580 2023-07-24T05:46:50.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:50.110+0000 7fb17b39a700 1 -- 172.21.15.77:0/3238502709 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb174072490 con 0x7fb1740a4580 2023-07-24T05:46:50.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:50.110+0000 7fb16affd700 1 -- 172.21.15.77:0/3238502709 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fb164056070 con 0x7fb1740a4580 2023-07-24T05:46:50.117 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-24T05:46:50.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:50.114+0000 7fb17b39a700 1 -- 172.21.15.77:0/3238502709 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb1580662f0 msgr2=0x7fb1580687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:50.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:50.114+0000 7fb17b39a700 1 --2- 172.21.15.77:0/3238502709 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb1580662f0 0x7fb1580687b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb17000a9a0 tx=0x7fb170008040 comp rx=0 tx=0).stop 2023-07-24T05:46:50.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:50.114+0000 7fb17b39a700 1 -- 172.21.15.77:0/3238502709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1740a4580 msgr2=0x7fb1740c4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:50.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:50.114+0000 7fb17b39a700 1 --2- 172.21.15.77:0/3238502709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1740a4580 0x7fb1740c4900 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb164000c00 tx=0x7fb164004770 comp rx=0 tx=0).stop 2023-07-24T05:46:50.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:50.118+0000 7fb17b39a700 1 -- 172.21.15.77:0/3238502709 shutdown_connections 2023-07-24T05:46:50.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:50.118+0000 7fb17b39a700 1 --2- 172.21.15.77:0/3238502709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1740b13c0 0x7fb17409add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:50.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:50.118+0000 7fb17b39a700 1 --2- 172.21.15.77:0/3238502709 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb1740a4580 0x7fb1740c4900 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:50.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:50.118+0000 7fb17b39a700 1 --2- 172.21.15.77:0/3238502709 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb1580662f0 0x7fb1580687b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:50.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:50.118+0000 7fb17b39a700 1 --2- 172.21.15.77:0/3238502709 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb174069b10 0x7fb174156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:50.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:50.118+0000 7fb17b39a700 1 -- 172.21.15.77:0/3238502709 >> 172.21.15.77:0/3238502709 conn(0x7fb1740cacc0 msgr2=0x7fb1740c9720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:50.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:50.118+0000 7fb17b39a700 1 -- 172.21.15.77:0/3238502709 shutdown_connections 2023-07-24T05:46:50.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:50.118+0000 7fb17b39a700 1 -- 172.21.15.77:0/3238502709 wait complete. 2023-07-24T05:46:50.143 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-24T05:46:50.143 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-24T05:46:50.143 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi103.front.sepia.ceph.com 2023-07-24T05:46:50.143 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-24T05:46:50.143 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-24T05:46:50.144 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-24T05:46:50.144 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-24T05:46:50.144 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-24T05:46:50.144 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-24T05:46:50.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:50.145 DEBUG:teuthology.orchestra.run.smithi103:> ip addr 2023-07-24T05:46:50.163 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-24T05:46:50.163 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-24T05:46:50.163 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2023-07-24T05:46:50.163 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:46:50.163 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2023-07-24T05:46:50.163 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:46:50.164 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-24T05:46:50.164 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2023-07-24T05:46:50.164 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f0 2023-07-24T05:46:50.164 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-24T05:46:50.164 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2023-07-24T05:46:50.164 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f1 2023-07-24T05:46:50.164 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-24T05:46:50.164 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2023-07-24T05:46:50.165 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-24T05:46:50.165 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2023-07-24T05:46:50.165 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-24T05:46:50.165 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42311sec preferred_lft 42311sec 2023-07-24T05:46:50.165 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2023-07-24T05:46:50.165 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:46:50.165 INFO:teuthology.orchestra.run.smithi103.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-24T05:46:50.165 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 02:42:83:7d:62:09 brd ff:ff:ff:ff:ff:ff 2023-07-24T05:46:50.166 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-24T05:46:50.166 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:46:50.166 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-24T05:46:50.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:50.167 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec bash -c ' 2023-07-24T05:46:50.167 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2023-07-24T05:46:50.167 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link add name ceph-brx type bridge 2023-07-24T05:46:50.168 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip addr flush dev ceph-brx 2023-07-24T05:46:50.168 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set ceph-brx up 2023-07-24T05:46:50.168 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-24T05:46:50.168 DEBUG:teuthology.orchestra.run.smithi103:> ') 2023-07-24T05:46:50.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:50.310 DEBUG:teuthology.orchestra.run.smithi103:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-24T05:46:50.334 INFO:teuthology.orchestra.run.smithi103.stdout:1 2023-07-24T05:46:50.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:50.337 DEBUG:teuthology.orchestra.run.smithi103:> route 2023-07-24T05:46:50.408 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2023-07-24T05:46:50.408 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-24T05:46:50.408 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-24T05:46:50.408 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-24T05:46:50.409 INFO:teuthology.orchestra.run.smithi103.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-24T05:46:50.409 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-07-24T05:46:50.409 INFO:teuthology.orchestra.run.smithi103.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-24T05:46:50.409 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-24T05:46:50.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:50.410 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec bash -c ' 2023-07-24T05:46:50.410 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2023-07-24T05:46:50.411 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-24T05:46:50.411 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-24T05:46:50.411 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-24T05:46:50.411 DEBUG:teuthology.orchestra.run.smithi103:> ') 2023-07-24T05:46:50.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:50.528 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2023-07-24T05:46:50.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:50.543 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list-id 2023-07-24T05:46:50.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:50.603 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec bash -c ' 2023-07-24T05:46:50.603 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2023-07-24T05:46:50.603 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-24T05:46:50.604 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-07-24T05:46:50.604 DEBUG:teuthology.orchestra.run.smithi103:> ') 2023-07-24T05:46:50.724 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-07-24T05:46:50.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:50.725 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec bash -c ' 2023-07-24T05:46:50.725 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2023-07-24T05:46:50.725 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-07-24T05:46:50.725 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-24T05:46:50.725 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-07-24T05:46:50.726 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-07-24T05:46:50.726 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-07-24T05:46:50.726 DEBUG:teuthology.orchestra.run.smithi103:> ') 2023-07-24T05:46:50.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:50.910 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec bash -c ' 2023-07-24T05:46:50.910 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2023-07-24T05:46:50.911 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set brx.0 up 2023-07-24T05:46:50.911 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set dev brx.0 master ceph-brx 2023-07-24T05:46:50.911 DEBUG:teuthology.orchestra.run.smithi103:> ') 2023-07-24T05:46:50.988 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-07-24T05:46:50.988 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-24T05:46:50.988 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-24T05:46:51.005 INFO:teuthology.orchestra.run.smithi103.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-24T05:46:51.006 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-24T05:46:51.006 DEBUG:teuthology.orchestra.run.smithi103:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-24T05:46:51.068 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2023-07-24T05:46:51.145 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-24T05:46:51.146 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-24T05:46:51.226 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-24T05:46:51.228 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-24T05:46:51.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:51.229 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2023-07-24T05:46:51.293 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-24T05:46:51.293 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-07-24T05:46:51.342 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2023-07-24T05:46:51.373 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-24T05:46:51.374 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-24T05:46:51.445 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-24T05:46:51.447 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-24T05:46:51.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:51.448 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2023-07-24T05:46:51.490 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:2023-07-24T05:46:51.487+0000 7f82a03cc640 -1 init, newargv = 0x556d58be1840 newargc=15 2023-07-24T05:46:51.491 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[40367]: starting ceph client 2023-07-24T05:46:51.503 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi103.stderr:ceph-fuse[40367]: starting fuse 2023-07-24T05:46:52.603 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2023-07-24T05:46:52.640 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-24T05:46:52.641 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-24T05:46:52.717 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-24T05:46:52.720 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-24T05:46:52.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:52.722 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2023-07-24T05:46:52.781 INFO:teuthology.orchestra.run.smithi103.stdout:49 2023-07-24T05:46:52.781 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-07-24T05:46:52.781 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-24T05:46:52.782 DEBUG:teuthology.orchestra.run.smithi103:> import glob 2023-07-24T05:46:52.782 DEBUG:teuthology.orchestra.run.smithi103:> import re 2023-07-24T05:46:52.782 DEBUG:teuthology.orchestra.run.smithi103:> import os 2023-07-24T05:46:52.782 DEBUG:teuthology.orchestra.run.smithi103:> import subprocess 2023-07-24T05:46:52.783 DEBUG:teuthology.orchestra.run.smithi103:> 2023-07-24T05:46:52.783 DEBUG:teuthology.orchestra.run.smithi103:> def _find_admin_socket(client_name): 2023-07-24T05:46:52.783 DEBUG:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-07-24T05:46:52.783 DEBUG:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2023-07-24T05:46:52.784 DEBUG:teuthology.orchestra.run.smithi103:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-07-24T05:46:52.784 DEBUG:teuthology.orchestra.run.smithi103:> 2023-07-24T05:46:52.784 DEBUG:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2023-07-24T05:46:52.784 DEBUG:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2023-07-24T05:46:52.784 DEBUG:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2023-07-24T05:46:52.785 DEBUG:teuthology.orchestra.run.smithi103:> return files[0] 2023-07-24T05:46:52.785 DEBUG:teuthology.orchestra.run.smithi103:> 2023-07-24T05:46:52.785 DEBUG:teuthology.orchestra.run.smithi103:> for f in files: 2023-07-24T05:46:52.785 DEBUG:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-24T05:46:52.786 DEBUG:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-24T05:46:52.786 DEBUG:teuthology.orchestra.run.smithi103:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-24T05:46:52.786 DEBUG:teuthology.orchestra.run.smithi103:> contents = proc_f.read() 2023-07-24T05:46:52.786 DEBUG:teuthology.orchestra.run.smithi103:> if mountpoint in contents: 2023-07-24T05:46:52.786 DEBUG:teuthology.orchestra.run.smithi103:> return f 2023-07-24T05:46:52.787 DEBUG:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-24T05:46:52.787 DEBUG:teuthology.orchestra.run.smithi103:> 2023-07-24T05:46:52.787 DEBUG:teuthology.orchestra.run.smithi103:> print(_find_admin_socket("client.1")) 2023-07-24T05:46:52.787 DEBUG:teuthology.orchestra.run.smithi103:> ' 2023-07-24T05:46:52.942 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.1.40367.asok 2023-07-24T05:46:53.126 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.40367.asok 2023-07-24T05:46:53.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:53.127 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.40367.asok status 2023-07-24T05:46:53.323 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2023-07-24T05:46:53.323 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2023-07-24T05:46:53.323 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "e2c50893bf78471cc8ee960317cc10390300dfd5", 2023-07-24T05:46:53.323 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 18.0.0-5042-ge2c50893 (e2c50893bf78471cc8ee960317cc10390300dfd5) reef (dev)", 2023-07-24T05:46:53.323 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "1", 2023-07-24T05:46:53.323 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2023-07-24T05:46:53.324 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-07-24T05:46:53.324 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "40367", 2023-07-24T05:46:53.324 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2023-07-24T05:46:53.324 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2023-07-24T05:46:53.324 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2023-07-24T05:46:53.324 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2023-07-24T05:46:53.324 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4909, 2023-07-24T05:46:53.325 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2023-07-24T05:46:53.325 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2023-07-24T05:46:53.325 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2023-07-24T05:46:53.325 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4909 2023-07-24T05:46:53.325 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2023-07-24T05:46:53.325 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2023-07-24T05:46:53.325 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2023-07-24T05:46:53.325 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2023-07-24T05:46:53.326 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 1952730194 2023-07-24T05:46:53.326 INFO:teuthology.orchestra.run.smithi103.stdout: } 2023-07-24T05:46:53.326 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2023-07-24T05:46:53.326 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2023-07-24T05:46:53.326 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2023-07-24T05:46:53.326 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2023-07-24T05:46:53.326 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 1952730194 2023-07-24T05:46:53.326 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2023-07-24T05:46:53.327 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.4909 192.168.0.1:0/1952730194", 2023-07-24T05:46:53.327 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.1:0/1952730194", 2023-07-24T05:46:53.327 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2023-07-24T05:46:53.327 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 9, 2023-07-24T05:46:53.327 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 27, 2023-07-24T05:46:53.327 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2023-07-24T05:46:53.327 INFO:teuthology.orchestra.run.smithi103.stdout: "blocklisted": false, 2023-07-24T05:46:53.327 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs" 2023-07-24T05:46:53.328 INFO:teuthology.orchestra.run.smithi103.stdout:} 2023-07-24T05:46:53.337 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-24T05:46:53.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.510+0000 7fdcd26d2700 1 Processor -- start 2023-07-24T05:46:53.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.510+0000 7fdcd26d2700 1 -- start start 2023-07-24T05:46:53.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.510+0000 7fdcd26d2700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdccc161100 0x7fdccc0b1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:53.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.510+0000 7fdcd26d2700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdccc0af170 con 0x7fdccc0b15d0 2023-07-24T05:46:53.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.510+0000 7fdcd26d2700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdccc0ae5f0 con 0x7fdccc160d20 2023-07-24T05:46:53.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.510+0000 7fdcd26d2700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc0b1a40 con 0x7fdccc161100 2023-07-24T05:46:53.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.510+0000 7fdcd1ed1700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fdccc0b15d0 0x7fdccc0af700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:33134/0 (socket says 172.21.15.77:33134) 2023-07-24T05:46:53.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.510+0000 7fdcd1ed1700 1 -- 172.21.15.77:0/1534936744 learned_addr learned my addr 172.21.15.77:0/1534936744 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:53.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.510+0000 7fdcd0ecf700 1 --2- 172.21.15.77:0/1534936744 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdccc161100 0x7fdccc0b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:53.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.510+0000 7fdcc3fff700 1 -- 172.21.15.77:0/1534936744 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1714910818 0 0) 0x7fdccc0af170 con 0x7fdccc0b15d0 2023-07-24T05:46:53.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.514+0000 7fdcc3fff700 1 -- 172.21.15.77:0/1534936744 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcb80035d0 con 0x7fdccc0b15d0 2023-07-24T05:46:53.517 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.514+0000 7fdcc3fff700 1 -- 172.21.15.77:0/1534936744 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 148623073 0 0) 0x7fdccc0ae5f0 con 0x7fdccc160d20 2023-07-24T05:46:53.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.514+0000 7fdcc3fff700 1 -- 172.21.15.77:0/1534936744 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdccc0af170 con 0x7fdccc160d20 2023-07-24T05:46:53.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.514+0000 7fdcc3fff700 1 -- 172.21.15.77:0/1534936744 <== mon.1 v1:172.21.15.103:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 702501594 0 0) 0x7fdccc0af170 con 0x7fdccc160d20 2023-07-24T05:46:53.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.514+0000 7fdcc3fff700 1 -- 172.21.15.77:0/1534936744 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdccc161100 msgr2=0x7fdccc0b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:53.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.514+0000 7fdcc3fff700 1 --2- 172.21.15.77:0/1534936744 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdccc161100 0x7fdccc0b1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:53.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.514+0000 7fdcc3fff700 1 -- 172.21.15.77:0/1534936744 >> v1:172.21.15.77:6789/0 conn(0x7fdccc0b15d0 legacy=0x7fdccc0af700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:53.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.514+0000 7fdcc3fff700 1 -- 172.21.15.77:0/1534936744 --> v1:172.21.15.103:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdccc0ae8d0 con 0x7fdccc160d20 2023-07-24T05:46:53.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.514+0000 7fdcc3fff700 1 -- 172.21.15.77:0/1534936744 <== mon.1 v1:172.21.15.103:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4109865209 0 0) 0x7fdcc80019f0 con 0x7fdccc160d20 2023-07-24T05:46:53.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.514+0000 7fdcc3fff700 1 -- 172.21.15.77:0/1534936744 >> v1:172.21.15.103:6789/0 conn(0x7fdccc160d20 legacy=0x7fdccc0adba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:53.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.514+0000 7fdcc3fff700 1 --2- 172.21.15.77:0/1534936744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdcb8004c40 0x7fdcb8005020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:53.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.514+0000 7fdcc3fff700 1 --2- 172.21.15.77:0/1534936744 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcb8003810 0x7fdcb8003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:53.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.514+0000 7fdcc3fff700 1 --2- 172.21.15.77:0/1534936744 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdccc161100 0x7fdcb80041d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:53.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.514+0000 7fdcc3fff700 1 -- 172.21.15.77:0/1534936744 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc4001230 con 0x7fdcb8003810 2023-07-24T05:46:53.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.514+0000 7fdcc3fff700 1 -- 172.21.15.77:0/1534936744 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc0b1a40 con 0x7fdcb8004c40 2023-07-24T05:46:53.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.514+0000 7fdcc3fff700 1 -- 172.21.15.77:0/1534936744 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb800bb30 con 0x7fdccc161100 2023-07-24T05:46:53.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.514+0000 7fdcd0ecf700 1 --2- 172.21.15.77:0/1534936744 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcb8003810 0x7fdcb8003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:53.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.514+0000 7fdcd16d0700 1 --2- 172.21.15.77:0/1534936744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdcb8004c40 0x7fdcb8005020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:53.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.514+0000 7fdcd1ed1700 1 --2- 172.21.15.77:0/1534936744 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdccc161100 0x7fdcb80041d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:53.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.514+0000 7fdcd16d0700 1 -- 172.21.15.77:0/1534936744 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdccc161100 msgr2=0x7fdcb80041d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:53.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.514+0000 7fdcd16d0700 1 --2- 172.21.15.77:0/1534936744 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdccc161100 0x7fdcb80041d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:53.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.514+0000 7fdcd16d0700 1 -- 172.21.15.77:0/1534936744 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcb8003810 msgr2=0x7fdcb8003c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:53.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.514+0000 7fdcd16d0700 1 --2- 172.21.15.77:0/1534936744 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcb8003810 0x7fdcb8003c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:53.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.514+0000 7fdcd16d0700 1 -- 172.21.15.77:0/1534936744 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdccc0af170 con 0x7fdcb8004c40 2023-07-24T05:46:53.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.514+0000 7fdcd16d0700 1 --2- 172.21.15.77:0/1534936744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdcb8004c40 0x7fdcb8005020 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdcc800a720 tx=0x7fdcb80058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c071cb27dbe63f8 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:53.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.514+0000 7fdcc3fff700 1 -- 172.21.15.77:0/1534936744 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc800a210 con 0x7fdcb8004c40 2023-07-24T05:46:53.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.514+0000 7fdcc3fff700 1 -- 172.21.15.77:0/1534936744 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc8012660 con 0x7fdcb8004c40 2023-07-24T05:46:53.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.514+0000 7fdcc3fff700 1 -- 172.21.15.77:0/1534936744 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc8012a10 con 0x7fdcb8004c40 2023-07-24T05:46:53.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.514+0000 7fdcd26d2700 1 -- 172.21.15.77:0/1534936744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdcb8004c40 msgr2=0x7fdcb8005020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:53.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.514+0000 7fdcd26d2700 1 --2- 172.21.15.77:0/1534936744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdcb8004c40 0x7fdcb8005020 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdcc800a720 tx=0x7fdcb80058a0 comp rx=0 tx=0).stop 2023-07-24T05:46:53.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.514+0000 7fdcd1ed1700 1 -- 172.21.15.77:0/1534936744 reap_dead start 2023-07-24T05:46:53.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.518+0000 7fdcd26d2700 1 -- 172.21.15.77:0/1534936744 shutdown_connections 2023-07-24T05:46:53.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.518+0000 7fdcd26d2700 1 -- 172.21.15.77:0/1534936744 >> 172.21.15.77:0/1534936744 conn(0x7fdccc0cacc0 msgr2=0x7fdccc0cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:53.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.518+0000 7fdcd26d2700 1 -- 172.21.15.77:0/1534936744 shutdown_connections 2023-07-24T05:46:53.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.518+0000 7fdcd26d2700 1 -- 172.21.15.77:0/1534936744 wait complete. 2023-07-24T05:46:53.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.518+0000 7fdcd26d2700 1 Processor -- start 2023-07-24T05:46:53.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.518+0000 7fdcd26d2700 1 -- start start 2023-07-24T05:46:53.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.522+0000 7fdcd26d2700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdcb8004c40 0x7fdccc0989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:53.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.522+0000 7fdcd26d2700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdccc1fa840 0x7fdccc1f60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:53.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.522+0000 7fdcd26d2700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdccc09b520 0x7fdccc09b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:53.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.522+0000 7fdcd26d2700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc09a4e0 con 0x7fdccc09b520 2023-07-24T05:46:53.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.522+0000 7fdcd26d2700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc099060 con 0x7fdccc1fa840 2023-07-24T05:46:53.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.522+0000 7fdcd26d2700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc09a760 con 0x7fdcb8004c40 2023-07-24T05:46:53.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.522+0000 7fdcd1ed1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdccc09b520 0x7fdccc09b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:53.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.522+0000 7fdcd1ed1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdccc09b520 0x7fdccc09b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48644/0 (socket says 172.21.15.77:48644) 2023-07-24T05:46:53.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.522+0000 7fdcd1ed1700 1 -- 172.21.15.77:0/1476302004 learned_addr learned my addr 172.21.15.77:0/1476302004 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:53.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.522+0000 7fdcd16d0700 1 --2- 172.21.15.77:0/1476302004 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdcb8004c40 0x7fdccc0989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:53.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.522+0000 7fdcd0ecf700 1 --2- 172.21.15.77:0/1476302004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdccc1fa840 0x7fdccc1f60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:53.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.522+0000 7fdcd1ed1700 1 -- 172.21.15.77:0/1476302004 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdcb8004c40 msgr2=0x7fdccc0989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:53.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.522+0000 7fdcd1ed1700 1 --2- 172.21.15.77:0/1476302004 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdcb8004c40 0x7fdccc0989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:53.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.522+0000 7fdcd1ed1700 1 -- 172.21.15.77:0/1476302004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdccc1fa840 msgr2=0x7fdccc1f60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:53.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.522+0000 7fdcd1ed1700 1 --2- 172.21.15.77:0/1476302004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdccc1fa840 0x7fdccc1f60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:53.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.522+0000 7fdcd1ed1700 1 -- 172.21.15.77:0/1476302004 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdccc09aa40 con 0x7fdccc09b520 2023-07-24T05:46:53.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.522+0000 7fdcd1ed1700 1 --2- 172.21.15.77:0/1476302004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdccc09b520 0x7fdccc09b9a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fdccc06b770 tx=0x7fdcc4007570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:53.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.522+0000 7fdcc1ffb700 1 -- 172.21.15.77:0/1476302004 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4012560 con 0x7fdccc09b520 2023-07-24T05:46:53.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.522+0000 7fdcc1ffb700 1 -- 172.21.15.77:0/1476302004 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc40126c0 con 0x7fdccc09b520 2023-07-24T05:46:53.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.522+0000 7fdcd26d2700 1 -- 172.21.15.77:0/1476302004 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdccc09ad20 con 0x7fdccc09b520 2023-07-24T05:46:53.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.522+0000 7fdcc1ffb700 1 -- 172.21.15.77:0/1476302004 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4012a30 con 0x7fdccc09b520 2023-07-24T05:46:53.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.522+0000 7fdcd26d2700 1 -- 172.21.15.77:0/1476302004 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdccc1facc0 con 0x7fdccc09b520 2023-07-24T05:46:53.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.526+0000 7fdcd26d2700 1 -- 172.21.15.77:0/1476302004 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdccc09b240 con 0x7fdccc09b520 2023-07-24T05:46:53.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.526+0000 7fdcc1ffb700 1 -- 172.21.15.77:0/1476302004 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdcc4012b90 con 0x7fdccc09b520 2023-07-24T05:46:53.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.526+0000 7fdcc1ffb700 1 --2- 172.21.15.77:0/1476302004 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fdcb00662f0 0x7fdcb00687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:53.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.526+0000 7fdcc1ffb700 1 -- 172.21.15.77:0/1476302004 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdcc4083f60 con 0x7fdccc09b520 2023-07-24T05:46:53.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.530+0000 7fdcd16d0700 1 --2- 172.21.15.77:0/1476302004 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fdcb00662f0 0x7fdcb00687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:53.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.530+0000 7fdcd16d0700 1 --2- 172.21.15.77:0/1476302004 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fdcb00662f0 0x7fdcb00687b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdcc800a720 tx=0x7fdcc8020040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:53.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.534+0000 7fdcc1ffb700 1 -- 172.21.15.77:0/1476302004 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdccc09b240 con 0x7fdccc09b520 2023-07-24T05:46:53.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.742+0000 7fdcd26d2700 1 -- 172.21.15.77:0/1476302004 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdccc09b240 con 0x7fdccc09b520 2023-07-24T05:46:53.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.742+0000 7fdcc1ffb700 1 -- 172.21.15.77:0/1476302004 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fdccc09b240 con 0x7fdccc09b520 2023-07-24T05:46:53.747 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-07-24T05:46:53.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.746+0000 7fdcd26d2700 1 -- 172.21.15.77:0/1476302004 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fdcb00662f0 msgr2=0x7fdcb00687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:53.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.746+0000 7fdcd26d2700 1 --2- 172.21.15.77:0/1476302004 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fdcb00662f0 0x7fdcb00687b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdcc800a720 tx=0x7fdcc8020040 comp rx=0 tx=0).stop 2023-07-24T05:46:53.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.746+0000 7fdcd26d2700 1 -- 172.21.15.77:0/1476302004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdccc09b520 msgr2=0x7fdccc09b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:53.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.746+0000 7fdcd26d2700 1 --2- 172.21.15.77:0/1476302004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdccc09b520 0x7fdccc09b9a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fdccc06b770 tx=0x7fdcc4007570 comp rx=0 tx=0).stop 2023-07-24T05:46:53.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.746+0000 7fdcd26d2700 1 -- 172.21.15.77:0/1476302004 shutdown_connections 2023-07-24T05:46:53.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.746+0000 7fdcd26d2700 1 --2- 172.21.15.77:0/1476302004 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdccc09b520 0x7fdccc09b9a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:53.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.746+0000 7fdcd26d2700 1 --2- 172.21.15.77:0/1476302004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdccc1fa840 0x7fdccc1f60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:53.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.746+0000 7fdcd26d2700 1 --2- 172.21.15.77:0/1476302004 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fdcb00662f0 0x7fdcb00687b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:53.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.746+0000 7fdcd26d2700 1 --2- 172.21.15.77:0/1476302004 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdcb8004c40 0x7fdccc0989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:53.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.746+0000 7fdcd26d2700 1 -- 172.21.15.77:0/1476302004 >> 172.21.15.77:0/1476302004 conn(0x7fdccc0cacc0 msgr2=0x7fdccc06c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:53.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.746+0000 7fdcd26d2700 1 -- 172.21.15.77:0/1476302004 shutdown_connections 2023-07-24T05:46:53.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:53.746+0000 7fdcd26d2700 1 -- 172.21.15.77:0/1476302004 wait complete. 2023-07-24T05:46:53.770 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-24T05:46:53.770 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-24T05:46:53.770 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi103.front.sepia.ceph.com 2023-07-24T05:46:53.771 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-07-24T05:46:53.771 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-07-24T05:46:53.771 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-24T05:46:53.771 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-24T05:46:53.771 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-24T05:46:53.772 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-07-24T05:46:53.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:53.772 DEBUG:teuthology.orchestra.run.smithi103:> ip addr 2023-07-24T05:46:53.791 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-24T05:46:53.791 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-24T05:46:53.792 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2023-07-24T05:46:53.792 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:46:53.792 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2023-07-24T05:46:53.792 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:46:53.792 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-24T05:46:53.792 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2023-07-24T05:46:53.792 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f0 2023-07-24T05:46:53.793 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-24T05:46:53.793 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2023-07-24T05:46:53.793 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f1 2023-07-24T05:46:53.793 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-24T05:46:53.793 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2023-07-24T05:46:53.793 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-24T05:46:53.793 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2023-07-24T05:46:53.793 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-24T05:46:53.794 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42308sec preferred_lft 42308sec 2023-07-24T05:46:53.794 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2023-07-24T05:46:53.794 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:46:53.794 INFO:teuthology.orchestra.run.smithi103.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-24T05:46:53.794 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 02:42:83:7d:62:09 brd ff:ff:ff:ff:ff:ff 2023-07-24T05:46:53.794 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-24T05:46:53.794 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:46:53.794 INFO:teuthology.orchestra.run.smithi103.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-24T05:46:53.795 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 76:f3:da:2c:4c:04 brd ff:ff:ff:ff:ff:ff 2023-07-24T05:46:53.795 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-24T05:46:53.795 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:46:53.795 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::9c3d:27ff:fe84:130e/64 scope link 2023-07-24T05:46:53.795 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:46:53.795 INFO:teuthology.orchestra.run.smithi103.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-24T05:46:53.795 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 76:f3:da:2c:4c:04 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-24T05:46:53.795 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::74f3:daff:fe2c:4c04/64 scope link 2023-07-24T05:46:53.796 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:46:53.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:53.797 DEBUG:teuthology.orchestra.run.smithi103:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-24T05:46:53.878 INFO:teuthology.orchestra.run.smithi103.stdout:1 2023-07-24T05:46:53.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:53.881 DEBUG:teuthology.orchestra.run.smithi103:> route 2023-07-24T05:46:53.945 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2023-07-24T05:46:53.945 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-24T05:46:53.945 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-24T05:46:53.945 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-24T05:46:53.945 INFO:teuthology.orchestra.run.smithi103.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-24T05:46:53.945 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-07-24T05:46:53.946 INFO:teuthology.orchestra.run.smithi103.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-24T05:46:53.946 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-24T05:46:53.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:53.947 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec bash -c ' 2023-07-24T05:46:53.947 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2023-07-24T05:46:53.947 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-24T05:46:53.948 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-24T05:46:53.948 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-24T05:46:53.948 DEBUG:teuthology.orchestra.run.smithi103:> ') 2023-07-24T05:46:54.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:54.084 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2023-07-24T05:46:54.100 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-24T05:46:54.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:54.102 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list-id 2023-07-24T05:46:54.160 INFO:teuthology.orchestra.run.smithi103.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-07-24T05:46:54.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:54.162 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec bash -c ' 2023-07-24T05:46:54.162 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2023-07-24T05:46:54.162 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-24T05:46:54.162 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-07-24T05:46:54.162 DEBUG:teuthology.orchestra.run.smithi103:> ') 2023-07-24T05:46:54.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:54.277 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-07-24T05:46:54.309 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-24T05:46:54.309 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-24T05:46:54.310 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2023-07-24T05:46:54.310 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:46:54.310 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2023-07-24T05:46:54.310 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:46:54.310 INFO:teuthology.orchestra.run.smithi103.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-24T05:46:54.310 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 3a:67:71:72:a0:05 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-24T05:46:54.310 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-24T05:46:54.311 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:46:54.311 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::3867:71ff:fe72:a005/64 scope link 2023-07-24T05:46:54.311 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:46:54.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:54.313 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-07-24T05:46:54.389 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-24T05:46:54.390 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-24T05:46:54.390 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2023-07-24T05:46:54.390 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:46:54.390 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2023-07-24T05:46:54.390 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:46:54.390 INFO:teuthology.orchestra.run.smithi103.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-24T05:46:54.391 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 3a:67:71:72:a0:05 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-24T05:46:54.391 INFO:teuthology.orchestra.run.smithi103.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-24T05:46:54.391 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:46:54.391 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::3867:71ff:fe72:a005/64 scope link 2023-07-24T05:46:54.391 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:46:54.393 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-07-24T05:46:54.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:54.394 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec bash -c ' 2023-07-24T05:46:54.394 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2023-07-24T05:46:54.394 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-07-24T05:46:54.394 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-07-24T05:46:54.395 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-07-24T05:46:54.395 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-07-24T05:46:54.395 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-07-24T05:46:54.395 DEBUG:teuthology.orchestra.run.smithi103:> ') 2023-07-24T05:46:54.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:54.583 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec bash -c ' 2023-07-24T05:46:54.583 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2023-07-24T05:46:54.583 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set brx.1 up 2023-07-24T05:46:54.584 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set dev brx.1 master ceph-brx 2023-07-24T05:46:54.584 DEBUG:teuthology.orchestra.run.smithi103:> ') 2023-07-24T05:46:54.654 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-07-24T05:46:54.654 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-24T05:46:54.654 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-07-24T05:46:54.670 INFO:teuthology.orchestra.run.smithi103.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-07-24T05:46:54.671 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-24T05:46:54.671 DEBUG:teuthology.orchestra.run.smithi103:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-07-24T05:46:54.727 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2023-07-24T05:46:54.805 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-24T05:46:54.805 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-24T05:46:54.807 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:46:54.814 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:46:54.882 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-24T05:46:54.885 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-24T05:46:54.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:54.886 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2023-07-24T05:46:54.944 INFO:teuthology.orchestra.run.smithi103.stdout:49 2023-07-24T05:46:54.944 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [49] 2023-07-24T05:46:54.945 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-07-24T05:46:54.994 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2023-07-24T05:46:55.027 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-24T05:46:55.028 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-24T05:46:55.102 INFO:teuthology.orchestra.run.smithi103.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-24T05:46:55.104 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-24T05:46:55.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:55.105 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2023-07-24T05:46:55.135 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi103.stderr:2023-07-24T05:46:55.131+0000 7fd21ef7f640 -1 init, newargv = 0x55dc13283d10 newargc=15 2023-07-24T05:46:55.135 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi103.stderr:ceph-fuse[40483]: starting ceph client 2023-07-24T05:46:55.147 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi103.stderr:ceph-fuse[40483]: starting fuse 2023-07-24T05:46:55.147 INFO:teuthology.orchestra.run.smithi103.stdout:49 2023-07-24T05:46:55.148 INFO:teuthology.orchestra.run.smithi103.stdout:50 2023-07-24T05:46:55.148 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49, 50] 2023-07-24T05:46:55.149 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-24T05:46:55.149 DEBUG:teuthology.orchestra.run.smithi103:> import glob 2023-07-24T05:46:55.149 DEBUG:teuthology.orchestra.run.smithi103:> import re 2023-07-24T05:46:55.150 DEBUG:teuthology.orchestra.run.smithi103:> import os 2023-07-24T05:46:55.150 DEBUG:teuthology.orchestra.run.smithi103:> import subprocess 2023-07-24T05:46:55.150 DEBUG:teuthology.orchestra.run.smithi103:> 2023-07-24T05:46:55.150 DEBUG:teuthology.orchestra.run.smithi103:> def _find_admin_socket(client_name): 2023-07-24T05:46:55.150 DEBUG:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-07-24T05:46:55.151 DEBUG:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2023-07-24T05:46:55.151 DEBUG:teuthology.orchestra.run.smithi103:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-07-24T05:46:55.151 DEBUG:teuthology.orchestra.run.smithi103:> 2023-07-24T05:46:55.151 DEBUG:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2023-07-24T05:46:55.152 DEBUG:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2023-07-24T05:46:55.152 DEBUG:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2023-07-24T05:46:55.152 DEBUG:teuthology.orchestra.run.smithi103:> return files[0] 2023-07-24T05:46:55.152 DEBUG:teuthology.orchestra.run.smithi103:> 2023-07-24T05:46:55.152 DEBUG:teuthology.orchestra.run.smithi103:> for f in files: 2023-07-24T05:46:55.153 DEBUG:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-24T05:46:55.153 DEBUG:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-24T05:46:55.153 DEBUG:teuthology.orchestra.run.smithi103:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-24T05:46:55.153 DEBUG:teuthology.orchestra.run.smithi103:> contents = proc_f.read() 2023-07-24T05:46:55.154 DEBUG:teuthology.orchestra.run.smithi103:> if mountpoint in contents: 2023-07-24T05:46:55.154 DEBUG:teuthology.orchestra.run.smithi103:> return f 2023-07-24T05:46:55.154 DEBUG:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-24T05:46:55.154 DEBUG:teuthology.orchestra.run.smithi103:> 2023-07-24T05:46:55.154 DEBUG:teuthology.orchestra.run.smithi103:> print(_find_admin_socket("client.3")) 2023-07-24T05:46:55.155 DEBUG:teuthology.orchestra.run.smithi103:> ' 2023-07-24T05:46:55.311 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.3.40483.asok 2023-07-24T05:46:55.495 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.40483.asok 2023-07-24T05:46:55.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:55.495 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.40483.asok status 2023-07-24T05:46:55.689 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2023-07-24T05:46:55.689 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2023-07-24T05:46:55.689 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "e2c50893bf78471cc8ee960317cc10390300dfd5", 2023-07-24T05:46:55.689 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 18.0.0-5042-ge2c50893 (e2c50893bf78471cc8ee960317cc10390300dfd5) reef (dev)", 2023-07-24T05:46:55.689 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "3", 2023-07-24T05:46:55.689 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2023-07-24T05:46:55.690 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-07-24T05:46:55.690 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "40483", 2023-07-24T05:46:55.690 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2023-07-24T05:46:55.690 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2023-07-24T05:46:55.690 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2023-07-24T05:46:55.690 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2023-07-24T05:46:55.690 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4727, 2023-07-24T05:46:55.690 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2023-07-24T05:46:55.691 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2023-07-24T05:46:55.691 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2023-07-24T05:46:55.691 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 4727 2023-07-24T05:46:55.691 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2023-07-24T05:46:55.691 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2023-07-24T05:46:55.691 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2023-07-24T05:46:55.691 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.2:0", 2023-07-24T05:46:55.691 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 3320472139 2023-07-24T05:46:55.692 INFO:teuthology.orchestra.run.smithi103.stdout: } 2023-07-24T05:46:55.692 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2023-07-24T05:46:55.692 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2023-07-24T05:46:55.692 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2023-07-24T05:46:55.692 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.2:0", 2023-07-24T05:46:55.692 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 3320472139 2023-07-24T05:46:55.692 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2023-07-24T05:46:55.693 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.4727 192.168.0.2:0/3320472139", 2023-07-24T05:46:55.693 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.2:0/3320472139", 2023-07-24T05:46:55.693 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2023-07-24T05:46:55.693 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 9, 2023-07-24T05:46:55.693 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 27, 2023-07-24T05:46:55.693 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2023-07-24T05:46:55.693 INFO:teuthology.orchestra.run.smithi103.stdout: "blocklisted": false, 2023-07-24T05:46:55.693 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs" 2023-07-24T05:46:55.694 INFO:teuthology.orchestra.run.smithi103.stdout:} 2023-07-24T05:46:55.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:55.703 DEBUG:teuthology.orchestra.run.smithi077:> stat --file-system '--printf=%T 2023-07-24T05:46:55.703 DEBUG:teuthology.orchestra.run.smithi077:> ' -- /home/ubuntu/cephtest/mnt.0 2023-07-24T05:46:55.724 INFO:teuthology.orchestra.run.smithi077.stdout:fuseblk 2023-07-24T05:46:55.724 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-07-24T05:46:55.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:55.725 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-24T05:46:55.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:55.802 DEBUG:teuthology.orchestra.run.smithi077:> stat --file-system '--printf=%T 2023-07-24T05:46:55.802 DEBUG:teuthology.orchestra.run.smithi077:> ' -- /home/ubuntu/cephtest/mnt.2 2023-07-24T05:46:55.863 INFO:teuthology.orchestra.run.smithi077.stdout:fuseblk 2023-07-24T05:46:55.863 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-07-24T05:46:55.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:55.864 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-07-24T05:46:55.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:55.933 DEBUG:teuthology.orchestra.run.smithi103:> stat --file-system '--printf=%T 2023-07-24T05:46:55.933 DEBUG:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.1 2023-07-24T05:46:55.951 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2023-07-24T05:46:55.952 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-07-24T05:46:55.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:55.953 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-24T05:46:56.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:56.031 DEBUG:teuthology.orchestra.run.smithi103:> stat --file-system '--printf=%T 2023-07-24T05:46:56.031 DEBUG:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.3 2023-07-24T05:46:56.092 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2023-07-24T05:46:56.092 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-07-24T05:46:56.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:46:56.093 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-07-24T05:46:56.174 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-07-24T05:46:56.189 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-24T05:46:56.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.357+0000 7faa5edf6700 1 Processor -- start 2023-07-24T05:46:56.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.357+0000 7faa5edf6700 1 -- start start 2023-07-24T05:46:56.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.361+0000 7faa5edf6700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7faa5806ac20 0x7faa580b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:56.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.361+0000 7faa5edf6700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faa580b2990 0x7faa580cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:56.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.361+0000 7faa5edf6700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa580cce50 con 0x7faa580ae5a0 2023-07-24T05:46:56.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.361+0000 7faa5edf6700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa58159bf0 con 0x7faa5806ac20 2023-07-24T05:46:56.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.361+0000 7faa5edf6700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa580cd130 con 0x7faa580b2990 2023-07-24T05:46:56.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.361+0000 7faa5ddf4700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7faa5806ac20 0x7faa580b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:56.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.361+0000 7faa5ddf4700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7faa5806ac20 0x7faa580b1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:44246/0 (socket says 172.21.15.77:44246) 2023-07-24T05:46:56.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.361+0000 7faa5ddf4700 1 -- 172.21.15.77:0/2401994222 learned_addr learned my addr 172.21.15.77:0/2401994222 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:56.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.361+0000 7faa5e5f5700 1 --2- 172.21.15.77:0/2401994222 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faa580b2990 0x7faa580cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:56.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.361+0000 7faa5ddf4700 1 -- 172.21.15.77:0/2401994222 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faa580b2990 msgr2=0x7faa580cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:56.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.365+0000 7faa5ddf4700 1 --2- 172.21.15.77:0/2401994222 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faa580b2990 0x7faa580cdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:56.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.365+0000 7faa5ddf4700 1 -- 172.21.15.77:0/2401994222 >> v1:172.21.15.103:6789/0 conn(0x7faa580ae5a0 legacy=0x7faa5806b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:56.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.365+0000 7faa5ddf4700 1 -- 172.21.15.77:0/2401994222 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa580cd410 con 0x7faa5806ac20 2023-07-24T05:46:56.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.365+0000 7faa5ddf4700 1 --2- 172.21.15.77:0/2401994222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa5806ac20 0x7faa580b1670 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7faa54009e50 tx=0x7faa5400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e982992b5429e87 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:56.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.365+0000 7faa5cdf2700 1 -- 172.21.15.77:0/2401994222 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5400e070 con 0x7faa5806ac20 2023-07-24T05:46:56.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.365+0000 7faa5cdf2700 1 -- 172.21.15.77:0/2401994222 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa5400b9c0 con 0x7faa5806ac20 2023-07-24T05:46:56.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.365+0000 7faa5cdf2700 1 -- 172.21.15.77:0/2401994222 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5400bd70 con 0x7faa5806ac20 2023-07-24T05:46:56.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.365+0000 7faa5edf6700 1 -- 172.21.15.77:0/2401994222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa5806ac20 msgr2=0x7faa580b1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:56.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.365+0000 7faa5edf6700 1 --2- 172.21.15.77:0/2401994222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa5806ac20 0x7faa580b1670 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7faa54009e50 tx=0x7faa5400b330 comp rx=0 tx=0).stop 2023-07-24T05:46:56.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.365+0000 7faa5edf6700 1 -- 172.21.15.77:0/2401994222 shutdown_connections 2023-07-24T05:46:56.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.365+0000 7faa5edf6700 1 --2- 172.21.15.77:0/2401994222 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faa580b2990 0x7faa580cdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:56.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.365+0000 7faa5edf6700 1 --2- 172.21.15.77:0/2401994222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa5806ac20 0x7faa580b1670 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:56.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.365+0000 7faa5edf6700 1 -- 172.21.15.77:0/2401994222 >> 172.21.15.77:0/2401994222 conn(0x7faa580cacc0 msgr2=0x7faa580cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:56.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.365+0000 7faa5edf6700 1 -- 172.21.15.77:0/2401994222 shutdown_connections 2023-07-24T05:46:56.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.365+0000 7faa5edf6700 1 -- 172.21.15.77:0/2401994222 wait complete. 2023-07-24T05:46:56.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.369+0000 7faa5edf6700 1 Processor -- start 2023-07-24T05:46:56.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.369+0000 7faa5edf6700 1 -- start start 2023-07-24T05:46:56.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.369+0000 7faa5edf6700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa5806ac20 0x7faa58099b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:56.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.369+0000 7faa5edf6700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa580ae5a0 0x7faa581590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:56.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.369+0000 7faa5edf6700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faa580b2990 0x7faa581f5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:56.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.369+0000 7faa5edf6700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa58159630 con 0x7faa580ae5a0 2023-07-24T05:46:56.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.369+0000 7faa5edf6700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa581f62f0 con 0x7faa5806ac20 2023-07-24T05:46:56.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.369+0000 7faa5edf6700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa581f65d0 con 0x7faa580b2990 2023-07-24T05:46:56.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.369+0000 7faa5d5f3700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa580ae5a0 0x7faa581590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:56.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.369+0000 7faa5d5f3700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa580ae5a0 0x7faa581590f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48654/0 (socket says 172.21.15.77:48654) 2023-07-24T05:46:56.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.369+0000 7faa5d5f3700 1 -- 172.21.15.77:0/3679197031 learned_addr learned my addr 172.21.15.77:0/3679197031 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:56.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.369+0000 7faa5e5f5700 1 --2- 172.21.15.77:0/3679197031 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faa580b2990 0x7faa581f5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:56.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.369+0000 7faa5ddf4700 1 --2- 172.21.15.77:0/3679197031 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa5806ac20 0x7faa58099b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:56.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.373+0000 7faa5d5f3700 1 -- 172.21.15.77:0/3679197031 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faa580b2990 msgr2=0x7faa581f5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:56.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.373+0000 7faa5d5f3700 1 --2- 172.21.15.77:0/3679197031 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faa580b2990 0x7faa581f5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:56.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.373+0000 7faa5d5f3700 1 -- 172.21.15.77:0/3679197031 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa5806ac20 msgr2=0x7faa58099b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:56.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.373+0000 7faa5d5f3700 1 --2- 172.21.15.77:0/3679197031 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa5806ac20 0x7faa58099b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:56.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.373+0000 7faa5d5f3700 1 -- 172.21.15.77:0/3679197031 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa54009b30 con 0x7faa580ae5a0 2023-07-24T05:46:56.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.373+0000 7faa5e5f5700 1 --2- 172.21.15.77:0/3679197031 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faa580b2990 0x7faa581f5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:46:56.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.373+0000 7faa5d5f3700 1 --2- 172.21.15.77:0/3679197031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa580ae5a0 0x7faa581590f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7faa4800c480 tx=0x7faa4800c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:56.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.373+0000 7faa4e7fc700 1 -- 172.21.15.77:0/3679197031 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa480052d0 con 0x7faa580ae5a0 2023-07-24T05:46:56.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.373+0000 7faa4e7fc700 1 -- 172.21.15.77:0/3679197031 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa48005430 con 0x7faa580ae5a0 2023-07-24T05:46:56.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.373+0000 7faa4e7fc700 1 -- 172.21.15.77:0/3679197031 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa480055a0 con 0x7faa580ae5a0 2023-07-24T05:46:56.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.373+0000 7faa5edf6700 1 -- 172.21.15.77:0/3679197031 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa581f68b0 con 0x7faa580ae5a0 2023-07-24T05:46:56.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.373+0000 7faa5edf6700 1 -- 172.21.15.77:0/3679197031 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa581f28a0 con 0x7faa580ae5a0 2023-07-24T05:46:56.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.373+0000 7faa5edf6700 1 -- 172.21.15.77:0/3679197031 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa58072490 con 0x7faa580ae5a0 2023-07-24T05:46:56.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.377+0000 7faa4e7fc700 1 -- 172.21.15.77:0/3679197031 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faa480036a0 con 0x7faa580ae5a0 2023-07-24T05:46:56.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.381+0000 7faa4e7fc700 1 --2- 172.21.15.77:0/3679197031 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7faa3c0662f0 0x7faa3c0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:56.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.381+0000 7faa4e7fc700 1 -- 172.21.15.77:0/3679197031 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7faa48083280 con 0x7faa580ae5a0 2023-07-24T05:46:56.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.381+0000 7faa5ddf4700 1 --2- 172.21.15.77:0/3679197031 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7faa3c0662f0 0x7faa3c0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:56.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.381+0000 7faa5ddf4700 1 --2- 172.21.15.77:0/3679197031 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7faa3c0662f0 0x7faa3c0687b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7faa5400b370 tx=0x7faa54009000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:56.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.385+0000 7faa4e7fc700 1 -- 172.21.15.77:0/3679197031 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faa48050480 con 0x7faa580ae5a0 2023-07-24T05:46:56.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.561+0000 7faa5edf6700 1 -- 172.21.15.77:0/3679197031 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa580b1060 con 0x7faa580ae5a0 2023-07-24T05:46:56.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.561+0000 7faa4e7fc700 1 -- 172.21.15.77:0/3679197031 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20204 (secure 0 0 0) 0x7faa48053aa0 con 0x7faa580ae5a0 2023-07-24T05:46:56.568 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:46:56.569 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":27,"fsid":"5aed5f7b-fb55-4d95-9c02-c6adbb1677b4","created":"2023-07-24T05:45:39.639731+0000","modified":"2023-07-24T05:46:48.442117+0000","last_up_change":"2023-07-24T05:45:52.319670+0000","last_in_change":"2023-07-24T05:45:43.643277+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-24T05:45:52.610430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-24T05:45:52.773787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-24T05:45:58.121732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-24T05:45:59.368726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-24T05:46:03.032057+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ffa0d496-461a-4053-b764-0627d969521b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6812","nonce":825987196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6817","nonce":825987196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6831","nonce":825987196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6824","nonce":825987196}]},"public_addr":"172.21.15.77:6812/825987196","cluster_addr":"172.21.15.77:6817/825987196","heartbeat_back_addr":"172.21.15.77:6831/825987196","heartbeat_front_addr":"172.21.15.77:6824/825987196","state":["exists","up"]},{"osd":1,"uuid":"9f595e5e-5c43-49bc-8ce4-ee70575c90da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6801","nonce":4133026815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6803","nonce":4133026815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6807","nonce":4133026815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6805","nonce":4133026815}]},"public_addr":"172.21.15.77:6801/4133026815","cluster_addr":"172.21.15.77:6803/4133026815","heartbeat_back_addr":"172.21.15.77:6807/4133026815","heartbeat_front_addr":"172.21.15.77:6805/4133026815","state":["exists","up"]},{"osd":2,"uuid":"2ac177aa-4d7d-4262-bd54-d2b9f29f4c3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6811","nonce":2394142159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6819","nonce":2394142159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6830","nonce":2394142159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6825","nonce":2394142159}]},"public_addr":"172.21.15.77:6811/2394142159","cluster_addr":"172.21.15.77:6819/2394142159","heartbeat_back_addr":"172.21.15.77:6830/2394142159","heartbeat_front_addr":"172.21.15.77:6825/2394142159","state":["exists","up"]},{"osd":3,"uuid":"17d7a251-19e8-484c-8172-a578ab3da153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6813","nonce":1492113982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6818","nonce":1492113982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6829","nonce":1492113982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6823","nonce":1492113982}]},"public_addr":"172.21.15.77:6813/1492113982","cluster_addr":"172.21.15.77:6818/1492113982","heartbeat_back_addr":"172.21.15.77:6829/1492113982","heartbeat_front_addr":"172.21.15.77:6823/1492113982","state":["exists","up"]},{"osd":4,"uuid":"bf63ca05-f06d-4e0f-ac44-2a416c70b919","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6825","nonce":1080481057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6827","nonce":1080481057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6831","nonce":1080481057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6829","nonce":1080481057}]},"public_addr":"172.21.15.103:6825/1080481057","cluster_addr":"172.21.15.103:6827/1080481057","heartbeat_back_addr":"172.21.15.103:6831/1080481057","heartbeat_front_addr":"172.21.15.103:6829/1080481057","state":["exists","up"]},{"osd":5,"uuid":"65a11a35-9e9f-4b3c-9fe3-b658d62b9318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6811","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6813","nonce":2756677504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6818","nonce":2756677504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6823","nonce":2756677504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6821","nonce":2756677504}]},"public_addr":"172.21.15.103:6813/2756677504","cluster_addr":"172.21.15.103:6818/2756677504","heartbeat_back_addr":"172.21.15.103:6823/2756677504","heartbeat_front_addr":"172.21.15.103:6821/2756677504","state":["exists","up"]},{"osd":6,"uuid":"750c1f87-686c-40b4-94a1-1a299dc78f3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6809","nonce":568977764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6812","nonce":568977764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6819","nonce":568977764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6815","nonce":568977764}]},"public_addr":"172.21.15.103:6809/568977764","cluster_addr":"172.21.15.103:6812/568977764","heartbeat_back_addr":"172.21.15.103:6819/568977764","heartbeat_front_addr":"172.21.15.103:6815/568977764","state":["exists","up"]},{"osd":7,"uuid":"d5fe4fb6-2e09-4158-885b-403803c85822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6801","nonce":1074557176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6803","nonce":1074557176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6807","nonce":1074557176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6805","nonce":1074557176}]},"public_addr":"172.21.15.103:6801/1074557176","cluster_addr":"172.21.15.103:6803/1074557176","heartbeat_back_addr":"172.21.15.103:6807/1074557176","heartbeat_front_addr":"172.21.15.103:6805/1074557176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.631032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.154109+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.398587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.679089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.311218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.353726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.314372+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.126212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1d","mappings":[{"from":3,"to":2}]},{"pgid":"4.31","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-24T05:46:56.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.565+0000 7faa5edf6700 1 -- 172.21.15.77:0/3679197031 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7faa3c0662f0 msgr2=0x7faa3c0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:56.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.565+0000 7faa5edf6700 1 --2- 172.21.15.77:0/3679197031 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7faa3c0662f0 0x7faa3c0687b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7faa5400b370 tx=0x7faa54009000 comp rx=0 tx=0).stop 2023-07-24T05:46:56.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.565+0000 7faa5edf6700 1 -- 172.21.15.77:0/3679197031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa580ae5a0 msgr2=0x7faa581590f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:56.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.565+0000 7faa5edf6700 1 --2- 172.21.15.77:0/3679197031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa580ae5a0 0x7faa581590f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7faa4800c480 tx=0x7faa4800c790 comp rx=0 tx=0).stop 2023-07-24T05:46:56.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.569+0000 7faa5edf6700 1 -- 172.21.15.77:0/3679197031 shutdown_connections 2023-07-24T05:46:56.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.569+0000 7faa5edf6700 1 --2- 172.21.15.77:0/3679197031 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7faa3c0662f0 0x7faa3c0687b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:56.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.569+0000 7faa5edf6700 1 --2- 172.21.15.77:0/3679197031 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7faa580b2990 0x7faa581f5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:56.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.569+0000 7faa5edf6700 1 --2- 172.21.15.77:0/3679197031 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa580ae5a0 0x7faa581590f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:56.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.569+0000 7faa5edf6700 1 --2- 172.21.15.77:0/3679197031 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa5806ac20 0x7faa58099b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:56.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.569+0000 7faa5edf6700 1 -- 172.21.15.77:0/3679197031 >> 172.21.15.77:0/3679197031 conn(0x7faa580cacc0 msgr2=0x7faa580aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:56.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.569+0000 7faa5edf6700 1 -- 172.21.15.77:0/3679197031 shutdown_connections 2023-07-24T05:46:56.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.569+0000 7faa5edf6700 1 -- 172.21.15.77:0/3679197031 wait complete. 2023-07-24T05:46:56.593 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-24T05:45:52.610430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-24T05:45:52.773787+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-24T05:45:58.121732+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-24T05:45:59.368726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-24T05:46:03.032057+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-24T05:46:56.594 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-24T05:46:56.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.765+0000 7f725a38b700 1 Processor -- start 2023-07-24T05:46:56.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.765+0000 7f725a38b700 1 -- start start 2023-07-24T05:46:56.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.769+0000 7f725a38b700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f725415a950 0x7f72540b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:56.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.769+0000 7f725a38b700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f725406a220 0x7f725406d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:56.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.769+0000 7f725a38b700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f725406b000 con 0x7f72540c4e70 2023-07-24T05:46:56.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.769+0000 7f725a38b700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72540b1ac0 con 0x7f725415a950 2023-07-24T05:46:56.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.769+0000 7f725a38b700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f725406a7c0 con 0x7f725406a220 2023-07-24T05:46:56.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.769+0000 7f7259389700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f725415a950 0x7f72540b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:56.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.769+0000 7f7259389700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f725415a950 0x7f72540b1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48656/0 (socket says 172.21.15.77:48656) 2023-07-24T05:46:56.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.769+0000 7f7259389700 1 -- 172.21.15.77:0/2266791891 learned_addr learned my addr 172.21.15.77:0/2266791891 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:56.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.769+0000 7f7259b8a700 1 --2- 172.21.15.77:0/2266791891 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f725406a220 0x7f725406d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:56.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.769+0000 7f7259389700 1 -- 172.21.15.77:0/2266791891 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f725406a220 msgr2=0x7f725406d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:56.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.769+0000 7f7259389700 1 --2- 172.21.15.77:0/2266791891 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f725406a220 0x7f725406d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:56.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.769+0000 7f7259389700 1 -- 172.21.15.77:0/2266791891 >> v1:172.21.15.103:6789/0 conn(0x7f72540c4e70 legacy=0x7f7254069b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:56.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.769+0000 7f7259389700 1 -- 172.21.15.77:0/2266791891 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f725406aaa0 con 0x7f725415a950 2023-07-24T05:46:56.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.769+0000 7f7259b8a700 1 --2- 172.21.15.77:0/2266791891 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f725406a220 0x7f725406d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:46:56.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.769+0000 7f7259389700 1 --2- 172.21.15.77:0/2266791891 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f725415a950 0x7f72540b1f10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7250009910 tx=0x7f7250009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd1511de703ed4f5 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:56.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.769+0000 7f724bfff700 1 -- 172.21.15.77:0/2266791891 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725000ba60 con 0x7f725415a950 2023-07-24T05:46:56.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.769+0000 7f724bfff700 1 -- 172.21.15.77:0/2266791891 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f725000bbc0 con 0x7f725415a950 2023-07-24T05:46:56.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.769+0000 7f724bfff700 1 -- 172.21.15.77:0/2266791891 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7250009e60 con 0x7f725415a950 2023-07-24T05:46:56.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.773+0000 7f725a38b700 1 -- 172.21.15.77:0/2266791891 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f725415a950 msgr2=0x7f72540b1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:56.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.773+0000 7f725a38b700 1 --2- 172.21.15.77:0/2266791891 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f725415a950 0x7f72540b1f10 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f7250009910 tx=0x7f7250009c20 comp rx=0 tx=0).stop 2023-07-24T05:46:56.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.773+0000 7f725a38b700 1 -- 172.21.15.77:0/2266791891 shutdown_connections 2023-07-24T05:46:56.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.773+0000 7f725a38b700 1 --2- 172.21.15.77:0/2266791891 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f725406a220 0x7f725406d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:56.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.773+0000 7f725a38b700 1 --2- 172.21.15.77:0/2266791891 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f725415a950 0x7f72540b1f10 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:56.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.773+0000 7f725a38b700 1 -- 172.21.15.77:0/2266791891 >> 172.21.15.77:0/2266791891 conn(0x7f72540ce260 msgr2=0x7f72540ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:56.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.773+0000 7f725a38b700 1 -- 172.21.15.77:0/2266791891 shutdown_connections 2023-07-24T05:46:56.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.773+0000 7f725a38b700 1 -- 172.21.15.77:0/2266791891 wait complete. 2023-07-24T05:46:56.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.773+0000 7f725a38b700 1 Processor -- start 2023-07-24T05:46:56.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.777+0000 7f725a38b700 1 -- start start 2023-07-24T05:46:56.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.777+0000 7f725a38b700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f725406a220 0x7f725414e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:56.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.777+0000 7f725a38b700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f72540c4e70 0x7f7254158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:56.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.777+0000 7f725a38b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f725415a950 0x7f7254159010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:56.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.777+0000 7f725a38b700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725415c5b0 con 0x7f725415a950 2023-07-24T05:46:56.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.777+0000 7f725a38b700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72540ae5d0 con 0x7f725406a220 2023-07-24T05:46:56.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.777+0000 7f725a38b700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72540ae890 con 0x7f72540c4e70 2023-07-24T05:46:56.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.777+0000 7f7259b8a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f725415a950 0x7f7254159010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:56.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.777+0000 7f7259b8a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f725415a950 0x7f7254159010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48662/0 (socket says 172.21.15.77:48662) 2023-07-24T05:46:56.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.777+0000 7f7259b8a700 1 -- 172.21.15.77:0/1796338079 learned_addr learned my addr 172.21.15.77:0/1796338079 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:56.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.777+0000 7f7259389700 1 --2- 172.21.15.77:0/1796338079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f725406a220 0x7f725414e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:56.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.777+0000 7f7258b88700 1 --2- 172.21.15.77:0/1796338079 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f72540c4e70 0x7f7254158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:56.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.777+0000 7f7259b8a700 1 -- 172.21.15.77:0/1796338079 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f72540c4e70 msgr2=0x7f7254158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:56.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.777+0000 7f7259b8a700 1 --2- 172.21.15.77:0/1796338079 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f72540c4e70 0x7f7254158ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:56.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.777+0000 7f7259b8a700 1 -- 172.21.15.77:0/1796338079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f725406a220 msgr2=0x7f725414e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:56.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.777+0000 7f7259b8a700 1 --2- 172.21.15.77:0/1796338079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f725406a220 0x7f725414e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:56.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.777+0000 7f7259b8a700 1 -- 172.21.15.77:0/1796338079 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7250009570 con 0x7f725415a950 2023-07-24T05:46:56.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.777+0000 7f7259b8a700 1 --2- 172.21.15.77:0/1796338079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f725415a950 0x7f7254159010 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f724c007df0 tx=0x7f724c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:56.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.777+0000 7f7249ffb700 1 -- 172.21.15.77:0/1796338079 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724c00ddd0 con 0x7f725415a950 2023-07-24T05:46:56.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.777+0000 7f7249ffb700 1 -- 172.21.15.77:0/1796338079 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724c00f040 con 0x7f725415a950 2023-07-24T05:46:56.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.777+0000 7f7249ffb700 1 -- 172.21.15.77:0/1796338079 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724c003c80 con 0x7f725415a950 2023-07-24T05:46:56.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.777+0000 7f725a38b700 1 -- 172.21.15.77:0/1796338079 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72540aeb70 con 0x7f725415a950 2023-07-24T05:46:56.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.781+0000 7f725a38b700 1 -- 172.21.15.77:0/1796338079 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f725415c240 con 0x7f725415a950 2023-07-24T05:46:56.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.781+0000 7f725a38b700 1 -- 172.21.15.77:0/1796338079 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f725406bd40 con 0x7f725415a950 2023-07-24T05:46:56.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.781+0000 7f7249ffb700 1 -- 172.21.15.77:0/1796338079 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f724c004030 con 0x7f725415a950 2023-07-24T05:46:56.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.781+0000 7f7249ffb700 1 --2- 172.21.15.77:0/1796338079 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f72380662f0 0x7f72380687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:56.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.785+0000 7f7249ffb700 1 -- 172.21.15.77:0/1796338079 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f724c084250 con 0x7f725415a950 2023-07-24T05:46:56.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.785+0000 7f7259389700 1 --2- 172.21.15.77:0/1796338079 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f72380662f0 0x7f72380687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:56.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.785+0000 7f7259389700 1 --2- 172.21.15.77:0/1796338079 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f72380662f0 0x7f72380687b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7250000c00 tx=0x7f7250008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:56.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.789+0000 7f7249ffb700 1 -- 172.21.15.77:0/1796338079 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f724c0513a0 con 0x7f725415a950 2023-07-24T05:46:56.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.961+0000 7f725a38b700 1 -- 172.21.15.77:0/1796338079 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7254071270 con 0x7f725415a950 2023-07-24T05:46:56.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.961+0000 7f7249ffb700 1 -- 172.21.15.77:0/1796338079 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f724c0549c0 con 0x7f725415a950 2023-07-24T05:46:56.969 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-07-24T05:46:56.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.965+0000 7f725a38b700 1 -- 172.21.15.77:0/1796338079 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f72380662f0 msgr2=0x7f72380687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:56.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.965+0000 7f725a38b700 1 --2- 172.21.15.77:0/1796338079 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f72380662f0 0x7f72380687b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7250000c00 tx=0x7f7250008030 comp rx=0 tx=0).stop 2023-07-24T05:46:56.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.965+0000 7f725a38b700 1 -- 172.21.15.77:0/1796338079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f725415a950 msgr2=0x7f7254159010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:56.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.965+0000 7f725a38b700 1 --2- 172.21.15.77:0/1796338079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f725415a950 0x7f7254159010 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f724c007df0 tx=0x7f724c00d3b0 comp rx=0 tx=0).stop 2023-07-24T05:46:56.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.965+0000 7f725a38b700 1 -- 172.21.15.77:0/1796338079 shutdown_connections 2023-07-24T05:46:56.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.965+0000 7f725a38b700 1 --2- 172.21.15.77:0/1796338079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f725415a950 0x7f7254159010 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:56.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.965+0000 7f725a38b700 1 --2- 172.21.15.77:0/1796338079 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f72380662f0 0x7f72380687b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:56.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.965+0000 7f725a38b700 1 --2- 172.21.15.77:0/1796338079 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f72540c4e70 0x7f7254158ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:56.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.965+0000 7f725a38b700 1 --2- 172.21.15.77:0/1796338079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f725406a220 0x7f725414e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:56.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.965+0000 7f725a38b700 1 -- 172.21.15.77:0/1796338079 >> 172.21.15.77:0/1796338079 conn(0x7f72540ce260 msgr2=0x7f72540aaf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:56.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.965+0000 7f725a38b700 1 -- 172.21.15.77:0/1796338079 shutdown_connections 2023-07-24T05:46:56.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:56.965+0000 7f725a38b700 1 -- 172.21.15.77:0/1796338079 wait complete. 2023-07-24T05:46:56.993 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-24T05:46:57.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.165+0000 7efc6b59e700 1 Processor -- start 2023-07-24T05:46:57.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.165+0000 7efc6b59e700 1 -- start start 2023-07-24T05:46:57.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.165+0000 7efc6b59e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7efc6c0aaf50 0x7efc6c0abb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:57.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.165+0000 7efc6b59e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efc6c06a520 0x7efc6c0ab330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:57.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.165+0000 7efc6b59e700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efc6c06d400 0x7efc6c0b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:57.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.165+0000 7efc6b59e700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc6c0ac400 con 0x7efc6c06d400 2023-07-24T05:46:57.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.165+0000 7efc6b59e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc6c06cf70 con 0x7efc6c0aaf50 2023-07-24T05:46:57.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.165+0000 7efc6b59e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c0ab870 con 0x7efc6c06a520 2023-07-24T05:46:57.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.165+0000 7efc6ad9d700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efc6c06d400 0x7efc6c0b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:57.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.165+0000 7efc6ad9d700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7efc6c06d400 0x7efc6c0b10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48670/0 (socket says 172.21.15.77:48670) 2023-07-24T05:46:57.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.165+0000 7efc6ad9d700 1 -- 172.21.15.77:0/1914096324 learned_addr learned my addr 172.21.15.77:0/1914096324 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:57.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.165+0000 7efc6a59c700 1 --2- 172.21.15.77:0/1914096324 >> v2:172.21.15.103:3300/0 conn(0x7efc6c0aaf50 0x7efc6c0abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:57.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.165+0000 7efc6ad9d700 1 -- 172.21.15.77:0/1914096324 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efc6c06a520 msgr2=0x7efc6c0ab330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:57.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.165+0000 7efc6ad9d700 1 --2- 172.21.15.77:0/1914096324 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efc6c06a520 0x7efc6c0ab330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:57.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.165+0000 7efc6ad9d700 1 -- 172.21.15.77:0/1914096324 >> v2:172.21.15.103:3300/0 conn(0x7efc6c0aaf50 msgr2=0x7efc6c0abb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:57.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.165+0000 7efc6ad9d700 1 --2- 172.21.15.77:0/1914096324 >> v2:172.21.15.103:3300/0 conn(0x7efc6c0aaf50 0x7efc6c0abb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:57.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.165+0000 7efc6ad9d700 1 -- 172.21.15.77:0/1914096324 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6c06ac90 con 0x7efc6c06d400 2023-07-24T05:46:57.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.165+0000 7efc6a59c700 1 --2- 172.21.15.77:0/1914096324 >> v2:172.21.15.103:3300/0 conn(0x7efc6c0aaf50 0x7efc6c0abb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:46:57.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.169+0000 7efc6ad9d700 1 --2- 172.21.15.77:0/1914096324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc6c06d400 0x7efc6c0b10b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7efc6c06bfd0 tx=0x7efc6400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12ee1a4e504a1b43 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:57.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.169+0000 7efc6959a700 1 -- 172.21.15.77:0/1914096324 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6400e070 con 0x7efc6c06d400 2023-07-24T05:46:57.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.169+0000 7efc6959a700 1 -- 172.21.15.77:0/1914096324 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc6400b9c0 con 0x7efc6c06d400 2023-07-24T05:46:57.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.169+0000 7efc6959a700 1 -- 172.21.15.77:0/1914096324 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6400bd70 con 0x7efc6c06d400 2023-07-24T05:46:57.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.169+0000 7efc6b59e700 1 -- 172.21.15.77:0/1914096324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc6c06d400 msgr2=0x7efc6c0b10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:57.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.169+0000 7efc6b59e700 1 --2- 172.21.15.77:0/1914096324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc6c06d400 0x7efc6c0b10b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7efc6c06bfd0 tx=0x7efc6400b330 comp rx=0 tx=0).stop 2023-07-24T05:46:57.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.169+0000 7efc6b59e700 1 -- 172.21.15.77:0/1914096324 shutdown_connections 2023-07-24T05:46:57.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.169+0000 7efc6b59e700 1 --2- 172.21.15.77:0/1914096324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc6c06d400 0x7efc6c0b10b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:57.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.169+0000 7efc6b59e700 1 --2- 172.21.15.77:0/1914096324 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efc6c06a520 0x7efc6c0ab330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:57.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.169+0000 7efc6b59e700 1 --2- 172.21.15.77:0/1914096324 >> v2:172.21.15.103:3300/0 conn(0x7efc6c0aaf50 0x7efc6c0abb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:57.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.169+0000 7efc6b59e700 1 -- 172.21.15.77:0/1914096324 >> 172.21.15.77:0/1914096324 conn(0x7efc6c0ce260 msgr2=0x7efc6c0ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:57.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.169+0000 7efc6b59e700 1 -- 172.21.15.77:0/1914096324 shutdown_connections 2023-07-24T05:46:57.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.169+0000 7efc6b59e700 1 -- 172.21.15.77:0/1914096324 wait complete. 2023-07-24T05:46:57.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.173+0000 7efc6b59e700 1 Processor -- start 2023-07-24T05:46:57.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.173+0000 7efc6b59e700 1 -- start start 2023-07-24T05:46:57.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.173+0000 7efc6b59e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efc6c06a520 0x7efc6c0c4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:57.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.177+0000 7efc6b59e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc6c06d400 0x7efc6c1f1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:57.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.177+0000 7efc6b59e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc6c0aaf50 0x7efc6c0adba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:57.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.177+0000 7efc6b59e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c0caaa0 con 0x7efc6c06d400 2023-07-24T05:46:57.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.177+0000 7efc6b59e700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c0c4750 con 0x7efc6c0aaf50 2023-07-24T05:46:57.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.177+0000 7efc6b59e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c0c42c0 con 0x7efc6c06a520 2023-07-24T05:46:57.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.177+0000 7efc69d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc6c06d400 0x7efc6c1f1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:57.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.177+0000 7efc69d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc6c06d400 0x7efc6c1f1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48678/0 (socket says 172.21.15.77:48678) 2023-07-24T05:46:57.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.177+0000 7efc69d9b700 1 -- 172.21.15.77:0/588987944 learned_addr learned my addr 172.21.15.77:0/588987944 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:57.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.177+0000 7efc6a59c700 1 --2- 172.21.15.77:0/588987944 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efc6c06a520 0x7efc6c0c4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:57.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.177+0000 7efc6ad9d700 1 --2- 172.21.15.77:0/588987944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc6c0aaf50 0x7efc6c0adba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:57.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.177+0000 7efc69d9b700 1 -- 172.21.15.77:0/588987944 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efc6c06a520 msgr2=0x7efc6c0c4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:57.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.177+0000 7efc69d9b700 1 --2- 172.21.15.77:0/588987944 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efc6c06a520 0x7efc6c0c4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:57.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.177+0000 7efc69d9b700 1 -- 172.21.15.77:0/588987944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc6c0aaf50 msgr2=0x7efc6c0adba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:57.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.177+0000 7efc69d9b700 1 --2- 172.21.15.77:0/588987944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc6c0aaf50 0x7efc6c0adba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:57.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.177+0000 7efc69d9b700 1 -- 172.21.15.77:0/588987944 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc64009b30 con 0x7efc6c06d400 2023-07-24T05:46:57.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.177+0000 7efc69d9b700 1 --2- 172.21.15.77:0/588987944 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc6c06d400 0x7efc6c1f1750 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7efc6000b550 tx=0x7efc6000b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:57.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.177+0000 7efc5affd700 1 -- 172.21.15.77:0/588987944 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc60011830 con 0x7efc6c06d400 2023-07-24T05:46:57.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.177+0000 7efc5affd700 1 -- 172.21.15.77:0/588987944 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc600119b0 con 0x7efc6c06d400 2023-07-24T05:46:57.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.177+0000 7efc5affd700 1 -- 172.21.15.77:0/588987944 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc60011d60 con 0x7efc6c06d400 2023-07-24T05:46:57.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.177+0000 7efc6b59e700 1 -- 172.21.15.77:0/588987944 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc6c0c3990 con 0x7efc6c06d400 2023-07-24T05:46:57.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.177+0000 7efc6b59e700 1 -- 172.21.15.77:0/588987944 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc6c0c3f50 con 0x7efc6c06d400 2023-07-24T05:46:57.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.181+0000 7efc6b59e700 1 -- 172.21.15.77:0/588987944 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc6c0ac760 con 0x7efc6c06d400 2023-07-24T05:46:57.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.181+0000 7efc5affd700 1 -- 172.21.15.77:0/588987944 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efc6001a400 con 0x7efc6c06d400 2023-07-24T05:46:57.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.181+0000 7efc5affd700 1 --2- 172.21.15.77:0/588987944 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7efc4c0662f0 0x7efc4c0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:57.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.181+0000 7efc5affd700 1 -- 172.21.15.77:0/588987944 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7efc60083fa0 con 0x7efc6c06d400 2023-07-24T05:46:57.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.181+0000 7efc6a59c700 1 --2- 172.21.15.77:0/588987944 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7efc4c0662f0 0x7efc4c0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:57.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.181+0000 7efc6a59c700 1 --2- 172.21.15.77:0/588987944 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7efc4c0662f0 0x7efc4c0687b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efc5c00ab60 tx=0x7efc5c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:57.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.189+0000 7efc5affd700 1 -- 172.21.15.77:0/588987944 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efc600510e0 con 0x7efc6c06d400 2023-07-24T05:46:57.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.361+0000 7efc6b59e700 1 -- 172.21.15.77:0/588987944 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7efc6c0c4430 con 0x7efc6c06d400 2023-07-24T05:46:57.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.361+0000 7efc5affd700 1 -- 172.21.15.77:0/588987944 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7efc600150a0 con 0x7efc6c06d400 2023-07-24T05:46:57.367 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 8 2023-07-24T05:46:57.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.365+0000 7efc6b59e700 1 -- 172.21.15.77:0/588987944 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7efc4c0662f0 msgr2=0x7efc4c0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:57.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.365+0000 7efc6b59e700 1 --2- 172.21.15.77:0/588987944 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7efc4c0662f0 0x7efc4c0687b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efc5c00ab60 tx=0x7efc5c008040 comp rx=0 tx=0).stop 2023-07-24T05:46:57.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.365+0000 7efc6b59e700 1 -- 172.21.15.77:0/588987944 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc6c06d400 msgr2=0x7efc6c1f1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:57.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.365+0000 7efc6b59e700 1 --2- 172.21.15.77:0/588987944 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc6c06d400 0x7efc6c1f1750 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7efc6000b550 tx=0x7efc6000b860 comp rx=0 tx=0).stop 2023-07-24T05:46:57.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.365+0000 7efc6b59e700 1 -- 172.21.15.77:0/588987944 shutdown_connections 2023-07-24T05:46:57.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.365+0000 7efc6b59e700 1 --2- 172.21.15.77:0/588987944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc6c0aaf50 0x7efc6c0adba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:57.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.365+0000 7efc6b59e700 1 --2- 172.21.15.77:0/588987944 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efc6c06d400 0x7efc6c1f1750 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:57.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.365+0000 7efc6b59e700 1 --2- 172.21.15.77:0/588987944 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7efc4c0662f0 0x7efc4c0687b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:57.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.365+0000 7efc6b59e700 1 --2- 172.21.15.77:0/588987944 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7efc6c06a520 0x7efc6c0c4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:57.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.365+0000 7efc6b59e700 1 -- 172.21.15.77:0/588987944 >> 172.21.15.77:0/588987944 conn(0x7efc6c0ce260 msgr2=0x7efc6c0b0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:57.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.369+0000 7efc6b59e700 1 -- 172.21.15.77:0/588987944 shutdown_connections 2023-07-24T05:46:57.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.369+0000 7efc6b59e700 1 -- 172.21.15.77:0/588987944 wait complete. 2023-07-24T05:46:57.394 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-24T05:46:57.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.565+0000 7f6ebc8b4700 1 Processor -- start 2023-07-24T05:46:57.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.565+0000 7f6ebc8b4700 1 -- start start 2023-07-24T05:46:57.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.569+0000 7f6ebc8b4700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6eb815c870 0x7f6eb80cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:57.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.569+0000 7f6ebc8b4700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6eb80b2230 0x7f6eb80cd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:57.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.569+0000 7f6ebc8b4700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eb80cf520 con 0x7f6eb815cc50 2023-07-24T05:46:57.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.569+0000 7f6ebc8b4700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eb806aaa0 con 0x7f6eb815c870 2023-07-24T05:46:57.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.569+0000 7f6ebc8b4700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eb806ad80 con 0x7f6eb80b2230 2023-07-24T05:46:57.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.569+0000 7f6eb6d9d700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6eb815c870 0x7f6eb80cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:57.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.569+0000 7f6eb6d9d700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6eb815c870 0x7f6eb80cefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48690/0 (socket says 172.21.15.77:48690) 2023-07-24T05:46:57.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.569+0000 7f6eb6d9d700 1 -- 172.21.15.77:0/2573147272 learned_addr learned my addr 172.21.15.77:0/2573147272 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:57.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.569+0000 7f6eb759e700 1 --2- 172.21.15.77:0/2573147272 >> v2:172.21.15.103:3300/0 conn(0x7f6eb80b2230 0x7f6eb80cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:57.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.569+0000 7f6eb5d9b700 1 -- 172.21.15.77:0/2573147272 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4188039425 0 0) 0x7f6eb80cf520 con 0x7f6eb815cc50 2023-07-24T05:46:57.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.569+0000 7f6eb6d9d700 1 -- 172.21.15.77:0/2573147272 >> v2:172.21.15.103:3300/0 conn(0x7f6eb80b2230 msgr2=0x7f6eb80cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:57.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.569+0000 7f6eb6d9d700 1 --2- 172.21.15.77:0/2573147272 >> v2:172.21.15.103:3300/0 conn(0x7f6eb80b2230 0x7f6eb80cd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:57.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.569+0000 7f6eb6d9d700 1 -- 172.21.15.77:0/2573147272 >> v1:172.21.15.103:6789/0 conn(0x7f6eb815cc50 legacy=0x7f6eb80b1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:57.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.569+0000 7f6eb6d9d700 1 -- 172.21.15.77:0/2573147272 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb806b060 con 0x7f6eb815c870 2023-07-24T05:46:57.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.569+0000 7f6eb6d9d700 1 --2- 172.21.15.77:0/2573147272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6eb815c870 0x7f6eb80cefe0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6eb80b5160 tx=0x7f6ea8009be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=994d3708d37dec65 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:57.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.569+0000 7f6eb5d9b700 1 -- 172.21.15.77:0/2573147272 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea8011830 con 0x7f6eb815c870 2023-07-24T05:46:57.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.569+0000 7f6eb5d9b700 1 -- 172.21.15.77:0/2573147272 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea8011990 con 0x7f6eb815c870 2023-07-24T05:46:57.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.569+0000 7f6eb5d9b700 1 -- 172.21.15.77:0/2573147272 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea8011d20 con 0x7f6eb815c870 2023-07-24T05:46:57.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.573+0000 7f6ebc8b4700 1 -- 172.21.15.77:0/2573147272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6eb815c870 msgr2=0x7f6eb80cefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:57.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.573+0000 7f6ebc8b4700 1 --2- 172.21.15.77:0/2573147272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6eb815c870 0x7f6eb80cefe0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6eb80b5160 tx=0x7f6ea8009be0 comp rx=0 tx=0).stop 2023-07-24T05:46:57.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.573+0000 7f6ebc8b4700 1 -- 172.21.15.77:0/2573147272 shutdown_connections 2023-07-24T05:46:57.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.573+0000 7f6ebc8b4700 1 --2- 172.21.15.77:0/2573147272 >> v2:172.21.15.103:3300/0 conn(0x7f6eb80b2230 0x7f6eb80cd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:57.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.573+0000 7f6ebc8b4700 1 --2- 172.21.15.77:0/2573147272 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6eb815c870 0x7f6eb80cefe0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:57.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.573+0000 7f6ebc8b4700 1 -- 172.21.15.77:0/2573147272 >> 172.21.15.77:0/2573147272 conn(0x7f6eb8089f80 msgr2=0x7f6eb809b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:57.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.573+0000 7f6ebc8b4700 1 -- 172.21.15.77:0/2573147272 shutdown_connections 2023-07-24T05:46:57.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.573+0000 7f6ebc8b4700 1 -- 172.21.15.77:0/2573147272 wait complete. 2023-07-24T05:46:57.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.577+0000 7f6ebc8b4700 1 Processor -- start 2023-07-24T05:46:57.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.577+0000 7f6ebc8b4700 1 -- start start 2023-07-24T05:46:57.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.577+0000 7f6ebc8b4700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6eb80b2230 0x7f6eb80cbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:57.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.577+0000 7f6ebc8b4700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6eb815c870 0x7f6eb80d2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:57.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.577+0000 7f6ebc8b4700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6eb815cc50 0x7f6eb80b0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:57.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.577+0000 7f6ebc8b4700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb80d30a0 con 0x7f6eb815c870 2023-07-24T05:46:57.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.577+0000 7f6ebc8b4700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb814f1d0 con 0x7f6eb80b2230 2023-07-24T05:46:57.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.577+0000 7f6ebc8b4700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb814f4b0 con 0x7f6eb815cc50 2023-07-24T05:46:57.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.577+0000 7f6eb659c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6eb815c870 0x7f6eb80d2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:57.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.577+0000 7f6eb759e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6eb815cc50 0x7f6eb80b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:57.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.577+0000 7f6eb6d9d700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6eb80b2230 0x7f6eb80cbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:57.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.577+0000 7f6eb659c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6eb815c870 0x7f6eb80d2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48706/0 (socket says 172.21.15.77:48706) 2023-07-24T05:46:57.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.577+0000 7f6eb659c700 1 -- 172.21.15.77:0/3204925036 learned_addr learned my addr 172.21.15.77:0/3204925036 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:57.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.581+0000 7f6eb6d9d700 1 -- 172.21.15.77:0/3204925036 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6eb815cc50 msgr2=0x7f6eb80b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:57.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.581+0000 7f6eb6d9d700 1 --2- 172.21.15.77:0/3204925036 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6eb815cc50 0x7f6eb80b0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:57.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.581+0000 7f6eb6d9d700 1 -- 172.21.15.77:0/3204925036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6eb815c870 msgr2=0x7f6eb80d2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:57.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.581+0000 7f6eb6d9d700 1 --2- 172.21.15.77:0/3204925036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6eb815c870 0x7f6eb80d2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:57.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.581+0000 7f6eb6d9d700 1 -- 172.21.15.77:0/3204925036 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea8009510 con 0x7f6eb80b2230 2023-07-24T05:46:57.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.581+0000 7f6eb659c700 1 --2- 172.21.15.77:0/3204925036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6eb815c870 0x7f6eb80d2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:46:57.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.581+0000 7f6eb6d9d700 1 --2- 172.21.15.77:0/3204925036 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6eb80b2230 0x7f6eb80cbb60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6ea8016000 tx=0x7f6ea8004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:57.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.581+0000 7f6e9f7fe700 1 -- 172.21.15.77:0/3204925036 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea8004300 con 0x7f6eb80b2230 2023-07-24T05:46:57.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.581+0000 7f6e9f7fe700 1 -- 172.21.15.77:0/3204925036 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea801f070 con 0x7f6eb80b2230 2023-07-24T05:46:57.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.581+0000 7f6ebc8b4700 1 -- 172.21.15.77:0/3204925036 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eb814f790 con 0x7f6eb80b2230 2023-07-24T05:46:57.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.581+0000 7f6e9f7fe700 1 -- 172.21.15.77:0/3204925036 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea80036c0 con 0x7f6eb80b2230 2023-07-24T05:46:57.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.581+0000 7f6ebc8b4700 1 -- 172.21.15.77:0/3204925036 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb814fd50 con 0x7f6eb80b2230 2023-07-24T05:46:57.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.581+0000 7f6ebc8b4700 1 -- 172.21.15.77:0/3204925036 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eb8072490 con 0x7f6eb80b2230 2023-07-24T05:46:57.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.585+0000 7f6e9f7fe700 1 -- 172.21.15.77:0/3204925036 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6ea8021030 con 0x7f6eb80b2230 2023-07-24T05:46:57.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.585+0000 7f6e9f7fe700 1 --2- 172.21.15.77:0/3204925036 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6ea40662f0 0x7f6ea40687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:57.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.585+0000 7f6e9f7fe700 1 -- 172.21.15.77:0/3204925036 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6ea8085380 con 0x7f6eb80b2230 2023-07-24T05:46:57.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.585+0000 7f6eb659c700 1 --2- 172.21.15.77:0/3204925036 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6ea40662f0 0x7f6ea40687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:57.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.589+0000 7f6eb659c700 1 --2- 172.21.15.77:0/3204925036 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6ea40662f0 0x7f6ea40687b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6eac000f60 tx=0x7f6eac009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:57.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.593+0000 7f6e9f7fe700 1 -- 172.21.15.77:0/3204925036 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6ea8052440 con 0x7f6eb80b2230 2023-07-24T05:46:57.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.765+0000 7f6ebc8b4700 1 -- 172.21.15.77:0/3204925036 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6eb815bdc0 con 0x7f6eb80b2230 2023-07-24T05:46:57.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.769+0000 7f6e9f7fe700 1 -- 172.21.15.77:0/3204925036 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6ea8055a60 con 0x7f6eb80b2230 2023-07-24T05:46:57.773 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-07-24T05:46:57.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.773+0000 7f6ebc8b4700 1 -- 172.21.15.77:0/3204925036 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6ea40662f0 msgr2=0x7f6ea40687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:57.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.773+0000 7f6ebc8b4700 1 --2- 172.21.15.77:0/3204925036 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6ea40662f0 0x7f6ea40687b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6eac000f60 tx=0x7f6eac009040 comp rx=0 tx=0).stop 2023-07-24T05:46:57.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.773+0000 7f6ebc8b4700 1 -- 172.21.15.77:0/3204925036 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6eb80b2230 msgr2=0x7f6eb80cbb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:57.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.773+0000 7f6ebc8b4700 1 --2- 172.21.15.77:0/3204925036 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6eb80b2230 0x7f6eb80cbb60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6ea8016000 tx=0x7f6ea8004770 comp rx=0 tx=0).stop 2023-07-24T05:46:57.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.773+0000 7f6ebc8b4700 1 -- 172.21.15.77:0/3204925036 shutdown_connections 2023-07-24T05:46:57.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.773+0000 7f6ebc8b4700 1 --2- 172.21.15.77:0/3204925036 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6ea40662f0 0x7f6ea40687b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:57.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.773+0000 7f6ebc8b4700 1 --2- 172.21.15.77:0/3204925036 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6eb815cc50 0x7f6eb80b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:57.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.773+0000 7f6ebc8b4700 1 --2- 172.21.15.77:0/3204925036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6eb815c870 0x7f6eb80d2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:57.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.773+0000 7f6ebc8b4700 1 --2- 172.21.15.77:0/3204925036 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6eb80b2230 0x7f6eb80cbb60 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:57.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.773+0000 7f6ebc8b4700 1 -- 172.21.15.77:0/3204925036 >> 172.21.15.77:0/3204925036 conn(0x7f6eb8089f80 msgr2=0x7f6eb809b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:57.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.773+0000 7f6ebc8b4700 1 -- 172.21.15.77:0/3204925036 shutdown_connections 2023-07-24T05:46:57.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.773+0000 7f6ebc8b4700 1 -- 172.21.15.77:0/3204925036 wait complete. 2023-07-24T05:46:57.800 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-24T05:46:57.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.969+0000 7fb56bdea700 1 Processor -- start 2023-07-24T05:46:57.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.969+0000 7fb56bdea700 1 -- start start 2023-07-24T05:46:57.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.969+0000 7fb56bdea700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb564161140 0x7fb5640c1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:57.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.969+0000 7fb56bdea700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5640c1db0 con 0x7fb5640cd300 2023-07-24T05:46:57.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.969+0000 7fb56bdea700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb564069d20 con 0x7fb5640c1950 2023-07-24T05:46:57.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.969+0000 7fb56bdea700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5640cd770 con 0x7fb564161140 2023-07-24T05:46:57.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.969+0000 7fb56a387700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb5640cd300 0x7fb56406a1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:33148/0 (socket says 172.21.15.77:33148) 2023-07-24T05:46:57.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.969+0000 7fb56a387700 1 -- 172.21.15.77:0/650807247 learned_addr learned my addr 172.21.15.77:0/650807247 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:57.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.973+0000 7fb569b86700 1 --2- 172.21.15.77:0/650807247 >> v2:172.21.15.103:3300/0 conn(0x7fb564161140 0x7fb5640c1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:57.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.973+0000 7fb568b84700 1 -- 172.21.15.77:0/650807247 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3172803915 0 0) 0x7fb5640c1db0 con 0x7fb5640cd300 2023-07-24T05:46:57.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.973+0000 7fb568b84700 1 -- 172.21.15.77:0/650807247 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5500035d0 con 0x7fb5640cd300 2023-07-24T05:46:57.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.973+0000 7fb569b86700 1 -- 172.21.15.77:0/650807247 >> v1:172.21.15.103:6789/0 conn(0x7fb5640c1950 legacy=0x7fb5640ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:57.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.973+0000 7fb569b86700 1 -- 172.21.15.77:0/650807247 >> v1:172.21.15.77:6789/0 conn(0x7fb5640cd300 legacy=0x7fb56406a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:57.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.973+0000 7fb569b86700 1 -- 172.21.15.77:0/650807247 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5640cd980 con 0x7fb564161140 2023-07-24T05:46:57.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.973+0000 7fb569b86700 1 --2- 172.21.15.77:0/650807247 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb564161140 0x7fb5640c1410 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb560009840 tx=0x7fb560009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8049523e9a84889 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:57.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.973+0000 7fb568b84700 1 -- 172.21.15.77:0/650807247 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb560005e50 con 0x7fb564161140 2023-07-24T05:46:57.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.973+0000 7fb568b84700 1 -- 172.21.15.77:0/650807247 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb560006030 con 0x7fb564161140 2023-07-24T05:46:57.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.973+0000 7fb568b84700 1 -- 172.21.15.77:0/650807247 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5600063c0 con 0x7fb564161140 2023-07-24T05:46:57.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.973+0000 7fb56bdea700 1 -- 172.21.15.77:0/650807247 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb564161140 msgr2=0x7fb5640c1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:57.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.973+0000 7fb56bdea700 1 --2- 172.21.15.77:0/650807247 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb564161140 0x7fb5640c1410 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb560009840 tx=0x7fb560009b50 comp rx=0 tx=0).stop 2023-07-24T05:46:57.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.973+0000 7fb56bdea700 1 -- 172.21.15.77:0/650807247 shutdown_connections 2023-07-24T05:46:57.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.973+0000 7fb56bdea700 1 --2- 172.21.15.77:0/650807247 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb564161140 0x7fb5640c1410 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:57.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.973+0000 7fb56bdea700 1 -- 172.21.15.77:0/650807247 >> 172.21.15.77:0/650807247 conn(0x7fb5640ce440 msgr2=0x7fb5640ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:57.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.977+0000 7fb56bdea700 1 -- 172.21.15.77:0/650807247 shutdown_connections 2023-07-24T05:46:57.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.977+0000 7fb56bdea700 1 -- 172.21.15.77:0/650807247 wait complete. 2023-07-24T05:46:57.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.977+0000 7fb56bdea700 1 Processor -- start 2023-07-24T05:46:57.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.977+0000 7fb56bdea700 1 -- start start 2023-07-24T05:46:57.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.977+0000 7fb56bdea700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5640c1950 0x7fb5640ab2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:57.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.977+0000 7fb56bdea700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5640cd300 0x7fb564158890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:57.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.977+0000 7fb56bdea700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb564161140 0x7fb5640c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:57.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.977+0000 7fb56bdea700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb564159300 con 0x7fb5640cd300 2023-07-24T05:46:57.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.977+0000 7fb56bdea700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5641595e0 con 0x7fb5640c1950 2023-07-24T05:46:57.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.977+0000 7fb56bdea700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5641598c0 con 0x7fb564161140 2023-07-24T05:46:57.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.981+0000 7fb569385700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5640cd300 0x7fb564158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:57.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.981+0000 7fb569385700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5640cd300 0x7fb564158890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48720/0 (socket says 172.21.15.77:48720) 2023-07-24T05:46:57.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.981+0000 7fb569385700 1 -- 172.21.15.77:0/3866957174 learned_addr learned my addr 172.21.15.77:0/3866957174 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:57.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.981+0000 7fb569b86700 1 --2- 172.21.15.77:0/3866957174 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5640c1950 0x7fb5640ab2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:57.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.981+0000 7fb56a387700 1 --2- 172.21.15.77:0/3866957174 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb564161140 0x7fb5640c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:57.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.981+0000 7fb569385700 1 -- 172.21.15.77:0/3866957174 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb564161140 msgr2=0x7fb5640c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:57.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.981+0000 7fb569385700 1 --2- 172.21.15.77:0/3866957174 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb564161140 0x7fb5640c42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:57.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.981+0000 7fb569385700 1 -- 172.21.15.77:0/3866957174 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5640c1950 msgr2=0x7fb5640ab2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:57.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.981+0000 7fb569385700 1 --2- 172.21.15.77:0/3866957174 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5640c1950 0x7fb5640ab2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:57.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.981+0000 7fb569385700 1 -- 172.21.15.77:0/3866957174 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb560009450 con 0x7fb5640cd300 2023-07-24T05:46:57.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.981+0000 7fb56a387700 1 --2- 172.21.15.77:0/3866957174 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb564161140 0x7fb5640c42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:46:57.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.981+0000 7fb569385700 1 --2- 172.21.15.77:0/3866957174 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5640cd300 0x7fb564158890 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb55400c500 tx=0x7fb55400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:57.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.981+0000 7fb55a7fc700 1 -- 172.21.15.77:0/3866957174 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5540052d0 con 0x7fb5640cd300 2023-07-24T05:46:57.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.981+0000 7fb55a7fc700 1 -- 172.21.15.77:0/3866957174 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb554005430 con 0x7fb5640cd300 2023-07-24T05:46:57.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.981+0000 7fb56bdea700 1 -- 172.21.15.77:0/3866957174 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb564159ba0 con 0x7fb5640cd300 2023-07-24T05:46:57.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.981+0000 7fb55a7fc700 1 -- 172.21.15.77:0/3866957174 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5540055a0 con 0x7fb5640cd300 2023-07-24T05:46:57.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.981+0000 7fb56bdea700 1 -- 172.21.15.77:0/3866957174 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5640ab9e0 con 0x7fb5640cd300 2023-07-24T05:46:57.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.981+0000 7fb56bdea700 1 -- 172.21.15.77:0/3866957174 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb564144a50 con 0x7fb5640cd300 2023-07-24T05:46:57.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.985+0000 7fb55a7fc700 1 -- 172.21.15.77:0/3866957174 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb5540036a0 con 0x7fb5640cd300 2023-07-24T05:46:57.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.985+0000 7fb55a7fc700 1 --2- 172.21.15.77:0/3866957174 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb5480662f0 0x7fb5480687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:57.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.989+0000 7fb55a7fc700 1 -- 172.21.15.77:0/3866957174 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb5540831a0 con 0x7fb5640cd300 2023-07-24T05:46:57.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.989+0000 7fb569b86700 1 --2- 172.21.15.77:0/3866957174 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb5480662f0 0x7fb5480687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:57.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.989+0000 7fb569b86700 1 --2- 172.21.15.77:0/3866957174 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb5480662f0 0x7fb5480687b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb560009b90 tx=0x7fb560008070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:57.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:57.993+0000 7fb55a7fc700 1 -- 172.21.15.77:0/3866957174 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb564144a50 con 0x7fb5640cd300 2023-07-24T05:46:58.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.165+0000 7fb56bdea700 1 -- 172.21.15.77:0/3866957174 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb5640ab9e0 con 0x7fb5640cd300 2023-07-24T05:46:58.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.165+0000 7fb55a7fc700 1 -- 172.21.15.77:0/3866957174 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb5640ab9e0 con 0x7fb5640cd300 2023-07-24T05:46:58.171 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-07-24T05:46:58.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.169+0000 7fb56bdea700 1 -- 172.21.15.77:0/3866957174 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb5480662f0 msgr2=0x7fb5480687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:58.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.169+0000 7fb56bdea700 1 --2- 172.21.15.77:0/3866957174 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb5480662f0 0x7fb5480687b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb560009b90 tx=0x7fb560008070 comp rx=0 tx=0).stop 2023-07-24T05:46:58.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.169+0000 7fb56bdea700 1 -- 172.21.15.77:0/3866957174 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5640cd300 msgr2=0x7fb564158890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:58.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.169+0000 7fb56bdea700 1 --2- 172.21.15.77:0/3866957174 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5640cd300 0x7fb564158890 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb55400c500 tx=0x7fb55400c810 comp rx=0 tx=0).stop 2023-07-24T05:46:58.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.169+0000 7fb56bdea700 1 -- 172.21.15.77:0/3866957174 shutdown_connections 2023-07-24T05:46:58.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.169+0000 7fb56bdea700 1 --2- 172.21.15.77:0/3866957174 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb5480662f0 0x7fb5480687b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:58.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.169+0000 7fb56bdea700 1 --2- 172.21.15.77:0/3866957174 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb564161140 0x7fb5640c42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:58.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.169+0000 7fb56bdea700 1 --2- 172.21.15.77:0/3866957174 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5640cd300 0x7fb564158890 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:58.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.169+0000 7fb56bdea700 1 --2- 172.21.15.77:0/3866957174 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb5640c1950 0x7fb5640ab2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:58.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.169+0000 7fb56bdea700 1 -- 172.21.15.77:0/3866957174 >> 172.21.15.77:0/3866957174 conn(0x7fb5640ce440 msgr2=0x7fb5640ad080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:58.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.169+0000 7fb56bdea700 1 -- 172.21.15.77:0/3866957174 shutdown_connections 2023-07-24T05:46:58.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.169+0000 7fb56bdea700 1 -- 172.21.15.77:0/3866957174 wait complete. 2023-07-24T05:46:58.193 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-24T05:46:58.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.361+0000 7f3b7954c700 1 Processor -- start 2023-07-24T05:46:58.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.361+0000 7f3b7954c700 1 -- start start 2023-07-24T05:46:58.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.365+0000 7f3b7954c700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3b7415cac0 0x7f3b740cc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:58.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.365+0000 7f3b7954c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3b7406e5a0 0x7f3b740b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:58.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.365+0000 7f3b7954c700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b7406ce00 con 0x7f3b7406ec60 2023-07-24T05:46:58.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.365+0000 7f3b7954c700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b740b13a0 con 0x7f3b7415cac0 2023-07-24T05:46:58.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.365+0000 7f3b7954c700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7406d0a0 con 0x7f3b7406e5a0 2023-07-24T05:46:58.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.365+0000 7f3b73fff700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f3b7415cac0 0x7f3b740cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:58.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.365+0000 7f3b6b7fe700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f3b7406ec60 0x7f3b7406de90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:33152/0 (socket says 172.21.15.77:33152) 2023-07-24T05:46:58.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.365+0000 7f3b6b7fe700 1 -- 172.21.15.77:0/3357747576 learned_addr learned my addr 172.21.15.77:0/3357747576 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:58.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.365+0000 7f3b78d4b700 1 --2- 172.21.15.77:0/3357747576 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3b7406e5a0 0x7f3b740b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:58.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.369+0000 7f3b737fe700 1 -- 172.21.15.77:0/3357747576 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3441586004 0 0) 0x7f3b7406ce00 con 0x7f3b7406ec60 2023-07-24T05:46:58.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.369+0000 7f3b737fe700 1 -- 172.21.15.77:0/3357747576 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b600035d0 con 0x7f3b7406ec60 2023-07-24T05:46:58.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.369+0000 7f3b73fff700 1 -- 172.21.15.77:0/3357747576 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3b7406e5a0 msgr2=0x7f3b740b17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:58.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.369+0000 7f3b73fff700 1 --2- 172.21.15.77:0/3357747576 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3b7406e5a0 0x7f3b740b17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:58.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.369+0000 7f3b737fe700 1 -- 172.21.15.77:0/3357747576 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 191162823 0 0) 0x7f3b600035d0 con 0x7f3b7406ec60 2023-07-24T05:46:58.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.369+0000 7f3b73fff700 1 -- 172.21.15.77:0/3357747576 >> v1:172.21.15.77:6789/0 conn(0x7f3b7406ec60 legacy=0x7f3b7406de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:58.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.369+0000 7f3b73fff700 1 -- 172.21.15.77:0/3357747576 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b7406d380 con 0x7f3b7415cac0 2023-07-24T05:46:58.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.369+0000 7f3b73fff700 1 --2- 172.21.15.77:0/3357747576 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b7415cac0 0x7f3b740cc380 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3b64009850 tx=0x7f3b64009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce9a55c8b285c9de server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:58.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.369+0000 7f3b737fe700 1 -- 172.21.15.77:0/3357747576 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c001690 con 0x7f3b7415cac0 2023-07-24T05:46:58.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.369+0000 7f3b737fe700 1 -- 172.21.15.77:0/3357747576 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b64004030 con 0x7f3b7415cac0 2023-07-24T05:46:58.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.369+0000 7f3b737fe700 1 -- 172.21.15.77:0/3357747576 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b640043e0 con 0x7f3b7415cac0 2023-07-24T05:46:58.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.369+0000 7f3b7954c700 1 -- 172.21.15.77:0/3357747576 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b7415cac0 msgr2=0x7f3b740cc380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:58.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.369+0000 7f3b7954c700 1 --2- 172.21.15.77:0/3357747576 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b7415cac0 0x7f3b740cc380 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3b64009850 tx=0x7f3b64009b60 comp rx=0 tx=0).stop 2023-07-24T05:46:58.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.369+0000 7f3b7954c700 1 -- 172.21.15.77:0/3357747576 shutdown_connections 2023-07-24T05:46:58.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.369+0000 7f3b7954c700 1 --2- 172.21.15.77:0/3357747576 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3b7406e5a0 0x7f3b740b17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:58.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.369+0000 7f3b7954c700 1 --2- 172.21.15.77:0/3357747576 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b7415cac0 0x7f3b740cc380 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:58.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.369+0000 7f3b7954c700 1 -- 172.21.15.77:0/3357747576 >> 172.21.15.77:0/3357747576 conn(0x7f3b74069cf0 msgr2=0x7f3b740d0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:58.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.369+0000 7f3b7954c700 1 -- 172.21.15.77:0/3357747576 shutdown_connections 2023-07-24T05:46:58.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.369+0000 7f3b7954c700 1 -- 172.21.15.77:0/3357747576 wait complete. 2023-07-24T05:46:58.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.373+0000 7f3b7954c700 1 Processor -- start 2023-07-24T05:46:58.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.373+0000 7f3b7954c700 1 -- start start 2023-07-24T05:46:58.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.373+0000 7f3b7954c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b7406e5a0 0x7f3b740b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:58.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.373+0000 7f3b7954c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3b7406ec60 0x7f3b740cf450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:58.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.373+0000 7f3b7954c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b7415cac0 0x7f3b740cf990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:58.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.373+0000 7f3b7954c700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b741f6430 con 0x7f3b7415cac0 2023-07-24T05:46:58.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.373+0000 7f3b7954c700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b741f27b0 con 0x7f3b7406e5a0 2023-07-24T05:46:58.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.373+0000 7f3b7954c700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b741f1ee0 con 0x7f3b7406ec60 2023-07-24T05:46:58.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.373+0000 7f3b78d4b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b7415cac0 0x7f3b740cf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:58.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.373+0000 7f3b78d4b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b7415cac0 0x7f3b740cf990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48748/0 (socket says 172.21.15.77:48748) 2023-07-24T05:46:58.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.373+0000 7f3b78d4b700 1 -- 172.21.15.77:0/2079256462 learned_addr learned my addr 172.21.15.77:0/2079256462 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:58.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.377+0000 7f3b73fff700 1 --2- 172.21.15.77:0/2079256462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b7406e5a0 0x7f3b740b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:58.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.377+0000 7f3b6b7fe700 1 --2- 172.21.15.77:0/2079256462 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3b7406ec60 0x7f3b740cf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:58.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.377+0000 7f3b78d4b700 1 -- 172.21.15.77:0/2079256462 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3b7406ec60 msgr2=0x7f3b740cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:58.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.377+0000 7f3b78d4b700 1 --2- 172.21.15.77:0/2079256462 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3b7406ec60 0x7f3b740cf450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:58.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.377+0000 7f3b78d4b700 1 -- 172.21.15.77:0/2079256462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b7406e5a0 msgr2=0x7f3b740b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:58.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.377+0000 7f3b78d4b700 1 --2- 172.21.15.77:0/2079256462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b7406e5a0 0x7f3b740b30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:58.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.377+0000 7f3b78d4b700 1 -- 172.21.15.77:0/2079256462 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b640094b0 con 0x7f3b7415cac0 2023-07-24T05:46:58.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.377+0000 7f3b78d4b700 1 --2- 172.21.15.77:0/2079256462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b7415cac0 0x7f3b740cf990 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c00efc0 tx=0x7f3b6c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:58.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.377+0000 7f3b717fa700 1 -- 172.21.15.77:0/2079256462 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c009ba0 con 0x7f3b7415cac0 2023-07-24T05:46:58.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.377+0000 7f3b717fa700 1 -- 172.21.15.77:0/2079256462 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b6c00f040 con 0x7f3b7415cac0 2023-07-24T05:46:58.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.377+0000 7f3b717fa700 1 -- 172.21.15.77:0/2079256462 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c014480 con 0x7f3b7415cac0 2023-07-24T05:46:58.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.377+0000 7f3b7954c700 1 -- 172.21.15.77:0/2079256462 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b741f6150 con 0x7f3b7415cac0 2023-07-24T05:46:58.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.377+0000 7f3b7954c700 1 -- 172.21.15.77:0/2079256462 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b741f23d0 con 0x7f3b7415cac0 2023-07-24T05:46:58.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.377+0000 7f3b7954c700 1 -- 172.21.15.77:0/2079256462 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b741f28f0 con 0x7f3b7415cac0 2023-07-24T05:46:58.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.381+0000 7f3b717fa700 1 -- 172.21.15.77:0/2079256462 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3b6c0145e0 con 0x7f3b7415cac0 2023-07-24T05:46:58.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.381+0000 7f3b717fa700 1 --2- 172.21.15.77:0/2079256462 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3b540662f0 0x7f3b540687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:58.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.381+0000 7f3b717fa700 1 -- 172.21.15.77:0/2079256462 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3b6c0849a0 con 0x7f3b7415cac0 2023-07-24T05:46:58.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.381+0000 7f3b73fff700 1 --2- 172.21.15.77:0/2079256462 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3b540662f0 0x7f3b540687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:58.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.385+0000 7f3b73fff700 1 --2- 172.21.15.77:0/2079256462 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3b540662f0 0x7f3b540687b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3b640090b0 tx=0x7f3b64008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:58.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.385+0000 7f3b717fa700 1 -- 172.21.15.77:0/2079256462 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3b741f28f0 con 0x7f3b7415cac0 2023-07-24T05:46:58.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.561+0000 7f3b7954c700 1 -- 172.21.15.77:0/2079256462 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3b741f28f0 con 0x7f3b7415cac0 2023-07-24T05:46:58.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.561+0000 7f3b717fa700 1 -- 172.21.15.77:0/2079256462 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3b741f28f0 con 0x7f3b7415cac0 2023-07-24T05:46:58.566 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-07-24T05:46:58.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.561+0000 7f3b7954c700 1 -- 172.21.15.77:0/2079256462 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3b540662f0 msgr2=0x7f3b540687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:58.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.561+0000 7f3b7954c700 1 --2- 172.21.15.77:0/2079256462 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3b540662f0 0x7f3b540687b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3b640090b0 tx=0x7f3b64008030 comp rx=0 tx=0).stop 2023-07-24T05:46:58.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.561+0000 7f3b7954c700 1 -- 172.21.15.77:0/2079256462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b7415cac0 msgr2=0x7f3b740cf990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:58.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.561+0000 7f3b7954c700 1 --2- 172.21.15.77:0/2079256462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b7415cac0 0x7f3b740cf990 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c00efc0 tx=0x7f3b6c00c3a0 comp rx=0 tx=0).stop 2023-07-24T05:46:58.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.565+0000 7f3b7954c700 1 -- 172.21.15.77:0/2079256462 shutdown_connections 2023-07-24T05:46:58.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.565+0000 7f3b7954c700 1 --2- 172.21.15.77:0/2079256462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b7415cac0 0x7f3b740cf990 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:58.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.565+0000 7f3b7954c700 1 --2- 172.21.15.77:0/2079256462 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3b540662f0 0x7f3b540687b0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:58.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.565+0000 7f3b7954c700 1 --2- 172.21.15.77:0/2079256462 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3b7406ec60 0x7f3b740cf450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:58.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.565+0000 7f3b7954c700 1 --2- 172.21.15.77:0/2079256462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3b7406e5a0 0x7f3b740b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:58.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.565+0000 7f3b7954c700 1 -- 172.21.15.77:0/2079256462 >> 172.21.15.77:0/2079256462 conn(0x7f3b74069cf0 msgr2=0x7f3b7415d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:58.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.565+0000 7f3b7954c700 1 -- 172.21.15.77:0/2079256462 shutdown_connections 2023-07-24T05:46:58.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.565+0000 7f3b7954c700 1 -- 172.21.15.77:0/2079256462 wait complete. 2023-07-24T05:46:58.591 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-24T05:46:58.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.761+0000 7f162c78d700 1 Processor -- start 2023-07-24T05:46:58.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.761+0000 7f162c78d700 1 -- start start 2023-07-24T05:46:58.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.765+0000 7f162c78d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f16240ca890 0x7f16240cbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:58.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.765+0000 7f162c78d700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f16240cc520 0x7f162406cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:58.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.765+0000 7f162c78d700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f162406a5c0 con 0x7f16240cde50 2023-07-24T05:46:58.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.765+0000 7f162c78d700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16240cb5a0 con 0x7f16240ca890 2023-07-24T05:46:58.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.765+0000 7f162c78d700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162406a8a0 con 0x7f16240cc520 2023-07-24T05:46:58.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.765+0000 7f1629d28700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f16240ca890 0x7f16240cbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:58.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.765+0000 7f162a529700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f16240cde50 0x7f16240cae90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.77:38162/0 (socket says 172.21.15.77:38162) 2023-07-24T05:46:58.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.765+0000 7f162a529700 1 -- 172.21.15.77:0/341727107 learned_addr learned my addr 172.21.15.77:0/341727107 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:58.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.765+0000 7f162ad2a700 1 --2- 172.21.15.77:0/341727107 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f16240cc520 0x7f162406cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:58.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.765+0000 7f1629527700 1 -- 172.21.15.77:0/341727107 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2650585891 0 0) 0x7f162406a5c0 con 0x7f16240cde50 2023-07-24T05:46:58.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.765+0000 7f1629527700 1 -- 172.21.15.77:0/341727107 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16100035d0 con 0x7f16240cde50 2023-07-24T05:46:58.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.769+0000 7f1629d28700 1 -- 172.21.15.77:0/341727107 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f16240cc520 msgr2=0x7f162406cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:58.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.769+0000 7f1629d28700 1 --2- 172.21.15.77:0/341727107 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f16240cc520 0x7f162406cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:58.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.769+0000 7f1629d28700 1 -- 172.21.15.77:0/341727107 >> v1:172.21.15.103:6789/0 conn(0x7f16240cde50 legacy=0x7f16240cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:58.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.769+0000 7f1629d28700 1 -- 172.21.15.77:0/341727107 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f162406ab80 con 0x7f16240ca890 2023-07-24T05:46:58.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.769+0000 7f162ad2a700 1 --2- 172.21.15.77:0/341727107 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f16240cc520 0x7f162406cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:46:58.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.769+0000 7f1629d28700 1 --2- 172.21.15.77:0/341727107 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16240ca890 0x7f16240cbfe0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f161400baf0 tx=0x7f161400be00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73d6305916a943ca server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:58.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.769+0000 7f1629527700 1 -- 172.21.15.77:0/341727107 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161400dc70 con 0x7f16240ca890 2023-07-24T05:46:58.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.769+0000 7f1629527700 1 -- 172.21.15.77:0/341727107 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161400ddd0 con 0x7f16240ca890 2023-07-24T05:46:58.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.769+0000 7f1629527700 1 -- 172.21.15.77:0/341727107 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1614010690 con 0x7f16240ca890 2023-07-24T05:46:58.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.769+0000 7f162c78d700 1 -- 172.21.15.77:0/341727107 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16240ca890 msgr2=0x7f16240cbfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:58.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.769+0000 7f162c78d700 1 --2- 172.21.15.77:0/341727107 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16240ca890 0x7f16240cbfe0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f161400baf0 tx=0x7f161400be00 comp rx=0 tx=0).stop 2023-07-24T05:46:58.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.769+0000 7f162c78d700 1 -- 172.21.15.77:0/341727107 shutdown_connections 2023-07-24T05:46:58.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.769+0000 7f162c78d700 1 --2- 172.21.15.77:0/341727107 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f16240cc520 0x7f162406cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:58.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.769+0000 7f162c78d700 1 --2- 172.21.15.77:0/341727107 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16240ca890 0x7f16240cbfe0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:58.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.769+0000 7f162c78d700 1 -- 172.21.15.77:0/341727107 >> 172.21.15.77:0/341727107 conn(0x7f16240ce410 msgr2=0x7f16240ce7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:58.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.769+0000 7f162c78d700 1 -- 172.21.15.77:0/341727107 shutdown_connections 2023-07-24T05:46:58.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.769+0000 7f162c78d700 1 -- 172.21.15.77:0/341727107 wait complete. 2023-07-24T05:46:58.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.773+0000 7f162c78d700 1 Processor -- start 2023-07-24T05:46:58.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.773+0000 7f162c78d700 1 -- start start 2023-07-24T05:46:58.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.773+0000 7f162c78d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16240ca890 0x7f16240c2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:58.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.773+0000 7f162c78d700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16240cc520 0x7f1624152e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:58.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.773+0000 7f162c78d700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f16240cde50 0x7f16241ee020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:58.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.773+0000 7f162c78d700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16241f12c0 con 0x7f16240ca890 2023-07-24T05:46:58.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.773+0000 7f162c78d700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16240c3c40 con 0x7f16240cc520 2023-07-24T05:46:58.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.773+0000 7f162c78d700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16240b0580 con 0x7f16240cde50 2023-07-24T05:46:58.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.773+0000 7f162a529700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16240ca890 0x7f16240c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:58.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.773+0000 7f162a529700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16240ca890 0x7f16240c2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48758/0 (socket says 172.21.15.77:48758) 2023-07-24T05:46:58.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.773+0000 7f162a529700 1 -- 172.21.15.77:0/2644536720 learned_addr learned my addr 172.21.15.77:0/2644536720 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:58.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.773+0000 7f1629d28700 1 --2- 172.21.15.77:0/2644536720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16240cc520 0x7f1624152e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:58.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.773+0000 7f162ad2a700 1 --2- 172.21.15.77:0/2644536720 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f16240cde50 0x7f16241ee020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:58.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.773+0000 7f162a529700 1 -- 172.21.15.77:0/2644536720 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f16240cde50 msgr2=0x7f16241ee020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:58.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.773+0000 7f162a529700 1 --2- 172.21.15.77:0/2644536720 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f16240cde50 0x7f16241ee020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:58.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.773+0000 7f162a529700 1 -- 172.21.15.77:0/2644536720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16240cc520 msgr2=0x7f1624152e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:58.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.773+0000 7f162a529700 1 --2- 172.21.15.77:0/2644536720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16240cc520 0x7f1624152e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:58.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.773+0000 7f162a529700 1 -- 172.21.15.77:0/2644536720 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f161c009a70 con 0x7f16240ca890 2023-07-24T05:46:58.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.773+0000 7f1629d28700 1 --2- 172.21.15.77:0/2644536720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16240cc520 0x7f1624152e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:46:58.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.773+0000 7f162a529700 1 --2- 172.21.15.77:0/2644536720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16240ca890 0x7f16240c2950 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1620001130 tx=0x7f162000c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:58.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.777+0000 7f161affd700 1 -- 172.21.15.77:0/2644536720 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1620005de0 con 0x7f16240ca890 2023-07-24T05:46:58.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.777+0000 7f161affd700 1 -- 172.21.15.77:0/2644536720 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16200070d0 con 0x7f16240ca890 2023-07-24T05:46:58.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.777+0000 7f162c78d700 1 -- 172.21.15.77:0/2644536720 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f161400b750 con 0x7f16240ca890 2023-07-24T05:46:58.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.777+0000 7f161affd700 1 -- 172.21.15.77:0/2644536720 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1620007460 con 0x7f16240ca890 2023-07-24T05:46:58.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.777+0000 7f162c78d700 1 -- 172.21.15.77:0/2644536720 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16240c3310 con 0x7f16240ca890 2023-07-24T05:46:58.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.777+0000 7f162c78d700 1 -- 172.21.15.77:0/2644536720 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16240cd040 con 0x7f16240ca890 2023-07-24T05:46:58.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.777+0000 7f161affd700 1 -- 172.21.15.77:0/2644536720 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f16200075c0 con 0x7f16240ca890 2023-07-24T05:46:58.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.781+0000 7f161affd700 1 --2- 172.21.15.77:0/2644536720 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f16080662f0 0x7f16080687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:58.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.781+0000 7f161affd700 1 -- 172.21.15.77:0/2644536720 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f16200835c0 con 0x7f16240ca890 2023-07-24T05:46:58.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.781+0000 7f1629d28700 1 --2- 172.21.15.77:0/2644536720 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f16080662f0 0x7f16080687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:58.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.781+0000 7f1629d28700 1 --2- 172.21.15.77:0/2644536720 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f16080662f0 0x7f16080687b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f161400bfd0 tx=0x7f1614013000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:58.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.785+0000 7f161affd700 1 -- 172.21.15.77:0/2644536720 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f16200505f0 con 0x7f16240ca890 2023-07-24T05:46:58.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.957+0000 7f162c78d700 1 -- 172.21.15.77:0/2644536720 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f162404df10 con 0x7f16240ca890 2023-07-24T05:46:58.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.961+0000 7f161affd700 1 -- 172.21.15.77:0/2644536720 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20204 (secure 0 0 0) 0x7f1620001280 con 0x7f16240ca890 2023-07-24T05:46:58.967 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:46:58.968 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":27,"fsid":"5aed5f7b-fb55-4d95-9c02-c6adbb1677b4","created":"2023-07-24T05:45:39.639731+0000","modified":"2023-07-24T05:46:48.442117+0000","last_up_change":"2023-07-24T05:45:52.319670+0000","last_in_change":"2023-07-24T05:45:43.643277+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-24T05:45:52.610430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-24T05:45:52.773787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-24T05:45:58.121732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-24T05:45:59.368726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-24T05:46:03.032057+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ffa0d496-461a-4053-b764-0627d969521b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6812","nonce":825987196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6817","nonce":825987196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6831","nonce":825987196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6824","nonce":825987196}]},"public_addr":"172.21.15.77:6812/825987196","cluster_addr":"172.21.15.77:6817/825987196","heartbeat_back_addr":"172.21.15.77:6831/825987196","heartbeat_front_addr":"172.21.15.77:6824/825987196","state":["exists","up"]},{"osd":1,"uuid":"9f595e5e-5c43-49bc-8ce4-ee70575c90da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6801","nonce":4133026815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6803","nonce":4133026815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6807","nonce":4133026815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6805","nonce":4133026815}]},"public_addr":"172.21.15.77:6801/4133026815","cluster_addr":"172.21.15.77:6803/4133026815","heartbeat_back_addr":"172.21.15.77:6807/4133026815","heartbeat_front_addr":"172.21.15.77:6805/4133026815","state":["exists","up"]},{"osd":2,"uuid":"2ac177aa-4d7d-4262-bd54-d2b9f29f4c3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6811","nonce":2394142159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6819","nonce":2394142159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6830","nonce":2394142159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6825","nonce":2394142159}]},"public_addr":"172.21.15.77:6811/2394142159","cluster_addr":"172.21.15.77:6819/2394142159","heartbeat_back_addr":"172.21.15.77:6830/2394142159","heartbeat_front_addr":"172.21.15.77:6825/2394142159","state":["exists","up"]},{"osd":3,"uuid":"17d7a251-19e8-484c-8172-a578ab3da153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6813","nonce":1492113982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6818","nonce":1492113982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6829","nonce":1492113982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6823","nonce":1492113982}]},"public_addr":"172.21.15.77:6813/1492113982","cluster_addr":"172.21.15.77:6818/1492113982","heartbeat_back_addr":"172.21.15.77:6829/1492113982","heartbeat_front_addr":"172.21.15.77:6823/1492113982","state":["exists","up"]},{"osd":4,"uuid":"bf63ca05-f06d-4e0f-ac44-2a416c70b919","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6825","nonce":1080481057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6827","nonce":1080481057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6831","nonce":1080481057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6829","nonce":1080481057}]},"public_addr":"172.21.15.103:6825/1080481057","cluster_addr":"172.21.15.103:6827/1080481057","heartbeat_back_addr":"172.21.15.103:6831/1080481057","heartbeat_front_addr":"172.21.15.103:6829/1080481057","state":["exists","up"]},{"osd":5,"uuid":"65a11a35-9e9f-4b3c-9fe3-b658d62b9318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6811","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6813","nonce":2756677504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6818","nonce":2756677504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6823","nonce":2756677504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6821","nonce":2756677504}]},"public_addr":"172.21.15.103:6813/2756677504","cluster_addr":"172.21.15.103:6818/2756677504","heartbeat_back_addr":"172.21.15.103:6823/2756677504","heartbeat_front_addr":"172.21.15.103:6821/2756677504","state":["exists","up"]},{"osd":6,"uuid":"750c1f87-686c-40b4-94a1-1a299dc78f3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6809","nonce":568977764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6812","nonce":568977764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6819","nonce":568977764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6815","nonce":568977764}]},"public_addr":"172.21.15.103:6809/568977764","cluster_addr":"172.21.15.103:6812/568977764","heartbeat_back_addr":"172.21.15.103:6819/568977764","heartbeat_front_addr":"172.21.15.103:6815/568977764","state":["exists","up"]},{"osd":7,"uuid":"d5fe4fb6-2e09-4158-885b-403803c85822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6801","nonce":1074557176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6803","nonce":1074557176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6807","nonce":1074557176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6805","nonce":1074557176}]},"public_addr":"172.21.15.103:6801/1074557176","cluster_addr":"172.21.15.103:6803/1074557176","heartbeat_back_addr":"172.21.15.103:6807/1074557176","heartbeat_front_addr":"172.21.15.103:6805/1074557176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.631032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.154109+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.398587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.679089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.311218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.353726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.314372+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.126212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1d","mappings":[{"from":3,"to":2}]},{"pgid":"4.31","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-24T05:46:58.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.965+0000 7f162c78d700 1 -- 172.21.15.77:0/2644536720 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f16080662f0 msgr2=0x7f16080687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:58.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.965+0000 7f162c78d700 1 --2- 172.21.15.77:0/2644536720 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f16080662f0 0x7f16080687b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f161400bfd0 tx=0x7f1614013000 comp rx=0 tx=0).stop 2023-07-24T05:46:58.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.965+0000 7f162c78d700 1 -- 172.21.15.77:0/2644536720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16240ca890 msgr2=0x7f16240c2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:58.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.965+0000 7f162c78d700 1 --2- 172.21.15.77:0/2644536720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16240ca890 0x7f16240c2950 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1620001130 tx=0x7f162000c7d0 comp rx=0 tx=0).stop 2023-07-24T05:46:58.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.965+0000 7f162c78d700 1 -- 172.21.15.77:0/2644536720 shutdown_connections 2023-07-24T05:46:58.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.965+0000 7f162c78d700 1 --2- 172.21.15.77:0/2644536720 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f16080662f0 0x7f16080687b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:58.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.965+0000 7f162c78d700 1 --2- 172.21.15.77:0/2644536720 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f16240cde50 0x7f16241ee020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:58.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.965+0000 7f162c78d700 1 --2- 172.21.15.77:0/2644536720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16240cc520 0x7f1624152e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:58.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.965+0000 7f162c78d700 1 --2- 172.21.15.77:0/2644536720 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f16240ca890 0x7f16240c2950 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:58.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.965+0000 7f162c78d700 1 -- 172.21.15.77:0/2644536720 >> 172.21.15.77:0/2644536720 conn(0x7f16240ce410 msgr2=0x7f16240abd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:58.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.965+0000 7f162c78d700 1 -- 172.21.15.77:0/2644536720 shutdown_connections 2023-07-24T05:46:58.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:58.965+0000 7f162c78d700 1 -- 172.21.15.77:0/2644536720 wait complete. 2023-07-24T05:46:58.991 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-24T05:45:52.610430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-24T05:45:52.773787+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-24T05:45:58.121732+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-24T05:45:59.368726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-24T05:46:03.032057+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-24T05:46:58.992 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-24T05:46:59.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.165+0000 7f3496cd6700 1 Processor -- start 2023-07-24T05:46:59.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.165+0000 7f3496cd6700 1 -- start start 2023-07-24T05:46:59.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.169+0000 7f3496cd6700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f349006afc0 0x7f34900b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:59.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.169+0000 7f3496cd6700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f34900d2fc0 0x7f34900d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:59.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.169+0000 7f3496cd6700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3490160fa0 con 0x7f349015db20 2023-07-24T05:46:59.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.169+0000 7f3496cd6700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34900d0360 con 0x7f34900d2fc0 2023-07-24T05:46:59.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.169+0000 7f3496cd6700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34900b20b0 con 0x7f349006afc0 2023-07-24T05:46:59.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.169+0000 7f3495273700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f34900d2fc0 0x7f34900d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:59.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.169+0000 7f3494a72700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f349006afc0 0x7f34900b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:59.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.169+0000 7f3495273700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f34900d2fc0 0x7f34900d1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48766/0 (socket says 172.21.15.77:48766) 2023-07-24T05:46:59.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.169+0000 7f3495273700 1 -- 172.21.15.77:0/3754352742 learned_addr learned my addr 172.21.15.77:0/3754352742 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:59.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.169+0000 7f348ffff700 1 --1- 172.21.15.77:0/3754352742 >> v1:172.21.15.103:6789/0 conn(0x7f349015db20 0x7f34900d28b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.77:38176/0 (socket says 172.21.15.77:38176) 2023-07-24T05:46:59.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.169+0000 7f3495273700 1 -- 172.21.15.77:0/3754352742 >> v2:172.21.15.103:3300/0 conn(0x7f349006afc0 msgr2=0x7f34900b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:46:59.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.169+0000 7f3495273700 1 --2- 172.21.15.77:0/3754352742 >> v2:172.21.15.103:3300/0 conn(0x7f349006afc0 0x7f34900b1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:59.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.169+0000 7f3495273700 1 -- 172.21.15.77:0/3754352742 >> v1:172.21.15.103:6789/0 conn(0x7f349015db20 legacy=0x7f34900d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:59.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.169+0000 7f3495273700 1 -- 172.21.15.77:0/3754352742 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3490160670 con 0x7f34900d2fc0 2023-07-24T05:46:59.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.169+0000 7f3494a72700 1 --2- 172.21.15.77:0/3754352742 >> v2:172.21.15.103:3300/0 conn(0x7f349006afc0 0x7f34900b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:46:59.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.169+0000 7f3495273700 1 --2- 172.21.15.77:0/3754352742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34900d2fc0 0x7f34900d1520 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f349006dc40 tx=0x7f348800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dec76b28718fda0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:59.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.169+0000 7f348f7fe700 1 -- 172.21.15.77:0/3754352742 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348800e070 con 0x7f34900d2fc0 2023-07-24T05:46:59.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.173+0000 7f348f7fe700 1 -- 172.21.15.77:0/3754352742 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348800b910 con 0x7f34900d2fc0 2023-07-24T05:46:59.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.173+0000 7f348f7fe700 1 -- 172.21.15.77:0/3754352742 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348800bcc0 con 0x7f34900d2fc0 2023-07-24T05:46:59.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.173+0000 7f3496cd6700 1 -- 172.21.15.77:0/3754352742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34900d2fc0 msgr2=0x7f34900d1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:59.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.173+0000 7f3496cd6700 1 --2- 172.21.15.77:0/3754352742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34900d2fc0 0x7f34900d1520 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f349006dc40 tx=0x7f348800b330 comp rx=0 tx=0).stop 2023-07-24T05:46:59.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.173+0000 7f3496cd6700 1 -- 172.21.15.77:0/3754352742 shutdown_connections 2023-07-24T05:46:59.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.173+0000 7f3496cd6700 1 --2- 172.21.15.77:0/3754352742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34900d2fc0 0x7f34900d1520 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:59.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.173+0000 7f3496cd6700 1 --2- 172.21.15.77:0/3754352742 >> v2:172.21.15.103:3300/0 conn(0x7f349006afc0 0x7f34900b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:59.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.173+0000 7f3496cd6700 1 -- 172.21.15.77:0/3754352742 >> 172.21.15.77:0/3754352742 conn(0x7f349009bc20 msgr2=0x7f34900b7920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:59.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.173+0000 7f3496cd6700 1 -- 172.21.15.77:0/3754352742 shutdown_connections 2023-07-24T05:46:59.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.173+0000 7f3496cd6700 1 -- 172.21.15.77:0/3754352742 wait complete. 2023-07-24T05:46:59.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.177+0000 7f3496cd6700 1 Processor -- start 2023-07-24T05:46:59.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.177+0000 7f3496cd6700 1 -- start start 2023-07-24T05:46:59.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.177+0000 7f3496cd6700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f349006afc0 0x7f34900a0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:59.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.177+0000 7f3496cd6700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f34900d2fc0 0x7f3490156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:59.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.177+0000 7f3496cd6700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f349015db20 0x7f34900b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:59.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.177+0000 7f3496cd6700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34901f2e30 con 0x7f349006afc0 2023-07-24T05:46:59.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.177+0000 7f3496cd6700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34900a07a0 con 0x7f34900d2fc0 2023-07-24T05:46:59.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.177+0000 7f3496cd6700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34901573d0 con 0x7f349015db20 2023-07-24T05:46:59.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.177+0000 7f3494a72700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f349006afc0 0x7f34900a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:59.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.177+0000 7f3494a72700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f349006afc0 0x7f34900a0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48770/0 (socket says 172.21.15.77:48770) 2023-07-24T05:46:59.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.177+0000 7f3494a72700 1 -- 172.21.15.77:0/3210646009 learned_addr learned my addr 172.21.15.77:0/3210646009 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:59.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.177+0000 7f348ffff700 1 --2- 172.21.15.77:0/3210646009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f34900d2fc0 0x7f3490156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:59.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.177+0000 7f3495273700 1 --2- 172.21.15.77:0/3210646009 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f349015db20 0x7f34900b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:59.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.177+0000 7f3494a72700 1 -- 172.21.15.77:0/3210646009 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f349015db20 msgr2=0x7f34900b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:59.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.177+0000 7f3494a72700 1 --2- 172.21.15.77:0/3210646009 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f349015db20 0x7f34900b0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:59.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.177+0000 7f3494a72700 1 -- 172.21.15.77:0/3210646009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f34900d2fc0 msgr2=0x7f3490156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:59.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.177+0000 7f3494a72700 1 --2- 172.21.15.77:0/3210646009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f34900d2fc0 0x7f3490156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:59.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.177+0000 7f3494a72700 1 -- 172.21.15.77:0/3210646009 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34840094b0 con 0x7f349006afc0 2023-07-24T05:46:59.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.181+0000 7f3494a72700 1 --2- 172.21.15.77:0/3210646009 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f349006afc0 0x7f34900a0260 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f348400ebe0 tx=0x7f348400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:59.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.181+0000 7f348d7fa700 1 -- 172.21.15.77:0/3210646009 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348400c850 con 0x7f349006afc0 2023-07-24T05:46:59.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.181+0000 7f348d7fa700 1 -- 172.21.15.77:0/3210646009 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348400c9b0 con 0x7f349006afc0 2023-07-24T05:46:59.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.181+0000 7f3496cd6700 1 -- 172.21.15.77:0/3210646009 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3488009b30 con 0x7f349006afc0 2023-07-24T05:46:59.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.181+0000 7f348d7fa700 1 -- 172.21.15.77:0/3210646009 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348400cd40 con 0x7f349006afc0 2023-07-24T05:46:59.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.181+0000 7f3496cd6700 1 -- 172.21.15.77:0/3210646009 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34901f2490 con 0x7f349006afc0 2023-07-24T05:46:59.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.181+0000 7f3496cd6700 1 -- 172.21.15.77:0/3210646009 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f349004df10 con 0x7f349006afc0 2023-07-24T05:46:59.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.181+0000 7f348d7fa700 1 -- 172.21.15.77:0/3210646009 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3484013470 con 0x7f349006afc0 2023-07-24T05:46:59.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.185+0000 7f348d7fa700 1 --2- 172.21.15.77:0/3210646009 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f34740662f0 0x7f34740687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:59.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.185+0000 7f348d7fa700 1 -- 172.21.15.77:0/3210646009 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f34840840f0 con 0x7f349006afc0 2023-07-24T05:46:59.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.185+0000 7f348ffff700 1 --2- 172.21.15.77:0/3210646009 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f34740662f0 0x7f34740687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:59.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.185+0000 7f348ffff700 1 --2- 172.21.15.77:0/3210646009 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f34740662f0 0x7f34740687b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f34900b4220 tx=0x7f347c007ef0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:59.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.189+0000 7f348d7fa700 1 -- 172.21.15.77:0/3210646009 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3484051230 con 0x7f349006afc0 2023-07-24T05:46:59.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.357+0000 7f3496cd6700 1 -- 172.21.15.77:0/3210646009 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3490072f90 con 0x7f349006afc0 2023-07-24T05:46:59.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.357+0000 7f348d7fa700 1 -- 172.21.15.77:0/3210646009 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f348400cea0 con 0x7f349006afc0 2023-07-24T05:46:59.364 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-07-24T05:46:59.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.361+0000 7f3496cd6700 1 -- 172.21.15.77:0/3210646009 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f34740662f0 msgr2=0x7f34740687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:59.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.361+0000 7f3496cd6700 1 --2- 172.21.15.77:0/3210646009 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f34740662f0 0x7f34740687b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f34900b4220 tx=0x7f347c007ef0 comp rx=0 tx=0).stop 2023-07-24T05:46:59.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.361+0000 7f3496cd6700 1 -- 172.21.15.77:0/3210646009 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f349006afc0 msgr2=0x7f34900a0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:59.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.361+0000 7f3496cd6700 1 --2- 172.21.15.77:0/3210646009 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f349006afc0 0x7f34900a0260 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f348400ebe0 tx=0x7f348400eef0 comp rx=0 tx=0).stop 2023-07-24T05:46:59.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.365+0000 7f3496cd6700 1 -- 172.21.15.77:0/3210646009 shutdown_connections 2023-07-24T05:46:59.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.365+0000 7f3496cd6700 1 --2- 172.21.15.77:0/3210646009 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f34740662f0 0x7f34740687b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:59.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.365+0000 7f3496cd6700 1 --2- 172.21.15.77:0/3210646009 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f349015db20 0x7f34900b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:59.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.365+0000 7f3496cd6700 1 --2- 172.21.15.77:0/3210646009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f34900d2fc0 0x7f3490156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:59.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.365+0000 7f3496cd6700 1 --2- 172.21.15.77:0/3210646009 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f349006afc0 0x7f34900a0260 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:59.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.365+0000 7f3496cd6700 1 -- 172.21.15.77:0/3210646009 >> 172.21.15.77:0/3210646009 conn(0x7f349009bc20 msgr2=0x7f34900af6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:59.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.365+0000 7f3496cd6700 1 -- 172.21.15.77:0/3210646009 shutdown_connections 2023-07-24T05:46:59.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.365+0000 7f3496cd6700 1 -- 172.21.15.77:0/3210646009 wait complete. 2023-07-24T05:46:59.390 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-24T05:46:59.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.557+0000 7f2f5f8b5700 1 Processor -- start 2023-07-24T05:46:59.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.557+0000 7f2f5f8b5700 1 -- start start 2023-07-24T05:46:59.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.557+0000 7f2f5f8b5700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2f580cb530 0x7f2f580c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:59.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.557+0000 7f2f5f8b5700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f580add10 con 0x7f2f580ca250 2023-07-24T05:46:59.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.557+0000 7f2f5f8b5700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f5815e530 con 0x7f2f580ad930 2023-07-24T05:46:59.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.557+0000 7f2f5f8b5700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f580cf2f0 con 0x7f2f580cb530 2023-07-24T05:46:59.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.557+0000 7f2f5de52700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f2f580ca250 0x7f2f580cc010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:33154/0 (socket says 172.21.15.77:33154) 2023-07-24T05:46:59.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.557+0000 7f2f5de52700 1 -- 172.21.15.77:0/3576597618 learned_addr learned my addr 172.21.15.77:0/3576597618 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:59.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.557+0000 7f2f5ce50700 1 --2- 172.21.15.77:0/3576597618 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2f580cb530 0x7f2f580c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:59.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.561+0000 7f2f5ce50700 1 -- 172.21.15.77:0/3576597618 >> v1:172.21.15.103:6789/0 conn(0x7f2f580ad930 legacy=0x7f2f580cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:59.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.561+0000 7f2f5ce50700 1 -- 172.21.15.77:0/3576597618 >> v1:172.21.15.77:6789/0 conn(0x7f2f580ca250 legacy=0x7f2f580cc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:59.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.561+0000 7f2f5ce50700 1 -- 172.21.15.77:0/3576597618 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f5815ae00 con 0x7f2f580cb530 2023-07-24T05:46:59.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.561+0000 7f2f4ffff700 1 -- 172.21.15.77:0/3576597618 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4190468798 0 0) 0x7f2f580add10 con 0x7f2f580ca250 2023-07-24T05:46:59.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.561+0000 7f2f5ce50700 1 --2- 172.21.15.77:0/3576597618 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2f580cb530 0x7f2f580c9d10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2f48009880 tx=0x7f2f48009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a35b79158769b578 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:59.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.561+0000 7f2f4ffff700 1 -- 172.21.15.77:0/3576597618 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f48011830 con 0x7f2f580cb530 2023-07-24T05:46:59.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.561+0000 7f2f4ffff700 1 -- 172.21.15.77:0/3576597618 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f48011990 con 0x7f2f580cb530 2023-07-24T05:46:59.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.561+0000 7f2f4ffff700 1 -- 172.21.15.77:0/3576597618 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f48011d20 con 0x7f2f580cb530 2023-07-24T05:46:59.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.561+0000 7f2f5f8b5700 1 -- 172.21.15.77:0/3576597618 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2f580cb530 msgr2=0x7f2f580c9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:59.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.561+0000 7f2f5f8b5700 1 --2- 172.21.15.77:0/3576597618 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2f580cb530 0x7f2f580c9d10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2f48009880 tx=0x7f2f48009b90 comp rx=0 tx=0).stop 2023-07-24T05:46:59.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.561+0000 7f2f5f8b5700 1 -- 172.21.15.77:0/3576597618 shutdown_connections 2023-07-24T05:46:59.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.561+0000 7f2f5f8b5700 1 --2- 172.21.15.77:0/3576597618 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2f580cb530 0x7f2f580c9d10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:59.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.561+0000 7f2f5f8b5700 1 -- 172.21.15.77:0/3576597618 >> 172.21.15.77:0/3576597618 conn(0x7f2f580ce440 msgr2=0x7f2f580ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:59.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.561+0000 7f2f5f8b5700 1 -- 172.21.15.77:0/3576597618 shutdown_connections 2023-07-24T05:46:59.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.561+0000 7f2f5f8b5700 1 -- 172.21.15.77:0/3576597618 wait complete. 2023-07-24T05:46:59.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.565+0000 7f2f5f8b5700 1 Processor -- start 2023-07-24T05:46:59.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.565+0000 7f2f5f8b5700 1 -- start start 2023-07-24T05:46:59.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.569+0000 7f2f5f8b5700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f580ad930 0x7f2f581f5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:59.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.569+0000 7f2f5f8b5700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2f580ca250 0x7f2f5806d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:59.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.569+0000 7f2f5f8b5700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2f580cb530 0x7f2f58155730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:59.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.569+0000 7f2f5f8b5700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5806c3c0 con 0x7f2f580ad930 2023-07-24T05:46:59.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.569+0000 7f2f5f8b5700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5806c6a0 con 0x7f2f580cb530 2023-07-24T05:46:59.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.569+0000 7f2f5f8b5700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5806c980 con 0x7f2f580ca250 2023-07-24T05:46:59.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.569+0000 7f2f5d651700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f580ad930 0x7f2f581f5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:59.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.569+0000 7f2f5d651700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f580ad930 0x7f2f581f5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48772/0 (socket says 172.21.15.77:48772) 2023-07-24T05:46:59.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.569+0000 7f2f5d651700 1 -- 172.21.15.77:0/3763527634 learned_addr learned my addr 172.21.15.77:0/3763527634 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:59.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.569+0000 7f2f5ce50700 1 --2- 172.21.15.77:0/3763527634 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2f580ca250 0x7f2f5806d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:59.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.569+0000 7f2f5de52700 1 --2- 172.21.15.77:0/3763527634 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2f580cb530 0x7f2f58155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:59.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.569+0000 7f2f5d651700 1 -- 172.21.15.77:0/3763527634 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2f580ca250 msgr2=0x7f2f5806d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:59.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.569+0000 7f2f5d651700 1 --2- 172.21.15.77:0/3763527634 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2f580ca250 0x7f2f5806d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:59.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.569+0000 7f2f5d651700 1 -- 172.21.15.77:0/3763527634 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2f580cb530 msgr2=0x7f2f58155730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:59.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.569+0000 7f2f5d651700 1 --2- 172.21.15.77:0/3763527634 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2f580cb530 0x7f2f58155730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:59.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.569+0000 7f2f5d651700 1 -- 172.21.15.77:0/3763527634 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f480094b0 con 0x7f2f580ad930 2023-07-24T05:46:59.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.569+0000 7f2f5d651700 1 --2- 172.21.15.77:0/3763527634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f580ad930 0x7f2f581f5df0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2f5400c450 tx=0x7f2f5400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:59.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.569+0000 7f2f4dffb700 1 -- 172.21.15.77:0/3763527634 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f540052d0 con 0x7f2f580ad930 2023-07-24T05:46:59.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.569+0000 7f2f4dffb700 1 -- 172.21.15.77:0/3763527634 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f54005430 con 0x7f2f580ad930 2023-07-24T05:46:59.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.569+0000 7f2f5f8b5700 1 -- 172.21.15.77:0/3763527634 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f5806cc60 con 0x7f2f580ad930 2023-07-24T05:46:59.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.569+0000 7f2f4dffb700 1 -- 172.21.15.77:0/3763527634 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f54003930 con 0x7f2f580ad930 2023-07-24T05:46:59.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.569+0000 7f2f5f8b5700 1 -- 172.21.15.77:0/3763527634 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f5815dc10 con 0x7f2f580ad930 2023-07-24T05:46:59.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.573+0000 7f2f5f8b5700 1 -- 172.21.15.77:0/3763527634 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f5806ce50 con 0x7f2f580ad930 2023-07-24T05:46:59.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.573+0000 7f2f4dffb700 1 -- 172.21.15.77:0/3763527634 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2f54003a90 con 0x7f2f580ad930 2023-07-24T05:46:59.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.573+0000 7f2f4dffb700 1 --2- 172.21.15.77:0/3763527634 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2f3c0662f0 0x7f2f3c0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:59.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.573+0000 7f2f4dffb700 1 -- 172.21.15.77:0/3763527634 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2f54083580 con 0x7f2f580ad930 2023-07-24T05:46:59.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.573+0000 7f2f5ce50700 1 --2- 172.21.15.77:0/3763527634 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2f3c0662f0 0x7f2f3c0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:59.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.577+0000 7f2f5ce50700 1 --2- 172.21.15.77:0/3763527634 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2f3c0662f0 0x7f2f3c0687b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2f480090b0 tx=0x7f2f48008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:59.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.581+0000 7f2f4dffb700 1 -- 172.21.15.77:0/3763527634 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2f54050630 con 0x7f2f580ad930 2023-07-24T05:46:59.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.753+0000 7f2f5f8b5700 1 -- 172.21.15.77:0/3763527634 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2f5806c500 con 0x7f2f580ad930 2023-07-24T05:46:59.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.757+0000 7f2f4dffb700 1 -- 172.21.15.77:0/3763527634 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2f5806c500 con 0x7f2f580ad930 2023-07-24T05:46:59.762 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 8 2023-07-24T05:46:59.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.757+0000 7f2f5f8b5700 1 -- 172.21.15.77:0/3763527634 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2f3c0662f0 msgr2=0x7f2f3c0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:59.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.757+0000 7f2f5f8b5700 1 --2- 172.21.15.77:0/3763527634 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2f3c0662f0 0x7f2f3c0687b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2f480090b0 tx=0x7f2f48008030 comp rx=0 tx=0).stop 2023-07-24T05:46:59.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.757+0000 7f2f5f8b5700 1 -- 172.21.15.77:0/3763527634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f580ad930 msgr2=0x7f2f581f5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:59.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.757+0000 7f2f5f8b5700 1 --2- 172.21.15.77:0/3763527634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f580ad930 0x7f2f581f5df0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2f5400c450 tx=0x7f2f5400c810 comp rx=0 tx=0).stop 2023-07-24T05:46:59.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.757+0000 7f2f5f8b5700 1 -- 172.21.15.77:0/3763527634 shutdown_connections 2023-07-24T05:46:59.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.757+0000 7f2f5f8b5700 1 --2- 172.21.15.77:0/3763527634 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2f580cb530 0x7f2f58155730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:59.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.757+0000 7f2f5f8b5700 1 --2- 172.21.15.77:0/3763527634 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2f3c0662f0 0x7f2f3c0687b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:59.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.757+0000 7f2f5f8b5700 1 --2- 172.21.15.77:0/3763527634 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2f580ca250 0x7f2f5806d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:59.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.757+0000 7f2f5f8b5700 1 --2- 172.21.15.77:0/3763527634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f580ad930 0x7f2f581f5df0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:59.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.761+0000 7f2f5f8b5700 1 -- 172.21.15.77:0/3763527634 >> 172.21.15.77:0/3763527634 conn(0x7f2f580ce440 msgr2=0x7f2f58158f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:59.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.761+0000 7f2f5f8b5700 1 -- 172.21.15.77:0/3763527634 shutdown_connections 2023-07-24T05:46:59.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.761+0000 7f2f5f8b5700 1 -- 172.21.15.77:0/3763527634 wait complete. 2023-07-24T05:46:59.786 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-24T05:46:59.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.965+0000 7f843094b700 1 Processor -- start 2023-07-24T05:46:59.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.965+0000 7f843094b700 1 -- start start 2023-07-24T05:46:59.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.969+0000 7f843094b700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f842c0b1a20 0x7f842c15db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:59.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.969+0000 7f843094b700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f842c0d0360 con 0x7f842c0d2fc0 2023-07-24T05:46:59.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.969+0000 7f843094b700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f842c160fa0 con 0x7f842c06afc0 2023-07-24T05:46:59.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.969+0000 7f843094b700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f842c0b1ed0 con 0x7f842c0b1a20 2023-07-24T05:46:59.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.969+0000 7f8429d9b700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f842c0d2fc0 0x7f842c0d1520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:33156/0 (socket says 172.21.15.77:33156) 2023-07-24T05:46:59.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.969+0000 7f8429d9b700 1 -- 172.21.15.77:0/596201333 learned_addr learned my addr 172.21.15.77:0/596201333 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:46:59.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.969+0000 7f842ad9d700 1 --2- 172.21.15.77:0/596201333 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f842c0b1a20 0x7f842c15db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:59.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.969+0000 7f842959a700 1 -- 172.21.15.77:0/596201333 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3081549254 0 0) 0x7f842c0d0360 con 0x7f842c0d2fc0 2023-07-24T05:46:59.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.969+0000 7f842959a700 1 -- 172.21.15.77:0/596201333 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84140035d0 con 0x7f842c0d2fc0 2023-07-24T05:46:59.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.969+0000 7f842959a700 1 -- 172.21.15.77:0/596201333 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1014155549 0 0) 0x7f842c160fa0 con 0x7f842c06afc0 2023-07-24T05:46:59.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.969+0000 7f842959a700 1 -- 172.21.15.77:0/596201333 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f842c0d0360 con 0x7f842c06afc0 2023-07-24T05:46:59.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.969+0000 7f842ad9d700 1 -- 172.21.15.77:0/596201333 >> v1:172.21.15.103:6789/0 conn(0x7f842c06afc0 legacy=0x7f842c0d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:59.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.969+0000 7f842ad9d700 1 -- 172.21.15.77:0/596201333 >> v1:172.21.15.77:6789/0 conn(0x7f842c0d2fc0 legacy=0x7f842c0d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:59.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.969+0000 7f842ad9d700 1 -- 172.21.15.77:0/596201333 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f842c15e060 con 0x7f842c0b1a20 2023-07-24T05:46:59.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.969+0000 7f842ad9d700 1 --2- 172.21.15.77:0/596201333 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f842c0b1a20 0x7f842c15db20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8424009dc0 tx=0x7f842400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c97703d4a3603811 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:59.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.973+0000 7f842959a700 1 -- 172.21.15.77:0/596201333 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842400e070 con 0x7f842c0b1a20 2023-07-24T05:46:59.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.973+0000 7f842959a700 1 -- 172.21.15.77:0/596201333 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842400bb20 con 0x7f842c0b1a20 2023-07-24T05:46:59.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.973+0000 7f842959a700 1 -- 172.21.15.77:0/596201333 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842400be90 con 0x7f842c0b1a20 2023-07-24T05:46:59.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.973+0000 7f843094b700 1 -- 172.21.15.77:0/596201333 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f842c0b1a20 msgr2=0x7f842c15db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:59.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.973+0000 7f843094b700 1 --2- 172.21.15.77:0/596201333 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f842c0b1a20 0x7f842c15db20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8424009dc0 tx=0x7f842400b330 comp rx=0 tx=0).stop 2023-07-24T05:46:59.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.973+0000 7f843094b700 1 -- 172.21.15.77:0/596201333 shutdown_connections 2023-07-24T05:46:59.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.973+0000 7f843094b700 1 --2- 172.21.15.77:0/596201333 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f842c0b1a20 0x7f842c15db20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:59.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.973+0000 7f843094b700 1 -- 172.21.15.77:0/596201333 >> 172.21.15.77:0/596201333 conn(0x7f842c09bc20 msgr2=0x7f842c0b7920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:46:59.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.973+0000 7f843094b700 1 -- 172.21.15.77:0/596201333 shutdown_connections 2023-07-24T05:46:59.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.973+0000 7f843094b700 1 -- 172.21.15.77:0/596201333 wait complete. 2023-07-24T05:46:59.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.977+0000 7f843094b700 1 Processor -- start 2023-07-24T05:46:59.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.977+0000 7f843094b700 1 -- start start 2023-07-24T05:46:59.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.981+0000 7f843094b700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f842c06afc0 0x7f842c0b4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:59.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.981+0000 7f843094b700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f842c0b1a20 0x7f842c156e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:59.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.981+0000 7f843094b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f842c0d2fc0 0x7f842c0c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:59.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.981+0000 7f843094b700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842c0c83f0 con 0x7f842c0d2fc0 2023-07-24T05:46:59.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.981+0000 7f843094b700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842c0c8620 con 0x7f842c0b1a20 2023-07-24T05:46:59.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.981+0000 7f843094b700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f842c0c8900 con 0x7f842c06afc0 2023-07-24T05:46:59.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.981+0000 7f842ad9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f842c0d2fc0 0x7f842c0c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:59.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.981+0000 7f842a59c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f842c06afc0 0x7f842c0b4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:59.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.981+0000 7f842ad9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f842c0d2fc0 0x7f842c0c7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48784/0 (socket says 172.21.15.77:48784) 2023-07-24T05:46:59.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.981+0000 7f842ad9d700 1 -- 172.21.15.77:0/2201892386 learned_addr learned my addr 172.21.15.77:0/2201892386 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:46:59.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.981+0000 7f8429d9b700 1 --2- 172.21.15.77:0/2201892386 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f842c0b1a20 0x7f842c156e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:59.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.981+0000 7f842ad9d700 1 -- 172.21.15.77:0/2201892386 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f842c06afc0 msgr2=0x7f842c0b4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:59.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.981+0000 7f842ad9d700 1 --2- 172.21.15.77:0/2201892386 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f842c06afc0 0x7f842c0b4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:59.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.981+0000 7f842ad9d700 1 -- 172.21.15.77:0/2201892386 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f842c0b1a20 msgr2=0x7f842c156e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:46:59.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.981+0000 7f842ad9d700 1 --2- 172.21.15.77:0/2201892386 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f842c0b1a20 0x7f842c156e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:46:59.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.981+0000 7f842ad9d700 1 -- 172.21.15.77:0/2201892386 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8424009a70 con 0x7f842c0d2fc0 2023-07-24T05:46:59.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.981+0000 7f842ad9d700 1 --2- 172.21.15.77:0/2201892386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f842c0d2fc0 0x7f842c0c7eb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8424009fd0 tx=0x7f8424004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:59.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.981+0000 7f841affd700 1 -- 172.21.15.77:0/2201892386 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8424007000 con 0x7f842c0d2fc0 2023-07-24T05:46:59.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.981+0000 7f841affd700 1 -- 172.21.15.77:0/2201892386 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842401f070 con 0x7f842c0d2fc0 2023-07-24T05:46:59.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.981+0000 7f841affd700 1 -- 172.21.15.77:0/2201892386 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8424003c80 con 0x7f842c0d2fc0 2023-07-24T05:46:59.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.981+0000 7f843094b700 1 -- 172.21.15.77:0/2201892386 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f842c0c8be0 con 0x7f842c0d2fc0 2023-07-24T05:46:59.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.981+0000 7f843094b700 1 -- 172.21.15.77:0/2201892386 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f842c0ca2b0 con 0x7f842c0d2fc0 2023-07-24T05:46:59.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.985+0000 7f843094b700 1 -- 172.21.15.77:0/2201892386 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f842c04df10 con 0x7f842c0d2fc0 2023-07-24T05:46:59.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.985+0000 7f841affd700 1 -- 172.21.15.77:0/2201892386 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8424004030 con 0x7f842c0d2fc0 2023-07-24T05:46:59.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.985+0000 7f841affd700 1 --2- 172.21.15.77:0/2201892386 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f840c0662f0 0x7f840c0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:46:59.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.985+0000 7f841affd700 1 -- 172.21.15.77:0/2201892386 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8424085750 con 0x7f842c0d2fc0 2023-07-24T05:46:59.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.985+0000 7f842a59c700 1 --2- 172.21.15.77:0/2201892386 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f840c0662f0 0x7f840c0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:46:59.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.989+0000 7f842a59c700 1 --2- 172.21.15.77:0/2201892386 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f840c0662f0 0x7f840c0687b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f841c0011e0 tx=0x7f841c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:46:59.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:46:59.993+0000 7f841affd700 1 -- 172.21.15.77:0/2201892386 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8424052890 con 0x7f842c0d2fc0 2023-07-24T05:47:00.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.169+0000 7f843094b700 1 -- 172.21.15.77:0/2201892386 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f842c0d3540 con 0x7f842c0d2fc0 2023-07-24T05:47:00.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.169+0000 7f841affd700 1 -- 172.21.15.77:0/2201892386 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8424055eb0 con 0x7f842c0d2fc0 2023-07-24T05:47:00.175 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-07-24T05:47:00.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.173+0000 7f843094b700 1 -- 172.21.15.77:0/2201892386 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f840c0662f0 msgr2=0x7f840c0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:00.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.173+0000 7f843094b700 1 --2- 172.21.15.77:0/2201892386 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f840c0662f0 0x7f840c0687b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f841c0011e0 tx=0x7f841c009040 comp rx=0 tx=0).stop 2023-07-24T05:47:00.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.173+0000 7f843094b700 1 -- 172.21.15.77:0/2201892386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f842c0d2fc0 msgr2=0x7f842c0c7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:00.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.173+0000 7f843094b700 1 --2- 172.21.15.77:0/2201892386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f842c0d2fc0 0x7f842c0c7eb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8424009fd0 tx=0x7f8424004af0 comp rx=0 tx=0).stop 2023-07-24T05:47:00.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.173+0000 7f843094b700 1 -- 172.21.15.77:0/2201892386 shutdown_connections 2023-07-24T05:47:00.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.173+0000 7f843094b700 1 --2- 172.21.15.77:0/2201892386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f842c0d2fc0 0x7f842c0c7eb0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:00.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.173+0000 7f843094b700 1 --2- 172.21.15.77:0/2201892386 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f842c0b1a20 0x7f842c156e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:00.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.173+0000 7f843094b700 1 --2- 172.21.15.77:0/2201892386 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f840c0662f0 0x7f840c0687b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:00.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.173+0000 7f843094b700 1 --2- 172.21.15.77:0/2201892386 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f842c06afc0 0x7f842c0b4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:00.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.173+0000 7f843094b700 1 -- 172.21.15.77:0/2201892386 >> 172.21.15.77:0/2201892386 conn(0x7f842c09bc20 msgr2=0x7f842c069b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:00.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.173+0000 7f843094b700 1 -- 172.21.15.77:0/2201892386 shutdown_connections 2023-07-24T05:47:00.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.173+0000 7f843094b700 1 -- 172.21.15.77:0/2201892386 wait complete. 2023-07-24T05:47:00.199 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-24T05:47:00.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.365+0000 7fa8cb59e700 1 Processor -- start 2023-07-24T05:47:00.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.365+0000 7fa8cb59e700 1 -- start start 2023-07-24T05:47:00.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.365+0000 7fa8cb59e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa8cc0af100 0x7fa8cc0ad600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:00.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.365+0000 7fa8cb59e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa8cc06ab20 0x7fa8cc06afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:00.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.365+0000 7fa8cb59e700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8cc15ea20 con 0x7fa8cc15a710 2023-07-24T05:47:00.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.365+0000 7fa8cb59e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8cc06b4f0 con 0x7fa8cc06ab20 2023-07-24T05:47:00.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.365+0000 7fa8cb59e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc15ed00 con 0x7fa8cc0af100 2023-07-24T05:47:00.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.365+0000 7fa8ca59c700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fa8cc15a710 0x7fa8cc15e260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:33172/0 (socket says 172.21.15.77:33172) 2023-07-24T05:47:00.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.365+0000 7fa8ca59c700 1 -- 172.21.15.77:0/2370558617 learned_addr learned my addr 172.21.15.77:0/2370558617 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:00.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.365+0000 7fa8c9d9b700 1 --2- 172.21.15.77:0/2370558617 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa8cc0af100 0x7fa8cc0ad600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:00.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.369+0000 7fa8cad9d700 1 --2- 172.21.15.77:0/2370558617 >> v2:172.21.15.103:3300/0 conn(0x7fa8cc06ab20 0x7fa8cc06afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:00.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.369+0000 7fa8c959a700 1 -- 172.21.15.77:0/2370558617 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4149143400 0 0) 0x7fa8cc15ea20 con 0x7fa8cc15a710 2023-07-24T05:47:00.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.369+0000 7fa8c959a700 1 -- 172.21.15.77:0/2370558617 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8b40035d0 con 0x7fa8cc15a710 2023-07-24T05:47:00.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.369+0000 7fa8c9d9b700 1 -- 172.21.15.77:0/2370558617 >> v2:172.21.15.103:3300/0 conn(0x7fa8cc06ab20 msgr2=0x7fa8cc06afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:00.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.369+0000 7fa8c9d9b700 1 --2- 172.21.15.77:0/2370558617 >> v2:172.21.15.103:3300/0 conn(0x7fa8cc06ab20 0x7fa8cc06afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:00.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.369+0000 7fa8c9d9b700 1 -- 172.21.15.77:0/2370558617 >> v1:172.21.15.77:6789/0 conn(0x7fa8cc15a710 legacy=0x7fa8cc15e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:00.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.369+0000 7fa8c9d9b700 1 -- 172.21.15.77:0/2370558617 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8cc15efe0 con 0x7fa8cc0af100 2023-07-24T05:47:00.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.369+0000 7fa8c9d9b700 1 --2- 172.21.15.77:0/2370558617 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa8cc0af100 0x7fa8cc0ad600 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0009850 tx=0x7fa8c0009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bd44e4daf72f7ef server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:00.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.369+0000 7fa8c959a700 1 -- 172.21.15.77:0/2370558617 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c0011830 con 0x7fa8cc0af100 2023-07-24T05:47:00.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.369+0000 7fa8c959a700 1 -- 172.21.15.77:0/2370558617 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c0011990 con 0x7fa8cc0af100 2023-07-24T05:47:00.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.369+0000 7fa8c959a700 1 -- 172.21.15.77:0/2370558617 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c0011d40 con 0x7fa8cc0af100 2023-07-24T05:47:00.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.369+0000 7fa8cb59e700 1 -- 172.21.15.77:0/2370558617 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa8cc0af100 msgr2=0x7fa8cc0ad600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:00.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.369+0000 7fa8cb59e700 1 --2- 172.21.15.77:0/2370558617 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa8cc0af100 0x7fa8cc0ad600 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0009850 tx=0x7fa8c0009b60 comp rx=0 tx=0).stop 2023-07-24T05:47:00.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.373+0000 7fa8cb59e700 1 -- 172.21.15.77:0/2370558617 shutdown_connections 2023-07-24T05:47:00.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.373+0000 7fa8cb59e700 1 --2- 172.21.15.77:0/2370558617 >> v2:172.21.15.103:3300/0 conn(0x7fa8cc06ab20 0x7fa8cc06afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:00.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.373+0000 7fa8cb59e700 1 --2- 172.21.15.77:0/2370558617 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa8cc0af100 0x7fa8cc0ad600 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:00.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.373+0000 7fa8cb59e700 1 -- 172.21.15.77:0/2370558617 >> 172.21.15.77:0/2370558617 conn(0x7fa8cc0afcf0 msgr2=0x7fa8cc0b0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:00.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.373+0000 7fa8cb59e700 1 -- 172.21.15.77:0/2370558617 shutdown_connections 2023-07-24T05:47:00.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.373+0000 7fa8cb59e700 1 -- 172.21.15.77:0/2370558617 wait complete. 2023-07-24T05:47:00.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.377+0000 7fa8cb59e700 1 Processor -- start 2023-07-24T05:47:00.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.377+0000 7fa8cb59e700 1 -- start start 2023-07-24T05:47:00.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.377+0000 7fa8cb59e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8cc06ab20 0x7fa8cc0b0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:00.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.377+0000 7fa8cb59e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa8cc0af100 0x7fa8cc155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:00.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.377+0000 7fa8cb59e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8cc15a710 0x7fa8cc099400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:00.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.377+0000 7fa8cb59e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc0b14d0 con 0x7fa8cc06ab20 2023-07-24T05:47:00.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.377+0000 7fa8cb59e700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc0b17b0 con 0x7fa8cc15a710 2023-07-24T05:47:00.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.377+0000 7fa8cb59e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc0b1a90 con 0x7fa8cc0af100 2023-07-24T05:47:00.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.377+0000 7fa8ca59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8cc06ab20 0x7fa8cc0b0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:00.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.377+0000 7fa8ca59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8cc06ab20 0x7fa8cc0b0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48792/0 (socket says 172.21.15.77:48792) 2023-07-24T05:47:00.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.377+0000 7fa8ca59c700 1 -- 172.21.15.77:0/2945560687 learned_addr learned my addr 172.21.15.77:0/2945560687 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:00.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.377+0000 7fa8c9d9b700 1 --2- 172.21.15.77:0/2945560687 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa8cc0af100 0x7fa8cc155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:00.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.377+0000 7fa8cad9d700 1 --2- 172.21.15.77:0/2945560687 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8cc15a710 0x7fa8cc099400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:00.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.377+0000 7fa8ca59c700 1 -- 172.21.15.77:0/2945560687 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa8cc0af100 msgr2=0x7fa8cc155e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:00.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.377+0000 7fa8ca59c700 1 --2- 172.21.15.77:0/2945560687 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa8cc0af100 0x7fa8cc155e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:00.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.377+0000 7fa8ca59c700 1 -- 172.21.15.77:0/2945560687 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8cc15a710 msgr2=0x7fa8cc099400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:00.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.377+0000 7fa8ca59c700 1 --2- 172.21.15.77:0/2945560687 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8cc15a710 0x7fa8cc099400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:00.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.377+0000 7fa8ca59c700 1 -- 172.21.15.77:0/2945560687 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c00094b0 con 0x7fa8cc06ab20 2023-07-24T05:47:00.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.377+0000 7fa8ca59c700 1 --2- 172.21.15.77:0/2945560687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8cc06ab20 0x7fa8cc0b0e80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc00c700 tx=0x7fa8bc00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:00.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.377+0000 7fa8baffd700 1 -- 172.21.15.77:0/2945560687 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc005d90 con 0x7fa8cc06ab20 2023-07-24T05:47:00.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.377+0000 7fa8cb59e700 1 -- 172.21.15.77:0/2945560687 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8cc0b1d70 con 0x7fa8cc06ab20 2023-07-24T05:47:00.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.377+0000 7fa8baffd700 1 -- 172.21.15.77:0/2945560687 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8bc0070d0 con 0x7fa8cc06ab20 2023-07-24T05:47:00.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.377+0000 7fa8baffd700 1 -- 172.21.15.77:0/2945560687 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc007480 con 0x7fa8cc06ab20 2023-07-24T05:47:00.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.377+0000 7fa8cb59e700 1 -- 172.21.15.77:0/2945560687 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8cc099940 con 0x7fa8cc06ab20 2023-07-24T05:47:00.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.381+0000 7fa8cb59e700 1 -- 172.21.15.77:0/2945560687 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8cc072490 con 0x7fa8cc06ab20 2023-07-24T05:47:00.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.381+0000 7fa8baffd700 1 -- 172.21.15.77:0/2945560687 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa8bc0075e0 con 0x7fa8cc06ab20 2023-07-24T05:47:00.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.385+0000 7fa8baffd700 1 --2- 172.21.15.77:0/2945560687 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa8ac0662f0 0x7fa8ac0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:00.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.385+0000 7fa8baffd700 1 -- 172.21.15.77:0/2945560687 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa8bc083590 con 0x7fa8cc06ab20 2023-07-24T05:47:00.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.385+0000 7fa8c9d9b700 1 --2- 172.21.15.77:0/2945560687 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa8ac0662f0 0x7fa8ac0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:00.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.385+0000 7fa8c9d9b700 1 --2- 172.21.15.77:0/2945560687 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa8ac0662f0 0x7fa8ac0687b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa8c00090b0 tx=0x7fa8c0008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:00.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.389+0000 7fa8baffd700 1 -- 172.21.15.77:0/2945560687 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa8bc0506e0 con 0x7fa8cc06ab20 2023-07-24T05:47:00.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.561+0000 7fa8cb59e700 1 -- 172.21.15.77:0/2945560687 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa8cc09f350 con 0x7fa8cc06ab20 2023-07-24T05:47:00.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.561+0000 7fa8baffd700 1 -- 172.21.15.77:0/2945560687 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa8bc053d00 con 0x7fa8cc06ab20 2023-07-24T05:47:00.568 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-07-24T05:47:00.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.565+0000 7fa8cb59e700 1 -- 172.21.15.77:0/2945560687 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa8ac0662f0 msgr2=0x7fa8ac0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:00.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.565+0000 7fa8cb59e700 1 --2- 172.21.15.77:0/2945560687 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa8ac0662f0 0x7fa8ac0687b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa8c00090b0 tx=0x7fa8c0008030 comp rx=0 tx=0).stop 2023-07-24T05:47:00.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.565+0000 7fa8cb59e700 1 -- 172.21.15.77:0/2945560687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8cc06ab20 msgr2=0x7fa8cc0b0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:00.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.565+0000 7fa8cb59e700 1 --2- 172.21.15.77:0/2945560687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8cc06ab20 0x7fa8cc0b0e80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc00c700 tx=0x7fa8bc00ca10 comp rx=0 tx=0).stop 2023-07-24T05:47:00.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.565+0000 7fa8cb59e700 1 -- 172.21.15.77:0/2945560687 shutdown_connections 2023-07-24T05:47:00.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.565+0000 7fa8cb59e700 1 --2- 172.21.15.77:0/2945560687 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8cc15a710 0x7fa8cc099400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:00.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.565+0000 7fa8cb59e700 1 --2- 172.21.15.77:0/2945560687 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa8ac0662f0 0x7fa8ac0687b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:00.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.565+0000 7fa8cb59e700 1 --2- 172.21.15.77:0/2945560687 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa8cc0af100 0x7fa8cc155e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:00.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.565+0000 7fa8cb59e700 1 --2- 172.21.15.77:0/2945560687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa8cc06ab20 0x7fa8cc0b0e80 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:00.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.565+0000 7fa8cb59e700 1 -- 172.21.15.77:0/2945560687 >> 172.21.15.77:0/2945560687 conn(0x7fa8cc0afcf0 msgr2=0x7fa8cc0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:00.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.565+0000 7fa8cb59e700 1 -- 172.21.15.77:0/2945560687 shutdown_connections 2023-07-24T05:47:00.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.565+0000 7fa8cb59e700 1 -- 172.21.15.77:0/2945560687 wait complete. 2023-07-24T05:47:00.592 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-24T05:47:00.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.769+0000 7f1e0f59e700 1 Processor -- start 2023-07-24T05:47:00.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.769+0000 7f1e0f59e700 1 -- start start 2023-07-24T05:47:00.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.773+0000 7f1e0f59e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1e1015a950 0x7f1e100b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:00.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.773+0000 7f1e0f59e700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1e1006a220 0x7f1e1006d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:00.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.773+0000 7f1e0f59e700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e1006b000 con 0x7f1e100c4e70 2023-07-24T05:47:00.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.773+0000 7f1e0f59e700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e100b1ac0 con 0x7f1e1006a220 2023-07-24T05:47:00.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.773+0000 7f1e0f59e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1006a7c0 con 0x7f1e1015a950 2023-07-24T05:47:00.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.773+0000 7f1e0dd9b700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f1e100c4e70 0x7f1e10069b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:33184/0 (socket says 172.21.15.77:33184) 2023-07-24T05:47:00.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.773+0000 7f1e0dd9b700 1 -- 172.21.15.77:0/3877496257 learned_addr learned my addr 172.21.15.77:0/3877496257 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:00.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.773+0000 7f1e0e59c700 1 --2- 172.21.15.77:0/3877496257 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1e1015a950 0x7f1e100b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:00.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.773+0000 7f1e0ed9d700 1 --2- 172.21.15.77:0/3877496257 >> v2:172.21.15.77:3300/0 conn(0x7f1e1006a220 0x7f1e1006d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:00.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.773+0000 7f1e0d59a700 1 -- 172.21.15.77:0/3877496257 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3621625866 0 0) 0x7f1e1006b000 con 0x7f1e100c4e70 2023-07-24T05:47:00.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.773+0000 7f1e0e59c700 1 -- 172.21.15.77:0/3877496257 >> v2:172.21.15.77:3300/0 conn(0x7f1e1006a220 msgr2=0x7f1e1006d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:00.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.773+0000 7f1e0e59c700 1 --2- 172.21.15.77:0/3877496257 >> v2:172.21.15.77:3300/0 conn(0x7f1e1006a220 0x7f1e1006d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:00.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.773+0000 7f1e0e59c700 1 -- 172.21.15.77:0/3877496257 >> v1:172.21.15.77:6789/0 conn(0x7f1e100c4e70 legacy=0x7f1e10069b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:00.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.773+0000 7f1e0e59c700 1 -- 172.21.15.77:0/3877496257 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1006aaa0 con 0x7f1e1015a950 2023-07-24T05:47:00.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.773+0000 7f1e0ed9d700 1 --2- 172.21.15.77:0/3877496257 >> v2:172.21.15.77:3300/0 conn(0x7f1e1006a220 0x7f1e1006d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:47:00.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.773+0000 7f1e0e59c700 1 --2- 172.21.15.77:0/3877496257 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1e1015a950 0x7f1e100b1f10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1e00009850 tx=0x7f1e00009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ebd2344cbb93430 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:00.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.773+0000 7f1e0d59a700 1 -- 172.21.15.77:0/3877496257 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e00011830 con 0x7f1e1015a950 2023-07-24T05:47:00.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.773+0000 7f1e0d59a700 1 -- 172.21.15.77:0/3877496257 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e00011990 con 0x7f1e1015a950 2023-07-24T05:47:00.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.773+0000 7f1e0d59a700 1 -- 172.21.15.77:0/3877496257 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e00011d40 con 0x7f1e1015a950 2023-07-24T05:47:00.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.777+0000 7f1e0f59e700 1 -- 172.21.15.77:0/3877496257 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1e1015a950 msgr2=0x7f1e100b1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:00.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.777+0000 7f1e0f59e700 1 --2- 172.21.15.77:0/3877496257 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1e1015a950 0x7f1e100b1f10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1e00009850 tx=0x7f1e00009b60 comp rx=0 tx=0).stop 2023-07-24T05:47:00.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.777+0000 7f1e0f59e700 1 -- 172.21.15.77:0/3877496257 shutdown_connections 2023-07-24T05:47:00.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.777+0000 7f1e0f59e700 1 --2- 172.21.15.77:0/3877496257 >> v2:172.21.15.77:3300/0 conn(0x7f1e1006a220 0x7f1e1006d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:00.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.777+0000 7f1e0f59e700 1 --2- 172.21.15.77:0/3877496257 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1e1015a950 0x7f1e100b1f10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:00.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.777+0000 7f1e0f59e700 1 -- 172.21.15.77:0/3877496257 >> 172.21.15.77:0/3877496257 conn(0x7f1e100ce260 msgr2=0x7f1e100ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:00.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.777+0000 7f1e0f59e700 1 -- 172.21.15.77:0/3877496257 shutdown_connections 2023-07-24T05:47:00.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.777+0000 7f1e0f59e700 1 -- 172.21.15.77:0/3877496257 wait complete. 2023-07-24T05:47:00.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.781+0000 7f1e0f59e700 1 Processor -- start 2023-07-24T05:47:00.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.781+0000 7f1e0f59e700 1 -- start start 2023-07-24T05:47:00.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.781+0000 7f1e0f59e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e1006a220 0x7f1e10158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:00.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.781+0000 7f1e0f59e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1e100c4e70 0x7f1e100c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:00.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.781+0000 7f1e0f59e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e1015a950 0x7f1e10154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:00.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.781+0000 7f1e0f59e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e100ca310 con 0x7f1e1006a220 2023-07-24T05:47:00.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.781+0000 7f1e0f59e700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1015ca40 con 0x7f1e1015a950 2023-07-24T05:47:00.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.781+0000 7f1e0f59e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e100ca100 con 0x7f1e100c4e70 2023-07-24T05:47:00.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.781+0000 7f1e0e59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e1006a220 0x7f1e10158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:00.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.781+0000 7f1e0e59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e1006a220 0x7f1e10158e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48820/0 (socket says 172.21.15.77:48820) 2023-07-24T05:47:00.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.781+0000 7f1e0e59c700 1 -- 172.21.15.77:0/577376368 learned_addr learned my addr 172.21.15.77:0/577376368 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:00.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.781+0000 7f1e0ed9d700 1 --2- 172.21.15.77:0/577376368 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e1015a950 0x7f1e10154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:00.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.781+0000 7f1e0dd9b700 1 --2- 172.21.15.77:0/577376368 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1e100c4e70 0x7f1e100c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:00.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.781+0000 7f1e0e59c700 1 -- 172.21.15.77:0/577376368 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1e100c4e70 msgr2=0x7f1e100c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:00.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.781+0000 7f1e0e59c700 1 --2- 172.21.15.77:0/577376368 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1e100c4e70 0x7f1e100c9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:00.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.781+0000 7f1e0e59c700 1 -- 172.21.15.77:0/577376368 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e1015a950 msgr2=0x7f1e10154bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:00.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.781+0000 7f1e0e59c700 1 --2- 172.21.15.77:0/577376368 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e1015a950 0x7f1e10154bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:00.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.781+0000 7f1e0e59c700 1 -- 172.21.15.77:0/577376368 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e08009a70 con 0x7f1e1006a220 2023-07-24T05:47:00.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.781+0000 7f1e0dd9b700 1 --2- 172.21.15.77:0/577376368 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1e100c4e70 0x7f1e100c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:00.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.781+0000 7f1e0e59c700 1 --2- 172.21.15.77:0/577376368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e1006a220 0x7f1e10158e80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1e000090b0 tx=0x7f1e00004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:00.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.781+0000 7f1dfeffd700 1 -- 172.21.15.77:0/577376368 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e000044d0 con 0x7f1e1006a220 2023-07-24T05:47:00.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.781+0000 7f1e0f59e700 1 -- 172.21.15.77:0/577376368 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e000094b0 con 0x7f1e1006a220 2023-07-24T05:47:00.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.781+0000 7f1dfeffd700 1 -- 172.21.15.77:0/577376368 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0001f070 con 0x7f1e1006a220 2023-07-24T05:47:00.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.781+0000 7f1dfeffd700 1 -- 172.21.15.77:0/577376368 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e00003900 con 0x7f1e1006a220 2023-07-24T05:47:00.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.785+0000 7f1e0f59e700 1 -- 172.21.15.77:0/577376368 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e1015c380 con 0x7f1e1006a220 2023-07-24T05:47:00.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.785+0000 7f1e0f59e700 1 -- 172.21.15.77:0/577376368 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e1006bd40 con 0x7f1e1006a220 2023-07-24T05:47:00.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.785+0000 7f1dfeffd700 1 -- 172.21.15.77:0/577376368 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1e00003a60 con 0x7f1e1006a220 2023-07-24T05:47:00.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.785+0000 7f1dfeffd700 1 --2- 172.21.15.77:0/577376368 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f1df00662f0 0x7f1df00687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:00.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.789+0000 7f1dfeffd700 1 -- 172.21.15.77:0/577376368 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1e00021070 con 0x7f1e1006a220 2023-07-24T05:47:00.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.789+0000 7f1e0dd9b700 1 --2- 172.21.15.77:0/577376368 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f1df00662f0 0x7f1df00687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:00.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.789+0000 7f1e0dd9b700 1 --2- 172.21.15.77:0/577376368 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f1df00662f0 0x7f1df00687b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1e101f51e0 tx=0x7f1e04007d70 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:00.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.793+0000 7f1dfeffd700 1 -- 172.21.15.77:0/577376368 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1e00052900 con 0x7f1e1006a220 2023-07-24T05:47:00.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.957+0000 7f1e0f59e700 1 -- 172.21.15.77:0/577376368 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f1e10072490 con 0x7f1e1006a220 2023-07-24T05:47:00.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.961+0000 7f1dfeffd700 1 -- 172.21.15.77:0/577376368 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1e00055f20 con 0x7f1e1006a220 2023-07-24T05:47:00.966 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-07-24T05:47:00.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.965+0000 7f1e0f59e700 1 -- 172.21.15.77:0/577376368 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f1df00662f0 msgr2=0x7f1df00687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:00.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.965+0000 7f1e0f59e700 1 --2- 172.21.15.77:0/577376368 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f1df00662f0 0x7f1df00687b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1e101f51e0 tx=0x7f1e04007d70 comp rx=0 tx=0).stop 2023-07-24T05:47:00.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.965+0000 7f1e0f59e700 1 -- 172.21.15.77:0/577376368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e1006a220 msgr2=0x7f1e10158e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:00.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.965+0000 7f1e0f59e700 1 --2- 172.21.15.77:0/577376368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e1006a220 0x7f1e10158e80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1e000090b0 tx=0x7f1e00004770 comp rx=0 tx=0).stop 2023-07-24T05:47:00.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.965+0000 7f1e0f59e700 1 -- 172.21.15.77:0/577376368 shutdown_connections 2023-07-24T05:47:00.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.965+0000 7f1e0f59e700 1 --2- 172.21.15.77:0/577376368 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1e1015a950 0x7f1e10154bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:00.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.965+0000 7f1e0f59e700 1 --2- 172.21.15.77:0/577376368 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f1df00662f0 0x7f1df00687b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:00.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.965+0000 7f1e0f59e700 1 --2- 172.21.15.77:0/577376368 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1e100c4e70 0x7f1e100c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:00.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.965+0000 7f1e0f59e700 1 --2- 172.21.15.77:0/577376368 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1e1006a220 0x7f1e10158e80 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:00.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.965+0000 7f1e0f59e700 1 -- 172.21.15.77:0/577376368 >> 172.21.15.77:0/577376368 conn(0x7f1e100ce260 msgr2=0x7f1e100c4650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:00.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.965+0000 7f1e0f59e700 1 -- 172.21.15.77:0/577376368 shutdown_connections 2023-07-24T05:47:00.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:00.965+0000 7f1e0f59e700 1 -- 172.21.15.77:0/577376368 wait complete. 2023-07-24T05:47:00.992 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-24T05:47:01.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.157+0000 7fd70d047700 1 Processor -- start 2023-07-24T05:47:01.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.157+0000 7fd70d047700 1 -- start start 2023-07-24T05:47:01.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.157+0000 7fd70d047700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd7080b13c0 0x7fd70806adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:01.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.157+0000 7fd70d047700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd708069b10 0x7fd708069fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:01.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.157+0000 7fd70d047700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7080702f0 con 0x7fd7080a4580 2023-07-24T05:47:01.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.157+0000 7fd70d047700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd70806a500 con 0x7fd708069b10 2023-07-24T05:47:01.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.157+0000 7fd70d047700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7080adc40 con 0x7fd7080b13c0 2023-07-24T05:47:01.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.157+0000 7fd70c846700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd708069b10 0x7fd708069fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:01.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.161+0000 7fd6fffff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fd7080a4580 0x7fd70806fbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.77:38204/0 (socket says 172.21.15.77:38204) 2023-07-24T05:47:01.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.161+0000 7fd707fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd7080b13c0 0x7fd70806adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:01.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.161+0000 7fd6fffff700 1 -- 172.21.15.77:0/1801271423 learned_addr learned my addr 172.21.15.77:0/1801271423 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:01.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.161+0000 7fd707fff700 1 -- 172.21.15.77:0/1801271423 >> v2:172.21.15.77:3300/0 conn(0x7fd708069b10 msgr2=0x7fd708069fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:01.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.161+0000 7fd707fff700 1 --2- 172.21.15.77:0/1801271423 >> v2:172.21.15.77:3300/0 conn(0x7fd708069b10 0x7fd708069fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:01.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.161+0000 7fd707fff700 1 -- 172.21.15.77:0/1801271423 >> v1:172.21.15.103:6789/0 conn(0x7fd7080a4580 legacy=0x7fd70806fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:01.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.161+0000 7fd707fff700 1 -- 172.21.15.77:0/1801271423 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd70806b330 con 0x7fd7080b13c0 2023-07-24T05:47:01.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.161+0000 7fd7077fe700 1 -- 172.21.15.77:0/1801271423 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3361725998 0 0) 0x7fd7080702f0 con 0x7fd7080a4580 2023-07-24T05:47:01.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.161+0000 7fd707fff700 1 --2- 172.21.15.77:0/1801271423 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7080b13c0 0x7fd70806adf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd70806f1a0 tx=0x7fd6f8009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a93cafaef97cc87 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:01.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.161+0000 7fd7077fe700 1 -- 172.21.15.77:0/1801271423 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8011830 con 0x7fd7080b13c0 2023-07-24T05:47:01.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.161+0000 7fd7077fe700 1 -- 172.21.15.77:0/1801271423 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f8011990 con 0x7fd7080b13c0 2023-07-24T05:47:01.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.161+0000 7fd7077fe700 1 -- 172.21.15.77:0/1801271423 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8011d20 con 0x7fd7080b13c0 2023-07-24T05:47:01.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.161+0000 7fd70d047700 1 -- 172.21.15.77:0/1801271423 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7080b13c0 msgr2=0x7fd70806adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:01.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.161+0000 7fd70d047700 1 --2- 172.21.15.77:0/1801271423 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7080b13c0 0x7fd70806adf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd70806f1a0 tx=0x7fd6f8009b30 comp rx=0 tx=0).stop 2023-07-24T05:47:01.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.161+0000 7fd70d047700 1 -- 172.21.15.77:0/1801271423 shutdown_connections 2023-07-24T05:47:01.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.161+0000 7fd70d047700 1 --2- 172.21.15.77:0/1801271423 >> v2:172.21.15.77:3300/0 conn(0x7fd708069b10 0x7fd708069fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:01.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.161+0000 7fd70d047700 1 --2- 172.21.15.77:0/1801271423 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7080b13c0 0x7fd70806adf0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:01.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.161+0000 7fd70d047700 1 -- 172.21.15.77:0/1801271423 >> 172.21.15.77:0/1801271423 conn(0x7fd7080cacc0 msgr2=0x7fd7080cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:01.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.161+0000 7fd70d047700 1 -- 172.21.15.77:0/1801271423 shutdown_connections 2023-07-24T05:47:01.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.161+0000 7fd70d047700 1 -- 172.21.15.77:0/1801271423 wait complete. 2023-07-24T05:47:01.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.165+0000 7fd70d047700 1 Processor -- start 2023-07-24T05:47:01.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.165+0000 7fd70d047700 1 -- start start 2023-07-24T05:47:01.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.169+0000 7fd70d047700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd708069b10 0x7fd70815ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:01.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.169+0000 7fd70d047700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7080a4580 0x7fd7080c4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:01.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.169+0000 7fd70d047700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd7080b13c0 0x7fd70809b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:01.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.169+0000 7fd70d047700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd708151c70 con 0x7fd708069b10 2023-07-24T05:47:01.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.169+0000 7fd70d047700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7081511b0 con 0x7fd7080a4580 2023-07-24T05:47:01.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.169+0000 7fd70d047700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd708150d20 con 0x7fd7080b13c0 2023-07-24T05:47:01.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.169+0000 7fd707fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd708069b10 0x7fd70815ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:01.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.169+0000 7fd707fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd708069b10 0x7fd70815ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48846/0 (socket says 172.21.15.77:48846) 2023-07-24T05:47:01.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.169+0000 7fd707fff700 1 -- 172.21.15.77:0/769113702 learned_addr learned my addr 172.21.15.77:0/769113702 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:01.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.169+0000 7fd6fffff700 1 --2- 172.21.15.77:0/769113702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7080a4580 0x7fd7080c4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:01.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.169+0000 7fd70c846700 1 --2- 172.21.15.77:0/769113702 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd7080b13c0 0x7fd70809b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:01.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.169+0000 7fd707fff700 1 -- 172.21.15.77:0/769113702 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd7080b13c0 msgr2=0x7fd70809b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:01.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.169+0000 7fd707fff700 1 --2- 172.21.15.77:0/769113702 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd7080b13c0 0x7fd70809b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:01.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.169+0000 7fd707fff700 1 -- 172.21.15.77:0/769113702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7080a4580 msgr2=0x7fd7080c4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:01.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.169+0000 7fd707fff700 1 --2- 172.21.15.77:0/769113702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7080a4580 0x7fd7080c4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:01.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.169+0000 7fd707fff700 1 -- 172.21.15.77:0/769113702 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f80094b0 con 0x7fd708069b10 2023-07-24T05:47:01.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.169+0000 7fd6fffff700 1 --2- 172.21.15.77:0/769113702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7080a4580 0x7fd7080c4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:01.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.169+0000 7fd707fff700 1 --2- 172.21.15.77:0/769113702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd708069b10 0x7fd70815ca00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8009b70 tx=0x7fd6f8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:01.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.169+0000 7fd7057fa700 1 -- 172.21.15.77:0/769113702 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f80036c0 con 0x7fd708069b10 2023-07-24T05:47:01.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.169+0000 7fd7057fa700 1 -- 172.21.15.77:0/769113702 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f801f070 con 0x7fd708069b10 2023-07-24T05:47:01.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.169+0000 7fd70d047700 1 -- 172.21.15.77:0/769113702 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7080c4fc0 con 0x7fd708069b10 2023-07-24T05:47:01.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.169+0000 7fd7057fa700 1 -- 172.21.15.77:0/769113702 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8003a20 con 0x7fd708069b10 2023-07-24T05:47:01.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.169+0000 7fd70d047700 1 -- 172.21.15.77:0/769113702 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7080c35c0 con 0x7fd708069b10 2023-07-24T05:47:01.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.173+0000 7fd70d047700 1 -- 172.21.15.77:0/769113702 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd708072490 con 0x7fd708069b10 2023-07-24T05:47:01.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.173+0000 7fd7057fa700 1 -- 172.21.15.77:0/769113702 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd6f8003b80 con 0x7fd708069b10 2023-07-24T05:47:01.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.173+0000 7fd7057fa700 1 --2- 172.21.15.77:0/769113702 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd6e80662f0 0x7fd6e80687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:01.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.173+0000 7fd7057fa700 1 -- 172.21.15.77:0/769113702 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd6f8021070 con 0x7fd708069b10 2023-07-24T05:47:01.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.177+0000 7fd6fffff700 1 --2- 172.21.15.77:0/769113702 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd6e80662f0 0x7fd6e80687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:01.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.177+0000 7fd6fffff700 1 --2- 172.21.15.77:0/769113702 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd6e80662f0 0x7fd6e80687b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd708070ea0 tx=0x7fd6f0007cc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:01.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.181+0000 7fd7057fa700 1 -- 172.21.15.77:0/769113702 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd6f8052b30 con 0x7fd708069b10 2023-07-24T05:47:01.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.353+0000 7fd70d047700 1 -- 172.21.15.77:0/769113702 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7080adeb0 con 0x7fd708069b10 2023-07-24T05:47:01.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.357+0000 7fd7057fa700 1 -- 172.21.15.77:0/769113702 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20204 (secure 0 0 0) 0x7fd6f8056150 con 0x7fd708069b10 2023-07-24T05:47:01.363 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:47:01.363 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":27,"fsid":"5aed5f7b-fb55-4d95-9c02-c6adbb1677b4","created":"2023-07-24T05:45:39.639731+0000","modified":"2023-07-24T05:46:48.442117+0000","last_up_change":"2023-07-24T05:45:52.319670+0000","last_in_change":"2023-07-24T05:45:43.643277+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-24T05:45:52.610430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-24T05:45:52.773787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-24T05:45:58.121732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-24T05:45:59.368726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-24T05:46:03.032057+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ffa0d496-461a-4053-b764-0627d969521b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6812","nonce":825987196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6817","nonce":825987196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6831","nonce":825987196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6824","nonce":825987196}]},"public_addr":"172.21.15.77:6812/825987196","cluster_addr":"172.21.15.77:6817/825987196","heartbeat_back_addr":"172.21.15.77:6831/825987196","heartbeat_front_addr":"172.21.15.77:6824/825987196","state":["exists","up"]},{"osd":1,"uuid":"9f595e5e-5c43-49bc-8ce4-ee70575c90da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6801","nonce":4133026815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6803","nonce":4133026815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6807","nonce":4133026815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6805","nonce":4133026815}]},"public_addr":"172.21.15.77:6801/4133026815","cluster_addr":"172.21.15.77:6803/4133026815","heartbeat_back_addr":"172.21.15.77:6807/4133026815","heartbeat_front_addr":"172.21.15.77:6805/4133026815","state":["exists","up"]},{"osd":2,"uuid":"2ac177aa-4d7d-4262-bd54-d2b9f29f4c3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6811","nonce":2394142159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6819","nonce":2394142159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6830","nonce":2394142159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6825","nonce":2394142159}]},"public_addr":"172.21.15.77:6811/2394142159","cluster_addr":"172.21.15.77:6819/2394142159","heartbeat_back_addr":"172.21.15.77:6830/2394142159","heartbeat_front_addr":"172.21.15.77:6825/2394142159","state":["exists","up"]},{"osd":3,"uuid":"17d7a251-19e8-484c-8172-a578ab3da153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6813","nonce":1492113982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6818","nonce":1492113982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6829","nonce":1492113982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6823","nonce":1492113982}]},"public_addr":"172.21.15.77:6813/1492113982","cluster_addr":"172.21.15.77:6818/1492113982","heartbeat_back_addr":"172.21.15.77:6829/1492113982","heartbeat_front_addr":"172.21.15.77:6823/1492113982","state":["exists","up"]},{"osd":4,"uuid":"bf63ca05-f06d-4e0f-ac44-2a416c70b919","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6825","nonce":1080481057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6827","nonce":1080481057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6831","nonce":1080481057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6829","nonce":1080481057}]},"public_addr":"172.21.15.103:6825/1080481057","cluster_addr":"172.21.15.103:6827/1080481057","heartbeat_back_addr":"172.21.15.103:6831/1080481057","heartbeat_front_addr":"172.21.15.103:6829/1080481057","state":["exists","up"]},{"osd":5,"uuid":"65a11a35-9e9f-4b3c-9fe3-b658d62b9318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6811","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6813","nonce":2756677504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6818","nonce":2756677504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6823","nonce":2756677504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6821","nonce":2756677504}]},"public_addr":"172.21.15.103:6813/2756677504","cluster_addr":"172.21.15.103:6818/2756677504","heartbeat_back_addr":"172.21.15.103:6823/2756677504","heartbeat_front_addr":"172.21.15.103:6821/2756677504","state":["exists","up"]},{"osd":6,"uuid":"750c1f87-686c-40b4-94a1-1a299dc78f3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6809","nonce":568977764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6812","nonce":568977764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6819","nonce":568977764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6815","nonce":568977764}]},"public_addr":"172.21.15.103:6809/568977764","cluster_addr":"172.21.15.103:6812/568977764","heartbeat_back_addr":"172.21.15.103:6819/568977764","heartbeat_front_addr":"172.21.15.103:6815/568977764","state":["exists","up"]},{"osd":7,"uuid":"d5fe4fb6-2e09-4158-885b-403803c85822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6801","nonce":1074557176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6803","nonce":1074557176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6807","nonce":1074557176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6805","nonce":1074557176}]},"public_addr":"172.21.15.103:6801/1074557176","cluster_addr":"172.21.15.103:6803/1074557176","heartbeat_back_addr":"172.21.15.103:6807/1074557176","heartbeat_front_addr":"172.21.15.103:6805/1074557176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.631032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.154109+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.398587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.679089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.311218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.353726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.314372+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.126212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1d","mappings":[{"from":3,"to":2}]},{"pgid":"4.31","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-24T05:47:01.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.361+0000 7fd70d047700 1 -- 172.21.15.77:0/769113702 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd6e80662f0 msgr2=0x7fd6e80687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:01.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.361+0000 7fd70d047700 1 --2- 172.21.15.77:0/769113702 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd6e80662f0 0x7fd6e80687b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd708070ea0 tx=0x7fd6f0007cc0 comp rx=0 tx=0).stop 2023-07-24T05:47:01.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.361+0000 7fd70d047700 1 -- 172.21.15.77:0/769113702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd708069b10 msgr2=0x7fd70815ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:01.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.361+0000 7fd70d047700 1 --2- 172.21.15.77:0/769113702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd708069b10 0x7fd70815ca00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8009b70 tx=0x7fd6f8004770 comp rx=0 tx=0).stop 2023-07-24T05:47:01.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.361+0000 7fd70d047700 1 -- 172.21.15.77:0/769113702 shutdown_connections 2023-07-24T05:47:01.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.361+0000 7fd70d047700 1 --2- 172.21.15.77:0/769113702 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd6e80662f0 0x7fd6e80687b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:01.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.361+0000 7fd70d047700 1 --2- 172.21.15.77:0/769113702 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd7080b13c0 0x7fd70809b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:01.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.361+0000 7fd70d047700 1 --2- 172.21.15.77:0/769113702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7080a4580 0x7fd7080c4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:01.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.361+0000 7fd70d047700 1 --2- 172.21.15.77:0/769113702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd708069b10 0x7fd70815ca00 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:01.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.361+0000 7fd70d047700 1 -- 172.21.15.77:0/769113702 >> 172.21.15.77:0/769113702 conn(0x7fd7080cacc0 msgr2=0x7fd7080704e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:01.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.361+0000 7fd70d047700 1 -- 172.21.15.77:0/769113702 shutdown_connections 2023-07-24T05:47:01.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.361+0000 7fd70d047700 1 -- 172.21.15.77:0/769113702 wait complete. 2023-07-24T05:47:01.386 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-24T05:45:52.610430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-24T05:45:52.773787+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-24T05:45:58.121732+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-24T05:45:59.368726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-24T05:46:03.032057+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-24T05:47:01.387 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-24T05:47:01.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.561+0000 7f6a306a9700 1 Processor -- start 2023-07-24T05:47:01.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.561+0000 7f6a306a9700 1 -- start start 2023-07-24T05:47:01.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.561+0000 7f6a306a9700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6a2806b230 0x7f6a28163b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:01.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.561+0000 7f6a306a9700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a280c9280 con 0x7f6a280cc010 2023-07-24T05:47:01.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.561+0000 7f6a306a9700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a280cc890 con 0x7f6a28158ec0 2023-07-24T05:47:01.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.561+0000 7f6a306a9700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a280ab050 con 0x7f6a2806b230 2023-07-24T05:47:01.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.561+0000 7f6a2dc44700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f6a280cc010 0x7f6a28069b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:33186/0 (socket says 172.21.15.77:33186) 2023-07-24T05:47:01.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.561+0000 7f6a2dc44700 1 -- 172.21.15.77:0/3926030520 learned_addr learned my addr 172.21.15.77:0/3926030520 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:01.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.565+0000 7f6a2ec46700 1 --2- 172.21.15.77:0/3926030520 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6a2806b230 0x7f6a28163b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:01.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.565+0000 7f6a2d443700 1 -- 172.21.15.77:0/3926030520 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1219536063 0 0) 0x7f6a280c9280 con 0x7f6a280cc010 2023-07-24T05:47:01.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.565+0000 7f6a2d443700 1 -- 172.21.15.77:0/3926030520 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a140035d0 con 0x7f6a280cc010 2023-07-24T05:47:01.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.565+0000 7f6a2d443700 1 -- 172.21.15.77:0/3926030520 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 356497392 0 0) 0x7f6a140035d0 con 0x7f6a280cc010 2023-07-24T05:47:01.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.565+0000 7f6a2d443700 1 -- 172.21.15.77:0/3926030520 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6a2806b230 msgr2=0x7f6a28163b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:01.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.565+0000 7f6a2d443700 1 --2- 172.21.15.77:0/3926030520 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6a2806b230 0x7f6a28163b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:01.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.565+0000 7f6a2d443700 1 -- 172.21.15.77:0/3926030520 >> v1:172.21.15.103:6789/0 conn(0x7f6a28158ec0 legacy=0x7f6a280cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:01.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.565+0000 7f6a2d443700 1 -- 172.21.15.77:0/3926030520 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a280cc5b0 con 0x7f6a280cc010 2023-07-24T05:47:01.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.565+0000 7f6a2d443700 1 -- 172.21.15.77:0/3926030520 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4109865209 0 0) 0x7f6a18001670 con 0x7f6a280cc010 2023-07-24T05:47:01.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.565+0000 7f6a2d443700 1 -- 172.21.15.77:0/3926030520 >> v1:172.21.15.77:6789/0 conn(0x7f6a280cc010 legacy=0x7f6a28069b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:01.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.565+0000 7f6a2d443700 1 --2- 172.21.15.77:0/3926030520 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6a2806b230 0x7f6a14003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:01.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.565+0000 7f6a2d443700 1 --2- 172.21.15.77:0/3926030520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a14003fd0 0x7f6a14004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:01.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.565+0000 7f6a2d443700 1 --2- 172.21.15.77:0/3926030520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a14004db0 0x7f6a14005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:01.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.565+0000 7f6a2d443700 1 -- 172.21.15.77:0/3926030520 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a280ab050 con 0x7f6a14004db0 2023-07-24T05:47:01.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.565+0000 7f6a2d443700 1 -- 172.21.15.77:0/3926030520 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1400bbc0 con 0x7f6a14003fd0 2023-07-24T05:47:01.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.565+0000 7f6a2d443700 1 -- 172.21.15.77:0/3926030520 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1400bd80 con 0x7f6a2806b230 2023-07-24T05:47:01.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.565+0000 7f6a2dc44700 1 --2- 172.21.15.77:0/3926030520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a14003fd0 0x7f6a14004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:01.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.565+0000 7f6a2e445700 1 --2- 172.21.15.77:0/3926030520 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6a2806b230 0x7f6a14003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:01.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.565+0000 7f6a2ec46700 1 --2- 172.21.15.77:0/3926030520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a14004db0 0x7f6a14005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:01.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.565+0000 7f6a2dc44700 1 -- 172.21.15.77:0/3926030520 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6a2806b230 msgr2=0x7f6a14003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:01.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.565+0000 7f6a2dc44700 1 --2- 172.21.15.77:0/3926030520 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6a2806b230 0x7f6a14003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:01.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.565+0000 7f6a2dc44700 1 -- 172.21.15.77:0/3926030520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a14004db0 msgr2=0x7f6a14005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:01.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.565+0000 7f6a2dc44700 1 --2- 172.21.15.77:0/3926030520 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a14004db0 0x7f6a14005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:01.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.565+0000 7f6a2dc44700 1 -- 172.21.15.77:0/3926030520 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a140035d0 con 0x7f6a14003fd0 2023-07-24T05:47:01.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.565+0000 7f6a2dc44700 1 --2- 172.21.15.77:0/3926030520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a14003fd0 0x7f6a14004870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6a1800c350 tx=0x7f6a140058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95121ebddcfa8160 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:01.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.565+0000 7f6a2d443700 1 -- 172.21.15.77:0/3926030520 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a18007c30 con 0x7f6a14003fd0 2023-07-24T05:47:01.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.565+0000 7f6a2d443700 1 -- 172.21.15.77:0/3926030520 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1800ce70 con 0x7f6a14003fd0 2023-07-24T05:47:01.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.565+0000 7f6a2d443700 1 -- 172.21.15.77:0/3926030520 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a18005ba0 con 0x7f6a14003fd0 2023-07-24T05:47:01.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.569+0000 7f6a306a9700 1 -- 172.21.15.77:0/3926030520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a14003fd0 msgr2=0x7f6a14004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:01.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.569+0000 7f6a306a9700 1 --2- 172.21.15.77:0/3926030520 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a14003fd0 0x7f6a14004870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6a1800c350 tx=0x7f6a140058a0 comp rx=0 tx=0).stop 2023-07-24T05:47:01.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.569+0000 7f6a2ec46700 1 -- 172.21.15.77:0/3926030520 reap_dead start 2023-07-24T05:47:01.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.569+0000 7f6a306a9700 1 -- 172.21.15.77:0/3926030520 shutdown_connections 2023-07-24T05:47:01.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.569+0000 7f6a306a9700 1 -- 172.21.15.77:0/3926030520 >> 172.21.15.77:0/3926030520 conn(0x7f6a280ce440 msgr2=0x7f6a280ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:01.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.569+0000 7f6a306a9700 1 -- 172.21.15.77:0/3926030520 shutdown_connections 2023-07-24T05:47:01.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.569+0000 7f6a306a9700 1 -- 172.21.15.77:0/3926030520 wait complete. 2023-07-24T05:47:01.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.573+0000 7f6a306a9700 1 Processor -- start 2023-07-24T05:47:01.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.573+0000 7f6a306a9700 1 -- start start 2023-07-24T05:47:01.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.573+0000 7f6a306a9700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a14003fd0 0x7f6a280adfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:01.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.573+0000 7f6a306a9700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6a280aef50 0x7f6a280ae520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:01.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.573+0000 7f6a306a9700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a28168c40 0x7f6a28096700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:01.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.573+0000 7f6a306a9700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2814f970 con 0x7f6a14003fd0 2023-07-24T05:47:01.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.573+0000 7f6a306a9700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a280ab7d0 con 0x7f6a28168c40 2023-07-24T05:47:01.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.573+0000 7f6a306a9700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2814e890 con 0x7f6a280aef50 2023-07-24T05:47:01.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.573+0000 7f6a2e445700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a14003fd0 0x7f6a280adfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:01.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.573+0000 7f6a2e445700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a14003fd0 0x7f6a280adfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48870/0 (socket says 172.21.15.77:48870) 2023-07-24T05:47:01.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.573+0000 7f6a2e445700 1 -- 172.21.15.77:0/4128427122 learned_addr learned my addr 172.21.15.77:0/4128427122 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:01.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.573+0000 7f6a2e445700 1 -- 172.21.15.77:0/4128427122 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6a280aef50 msgr2=0x7f6a280ae520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:01.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.573+0000 7f6a2ec46700 1 --2- 172.21.15.77:0/4128427122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a28168c40 0x7f6a28096700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:01.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.573+0000 7f6a2dc44700 1 --2- 172.21.15.77:0/4128427122 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6a280aef50 0x7f6a280ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:01.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.573+0000 7f6a2e445700 1 --2- 172.21.15.77:0/4128427122 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6a280aef50 0x7f6a280ae520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:01.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.573+0000 7f6a2e445700 1 -- 172.21.15.77:0/4128427122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a28168c40 msgr2=0x7f6a28096700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:01.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.573+0000 7f6a2e445700 1 --2- 172.21.15.77:0/4128427122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a28168c40 0x7f6a28096700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:01.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.573+0000 7f6a2e445700 1 -- 172.21.15.77:0/4128427122 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2814f600 con 0x7f6a14003fd0 2023-07-24T05:47:01.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.573+0000 7f6a2dc44700 1 --2- 172.21.15.77:0/4128427122 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6a280aef50 0x7f6a280ae520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:47:01.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.573+0000 7f6a2ec46700 1 --2- 172.21.15.77:0/4128427122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a28168c40 0x7f6a28096700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:47:01.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.573+0000 7f6a2e445700 1 --2- 172.21.15.77:0/4128427122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a14003fd0 0x7f6a280adfe0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6a2400f820 tx=0x7f6a2400fbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:01.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.573+0000 7f6a1effd700 1 -- 172.21.15.77:0/4128427122 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a240052e0 con 0x7f6a14003fd0 2023-07-24T05:47:01.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.573+0000 7f6a1effd700 1 -- 172.21.15.77:0/4128427122 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a24005440 con 0x7f6a14003fd0 2023-07-24T05:47:01.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.573+0000 7f6a306a9700 1 -- 172.21.15.77:0/4128427122 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a2814e560 con 0x7f6a14003fd0 2023-07-24T05:47:01.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.573+0000 7f6a1effd700 1 -- 172.21.15.77:0/4128427122 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a240055b0 con 0x7f6a14003fd0 2023-07-24T05:47:01.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.577+0000 7f6a306a9700 1 -- 172.21.15.77:0/4128427122 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a2814fe20 con 0x7f6a14003fd0 2023-07-24T05:47:01.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.577+0000 7f6a306a9700 1 -- 172.21.15.77:0/4128427122 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a2804df10 con 0x7f6a14003fd0 2023-07-24T05:47:01.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.577+0000 7f6a1effd700 1 -- 172.21.15.77:0/4128427122 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6a24003930 con 0x7f6a14003fd0 2023-07-24T05:47:01.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.577+0000 7f6a1effd700 1 --2- 172.21.15.77:0/4128427122 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6a0c066320 0x7f6a0c0687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:01.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.581+0000 7f6a1effd700 1 -- 172.21.15.77:0/4128427122 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6a24083e10 con 0x7f6a14003fd0 2023-07-24T05:47:01.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.581+0000 7f6a2dc44700 1 --2- 172.21.15.77:0/4128427122 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6a0c066320 0x7f6a0c0687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:01.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.581+0000 7f6a2dc44700 1 --2- 172.21.15.77:0/4128427122 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6a0c066320 0x7f6a0c0687e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6a280aedb0 tx=0x7f6a18007000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:01.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.585+0000 7f6a1effd700 1 -- 172.21.15.77:0/4128427122 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6a24054a00 con 0x7f6a14003fd0 2023-07-24T05:47:01.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.757+0000 7f6a306a9700 1 -- 172.21.15.77:0/4128427122 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6a280c8ee0 con 0x7f6a14003fd0 2023-07-24T05:47:01.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.761+0000 7f6a1effd700 1 -- 172.21.15.77:0/4128427122 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6a24054590 con 0x7f6a14003fd0 2023-07-24T05:47:01.765 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-07-24T05:47:01.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.761+0000 7f6a306a9700 1 -- 172.21.15.77:0/4128427122 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6a0c066320 msgr2=0x7f6a0c0687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:01.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.761+0000 7f6a306a9700 1 --2- 172.21.15.77:0/4128427122 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6a0c066320 0x7f6a0c0687e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6a280aedb0 tx=0x7f6a18007000 comp rx=0 tx=0).stop 2023-07-24T05:47:01.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.761+0000 7f6a306a9700 1 -- 172.21.15.77:0/4128427122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a14003fd0 msgr2=0x7f6a280adfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:01.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.761+0000 7f6a306a9700 1 --2- 172.21.15.77:0/4128427122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a14003fd0 0x7f6a280adfe0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6a2400f820 tx=0x7f6a2400fbe0 comp rx=0 tx=0).stop 2023-07-24T05:47:01.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.761+0000 7f6a306a9700 1 -- 172.21.15.77:0/4128427122 shutdown_connections 2023-07-24T05:47:01.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.761+0000 7f6a306a9700 1 --2- 172.21.15.77:0/4128427122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a28168c40 0x7f6a28096700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:01.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.761+0000 7f6a306a9700 1 --2- 172.21.15.77:0/4128427122 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6a0c066320 0x7f6a0c0687e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:01.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.761+0000 7f6a306a9700 1 --2- 172.21.15.77:0/4128427122 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6a280aef50 0x7f6a280ae520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:01.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.761+0000 7f6a306a9700 1 --2- 172.21.15.77:0/4128427122 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a14003fd0 0x7f6a280adfe0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:01.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.761+0000 7f6a306a9700 1 -- 172.21.15.77:0/4128427122 >> 172.21.15.77:0/4128427122 conn(0x7f6a280ce440 msgr2=0x7f6a280abb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:01.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.761+0000 7f6a306a9700 1 -- 172.21.15.77:0/4128427122 shutdown_connections 2023-07-24T05:47:01.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.761+0000 7f6a306a9700 1 -- 172.21.15.77:0/4128427122 wait complete. 2023-07-24T05:47:01.789 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-24T05:47:01.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.961+0000 7fc6ad6a2700 1 Processor -- start 2023-07-24T05:47:01.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.965+0000 7fc6ad6a2700 1 -- start start 2023-07-24T05:47:01.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.965+0000 7fc6ad6a2700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc6a80d2fc0 0x7fc6a80b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:01.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.965+0000 7fc6ad6a2700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc6a815db20 0x7fc6a80d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:01.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.965+0000 7fc6ad6a2700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6a8160fa0 con 0x7fc6a806afc0 2023-07-24T05:47:01.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.965+0000 7fc6ad6a2700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6a80d0360 con 0x7fc6a80d2fc0 2023-07-24T05:47:01.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.965+0000 7fc6ad6a2700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a80b20b0 con 0x7fc6a815db20 2023-07-24T05:47:01.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.965+0000 7fc6a67fc700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc6a80d2fc0 0x7fc6a80b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:01.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.965+0000 7fc6a67fc700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc6a80d2fc0 0x7fc6a80b1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48878/0 (socket says 172.21.15.77:48878) 2023-07-24T05:47:01.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.965+0000 7fc6a77fe700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc6a815db20 0x7fc6a80d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:01.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.965+0000 7fc6a67fc700 1 -- 172.21.15.77:0/1751740026 learned_addr learned my addr 172.21.15.77:0/1751740026 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:01.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.969+0000 7fc6a5ffb700 1 -- 172.21.15.77:0/1751740026 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3371367257 0 0) 0x7fc6a8160fa0 con 0x7fc6a806afc0 2023-07-24T05:47:01.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.969+0000 7fc6a5ffb700 1 -- 172.21.15.77:0/1751740026 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6900035d0 con 0x7fc6a806afc0 2023-07-24T05:47:01.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.969+0000 7fc6a67fc700 1 -- 172.21.15.77:0/1751740026 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc6a815db20 msgr2=0x7fc6a80d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:01.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.969+0000 7fc6a67fc700 1 --2- 172.21.15.77:0/1751740026 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc6a815db20 0x7fc6a80d1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:01.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.969+0000 7fc6a67fc700 1 -- 172.21.15.77:0/1751740026 >> v1:172.21.15.103:6789/0 conn(0x7fc6a806afc0 legacy=0x7fc6a80d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:01.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.969+0000 7fc6a67fc700 1 -- 172.21.15.77:0/1751740026 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a8160670 con 0x7fc6a80d2fc0 2023-07-24T05:47:01.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.969+0000 7fc6a67fc700 1 --2- 172.21.15.77:0/1751740026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6a80d2fc0 0x7fc6a80b1a20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc69c009910 tx=0x7fc69c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aaab5b5105588eb server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:01.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.969+0000 7fc6a5ffb700 1 -- 172.21.15.77:0/1751740026 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69c011830 con 0x7fc6a80d2fc0 2023-07-24T05:47:01.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.969+0000 7fc6a5ffb700 1 -- 172.21.15.77:0/1751740026 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69c011990 con 0x7fc6a80d2fc0 2023-07-24T05:47:01.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.969+0000 7fc6a5ffb700 1 -- 172.21.15.77:0/1751740026 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69c011d00 con 0x7fc6a80d2fc0 2023-07-24T05:47:01.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.969+0000 7fc6ad6a2700 1 -- 172.21.15.77:0/1751740026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6a80d2fc0 msgr2=0x7fc6a80b1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:01.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.969+0000 7fc6ad6a2700 1 --2- 172.21.15.77:0/1751740026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6a80d2fc0 0x7fc6a80b1a20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc69c009910 tx=0x7fc69c009c20 comp rx=0 tx=0).stop 2023-07-24T05:47:01.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.969+0000 7fc6ad6a2700 1 -- 172.21.15.77:0/1751740026 shutdown_connections 2023-07-24T05:47:01.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.969+0000 7fc6ad6a2700 1 --2- 172.21.15.77:0/1751740026 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc6a815db20 0x7fc6a80d1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:01.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.969+0000 7fc6ad6a2700 1 --2- 172.21.15.77:0/1751740026 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6a80d2fc0 0x7fc6a80b1a20 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:01.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.969+0000 7fc6ad6a2700 1 -- 172.21.15.77:0/1751740026 >> 172.21.15.77:0/1751740026 conn(0x7fc6a809bc20 msgr2=0x7fc6a80b7920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:01.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.969+0000 7fc6ad6a2700 1 -- 172.21.15.77:0/1751740026 shutdown_connections 2023-07-24T05:47:01.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.969+0000 7fc6ad6a2700 1 -- 172.21.15.77:0/1751740026 wait complete. 2023-07-24T05:47:01.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.973+0000 7fc6ad6a2700 1 Processor -- start 2023-07-24T05:47:01.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.973+0000 7fc6ad6a2700 1 -- start start 2023-07-24T05:47:01.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.973+0000 7fc6ad6a2700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc6a806afc0 0x7fc6a80caa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:01.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.973+0000 7fc6ad6a2700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6a815db20 0x7fc6a815ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:01.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.973+0000 7fc6ad6a2700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6a80b3420 0x7fc6a815f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:01.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.973+0000 7fc6ad6a2700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a80cbd70 con 0x7fc6a80b3420 2023-07-24T05:47:01.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.973+0000 7fc6ad6a2700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a80d2960 con 0x7fc6a815db20 2023-07-24T05:47:01.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.973+0000 7fc6ad6a2700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a80cb160 con 0x7fc6a806afc0 2023-07-24T05:47:01.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.973+0000 7fc6a6ffd700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc6a806afc0 0x7fc6a80caa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:01.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.973+0000 7fc6a77fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6a80b3420 0x7fc6a815f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:01.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.977+0000 7fc6a6ffd700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc6a806afc0 0x7fc6a80caa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.77:39448/0 (socket says 172.21.15.77:39448) 2023-07-24T05:47:01.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.977+0000 7fc6a6ffd700 1 -- 172.21.15.77:0/2607118059 learned_addr learned my addr 172.21.15.77:0/2607118059 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:01.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.977+0000 7fc6a67fc700 1 --2- 172.21.15.77:0/2607118059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6a815db20 0x7fc6a815ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:01.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.977+0000 7fc6a77fe700 1 -- 172.21.15.77:0/2607118059 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc6a806afc0 msgr2=0x7fc6a80caa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:01.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.977+0000 7fc6a77fe700 1 --2- 172.21.15.77:0/2607118059 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc6a806afc0 0x7fc6a80caa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:01.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.977+0000 7fc6a77fe700 1 -- 172.21.15.77:0/2607118059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6a815db20 msgr2=0x7fc6a815ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:01.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.977+0000 7fc6a77fe700 1 --2- 172.21.15.77:0/2607118059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6a815db20 0x7fc6a815ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:01.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.977+0000 7fc6a77fe700 1 -- 172.21.15.77:0/2607118059 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69c009570 con 0x7fc6a80b3420 2023-07-24T05:47:01.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.977+0000 7fc6a77fe700 1 --2- 172.21.15.77:0/2607118059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6a80b3420 0x7fc6a815f3b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc6a000eba0 tx=0x7fc6a000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:01.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.977+0000 7fc68f7fe700 1 -- 172.21.15.77:0/2607118059 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a0009a80 con 0x7fc6a80b3420 2023-07-24T05:47:01.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.977+0000 7fc68f7fe700 1 -- 172.21.15.77:0/2607118059 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a000f040 con 0x7fc6a80b3420 2023-07-24T05:47:01.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.977+0000 7fc68f7fe700 1 -- 172.21.15.77:0/2607118059 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a000cc40 con 0x7fc6a80b3420 2023-07-24T05:47:01.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.977+0000 7fc6ad6a2700 1 -- 172.21.15.77:0/2607118059 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6a80cb440 con 0x7fc6a80b3420 2023-07-24T05:47:01.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.977+0000 7fc6ad6a2700 1 -- 172.21.15.77:0/2607118059 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6a80cba00 con 0x7fc6a80b3420 2023-07-24T05:47:01.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.977+0000 7fc6ad6a2700 1 -- 172.21.15.77:0/2607118059 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6a80cbee0 con 0x7fc6a80b3420 2023-07-24T05:47:01.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.981+0000 7fc68f7fe700 1 -- 172.21.15.77:0/2607118059 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc6a0014480 con 0x7fc6a80b3420 2023-07-24T05:47:01.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.981+0000 7fc68f7fe700 1 --2- 172.21.15.77:0/2607118059 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc694066320 0x7fc6940687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:01.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.981+0000 7fc68f7fe700 1 -- 172.21.15.77:0/2607118059 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc6a00849d0 con 0x7fc6a80b3420 2023-07-24T05:47:01.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.985+0000 7fc6a6ffd700 1 --2- 172.21.15.77:0/2607118059 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc694066320 0x7fc6940687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:01.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.985+0000 7fc6a6ffd700 1 --2- 172.21.15.77:0/2607118059 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc694066320 0x7fc6940687e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc6980011e0 tx=0x7fc698009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:01.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:01.989+0000 7fc68f7fe700 1 -- 172.21.15.77:0/2607118059 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc6a0055510 con 0x7fc6a80b3420 2023-07-24T05:47:02.164 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.157+0000 7fc6ad6a2700 1 -- 172.21.15.77:0/2607118059 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc6a804df10 con 0x7fc6a80b3420 2023-07-24T05:47:02.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.161+0000 7fc68f7fe700 1 -- 172.21.15.77:0/2607118059 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc6a00180a0 con 0x7fc6a80b3420 2023-07-24T05:47:02.165 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 8 2023-07-24T05:47:02.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.161+0000 7fc6ad6a2700 1 -- 172.21.15.77:0/2607118059 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc694066320 msgr2=0x7fc6940687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:02.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.161+0000 7fc6ad6a2700 1 --2- 172.21.15.77:0/2607118059 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc694066320 0x7fc6940687e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc6980011e0 tx=0x7fc698009040 comp rx=0 tx=0).stop 2023-07-24T05:47:02.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.161+0000 7fc6ad6a2700 1 -- 172.21.15.77:0/2607118059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6a80b3420 msgr2=0x7fc6a815f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:02.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.161+0000 7fc6ad6a2700 1 --2- 172.21.15.77:0/2607118059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6a80b3420 0x7fc6a815f3b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc6a000eba0 tx=0x7fc6a000eeb0 comp rx=0 tx=0).stop 2023-07-24T05:47:02.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.161+0000 7fc6ad6a2700 1 -- 172.21.15.77:0/2607118059 shutdown_connections 2023-07-24T05:47:02.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.161+0000 7fc6ad6a2700 1 --2- 172.21.15.77:0/2607118059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6a80b3420 0x7fc6a815f3b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:02.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.161+0000 7fc6ad6a2700 1 --2- 172.21.15.77:0/2607118059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc6a815db20 0x7fc6a815ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:02.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.161+0000 7fc6ad6a2700 1 --2- 172.21.15.77:0/2607118059 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc694066320 0x7fc6940687e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:02.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.161+0000 7fc6ad6a2700 1 --2- 172.21.15.77:0/2607118059 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc6a806afc0 0x7fc6a80caa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:02.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.161+0000 7fc6ad6a2700 1 -- 172.21.15.77:0/2607118059 >> 172.21.15.77:0/2607118059 conn(0x7fc6a809bc20 msgr2=0x7fc6a80af5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:02.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.161+0000 7fc6ad6a2700 1 -- 172.21.15.77:0/2607118059 shutdown_connections 2023-07-24T05:47:02.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.161+0000 7fc6ad6a2700 1 -- 172.21.15.77:0/2607118059 wait complete. 2023-07-24T05:47:02.186 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-24T05:47:02.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.361+0000 7fd9c999e700 1 Processor -- start 2023-07-24T05:47:02.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.361+0000 7fd9c999e700 1 -- start start 2023-07-24T05:47:02.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.365+0000 7fd9c999e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd9c415c870 0x7fd9c40cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:02.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.365+0000 7fd9c999e700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9c40cf520 con 0x7fd9c40b2230 2023-07-24T05:47:02.370 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.365+0000 7fd9c999e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9c406aaa0 con 0x7fd9c415cc50 2023-07-24T05:47:02.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.365+0000 7fd9c999e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c406ad80 con 0x7fd9c415c870 2023-07-24T05:47:02.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.365+0000 7fd9c919d700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd9c40b2230 0x7fd9c40cd090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:33188/0 (socket says 172.21.15.77:33188) 2023-07-24T05:47:02.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.365+0000 7fd9c919d700 1 -- 172.21.15.77:0/2861289150 learned_addr learned my addr 172.21.15.77:0/2861289150 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:02.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.365+0000 7fd9c899c700 1 --2- 172.21.15.77:0/2861289150 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd9c415c870 0x7fd9c40cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:02.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.365+0000 7fd9c37fe700 1 -- 172.21.15.77:0/2861289150 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 49427358 0 0) 0x7fd9c40cf520 con 0x7fd9c40b2230 2023-07-24T05:47:02.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.365+0000 7fd9c37fe700 1 -- 172.21.15.77:0/2861289150 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9b40035d0 con 0x7fd9c40b2230 2023-07-24T05:47:02.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.365+0000 7fd9c899c700 1 -- 172.21.15.77:0/2861289150 >> v1:172.21.15.103:6789/0 conn(0x7fd9c415cc50 legacy=0x7fd9c40b1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:02.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.365+0000 7fd9c899c700 1 -- 172.21.15.77:0/2861289150 >> v1:172.21.15.77:6789/0 conn(0x7fd9c40b2230 legacy=0x7fd9c40cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:02.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.365+0000 7fd9c899c700 1 -- 172.21.15.77:0/2861289150 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c406b060 con 0x7fd9c415c870 2023-07-24T05:47:02.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.365+0000 7fd9c899c700 1 --2- 172.21.15.77:0/2861289150 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd9c415c870 0x7fd9c40cefe0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8009870 tx=0x7fd9b8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d3b13e8ae445bfd server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:02.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.369+0000 7fd9c37fe700 1 -- 172.21.15.77:0/2861289150 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b8005e50 con 0x7fd9c415c870 2023-07-24T05:47:02.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.369+0000 7fd9c37fe700 1 -- 172.21.15.77:0/2861289150 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b8006030 con 0x7fd9c415c870 2023-07-24T05:47:02.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.369+0000 7fd9c37fe700 1 -- 172.21.15.77:0/2861289150 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b80063c0 con 0x7fd9c415c870 2023-07-24T05:47:02.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.369+0000 7fd9c999e700 1 -- 172.21.15.77:0/2861289150 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd9c415c870 msgr2=0x7fd9c40cefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:02.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.369+0000 7fd9c999e700 1 --2- 172.21.15.77:0/2861289150 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd9c415c870 0x7fd9c40cefe0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8009870 tx=0x7fd9b8009b80 comp rx=0 tx=0).stop 2023-07-24T05:47:02.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.369+0000 7fd9c999e700 1 -- 172.21.15.77:0/2861289150 shutdown_connections 2023-07-24T05:47:02.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.369+0000 7fd9c999e700 1 --2- 172.21.15.77:0/2861289150 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd9c415c870 0x7fd9c40cefe0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:02.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.369+0000 7fd9c999e700 1 -- 172.21.15.77:0/2861289150 >> 172.21.15.77:0/2861289150 conn(0x7fd9c4089f80 msgr2=0x7fd9c409b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:02.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.369+0000 7fd9c999e700 1 -- 172.21.15.77:0/2861289150 shutdown_connections 2023-07-24T05:47:02.375 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.369+0000 7fd9c999e700 1 -- 172.21.15.77:0/2861289150 wait complete. 2023-07-24T05:47:02.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.373+0000 7fd9c999e700 1 Processor -- start 2023-07-24T05:47:02.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.373+0000 7fd9c999e700 1 -- start start 2023-07-24T05:47:02.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.373+0000 7fd9c999e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9c40b2230 0x7fd9c40c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:02.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.373+0000 7fd9c999e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9c415c870 0x7fd9c40cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:02.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.373+0000 7fd9c999e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd9c415cc50 0x7fd9c415d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:02.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.373+0000 7fd9c999e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c40d1730 con 0x7fd9c40b2230 2023-07-24T05:47:02.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.373+0000 7fd9c999e700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c40c9090 con 0x7fd9c415c870 2023-07-24T05:47:02.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.373+0000 7fd9c999e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c415ab40 con 0x7fd9c415cc50 2023-07-24T05:47:02.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.373+0000 7fd9c899c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9c40b2230 0x7fd9c40c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:02.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.373+0000 7fd9c899c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9c40b2230 0x7fd9c40c82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48906/0 (socket says 172.21.15.77:48906) 2023-07-24T05:47:02.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.373+0000 7fd9c899c700 1 -- 172.21.15.77:0/2220627335 learned_addr learned my addr 172.21.15.77:0/2220627335 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:02.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.373+0000 7fd9c3fff700 1 --2- 172.21.15.77:0/2220627335 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9c415c870 0x7fd9c40cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:02.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.373+0000 7fd9c919d700 1 --2- 172.21.15.77:0/2220627335 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd9c415cc50 0x7fd9c415d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:02.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.373+0000 7fd9c899c700 1 -- 172.21.15.77:0/2220627335 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd9c415cc50 msgr2=0x7fd9c415d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:02.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.373+0000 7fd9c899c700 1 --2- 172.21.15.77:0/2220627335 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd9c415cc50 0x7fd9c415d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:02.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.373+0000 7fd9c899c700 1 -- 172.21.15.77:0/2220627335 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9c415c870 msgr2=0x7fd9c40cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:02.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.373+0000 7fd9c899c700 1 --2- 172.21.15.77:0/2220627335 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9c415c870 0x7fd9c40cbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:02.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.373+0000 7fd9c899c700 1 -- 172.21.15.77:0/2220627335 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b8009450 con 0x7fd9c40b2230 2023-07-24T05:47:02.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.373+0000 7fd9c3fff700 1 --2- 172.21.15.77:0/2220627335 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9c415c870 0x7fd9c40cbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:02.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.373+0000 7fd9c899c700 1 --2- 172.21.15.77:0/2220627335 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9c40b2230 0x7fd9c40c82d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8013040 tx=0x7fd9b8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:02.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.377+0000 7fd9c17fa700 1 -- 172.21.15.77:0/2220627335 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b8003ad0 con 0x7fd9c40b2230 2023-07-24T05:47:02.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.377+0000 7fd9c17fa700 1 -- 172.21.15.77:0/2220627335 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b8003c50 con 0x7fd9c40b2230 2023-07-24T05:47:02.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.377+0000 7fd9c999e700 1 -- 172.21.15.77:0/2220627335 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9c40c8810 con 0x7fd9c40b2230 2023-07-24T05:47:02.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.377+0000 7fd9c17fa700 1 -- 172.21.15.77:0/2220627335 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b80045e0 con 0x7fd9c40b2230 2023-07-24T05:47:02.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.377+0000 7fd9c999e700 1 -- 172.21.15.77:0/2220627335 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9c40c8db0 con 0x7fd9c40b2230 2023-07-24T05:47:02.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.377+0000 7fd9c999e700 1 -- 172.21.15.77:0/2220627335 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9c40d1870 con 0x7fd9c40b2230 2023-07-24T05:47:02.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.381+0000 7fd9c17fa700 1 -- 172.21.15.77:0/2220627335 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd9b8022070 con 0x7fd9c40b2230 2023-07-24T05:47:02.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.381+0000 7fd9c17fa700 1 --2- 172.21.15.77:0/2220627335 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd9a80662f0 0x7fd9a80687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:02.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.381+0000 7fd9c17fa700 1 -- 172.21.15.77:0/2220627335 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd9b8085920 con 0x7fd9c40b2230 2023-07-24T05:47:02.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.381+0000 7fd9c3fff700 1 --2- 172.21.15.77:0/2220627335 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd9a80662f0 0x7fd9a80687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:02.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.381+0000 7fd9c3fff700 1 --2- 172.21.15.77:0/2220627335 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd9a80662f0 0x7fd9a80687b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd9c41601b0 tx=0x7fd9b0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:02.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.385+0000 7fd9c17fa700 1 -- 172.21.15.77:0/2220627335 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd9c40d1870 con 0x7fd9c40b2230 2023-07-24T05:47:02.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.557+0000 7fd9c999e700 1 -- 172.21.15.77:0/2220627335 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd9c40d1870 con 0x7fd9c40b2230 2023-07-24T05:47:02.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.557+0000 7fd9c17fa700 1 -- 172.21.15.77:0/2220627335 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd9c40d1870 con 0x7fd9c40b2230 2023-07-24T05:47:02.564 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-07-24T05:47:02.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.561+0000 7fd9c999e700 1 -- 172.21.15.77:0/2220627335 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd9a80662f0 msgr2=0x7fd9a80687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:02.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.561+0000 7fd9c999e700 1 --2- 172.21.15.77:0/2220627335 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd9a80662f0 0x7fd9a80687b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd9c41601b0 tx=0x7fd9b0009040 comp rx=0 tx=0).stop 2023-07-24T05:47:02.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.561+0000 7fd9c999e700 1 -- 172.21.15.77:0/2220627335 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9c40b2230 msgr2=0x7fd9c40c82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:02.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.561+0000 7fd9c999e700 1 --2- 172.21.15.77:0/2220627335 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9c40b2230 0x7fd9c40c82d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8013040 tx=0x7fd9b8004770 comp rx=0 tx=0).stop 2023-07-24T05:47:02.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.561+0000 7fd9c999e700 1 -- 172.21.15.77:0/2220627335 shutdown_connections 2023-07-24T05:47:02.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.561+0000 7fd9c999e700 1 --2- 172.21.15.77:0/2220627335 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd9a80662f0 0x7fd9a80687b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:02.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.561+0000 7fd9c999e700 1 --2- 172.21.15.77:0/2220627335 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd9c415cc50 0x7fd9c415d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:02.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.561+0000 7fd9c999e700 1 --2- 172.21.15.77:0/2220627335 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9c415c870 0x7fd9c40cbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:02.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.561+0000 7fd9c999e700 1 --2- 172.21.15.77:0/2220627335 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd9c40b2230 0x7fd9c40c82d0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:02.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.561+0000 7fd9c999e700 1 -- 172.21.15.77:0/2220627335 >> 172.21.15.77:0/2220627335 conn(0x7fd9c4089f80 msgr2=0x7fd9c40b1640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:02.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.561+0000 7fd9c999e700 1 -- 172.21.15.77:0/2220627335 shutdown_connections 2023-07-24T05:47:02.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.561+0000 7fd9c999e700 1 -- 172.21.15.77:0/2220627335 wait complete. 2023-07-24T05:47:02.589 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-24T05:47:02.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.761+0000 7f2cc8b99700 1 Processor -- start 2023-07-24T05:47:02.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.761+0000 7f2cc8b99700 1 -- start start 2023-07-24T05:47:02.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.765+0000 7f2cc8b99700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2cc406afc0 0x7f2cc40b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:02.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.765+0000 7f2cc8b99700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2cc40d2fc0 0x7f2cc40d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:02.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.765+0000 7f2cc8b99700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cc4160fa0 con 0x7f2cc415db20 2023-07-24T05:47:02.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.765+0000 7f2cc8b99700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cc40d0360 con 0x7f2cc406afc0 2023-07-24T05:47:02.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.765+0000 7f2cc8b99700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc40b20b0 con 0x7f2cc40d2fc0 2023-07-24T05:47:02.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.765+0000 7f2cc1d9b700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f2cc415db20 0x7f2cc40d28b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:33196/0 (socket says 172.21.15.77:33196) 2023-07-24T05:47:02.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.765+0000 7f2cc1d9b700 1 -- 172.21.15.77:0/3576204333 learned_addr learned my addr 172.21.15.77:0/3576204333 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:02.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.765+0000 7f2cc2d9d700 1 --2- 172.21.15.77:0/3576204333 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2cc40d2fc0 0x7f2cc40d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:02.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.765+0000 7f2cc259c700 1 --2- 172.21.15.77:0/3576204333 >> v2:172.21.15.103:3300/0 conn(0x7f2cc406afc0 0x7f2cc40b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:02.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.765+0000 7f2cc159a700 1 -- 172.21.15.77:0/3576204333 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2052364736 0 0) 0x7f2cc4160fa0 con 0x7f2cc415db20 2023-07-24T05:47:02.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.765+0000 7f2cc159a700 1 -- 172.21.15.77:0/3576204333 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cac0035d0 con 0x7f2cc415db20 2023-07-24T05:47:02.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.765+0000 7f2cc259c700 1 -- 172.21.15.77:0/3576204333 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2cc40d2fc0 msgr2=0x7f2cc40d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:02.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.765+0000 7f2cc259c700 1 --2- 172.21.15.77:0/3576204333 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2cc40d2fc0 0x7f2cc40d1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:02.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.765+0000 7f2cc259c700 1 -- 172.21.15.77:0/3576204333 >> v1:172.21.15.77:6789/0 conn(0x7f2cc415db20 legacy=0x7f2cc40d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:02.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.765+0000 7f2cc259c700 1 -- 172.21.15.77:0/3576204333 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc4160670 con 0x7f2cc406afc0 2023-07-24T05:47:02.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.765+0000 7f2cc2d9d700 1 --2- 172.21.15.77:0/3576204333 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2cc40d2fc0 0x7f2cc40d1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:47:02.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.769+0000 7f2cc259c700 1 --2- 172.21.15.77:0/3576204333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cc406afc0 0x7f2cc40b1a20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4009850 tx=0x7f2cb4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5d6be20d3604e31 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:02.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.769+0000 7f2cc159a700 1 -- 172.21.15.77:0/3576204333 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb4011830 con 0x7f2cc406afc0 2023-07-24T05:47:02.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.769+0000 7f2cc159a700 1 -- 172.21.15.77:0/3576204333 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb4011990 con 0x7f2cc406afc0 2023-07-24T05:47:02.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.769+0000 7f2cc159a700 1 -- 172.21.15.77:0/3576204333 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb4011d40 con 0x7f2cc406afc0 2023-07-24T05:47:02.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.769+0000 7f2cc8b99700 1 -- 172.21.15.77:0/3576204333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cc406afc0 msgr2=0x7f2cc40b1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:02.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.769+0000 7f2cc8b99700 1 --2- 172.21.15.77:0/3576204333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cc406afc0 0x7f2cc40b1a20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4009850 tx=0x7f2cb4009b60 comp rx=0 tx=0).stop 2023-07-24T05:47:02.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.769+0000 7f2cc8b99700 1 -- 172.21.15.77:0/3576204333 shutdown_connections 2023-07-24T05:47:02.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.769+0000 7f2cc8b99700 1 --2- 172.21.15.77:0/3576204333 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2cc40d2fc0 0x7f2cc40d1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:02.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.769+0000 7f2cc8b99700 1 --2- 172.21.15.77:0/3576204333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cc406afc0 0x7f2cc40b1a20 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:02.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.769+0000 7f2cc8b99700 1 -- 172.21.15.77:0/3576204333 >> 172.21.15.77:0/3576204333 conn(0x7f2cc409bc20 msgr2=0x7f2cc40b7920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:02.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.769+0000 7f2cc8b99700 1 -- 172.21.15.77:0/3576204333 shutdown_connections 2023-07-24T05:47:02.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.769+0000 7f2cc8b99700 1 -- 172.21.15.77:0/3576204333 wait complete. 2023-07-24T05:47:02.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.773+0000 7f2cc8b99700 1 Processor -- start 2023-07-24T05:47:02.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.773+0000 7f2cc8b99700 1 -- start start 2023-07-24T05:47:02.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.773+0000 7f2cc8b99700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2cc406afc0 0x7f2cc40cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:02.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.773+0000 7f2cc8b99700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cc40d2fc0 0x7f2cc4069df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:02.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.773+0000 7f2cc8b99700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2cc415db20 0x7f2cc41561d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:02.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.773+0000 7f2cc8b99700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc40cc850 con 0x7f2cc415db20 2023-07-24T05:47:02.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.773+0000 7f2cc8b99700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc40c7d80 con 0x7f2cc40d2fc0 2023-07-24T05:47:02.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.773+0000 7f2cc8b99700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc40c8060 con 0x7f2cc406afc0 2023-07-24T05:47:02.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.773+0000 7f2cc2d9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2cc415db20 0x7f2cc41561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:02.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.773+0000 7f2cc2d9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2cc415db20 0x7f2cc41561d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48922/0 (socket says 172.21.15.77:48922) 2023-07-24T05:47:02.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.773+0000 7f2cc2d9d700 1 -- 172.21.15.77:0/1399518054 learned_addr learned my addr 172.21.15.77:0/1399518054 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:02.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.773+0000 7f2cc259c700 1 --2- 172.21.15.77:0/1399518054 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2cc406afc0 0x7f2cc40cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:02.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.773+0000 7f2cc1d9b700 1 --2- 172.21.15.77:0/1399518054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cc40d2fc0 0x7f2cc4069df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:02.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.773+0000 7f2cc2d9d700 1 -- 172.21.15.77:0/1399518054 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2cc406afc0 msgr2=0x7f2cc40cbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:02.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.773+0000 7f2cc2d9d700 1 --2- 172.21.15.77:0/1399518054 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2cc406afc0 0x7f2cc40cbdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:02.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.773+0000 7f2cc2d9d700 1 -- 172.21.15.77:0/1399518054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cc40d2fc0 msgr2=0x7f2cc4069df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:02.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.773+0000 7f2cc2d9d700 1 --2- 172.21.15.77:0/1399518054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cc40d2fc0 0x7f2cc4069df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:02.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.773+0000 7f2cc2d9d700 1 -- 172.21.15.77:0/1399518054 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cbc009a70 con 0x7f2cc415db20 2023-07-24T05:47:02.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.773+0000 7f2cc2d9d700 1 --2- 172.21.15.77:0/1399518054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2cc415db20 0x7f2cc41561d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc00efb0 tx=0x7f2cbc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:02.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.773+0000 7f2cb2ffd700 1 -- 172.21.15.77:0/1399518054 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc00cd40 con 0x7f2cc415db20 2023-07-24T05:47:02.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.777+0000 7f2cc8b99700 1 -- 172.21.15.77:0/1399518054 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cb40094b0 con 0x7f2cc415db20 2023-07-24T05:47:02.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.777+0000 7f2cb2ffd700 1 -- 172.21.15.77:0/1399518054 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cbc00f040 con 0x7f2cc415db20 2023-07-24T05:47:02.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.777+0000 7f2cb2ffd700 1 -- 172.21.15.77:0/1399518054 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc00cea0 con 0x7f2cc415db20 2023-07-24T05:47:02.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.777+0000 7f2cc8b99700 1 -- 172.21.15.77:0/1399518054 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cc40c83f0 con 0x7f2cc415db20 2023-07-24T05:47:02.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.777+0000 7f2cc8b99700 1 -- 172.21.15.77:0/1399518054 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cc404df10 con 0x7f2cc415db20 2023-07-24T05:47:02.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.777+0000 7f2cb2ffd700 1 -- 172.21.15.77:0/1399518054 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2cbc0146a0 con 0x7f2cc415db20 2023-07-24T05:47:02.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.781+0000 7f2cb2ffd700 1 --2- 172.21.15.77:0/1399518054 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2ca40662f0 0x7f2ca40687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:02.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.781+0000 7f2cb2ffd700 1 -- 172.21.15.77:0/1399518054 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2cbc084e00 con 0x7f2cc415db20 2023-07-24T05:47:02.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.781+0000 7f2cc259c700 1 --2- 172.21.15.77:0/1399518054 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2ca40662f0 0x7f2ca40687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:02.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.781+0000 7f2cc259c700 1 --2- 172.21.15.77:0/1399518054 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2ca40662f0 0x7f2ca40687b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2cb40090b0 tx=0x7f2cb4008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:02.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.785+0000 7f2cb2ffd700 1 -- 172.21.15.77:0/1399518054 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2cbc0558c0 con 0x7f2cc415db20 2023-07-24T05:47:02.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.957+0000 7f2cc8b99700 1 -- 172.21.15.77:0/1399518054 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2cc4160920 con 0x7f2cc415db20 2023-07-24T05:47:02.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.961+0000 7f2cb2ffd700 1 -- 172.21.15.77:0/1399518054 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2cbc009d50 con 0x7f2cc415db20 2023-07-24T05:47:02.966 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-07-24T05:47:02.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.961+0000 7f2cc8b99700 1 -- 172.21.15.77:0/1399518054 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2ca40662f0 msgr2=0x7f2ca40687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:02.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.961+0000 7f2cc8b99700 1 --2- 172.21.15.77:0/1399518054 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2ca40662f0 0x7f2ca40687b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2cb40090b0 tx=0x7f2cb4008030 comp rx=0 tx=0).stop 2023-07-24T05:47:02.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.961+0000 7f2cc8b99700 1 -- 172.21.15.77:0/1399518054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2cc415db20 msgr2=0x7f2cc41561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:02.968 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.961+0000 7f2cc8b99700 1 --2- 172.21.15.77:0/1399518054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2cc415db20 0x7f2cc41561d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc00efb0 tx=0x7f2cbc00c3a0 comp rx=0 tx=0).stop 2023-07-24T05:47:02.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.961+0000 7f2cc8b99700 1 -- 172.21.15.77:0/1399518054 shutdown_connections 2023-07-24T05:47:02.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.961+0000 7f2cc8b99700 1 --2- 172.21.15.77:0/1399518054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2cc415db20 0x7f2cc41561d0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:02.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.961+0000 7f2cc8b99700 1 --2- 172.21.15.77:0/1399518054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cc40d2fc0 0x7f2cc4069df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:02.969 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.961+0000 7f2cc8b99700 1 --2- 172.21.15.77:0/1399518054 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2ca40662f0 0x7f2ca40687b0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:02.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.961+0000 7f2cc8b99700 1 --2- 172.21.15.77:0/1399518054 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2cc406afc0 0x7f2cc40cbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:02.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.961+0000 7f2cc8b99700 1 -- 172.21.15.77:0/1399518054 >> 172.21.15.77:0/1399518054 conn(0x7f2cc409bc20 msgr2=0x7f2cc40d2500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:02.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.961+0000 7f2cc8b99700 1 -- 172.21.15.77:0/1399518054 shutdown_connections 2023-07-24T05:47:02.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:02.961+0000 7f2cc8b99700 1 -- 172.21.15.77:0/1399518054 wait complete. 2023-07-24T05:47:02.989 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-24T05:47:03.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.161+0000 7f065b59e700 1 Processor -- start 2023-07-24T05:47:03.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.161+0000 7f065b59e700 1 -- start start 2023-07-24T05:47:03.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.165+0000 7f065b59e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f065c15c9a0 0x7f065c06d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:03.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.165+0000 7f065b59e700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f065c06ac30 con 0x7f065c06bb60 2023-07-24T05:47:03.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.165+0000 7f065b59e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f065c06af10 con 0x7f065c0cf5c0 2023-07-24T05:47:03.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.165+0000 7f065b59e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f065c0cf170 con 0x7f065c15c9a0 2023-07-24T05:47:03.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.165+0000 7f0659d9b700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f065c06bb60 0x7f065c0d0290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55154/0 (socket says 172.21.15.77:55154) 2023-07-24T05:47:03.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.165+0000 7f0659d9b700 1 -- 172.21.15.77:0/2755335149 learned_addr learned my addr 172.21.15.77:0/2755335149 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:03.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.165+0000 7f065a59c700 1 --2- 172.21.15.77:0/2755335149 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f065c15c9a0 0x7f065c06d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:03.173 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.169+0000 7f065959a700 1 -- 172.21.15.77:0/2755335149 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1022272618 0 0) 0x7f065c06ac30 con 0x7f065c06bb60 2023-07-24T05:47:03.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.169+0000 7f065959a700 1 -- 172.21.15.77:0/2755335149 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06440035d0 con 0x7f065c06bb60 2023-07-24T05:47:03.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.169+0000 7f065959a700 1 -- 172.21.15.77:0/2755335149 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3832932329 0 0) 0x7f065c06af10 con 0x7f065c0cf5c0 2023-07-24T05:47:03.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.169+0000 7f065959a700 1 -- 172.21.15.77:0/2755335149 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f065c06ac30 con 0x7f065c0cf5c0 2023-07-24T05:47:03.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.169+0000 7f065959a700 1 -- 172.21.15.77:0/2755335149 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3752350415 0 0) 0x7f06440035d0 con 0x7f065c06bb60 2023-07-24T05:47:03.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.169+0000 7f065959a700 1 -- 172.21.15.77:0/2755335149 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f065c15c9a0 msgr2=0x7f065c06d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:03.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.169+0000 7f065959a700 1 --2- 172.21.15.77:0/2755335149 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f065c15c9a0 0x7f065c06d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:03.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.169+0000 7f065959a700 1 -- 172.21.15.77:0/2755335149 >> v1:172.21.15.103:6789/0 conn(0x7f065c0cf5c0 legacy=0x7f065c0d2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:03.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.169+0000 7f065959a700 1 -- 172.21.15.77:0/2755335149 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f065c06b1f0 con 0x7f065c06bb60 2023-07-24T05:47:03.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.169+0000 7f065959a700 1 -- 172.21.15.77:0/2755335149 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4109865209 0 0) 0x7f0650001670 con 0x7f065c06bb60 2023-07-24T05:47:03.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.169+0000 7f065959a700 1 -- 172.21.15.77:0/2755335149 >> v1:172.21.15.77:6789/0 conn(0x7f065c06bb60 legacy=0x7f065c0d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:03.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.169+0000 7f065959a700 1 --2- 172.21.15.77:0/2755335149 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0644003be0 0x7f0644003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:03.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.169+0000 7f065959a700 1 --2- 172.21.15.77:0/2755335149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0644004870 0x7f0644004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:03.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.169+0000 7f065959a700 1 --2- 172.21.15.77:0/2755335149 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0644005230 0x7f064400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:03.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.169+0000 7f065959a700 1 -- 172.21.15.77:0/2755335149 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065c0cf170 con 0x7f0644004870 2023-07-24T05:47:03.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.169+0000 7f065959a700 1 -- 172.21.15.77:0/2755335149 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064400bfa0 con 0x7f0644003be0 2023-07-24T05:47:03.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.169+0000 7f065959a700 1 -- 172.21.15.77:0/2755335149 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f064400c160 con 0x7f0644005230 2023-07-24T05:47:03.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.169+0000 7f065a59c700 1 --2- 172.21.15.77:0/2755335149 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f065c15c9a0 0x7f065c06d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:47:03.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.169+0000 7f0659d9b700 1 --2- 172.21.15.77:0/2755335149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0644004870 0x7f0644004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:03.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.169+0000 7f065ad9d700 1 --2- 172.21.15.77:0/2755335149 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0644005230 0x7f064400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:03.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.169+0000 7f065a59c700 1 --2- 172.21.15.77:0/2755335149 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0644003be0 0x7f0644003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:03.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.169+0000 7f0659d9b700 1 -- 172.21.15.77:0/2755335149 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0644005230 msgr2=0x7f064400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:03.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.169+0000 7f0659d9b700 1 --2- 172.21.15.77:0/2755335149 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0644005230 0x7f064400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:03.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.169+0000 7f0659d9b700 1 -- 172.21.15.77:0/2755335149 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0644003be0 msgr2=0x7f0644003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:03.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.169+0000 7f0659d9b700 1 --2- 172.21.15.77:0/2755335149 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0644003be0 0x7f0644003fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:03.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.169+0000 7f0659d9b700 1 -- 172.21.15.77:0/2755335149 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06440035d0 con 0x7f0644004870 2023-07-24T05:47:03.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.169+0000 7f0659d9b700 1 --2- 172.21.15.77:0/2755335149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0644004870 0x7f0644004cf0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f065000c240 tx=0x7f06440058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eb5e9c1773604c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:03.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.169+0000 7f065959a700 1 -- 172.21.15.77:0/2755335149 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065000cd80 con 0x7f0644004870 2023-07-24T05:47:03.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.169+0000 7f065959a700 1 -- 172.21.15.77:0/2755335149 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0650005980 con 0x7f0644004870 2023-07-24T05:47:03.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.169+0000 7f065959a700 1 -- 172.21.15.77:0/2755335149 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0650005d30 con 0x7f0644004870 2023-07-24T05:47:03.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.169+0000 7f065b59e700 1 -- 172.21.15.77:0/2755335149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0644004870 msgr2=0x7f0644004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:03.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.169+0000 7f065b59e700 1 --2- 172.21.15.77:0/2755335149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0644004870 0x7f0644004cf0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f065000c240 tx=0x7f06440058a0 comp rx=0 tx=0).stop 2023-07-24T05:47:03.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.169+0000 7f065ad9d700 1 -- 172.21.15.77:0/2755335149 reap_dead start 2023-07-24T05:47:03.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.173+0000 7f065b59e700 1 -- 172.21.15.77:0/2755335149 shutdown_connections 2023-07-24T05:47:03.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.173+0000 7f065b59e700 1 -- 172.21.15.77:0/2755335149 >> 172.21.15.77:0/2755335149 conn(0x7f065c0b5610 msgr2=0x7f065c0b5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:03.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.173+0000 7f065b59e700 1 -- 172.21.15.77:0/2755335149 shutdown_connections 2023-07-24T05:47:03.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.173+0000 7f065b59e700 1 -- 172.21.15.77:0/2755335149 wait complete. 2023-07-24T05:47:03.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.173+0000 7f065b59e700 1 Processor -- start 2023-07-24T05:47:03.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.173+0000 7f065b59e700 1 -- start start 2023-07-24T05:47:03.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.173+0000 7f065b59e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0644004870 0x7f065c1554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:03.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.173+0000 7f065b59e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f065c0c7830 0x7f065c0b3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:03.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.173+0000 7f065b59e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f065c159340 0x7f065c1597c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:03.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.173+0000 7f065b59e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065c155a20 con 0x7f065c0c7830 2023-07-24T05:47:03.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.173+0000 7f065b59e700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065c159d00 con 0x7f065c159340 2023-07-24T05:47:03.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.173+0000 7f065b59e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f065c0b3e90 con 0x7f0644004870 2023-07-24T05:47:03.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.177+0000 7f0659d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f065c0c7830 0x7f065c0b3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:03.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.177+0000 7f065a59c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0644004870 0x7f065c1554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:03.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.177+0000 7f0659d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f065c0c7830 0x7f065c0b3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34972/0 (socket says 172.21.15.77:34972) 2023-07-24T05:47:03.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.177+0000 7f0659d9b700 1 -- 172.21.15.77:0/3755152009 learned_addr learned my addr 172.21.15.77:0/3755152009 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:03.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.177+0000 7f065ad9d700 1 --2- 172.21.15.77:0/3755152009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f065c159340 0x7f065c1597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:03.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.177+0000 7f065a59c700 1 -- 172.21.15.77:0/3755152009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f065c159340 msgr2=0x7f065c1597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:03.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.177+0000 7f065a59c700 1 --2- 172.21.15.77:0/3755152009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f065c159340 0x7f065c1597c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:03.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.177+0000 7f065a59c700 1 -- 172.21.15.77:0/3755152009 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f065c0c7830 msgr2=0x7f065c0b3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:03.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.177+0000 7f065a59c700 1 --2- 172.21.15.77:0/3755152009 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f065c0c7830 0x7f065c0b3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:03.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.177+0000 7f065a59c700 1 -- 172.21.15.77:0/3755152009 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f065c0b4170 con 0x7f0644004870 2023-07-24T05:47:03.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.177+0000 7f0659d9b700 1 --2- 172.21.15.77:0/3755152009 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f065c0c7830 0x7f065c0b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:47:03.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.177+0000 7f065a59c700 1 --2- 172.21.15.77:0/3755152009 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0644004870 0x7f065c1554e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f064c0108d0 tx=0x7f064c010be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:03.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.177+0000 7f064affd700 1 -- 172.21.15.77:0/3755152009 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064c014800 con 0x7f0644004870 2023-07-24T05:47:03.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.177+0000 7f064affd700 1 -- 172.21.15.77:0/3755152009 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064c014960 con 0x7f0644004870 2023-07-24T05:47:03.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.177+0000 7f064affd700 1 -- 172.21.15.77:0/3755152009 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064c014cf0 con 0x7f0644004870 2023-07-24T05:47:03.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.177+0000 7f065b59e700 1 -- 172.21.15.77:0/3755152009 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f065c0b4450 con 0x7f0644004870 2023-07-24T05:47:03.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.177+0000 7f065b59e700 1 -- 172.21.15.77:0/3755152009 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f065c0b4a10 con 0x7f0644004870 2023-07-24T05:47:03.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.177+0000 7f065b59e700 1 -- 172.21.15.77:0/3755152009 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f065c072490 con 0x7f0644004870 2023-07-24T05:47:03.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.181+0000 7f064affd700 1 -- 172.21.15.77:0/3755152009 <== mon.2 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f064c01c400 con 0x7f0644004870 2023-07-24T05:47:03.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.181+0000 7f064affd700 1 --2- 172.21.15.77:0/3755152009 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f063c066320 0x7f063c0687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:03.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.181+0000 7f064affd700 1 -- 172.21.15.77:0/3755152009 <== mon.2 v2:172.21.15.103:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f064c084230 con 0x7f0644004870 2023-07-24T05:47:03.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.181+0000 7f0659d9b700 1 --2- 172.21.15.77:0/3755152009 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f063c066320 0x7f063c0687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:03.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.181+0000 7f0659d9b700 1 --2- 172.21.15.77:0/3755152009 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f063c066320 0x7f063c0687e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f06500018b0 tx=0x7f065000a000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:03.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.189+0000 7f064affd700 1 -- 172.21.15.77:0/3755152009 <== mon.2 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f064c0512f0 con 0x7f0644004870 2023-07-24T05:47:03.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.361+0000 7f065b59e700 1 -- 172.21.15.77:0/3755152009 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f065c155b60 con 0x7f0644004870 2023-07-24T05:47:03.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.361+0000 7f064affd700 1 -- 172.21.15.77:0/3755152009 <== mon.2 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f064c054910 con 0x7f0644004870 2023-07-24T05:47:03.368 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-07-24T05:47:03.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.365+0000 7f065b59e700 1 -- 172.21.15.77:0/3755152009 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f063c066320 msgr2=0x7f063c0687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:03.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.365+0000 7f065b59e700 1 --2- 172.21.15.77:0/3755152009 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f063c066320 0x7f063c0687e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f06500018b0 tx=0x7f065000a000 comp rx=0 tx=0).stop 2023-07-24T05:47:03.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.365+0000 7f065b59e700 1 -- 172.21.15.77:0/3755152009 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0644004870 msgr2=0x7f065c1554e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:03.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.365+0000 7f065b59e700 1 --2- 172.21.15.77:0/3755152009 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0644004870 0x7f065c1554e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f064c0108d0 tx=0x7f064c010be0 comp rx=0 tx=0).stop 2023-07-24T05:47:03.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.365+0000 7f065b59e700 1 -- 172.21.15.77:0/3755152009 shutdown_connections 2023-07-24T05:47:03.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.365+0000 7f065b59e700 1 --2- 172.21.15.77:0/3755152009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f065c159340 0x7f065c1597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:03.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.365+0000 7f065b59e700 1 --2- 172.21.15.77:0/3755152009 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f065c0c7830 0x7f065c0b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:03.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.365+0000 7f065b59e700 1 --2- 172.21.15.77:0/3755152009 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f063c066320 0x7f063c0687e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:03.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.365+0000 7f065b59e700 1 --2- 172.21.15.77:0/3755152009 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0644004870 0x7f065c1554e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:03.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.365+0000 7f065b59e700 1 -- 172.21.15.77:0/3755152009 >> 172.21.15.77:0/3755152009 conn(0x7f065c0b5610 msgr2=0x7f065c0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:03.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.365+0000 7f065b59e700 1 -- 172.21.15.77:0/3755152009 shutdown_connections 2023-07-24T05:47:03.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.365+0000 7f065b59e700 1 -- 172.21.15.77:0/3755152009 wait complete. 2023-07-24T05:47:03.393 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-24T05:47:03.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.561+0000 7f92b5af2700 1 Processor -- start 2023-07-24T05:47:03.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.561+0000 7f92b5af2700 1 -- start start 2023-07-24T05:47:03.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.561+0000 7f92b5af2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f92b00b4800 0x7f92b00b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:03.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.561+0000 7f92b5af2700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92b00d0300 con 0x7f92b00d2200 2023-07-24T05:47:03.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.561+0000 7f92b5af2700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92b015cde0 con 0x7f92b015ca00 2023-07-24T05:47:03.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.561+0000 7f92b5af2700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92b00d2670 con 0x7f92b00b4800 2023-07-24T05:47:03.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.565+0000 7f92affff700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f92b00d2200 0x7f92b00b40f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55158/0 (socket says 172.21.15.77:55158) 2023-07-24T05:47:03.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.565+0000 7f92affff700 1 -- 172.21.15.77:0/903087255 learned_addr learned my addr 172.21.15.77:0/903087255 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:03.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.565+0000 7f92b52f1700 1 --2- 172.21.15.77:0/903087255 >> v2:172.21.15.103:3300/0 conn(0x7f92b00b4800 0x7f92b00b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:03.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.565+0000 7f92af7fe700 1 -- 172.21.15.77:0/903087255 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1015911205 0 0) 0x7f92b00d0300 con 0x7f92b00d2200 2023-07-24T05:47:03.570 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.565+0000 7f92af7fe700 1 -- 172.21.15.77:0/903087255 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92980035d0 con 0x7f92b00d2200 2023-07-24T05:47:03.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.565+0000 7f92af7fe700 1 -- 172.21.15.77:0/903087255 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3775808324 0 0) 0x7f92b015cde0 con 0x7f92b015ca00 2023-07-24T05:47:03.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.565+0000 7f92af7fe700 1 -- 172.21.15.77:0/903087255 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92b00d0300 con 0x7f92b015ca00 2023-07-24T05:47:03.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.565+0000 7f92b52f1700 1 -- 172.21.15.77:0/903087255 >> v1:172.21.15.103:6789/0 conn(0x7f92b015ca00 legacy=0x7f92b006d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:03.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.565+0000 7f92b52f1700 1 -- 172.21.15.77:0/903087255 >> v1:172.21.15.77:6789/0 conn(0x7f92b00d2200 legacy=0x7f92b00b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:03.571 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.565+0000 7f92b52f1700 1 -- 172.21.15.77:0/903087255 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b00d2870 con 0x7f92b00b4800 2023-07-24T05:47:03.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.565+0000 7f92b52f1700 1 --2- 172.21.15.77:0/903087255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92b00b4800 0x7f92b00b11e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f92a8009d90 tx=0x7f92a800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4836f31bfe4aeac4 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:03.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.565+0000 7f92af7fe700 1 -- 172.21.15.77:0/903087255 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a800e070 con 0x7f92b00b4800 2023-07-24T05:47:03.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.565+0000 7f92af7fe700 1 -- 172.21.15.77:0/903087255 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a800bb20 con 0x7f92b00b4800 2023-07-24T05:47:03.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.565+0000 7f92af7fe700 1 -- 172.21.15.77:0/903087255 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a800be90 con 0x7f92b00b4800 2023-07-24T05:47:03.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.569+0000 7f92b5af2700 1 -- 172.21.15.77:0/903087255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92b00b4800 msgr2=0x7f92b00b11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:03.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.569+0000 7f92b5af2700 1 --2- 172.21.15.77:0/903087255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92b00b4800 0x7f92b00b11e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f92a8009d90 tx=0x7f92a800b330 comp rx=0 tx=0).stop 2023-07-24T05:47:03.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.569+0000 7f92b5af2700 1 -- 172.21.15.77:0/903087255 shutdown_connections 2023-07-24T05:47:03.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.569+0000 7f92b5af2700 1 --2- 172.21.15.77:0/903087255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92b00b4800 0x7f92b00b11e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:03.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.569+0000 7f92b5af2700 1 -- 172.21.15.77:0/903087255 >> 172.21.15.77:0/903087255 conn(0x7f92b00b7610 msgr2=0x7f92b00b7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:03.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.569+0000 7f92b5af2700 1 -- 172.21.15.77:0/903087255 shutdown_connections 2023-07-24T05:47:03.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.569+0000 7f92b5af2700 1 -- 172.21.15.77:0/903087255 wait complete. 2023-07-24T05:47:03.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.569+0000 7f92b5af2700 1 Processor -- start 2023-07-24T05:47:03.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.569+0000 7f92b5af2700 1 -- start start 2023-07-24T05:47:03.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.573+0000 7f92b5af2700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f92b00b4800 0x7f92b0160ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:03.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.573+0000 7f92b5af2700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92b00d2200 0x7f92b00b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:03.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.573+0000 7f92b5af2700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92b015ca00 0x7f92b01f9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:03.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.573+0000 7f92b5af2700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b01f79d0 con 0x7f92b015ca00 2023-07-24T05:47:03.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.573+0000 7f92b5af2700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b00b2d20 con 0x7f92b00d2200 2023-07-24T05:47:03.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.573+0000 7f92b5af2700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92b00b2760 con 0x7f92b00b4800 2023-07-24T05:47:03.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.573+0000 7f92b52f1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92b015ca00 0x7f92b01f9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:03.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.573+0000 7f92b52f1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92b015ca00 0x7f92b01f9980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34978/0 (socket says 172.21.15.77:34978) 2023-07-24T05:47:03.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.573+0000 7f92b52f1700 1 -- 172.21.15.77:0/3126139135 learned_addr learned my addr 172.21.15.77:0/3126139135 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:03.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.573+0000 7f92affff700 1 --2- 172.21.15.77:0/3126139135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92b00d2200 0x7f92b00b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:03.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.573+0000 7f92b4af0700 1 --2- 172.21.15.77:0/3126139135 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f92b00b4800 0x7f92b0160ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:03.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.573+0000 7f92b52f1700 1 -- 172.21.15.77:0/3126139135 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f92b00b4800 msgr2=0x7f92b0160ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:03.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.573+0000 7f92b52f1700 1 --2- 172.21.15.77:0/3126139135 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f92b00b4800 0x7f92b0160ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:03.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.573+0000 7f92b52f1700 1 -- 172.21.15.77:0/3126139135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92b00d2200 msgr2=0x7f92b00b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:03.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.573+0000 7f92b52f1700 1 --2- 172.21.15.77:0/3126139135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92b00d2200 0x7f92b00b1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:03.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.573+0000 7f92b52f1700 1 -- 172.21.15.77:0/3126139135 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a8009a70 con 0x7f92b015ca00 2023-07-24T05:47:03.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.573+0000 7f92b4af0700 1 --2- 172.21.15.77:0/3126139135 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f92b00b4800 0x7f92b0160ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:03.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.573+0000 7f92b52f1700 1 --2- 172.21.15.77:0/3126139135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92b015ca00 0x7f92b01f9980 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f92a8013000 tx=0x7f92a8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:03.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.573+0000 7f92ad7fa700 1 -- 172.21.15.77:0/3126139135 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a80098f0 con 0x7f92b015ca00 2023-07-24T05:47:03.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.573+0000 7f92ad7fa700 1 -- 172.21.15.77:0/3126139135 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a8020070 con 0x7f92b015ca00 2023-07-24T05:47:03.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.573+0000 7f92b5af2700 1 -- 172.21.15.77:0/3126139135 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92b00b2a40 con 0x7f92b015ca00 2023-07-24T05:47:03.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.573+0000 7f92ad7fa700 1 -- 172.21.15.77:0/3126139135 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a80276c0 con 0x7f92b015ca00 2023-07-24T05:47:03.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.573+0000 7f92b5af2700 1 -- 172.21.15.77:0/3126139135 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92b01fa640 con 0x7f92b015ca00 2023-07-24T05:47:03.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.573+0000 7f92b5af2700 1 -- 172.21.15.77:0/3126139135 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92b01f7b10 con 0x7f92b015ca00 2023-07-24T05:47:03.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.577+0000 7f92ad7fa700 1 -- 172.21.15.77:0/3126139135 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f92a8012430 con 0x7f92b015ca00 2023-07-24T05:47:03.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.577+0000 7f92ad7fa700 1 --2- 172.21.15.77:0/3126139135 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f929c0662f0 0x7f929c0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:03.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.577+0000 7f92ad7fa700 1 -- 172.21.15.77:0/3126139135 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f92a8022070 con 0x7f92b015ca00 2023-07-24T05:47:03.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.577+0000 7f92b4af0700 1 --2- 172.21.15.77:0/3126139135 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f929c0662f0 0x7f929c0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:03.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.581+0000 7f92b4af0700 1 --2- 172.21.15.77:0/3126139135 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f929c0662f0 0x7f929c0687b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f92b015c4d0 tx=0x7f92a4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:03.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.585+0000 7f92ad7fa700 1 -- 172.21.15.77:0/3126139135 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f92b01f7b10 con 0x7f92b015ca00 2023-07-24T05:47:03.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.757+0000 7f92b5af2700 1 -- 172.21.15.77:0/3126139135 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f92b01f7b10 con 0x7f92b015ca00 2023-07-24T05:47:03.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.761+0000 7f92ad7fa700 1 -- 172.21.15.77:0/3126139135 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20204 (secure 0 0 0) 0x7f92b01f7b10 con 0x7f92b015ca00 2023-07-24T05:47:03.767 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:47:03.767 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":27,"fsid":"5aed5f7b-fb55-4d95-9c02-c6adbb1677b4","created":"2023-07-24T05:45:39.639731+0000","modified":"2023-07-24T05:46:48.442117+0000","last_up_change":"2023-07-24T05:45:52.319670+0000","last_in_change":"2023-07-24T05:45:43.643277+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-24T05:45:52.610430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-24T05:45:52.773787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-24T05:45:58.121732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-24T05:45:59.368726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-24T05:46:03.032057+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ffa0d496-461a-4053-b764-0627d969521b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6812","nonce":825987196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6817","nonce":825987196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6831","nonce":825987196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6824","nonce":825987196}]},"public_addr":"172.21.15.77:6812/825987196","cluster_addr":"172.21.15.77:6817/825987196","heartbeat_back_addr":"172.21.15.77:6831/825987196","heartbeat_front_addr":"172.21.15.77:6824/825987196","state":["exists","up"]},{"osd":1,"uuid":"9f595e5e-5c43-49bc-8ce4-ee70575c90da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6801","nonce":4133026815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6803","nonce":4133026815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6807","nonce":4133026815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6805","nonce":4133026815}]},"public_addr":"172.21.15.77:6801/4133026815","cluster_addr":"172.21.15.77:6803/4133026815","heartbeat_back_addr":"172.21.15.77:6807/4133026815","heartbeat_front_addr":"172.21.15.77:6805/4133026815","state":["exists","up"]},{"osd":2,"uuid":"2ac177aa-4d7d-4262-bd54-d2b9f29f4c3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6811","nonce":2394142159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6819","nonce":2394142159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6830","nonce":2394142159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6825","nonce":2394142159}]},"public_addr":"172.21.15.77:6811/2394142159","cluster_addr":"172.21.15.77:6819/2394142159","heartbeat_back_addr":"172.21.15.77:6830/2394142159","heartbeat_front_addr":"172.21.15.77:6825/2394142159","state":["exists","up"]},{"osd":3,"uuid":"17d7a251-19e8-484c-8172-a578ab3da153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6813","nonce":1492113982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6818","nonce":1492113982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6829","nonce":1492113982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6823","nonce":1492113982}]},"public_addr":"172.21.15.77:6813/1492113982","cluster_addr":"172.21.15.77:6818/1492113982","heartbeat_back_addr":"172.21.15.77:6829/1492113982","heartbeat_front_addr":"172.21.15.77:6823/1492113982","state":["exists","up"]},{"osd":4,"uuid":"bf63ca05-f06d-4e0f-ac44-2a416c70b919","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6825","nonce":1080481057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6827","nonce":1080481057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6831","nonce":1080481057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6829","nonce":1080481057}]},"public_addr":"172.21.15.103:6825/1080481057","cluster_addr":"172.21.15.103:6827/1080481057","heartbeat_back_addr":"172.21.15.103:6831/1080481057","heartbeat_front_addr":"172.21.15.103:6829/1080481057","state":["exists","up"]},{"osd":5,"uuid":"65a11a35-9e9f-4b3c-9fe3-b658d62b9318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6811","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6813","nonce":2756677504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6818","nonce":2756677504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6823","nonce":2756677504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6821","nonce":2756677504}]},"public_addr":"172.21.15.103:6813/2756677504","cluster_addr":"172.21.15.103:6818/2756677504","heartbeat_back_addr":"172.21.15.103:6823/2756677504","heartbeat_front_addr":"172.21.15.103:6821/2756677504","state":["exists","up"]},{"osd":6,"uuid":"750c1f87-686c-40b4-94a1-1a299dc78f3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6809","nonce":568977764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6812","nonce":568977764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6819","nonce":568977764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6815","nonce":568977764}]},"public_addr":"172.21.15.103:6809/568977764","cluster_addr":"172.21.15.103:6812/568977764","heartbeat_back_addr":"172.21.15.103:6819/568977764","heartbeat_front_addr":"172.21.15.103:6815/568977764","state":["exists","up"]},{"osd":7,"uuid":"d5fe4fb6-2e09-4158-885b-403803c85822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6801","nonce":1074557176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6803","nonce":1074557176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6807","nonce":1074557176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6805","nonce":1074557176}]},"public_addr":"172.21.15.103:6801/1074557176","cluster_addr":"172.21.15.103:6803/1074557176","heartbeat_back_addr":"172.21.15.103:6807/1074557176","heartbeat_front_addr":"172.21.15.103:6805/1074557176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.631032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.154109+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.398587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.679089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.311218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.353726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.314372+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.126212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1d","mappings":[{"from":3,"to":2}]},{"pgid":"4.31","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-24T05:47:03.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.761+0000 7f92b5af2700 1 -- 172.21.15.77:0/3126139135 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f929c0662f0 msgr2=0x7f929c0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:03.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.761+0000 7f92b5af2700 1 --2- 172.21.15.77:0/3126139135 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f929c0662f0 0x7f929c0687b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f92b015c4d0 tx=0x7f92a4009040 comp rx=0 tx=0).stop 2023-07-24T05:47:03.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.761+0000 7f92b5af2700 1 -- 172.21.15.77:0/3126139135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92b015ca00 msgr2=0x7f92b01f9980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:03.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.761+0000 7f92b5af2700 1 --2- 172.21.15.77:0/3126139135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92b015ca00 0x7f92b01f9980 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f92a8013000 tx=0x7f92a8004af0 comp rx=0 tx=0).stop 2023-07-24T05:47:03.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.765+0000 7f92b5af2700 1 -- 172.21.15.77:0/3126139135 shutdown_connections 2023-07-24T05:47:03.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.765+0000 7f92b5af2700 1 --2- 172.21.15.77:0/3126139135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f92b015ca00 0x7f92b01f9980 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:03.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.765+0000 7f92b5af2700 1 --2- 172.21.15.77:0/3126139135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f92b00d2200 0x7f92b00b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:03.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.765+0000 7f92b5af2700 1 --2- 172.21.15.77:0/3126139135 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f929c0662f0 0x7f929c0687b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:03.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.765+0000 7f92b5af2700 1 --2- 172.21.15.77:0/3126139135 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f92b00b4800 0x7f92b0160ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:03.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.765+0000 7f92b5af2700 1 -- 172.21.15.77:0/3126139135 >> 172.21.15.77:0/3126139135 conn(0x7f92b00b7610 msgr2=0x7f92b00cf5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:03.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.765+0000 7f92b5af2700 1 -- 172.21.15.77:0/3126139135 shutdown_connections 2023-07-24T05:47:03.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.765+0000 7f92b5af2700 1 -- 172.21.15.77:0/3126139135 wait complete. 2023-07-24T05:47:03.790 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-24T05:45:52.610430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-24T05:45:52.773787+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-24T05:45:58.121732+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-24T05:45:59.368726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-24T05:46:03.032057+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-24T05:47:03.791 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-24T05:47:03.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.965+0000 7feb887ea700 1 Processor -- start 2023-07-24T05:47:03.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.965+0000 7feb887ea700 1 -- start start 2023-07-24T05:47:03.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.969+0000 7feb887ea700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7feb800ad930 0x7feb800cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:03.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.969+0000 7feb887ea700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7feb800cb360 0x7feb800c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:03.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.969+0000 7feb887ea700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb800add10 con 0x7feb800ca250 2023-07-24T05:47:03.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.969+0000 7feb887ea700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb800cf2f0 con 0x7feb800cb360 2023-07-24T05:47:03.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.969+0000 7feb887ea700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb8015e530 con 0x7feb800ad930 2023-07-24T05:47:03.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.969+0000 7feb85d85700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7feb800cb360 0x7feb800c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:03.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.969+0000 7feb85d85700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7feb800cb360 0x7feb800c9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34988/0 (socket says 172.21.15.77:34988) 2023-07-24T05:47:03.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.969+0000 7feb85d85700 1 -- 172.21.15.77:0/3352066731 learned_addr learned my addr 172.21.15.77:0/3352066731 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:03.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.969+0000 7feb86586700 1 --2- 172.21.15.77:0/3352066731 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7feb800ad930 0x7feb800cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:03.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.969+0000 7feb85d85700 1 -- 172.21.15.77:0/3352066731 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7feb800ad930 msgr2=0x7feb800cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:03.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.969+0000 7feb85d85700 1 --2- 172.21.15.77:0/3352066731 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7feb800ad930 0x7feb800cae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:03.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.969+0000 7feb85d85700 1 -- 172.21.15.77:0/3352066731 >> v1:172.21.15.77:6789/0 conn(0x7feb800ca250 legacy=0x7feb80069b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:03.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.973+0000 7feb85d85700 1 -- 172.21.15.77:0/3352066731 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb800cb7c0 con 0x7feb800cb360 2023-07-24T05:47:03.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.973+0000 7feb85d85700 1 --2- 172.21.15.77:0/3352066731 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb800cb360 0x7feb800c9d10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7feb70009910 tx=0x7feb70009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc93ea3d33a3037f server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:03.978 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.973+0000 7feb85584700 1 -- 172.21.15.77:0/3352066731 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7000ba60 con 0x7feb800cb360 2023-07-24T05:47:03.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.973+0000 7feb85584700 1 -- 172.21.15.77:0/3352066731 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7000bbc0 con 0x7feb800cb360 2023-07-24T05:47:03.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.973+0000 7feb85584700 1 -- 172.21.15.77:0/3352066731 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb70009e60 con 0x7feb800cb360 2023-07-24T05:47:03.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.973+0000 7feb887ea700 1 -- 172.21.15.77:0/3352066731 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb800cb360 msgr2=0x7feb800c9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:03.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.973+0000 7feb887ea700 1 --2- 172.21.15.77:0/3352066731 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb800cb360 0x7feb800c9d10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7feb70009910 tx=0x7feb70009c20 comp rx=0 tx=0).stop 2023-07-24T05:47:03.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.973+0000 7feb887ea700 1 -- 172.21.15.77:0/3352066731 shutdown_connections 2023-07-24T05:47:03.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.973+0000 7feb887ea700 1 --2- 172.21.15.77:0/3352066731 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb800cb360 0x7feb800c9d10 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:03.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.973+0000 7feb887ea700 1 --2- 172.21.15.77:0/3352066731 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7feb800ad930 0x7feb800cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:03.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.973+0000 7feb887ea700 1 -- 172.21.15.77:0/3352066731 >> 172.21.15.77:0/3352066731 conn(0x7feb800ce440 msgr2=0x7feb800ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:03.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.973+0000 7feb887ea700 1 -- 172.21.15.77:0/3352066731 shutdown_connections 2023-07-24T05:47:03.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.973+0000 7feb887ea700 1 -- 172.21.15.77:0/3352066731 wait complete. 2023-07-24T05:47:03.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.977+0000 7feb887ea700 1 Processor -- start 2023-07-24T05:47:03.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.977+0000 7feb887ea700 1 -- start start 2023-07-24T05:47:03.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.977+0000 7feb887ea700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7feb800ad930 0x7feb80157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:03.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.977+0000 7feb887ea700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb800ca250 0x7feb8015c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:03.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.977+0000 7feb887ea700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb800cb360 0x7feb8015cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:03.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.977+0000 7feb887ea700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb800c5a90 con 0x7feb800cb360 2023-07-24T05:47:03.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.977+0000 7feb887ea700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8015beb0 con 0x7feb800ca250 2023-07-24T05:47:03.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.977+0000 7feb887ea700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb8015c190 con 0x7feb800ad930 2023-07-24T05:47:03.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.981+0000 7feb86d87700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb800cb360 0x7feb8015cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:03.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.981+0000 7feb86d87700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb800cb360 0x7feb8015cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35000/0 (socket says 172.21.15.77:35000) 2023-07-24T05:47:03.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.981+0000 7feb86d87700 1 -- 172.21.15.77:0/492295407 learned_addr learned my addr 172.21.15.77:0/492295407 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:03.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.981+0000 7feb86586700 1 --2- 172.21.15.77:0/492295407 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7feb800ad930 0x7feb80157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:03.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.981+0000 7feb85d85700 1 --2- 172.21.15.77:0/492295407 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb800ca250 0x7feb8015c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:03.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.981+0000 7feb86d87700 1 -- 172.21.15.77:0/492295407 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7feb800ad930 msgr2=0x7feb80157fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:03.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.981+0000 7feb86d87700 1 --2- 172.21.15.77:0/492295407 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7feb800ad930 0x7feb80157fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:03.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.981+0000 7feb86d87700 1 -- 172.21.15.77:0/492295407 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb800ca250 msgr2=0x7feb8015c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:03.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.981+0000 7feb86d87700 1 --2- 172.21.15.77:0/492295407 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb800ca250 0x7feb8015c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:03.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.981+0000 7feb86d87700 1 -- 172.21.15.77:0/492295407 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb70009570 con 0x7feb800cb360 2023-07-24T05:47:03.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.981+0000 7feb85d85700 1 --2- 172.21.15.77:0/492295407 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb800ca250 0x7feb8015c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:03.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.981+0000 7feb86d87700 1 --2- 172.21.15.77:0/492295407 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb800cb360 0x7feb8015cad0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7feb7800cc50 tx=0x7feb7800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:03.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.981+0000 7feb76ffd700 1 -- 172.21.15.77:0/492295407 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7800ad80 con 0x7feb800cb360 2023-07-24T05:47:03.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.981+0000 7feb76ffd700 1 -- 172.21.15.77:0/492295407 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7800ce50 con 0x7feb800cb360 2023-07-24T05:47:03.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.981+0000 7feb887ea700 1 -- 172.21.15.77:0/492295407 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb800c56b0 con 0x7feb800cb360 2023-07-24T05:47:03.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.981+0000 7feb76ffd700 1 -- 172.21.15.77:0/492295407 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb78003c60 con 0x7feb800cb360 2023-07-24T05:47:03.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.981+0000 7feb887ea700 1 -- 172.21.15.77:0/492295407 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb8015b140 con 0x7feb800cb360 2023-07-24T05:47:03.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.985+0000 7feb887ea700 1 -- 172.21.15.77:0/492295407 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb800c5510 con 0x7feb800cb360 2023-07-24T05:47:03.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.985+0000 7feb76ffd700 1 -- 172.21.15.77:0/492295407 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7feb780050d0 con 0x7feb800cb360 2023-07-24T05:47:03.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.985+0000 7feb76ffd700 1 --2- 172.21.15.77:0/492295407 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7feb640662f0 0x7feb640687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:03.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.989+0000 7feb76ffd700 1 -- 172.21.15.77:0/492295407 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7feb78084140 con 0x7feb800cb360 2023-07-24T05:47:03.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.989+0000 7feb86586700 1 --2- 172.21.15.77:0/492295407 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7feb640662f0 0x7feb640687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:03.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.989+0000 7feb86586700 1 --2- 172.21.15.77:0/492295407 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7feb640662f0 0x7feb640687b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7feb7c006fd0 tx=0x7feb7c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:03.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:03.993+0000 7feb76ffd700 1 -- 172.21.15.77:0/492295407 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7feb800c5510 con 0x7feb800cb360 2023-07-24T05:47:04.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.165+0000 7feb887ea700 1 -- 172.21.15.77:0/492295407 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feb800c5510 con 0x7feb800cb360 2023-07-24T05:47:04.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.165+0000 7feb76ffd700 1 -- 172.21.15.77:0/492295407 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7feb800c5510 con 0x7feb800cb360 2023-07-24T05:47:04.172 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-07-24T05:47:04.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.169+0000 7feb887ea700 1 -- 172.21.15.77:0/492295407 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7feb640662f0 msgr2=0x7feb640687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:04.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.169+0000 7feb887ea700 1 --2- 172.21.15.77:0/492295407 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7feb640662f0 0x7feb640687b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7feb7c006fd0 tx=0x7feb7c008040 comp rx=0 tx=0).stop 2023-07-24T05:47:04.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.169+0000 7feb887ea700 1 -- 172.21.15.77:0/492295407 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb800cb360 msgr2=0x7feb8015cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:04.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.169+0000 7feb887ea700 1 --2- 172.21.15.77:0/492295407 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb800cb360 0x7feb8015cad0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7feb7800cc50 tx=0x7feb7800a340 comp rx=0 tx=0).stop 2023-07-24T05:47:04.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.169+0000 7feb887ea700 1 -- 172.21.15.77:0/492295407 shutdown_connections 2023-07-24T05:47:04.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.169+0000 7feb887ea700 1 --2- 172.21.15.77:0/492295407 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb800cb360 0x7feb8015cad0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:04.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.169+0000 7feb887ea700 1 --2- 172.21.15.77:0/492295407 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7feb800ca250 0x7feb8015c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:04.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.169+0000 7feb887ea700 1 --2- 172.21.15.77:0/492295407 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7feb640662f0 0x7feb640687b0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:04.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.169+0000 7feb887ea700 1 --2- 172.21.15.77:0/492295407 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7feb800ad930 0x7feb80157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:04.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.169+0000 7feb887ea700 1 -- 172.21.15.77:0/492295407 >> 172.21.15.77:0/492295407 conn(0x7feb800ce440 msgr2=0x7feb800acaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:04.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.169+0000 7feb887ea700 1 -- 172.21.15.77:0/492295407 shutdown_connections 2023-07-24T05:47:04.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.169+0000 7feb887ea700 1 -- 172.21.15.77:0/492295407 wait complete. 2023-07-24T05:47:04.193 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-24T05:47:04.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.369+0000 7f044ad21700 1 Processor -- start 2023-07-24T05:47:04.374 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.369+0000 7f044ad21700 1 -- start start 2023-07-24T05:47:04.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.369+0000 7f044ad21700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f04440cc3e0 0x7f0444159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:04.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.369+0000 7f044ad21700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f04440cc7c0 0x7f04440ccc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:04.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.369+0000 7f044ad21700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04440708c0 con 0x7f044406a4b0 2023-07-24T05:47:04.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.369+0000 7f044ad21700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0444159fe0 con 0x7f04440cc3e0 2023-07-24T05:47:04.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.369+0000 7f044ad21700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f044406a020 con 0x7f04440cc7c0 2023-07-24T05:47:04.377 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.373+0000 7f04492be700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f044406a4b0 0x7f044406a920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55174/0 (socket says 172.21.15.77:55174) 2023-07-24T05:47:04.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.373+0000 7f04492be700 1 -- 172.21.15.77:0/2429699023 learned_addr learned my addr 172.21.15.77:0/2429699023 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:04.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.373+0000 7f0448abd700 1 --2- 172.21.15.77:0/2429699023 >> v2:172.21.15.77:3300/0 conn(0x7f04440cc3e0 0x7f0444159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:04.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.373+0000 7f0443fff700 1 --2- 172.21.15.77:0/2429699023 >> v2:172.21.15.103:3300/0 conn(0x7f04440cc7c0 0x7f04440ccc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:04.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.373+0000 7f04437fe700 1 -- 172.21.15.77:0/2429699023 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3896565951 0 0) 0x7f04440708c0 con 0x7f044406a4b0 2023-07-24T05:47:04.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.373+0000 7f04437fe700 1 -- 172.21.15.77:0/2429699023 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04340057e0 con 0x7f044406a4b0 2023-07-24T05:47:04.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.373+0000 7f0448abd700 1 -- 172.21.15.77:0/2429699023 >> v2:172.21.15.103:3300/0 conn(0x7f04440cc7c0 msgr2=0x7f04440ccc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:04.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.373+0000 7f0448abd700 1 --2- 172.21.15.77:0/2429699023 >> v2:172.21.15.103:3300/0 conn(0x7f04440cc7c0 0x7f04440ccc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:04.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.373+0000 7f04437fe700 1 -- 172.21.15.77:0/2429699023 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3278102699 0 0) 0x7f04340057e0 con 0x7f044406a4b0 2023-07-24T05:47:04.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.373+0000 7f0448abd700 1 -- 172.21.15.77:0/2429699023 >> v1:172.21.15.77:6789/0 conn(0x7f044406a4b0 legacy=0x7f044406a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:04.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.373+0000 7f0448abd700 1 -- 172.21.15.77:0/2429699023 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0444070300 con 0x7f04440cc3e0 2023-07-24T05:47:04.380 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.373+0000 7f0448abd700 1 --2- 172.21.15.77:0/2429699023 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04440cc3e0 0x7f0444159aa0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f044406ff50 tx=0x7f0438009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f25860ed472957e0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:04.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.373+0000 7f04437fe700 1 -- 172.21.15.77:0/2429699023 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c0019f0 con 0x7f04440cc3e0 2023-07-24T05:47:04.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.373+0000 7f04437fe700 1 -- 172.21.15.77:0/2429699023 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0438004030 con 0x7f04440cc3e0 2023-07-24T05:47:04.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.373+0000 7f04437fe700 1 -- 172.21.15.77:0/2429699023 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04380043a0 con 0x7f04440cc3e0 2023-07-24T05:47:04.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.373+0000 7f044ad21700 1 -- 172.21.15.77:0/2429699023 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04440cc3e0 msgr2=0x7f0444159aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:04.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.373+0000 7f044ad21700 1 --2- 172.21.15.77:0/2429699023 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04440cc3e0 0x7f0444159aa0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f044406ff50 tx=0x7f0438009b30 comp rx=0 tx=0).stop 2023-07-24T05:47:04.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.373+0000 7f044ad21700 1 -- 172.21.15.77:0/2429699023 shutdown_connections 2023-07-24T05:47:04.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.373+0000 7f044ad21700 1 --2- 172.21.15.77:0/2429699023 >> v2:172.21.15.103:3300/0 conn(0x7f04440cc7c0 0x7f04440ccc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:04.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.373+0000 7f044ad21700 1 --2- 172.21.15.77:0/2429699023 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f04440cc3e0 0x7f0444159aa0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:04.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.373+0000 7f044ad21700 1 -- 172.21.15.77:0/2429699023 >> 172.21.15.77:0/2429699023 conn(0x7f04440b05d0 msgr2=0x7f04440b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:04.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.373+0000 7f044ad21700 1 -- 172.21.15.77:0/2429699023 shutdown_connections 2023-07-24T05:47:04.382 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.373+0000 7f044ad21700 1 -- 172.21.15.77:0/2429699023 wait complete. 2023-07-24T05:47:04.383 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.377+0000 7f044ad21700 1 Processor -- start 2023-07-24T05:47:04.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.377+0000 7f044ad21700 1 -- start start 2023-07-24T05:47:04.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.381+0000 7f044ad21700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f044406a4b0 0x7f0444151dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:04.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.381+0000 7f044ad21700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04440cc3e0 0x7f044414afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:04.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.381+0000 7f044ad21700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f04440cc7c0 0x7f04441e6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:04.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.381+0000 7f044ad21700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044414bab0 con 0x7f044406a4b0 2023-07-24T05:47:04.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.381+0000 7f044ad21700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0444153b00 con 0x7f04440cc3e0 2023-07-24T05:47:04.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.381+0000 7f044ad21700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0444153210 con 0x7f04440cc7c0 2023-07-24T05:47:04.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.381+0000 7f0448abd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f044406a4b0 0x7f0444151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:04.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.381+0000 7f0448abd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f044406a4b0 0x7f0444151dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35016/0 (socket says 172.21.15.77:35016) 2023-07-24T05:47:04.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.381+0000 7f0448abd700 1 -- 172.21.15.77:0/1764448154 learned_addr learned my addr 172.21.15.77:0/1764448154 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:04.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.381+0000 7f04492be700 1 --2- 172.21.15.77:0/1764448154 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f04440cc7c0 0x7f04441e6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:04.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.381+0000 7f0443fff700 1 --2- 172.21.15.77:0/1764448154 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04440cc3e0 0x7f044414afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:04.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.381+0000 7f0448abd700 1 -- 172.21.15.77:0/1764448154 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f04440cc7c0 msgr2=0x7f04441e6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:04.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.381+0000 7f0448abd700 1 --2- 172.21.15.77:0/1764448154 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f04440cc7c0 0x7f04441e6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:04.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.381+0000 7f0448abd700 1 -- 172.21.15.77:0/1764448154 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04440cc3e0 msgr2=0x7f044414afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:04.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.381+0000 7f0448abd700 1 --2- 172.21.15.77:0/1764448154 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04440cc3e0 0x7f044414afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:04.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.381+0000 7f0448abd700 1 -- 172.21.15.77:0/1764448154 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04380094b0 con 0x7f044406a4b0 2023-07-24T05:47:04.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.381+0000 7f04492be700 1 --2- 172.21.15.77:0/1764448154 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f04440cc7c0 0x7f04441e6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:04.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.381+0000 7f0448abd700 1 --2- 172.21.15.77:0/1764448154 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f044406a4b0 0x7f0444151dc0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f04380090b0 tx=0x7f0438004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:04.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.381+0000 7f04417fa700 1 -- 172.21.15.77:0/1764448154 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0438003db0 con 0x7f044406a4b0 2023-07-24T05:47:04.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.381+0000 7f04417fa700 1 -- 172.21.15.77:0/1764448154 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f043801f070 con 0x7f044406a4b0 2023-07-24T05:47:04.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.381+0000 7f04417fa700 1 -- 172.21.15.77:0/1764448154 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0438011870 con 0x7f044406a4b0 2023-07-24T05:47:04.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.381+0000 7f044ad21700 1 -- 172.21.15.77:0/1764448154 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04441534b0 con 0x7f044406a4b0 2023-07-24T05:47:04.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.381+0000 7f044ad21700 1 -- 172.21.15.77:0/1764448154 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04441524c0 con 0x7f044406a4b0 2023-07-24T05:47:04.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.381+0000 7f044ad21700 1 -- 172.21.15.77:0/1764448154 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f044404df10 con 0x7f044406a4b0 2023-07-24T05:47:04.390 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.385+0000 7f04417fa700 1 -- 172.21.15.77:0/1764448154 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f04380119d0 con 0x7f044406a4b0 2023-07-24T05:47:04.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.385+0000 7f04417fa700 1 --2- 172.21.15.77:0/1764448154 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f0428066320 0x7f04280687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:04.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.385+0000 7f04417fa700 1 -- 172.21.15.77:0/1764448154 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0438021070 con 0x7f044406a4b0 2023-07-24T05:47:04.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.385+0000 7f0443fff700 1 --2- 172.21.15.77:0/1764448154 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f0428066320 0x7f04280687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:04.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.389+0000 7f0443fff700 1 --2- 172.21.15.77:0/1764448154 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f0428066320 0x7f04280687e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0444151b80 tx=0x7f0430008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:04.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.393+0000 7f04417fa700 1 -- 172.21.15.77:0/1764448154 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0438052a30 con 0x7f044406a4b0 2023-07-24T05:47:04.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.561+0000 7f044ad21700 1 -- 172.21.15.77:0/1764448154 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f044406afd0 con 0x7f044406a4b0 2023-07-24T05:47:04.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.565+0000 7f04417fa700 1 -- 172.21.15.77:0/1764448154 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0438056050 con 0x7f044406a4b0 2023-07-24T05:47:04.569 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 8 2023-07-24T05:47:04.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.565+0000 7f044ad21700 1 -- 172.21.15.77:0/1764448154 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f0428066320 msgr2=0x7f04280687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:04.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.565+0000 7f044ad21700 1 --2- 172.21.15.77:0/1764448154 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f0428066320 0x7f04280687e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0444151b80 tx=0x7f0430008040 comp rx=0 tx=0).stop 2023-07-24T05:47:04.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.565+0000 7f044ad21700 1 -- 172.21.15.77:0/1764448154 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f044406a4b0 msgr2=0x7f0444151dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:04.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.565+0000 7f044ad21700 1 --2- 172.21.15.77:0/1764448154 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f044406a4b0 0x7f0444151dc0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f04380090b0 tx=0x7f0438004770 comp rx=0 tx=0).stop 2023-07-24T05:47:04.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.569+0000 7f044ad21700 1 -- 172.21.15.77:0/1764448154 shutdown_connections 2023-07-24T05:47:04.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.569+0000 7f044ad21700 1 --2- 172.21.15.77:0/1764448154 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f0428066320 0x7f04280687e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:04.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.569+0000 7f044ad21700 1 --2- 172.21.15.77:0/1764448154 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f04440cc7c0 0x7f04441e6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:04.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.569+0000 7f044ad21700 1 --2- 172.21.15.77:0/1764448154 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f04440cc3e0 0x7f044414afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:04.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.569+0000 7f044ad21700 1 --2- 172.21.15.77:0/1764448154 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f044406a4b0 0x7f0444151dc0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:04.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.569+0000 7f044ad21700 1 -- 172.21.15.77:0/1764448154 >> 172.21.15.77:0/1764448154 conn(0x7f04440b05d0 msgr2=0x7f04440cdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:04.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.569+0000 7f044ad21700 1 -- 172.21.15.77:0/1764448154 shutdown_connections 2023-07-24T05:47:04.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.569+0000 7f044ad21700 1 -- 172.21.15.77:0/1764448154 wait complete. 2023-07-24T05:47:04.595 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-24T05:47:04.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.769+0000 7f38fe59e700 1 Processor -- start 2023-07-24T05:47:04.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.769+0000 7f38fe59e700 1 -- start start 2023-07-24T05:47:04.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.773+0000 7f38fe59e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f38f815a950 0x7f38f80b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:04.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.773+0000 7f38fe59e700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f38f806a220 0x7f38f806d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:04.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.773+0000 7f38fe59e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38f806b000 con 0x7f38f80c4e70 2023-07-24T05:47:04.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.773+0000 7f38fe59e700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38f80b1ac0 con 0x7f38f806a220 2023-07-24T05:47:04.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.773+0000 7f38fe59e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38f806a7c0 con 0x7f38f815a950 2023-07-24T05:47:04.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.773+0000 7f38fdd9d700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f38f806a220 0x7f38f806d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:04.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.773+0000 7f38fd59c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f38f815a950 0x7f38f80b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:04.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.773+0000 7f38fcd9b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f38f80c4e70 0x7f38f8069b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.77:35042/0 (socket says 172.21.15.77:35042) 2023-07-24T05:47:04.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.773+0000 7f38fcd9b700 1 -- 172.21.15.77:0/3086361477 learned_addr learned my addr 172.21.15.77:0/3086361477 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:04.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.773+0000 7f38effff700 1 -- 172.21.15.77:0/3086361477 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3973659686 0 0) 0x7f38f806b000 con 0x7f38f80c4e70 2023-07-24T05:47:04.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.773+0000 7f38effff700 1 -- 172.21.15.77:0/3086361477 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38e40035d0 con 0x7f38f80c4e70 2023-07-24T05:47:04.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.773+0000 7f38fd59c700 1 -- 172.21.15.77:0/3086361477 >> v2:172.21.15.77:3300/0 conn(0x7f38f806a220 msgr2=0x7f38f806d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:04.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.773+0000 7f38fd59c700 1 --2- 172.21.15.77:0/3086361477 >> v2:172.21.15.77:3300/0 conn(0x7f38f806a220 0x7f38f806d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:04.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.773+0000 7f38fd59c700 1 -- 172.21.15.77:0/3086361477 >> v1:172.21.15.103:6789/0 conn(0x7f38f80c4e70 legacy=0x7f38f8069b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:04.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.773+0000 7f38fd59c700 1 -- 172.21.15.77:0/3086361477 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f806aaa0 con 0x7f38f815a950 2023-07-24T05:47:04.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.773+0000 7f38fdd9d700 1 --2- 172.21.15.77:0/3086361477 >> v2:172.21.15.77:3300/0 conn(0x7f38f806a220 0x7f38f806d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:47:04.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.773+0000 7f38fd59c700 1 --2- 172.21.15.77:0/3086361477 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38f815a950 0x7f38f80b1f10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f38f80b0dd0 tx=0x7f38f4009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77007b0ca51cfb12 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:04.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.773+0000 7f38effff700 1 -- 172.21.15.77:0/3086361477 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f4011830 con 0x7f38f815a950 2023-07-24T05:47:04.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.773+0000 7f38effff700 1 -- 172.21.15.77:0/3086361477 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f4011990 con 0x7f38f815a950 2023-07-24T05:47:04.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.777+0000 7f38effff700 1 -- 172.21.15.77:0/3086361477 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f4011d20 con 0x7f38f815a950 2023-07-24T05:47:04.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.777+0000 7f38fe59e700 1 -- 172.21.15.77:0/3086361477 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38f815a950 msgr2=0x7f38f80b1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:04.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.777+0000 7f38fe59e700 1 --2- 172.21.15.77:0/3086361477 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38f815a950 0x7f38f80b1f10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f38f80b0dd0 tx=0x7f38f4009b30 comp rx=0 tx=0).stop 2023-07-24T05:47:04.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.777+0000 7f38fe59e700 1 -- 172.21.15.77:0/3086361477 shutdown_connections 2023-07-24T05:47:04.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.777+0000 7f38fe59e700 1 --2- 172.21.15.77:0/3086361477 >> v2:172.21.15.77:3300/0 conn(0x7f38f806a220 0x7f38f806d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:04.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.777+0000 7f38fe59e700 1 --2- 172.21.15.77:0/3086361477 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38f815a950 0x7f38f80b1f10 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:04.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.777+0000 7f38fe59e700 1 -- 172.21.15.77:0/3086361477 >> 172.21.15.77:0/3086361477 conn(0x7f38f80ce260 msgr2=0x7f38f80ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:04.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.777+0000 7f38fe59e700 1 -- 172.21.15.77:0/3086361477 shutdown_connections 2023-07-24T05:47:04.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.777+0000 7f38fe59e700 1 -- 172.21.15.77:0/3086361477 wait complete. 2023-07-24T05:47:04.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.777+0000 7f38fe59e700 1 Processor -- start 2023-07-24T05:47:04.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.781+0000 7f38fe59e700 1 -- start start 2023-07-24T05:47:04.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.781+0000 7f38fe59e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38f806a220 0x7f38f815c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:04.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.781+0000 7f38fe59e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f38f80c4e70 0x7f38f81f1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:04.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.781+0000 7f38fe59e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38f815a950 0x7f38f80aafe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:04.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.781+0000 7f38fe59e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f815bf00 con 0x7f38f806a220 2023-07-24T05:47:04.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.781+0000 7f38fe59e700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f81f29c0 con 0x7f38f815a950 2023-07-24T05:47:04.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.781+0000 7f38fe59e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38f81f2ca0 con 0x7f38f80c4e70 2023-07-24T05:47:04.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.781+0000 7f38fd59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38f806a220 0x7f38f815c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:04.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.781+0000 7f38fd59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38f806a220 0x7f38f815c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35036/0 (socket says 172.21.15.77:35036) 2023-07-24T05:47:04.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.781+0000 7f38fd59c700 1 -- 172.21.15.77:0/4072042702 learned_addr learned my addr 172.21.15.77:0/4072042702 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:04.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.781+0000 7f38fcd9b700 1 --2- 172.21.15.77:0/4072042702 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f38f80c4e70 0x7f38f81f1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:04.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.781+0000 7f38fdd9d700 1 --2- 172.21.15.77:0/4072042702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38f815a950 0x7f38f80aafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:04.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.781+0000 7f38fd59c700 1 -- 172.21.15.77:0/4072042702 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f38f80c4e70 msgr2=0x7f38f81f1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:04.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.781+0000 7f38fd59c700 1 --2- 172.21.15.77:0/4072042702 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f38f80c4e70 0x7f38f81f1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:04.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.781+0000 7f38fd59c700 1 -- 172.21.15.77:0/4072042702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38f815a950 msgr2=0x7f38f80aafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:04.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.781+0000 7f38fd59c700 1 --2- 172.21.15.77:0/4072042702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38f815a950 0x7f38f80aafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:04.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.781+0000 7f38fd59c700 1 -- 172.21.15.77:0/4072042702 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f0009a70 con 0x7f38f806a220 2023-07-24T05:47:04.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.781+0000 7f38fd59c700 1 --2- 172.21.15.77:0/4072042702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38f806a220 0x7f38f815c950 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f38f4009b70 tx=0x7f38f4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:04.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.781+0000 7f38edffb700 1 -- 172.21.15.77:0/4072042702 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f40044c0 con 0x7f38f806a220 2023-07-24T05:47:04.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.781+0000 7f38edffb700 1 -- 172.21.15.77:0/4072042702 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f401f070 con 0x7f38f806a220 2023-07-24T05:47:04.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.781+0000 7f38fe59e700 1 -- 172.21.15.77:0/4072042702 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38f40094b0 con 0x7f38f806a220 2023-07-24T05:47:04.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.781+0000 7f38edffb700 1 -- 172.21.15.77:0/4072042702 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f40038c0 con 0x7f38f806a220 2023-07-24T05:47:04.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.785+0000 7f38fe59e700 1 -- 172.21.15.77:0/4072042702 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38f815c430 con 0x7f38f806a220 2023-07-24T05:47:04.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.785+0000 7f38fe59e700 1 -- 172.21.15.77:0/4072042702 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38f806bd40 con 0x7f38f806a220 2023-07-24T05:47:04.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.785+0000 7f38edffb700 1 -- 172.21.15.77:0/4072042702 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f38f4021030 con 0x7f38f806a220 2023-07-24T05:47:04.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.789+0000 7f38edffb700 1 --2- 172.21.15.77:0/4072042702 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f38dc0662f0 0x7f38dc0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:04.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.789+0000 7f38edffb700 1 -- 172.21.15.77:0/4072042702 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f38f4085400 con 0x7f38f806a220 2023-07-24T05:47:04.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.789+0000 7f38fcd9b700 1 --2- 172.21.15.77:0/4072042702 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f38dc0662f0 0x7f38dc0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:04.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.789+0000 7f38fcd9b700 1 --2- 172.21.15.77:0/4072042702 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f38dc0662f0 0x7f38dc0687b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f38f80abc20 tx=0x7f38e8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:04.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.793+0000 7f38edffb700 1 -- 172.21.15.77:0/4072042702 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f38f4052660 con 0x7f38f806a220 2023-07-24T05:47:04.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.969+0000 7f38fe59e700 1 -- 172.21.15.77:0/4072042702 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f38f815c650 con 0x7f38f806a220 2023-07-24T05:47:04.977 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.973+0000 7f38edffb700 1 -- 172.21.15.77:0/4072042702 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f38f4055c80 con 0x7f38f806a220 2023-07-24T05:47:04.977 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-07-24T05:47:04.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.973+0000 7f38fe59e700 1 -- 172.21.15.77:0/4072042702 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f38dc0662f0 msgr2=0x7f38dc0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:04.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.973+0000 7f38fe59e700 1 --2- 172.21.15.77:0/4072042702 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f38dc0662f0 0x7f38dc0687b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f38f80abc20 tx=0x7f38e8009040 comp rx=0 tx=0).stop 2023-07-24T05:47:04.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.973+0000 7f38fe59e700 1 -- 172.21.15.77:0/4072042702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38f806a220 msgr2=0x7f38f815c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:04.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.973+0000 7f38fe59e700 1 --2- 172.21.15.77:0/4072042702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38f806a220 0x7f38f815c950 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f38f4009b70 tx=0x7f38f4004770 comp rx=0 tx=0).stop 2023-07-24T05:47:04.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.973+0000 7f38fe59e700 1 -- 172.21.15.77:0/4072042702 shutdown_connections 2023-07-24T05:47:04.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.973+0000 7f38fe59e700 1 --2- 172.21.15.77:0/4072042702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38f815a950 0x7f38f80aafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:04.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.973+0000 7f38fe59e700 1 --2- 172.21.15.77:0/4072042702 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f38dc0662f0 0x7f38dc0687b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:04.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.973+0000 7f38fe59e700 1 --2- 172.21.15.77:0/4072042702 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f38f80c4e70 0x7f38f81f1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:04.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.973+0000 7f38fe59e700 1 --2- 172.21.15.77:0/4072042702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f38f806a220 0x7f38f815c950 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:04.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.973+0000 7f38fe59e700 1 -- 172.21.15.77:0/4072042702 >> 172.21.15.77:0/4072042702 conn(0x7f38f80ce260 msgr2=0x7f38f806fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:04.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.973+0000 7f38fe59e700 1 -- 172.21.15.77:0/4072042702 shutdown_connections 2023-07-24T05:47:04.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:04.973+0000 7f38fe59e700 1 -- 172.21.15.77:0/4072042702 wait complete. 2023-07-24T05:47:05.003 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-24T05:47:05.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.181+0000 7f903759e700 1 Processor -- start 2023-07-24T05:47:05.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.181+0000 7f903759e700 1 -- start start 2023-07-24T05:47:05.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.181+0000 7f903759e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f903815a950 0x7f90380b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:05.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.181+0000 7f903759e700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f90380c4e70 0x7f9038069b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:05.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.181+0000 7f903759e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f903806a050 0x7f90380aaf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:05.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.181+0000 7f903759e700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90380b1ac0 con 0x7f90380c4e70 2023-07-24T05:47:05.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.181+0000 7f903759e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f903806b000 con 0x7f903815a950 2023-07-24T05:47:05.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.181+0000 7f903759e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f903806a7c0 con 0x7f903806a050 2023-07-24T05:47:05.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.181+0000 7f902dd9b700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f90380c4e70 0x7f9038069b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:05.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.185+0000 7f9036d9d700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f903806a050 0x7f90380aaf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:05.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.185+0000 7f903659c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f903815a950 0x7f90380b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:05.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.185+0000 7f902dd9b700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f90380c4e70 0x7f9038069b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35042/0 (socket says 172.21.15.77:35042) 2023-07-24T05:47:05.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.185+0000 7f902dd9b700 1 -- 172.21.15.77:0/164113537 learned_addr learned my addr 172.21.15.77:0/164113537 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:05.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.185+0000 7f9036d9d700 1 -- 172.21.15.77:0/164113537 >> v2:172.21.15.103:3300/0 conn(0x7f903815a950 msgr2=0x7f90380b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:05.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.185+0000 7f9036d9d700 1 --2- 172.21.15.77:0/164113537 >> v2:172.21.15.103:3300/0 conn(0x7f903815a950 0x7f90380b1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:05.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.185+0000 7f9036d9d700 1 -- 172.21.15.77:0/164113537 >> v2:172.21.15.77:3300/0 conn(0x7f90380c4e70 msgr2=0x7f9038069b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:05.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.185+0000 7f9036d9d700 1 --2- 172.21.15.77:0/164113537 >> v2:172.21.15.77:3300/0 conn(0x7f90380c4e70 0x7f9038069b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:05.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.185+0000 7f9036d9d700 1 -- 172.21.15.77:0/164113537 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f903806aaa0 con 0x7f903806a050 2023-07-24T05:47:05.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.185+0000 7f902dd9b700 1 --2- 172.21.15.77:0/164113537 >> v2:172.21.15.77:3300/0 conn(0x7f90380c4e70 0x7f9038069b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:47:05.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.185+0000 7f9036d9d700 1 --2- 172.21.15.77:0/164113537 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f903806a050 0x7f90380aaf50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f90380b0dd0 tx=0x7f903000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75336181abc1760b server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:05.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.185+0000 7f9035d9b700 1 -- 172.21.15.77:0/164113537 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903000e070 con 0x7f903806a050 2023-07-24T05:47:05.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.185+0000 7f9035d9b700 1 -- 172.21.15.77:0/164113537 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903000bb20 con 0x7f903806a050 2023-07-24T05:47:05.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.185+0000 7f9035d9b700 1 -- 172.21.15.77:0/164113537 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9030012430 con 0x7f903806a050 2023-07-24T05:47:05.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.185+0000 7f903759e700 1 -- 172.21.15.77:0/164113537 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f903806a050 msgr2=0x7f90380aaf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:05.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.185+0000 7f903759e700 1 --2- 172.21.15.77:0/164113537 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f903806a050 0x7f90380aaf50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f90380b0dd0 tx=0x7f903000b330 comp rx=0 tx=0).stop 2023-07-24T05:47:05.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.185+0000 7f903759e700 1 -- 172.21.15.77:0/164113537 shutdown_connections 2023-07-24T05:47:05.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.185+0000 7f903759e700 1 --2- 172.21.15.77:0/164113537 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f903806a050 0x7f90380aaf50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:05.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.185+0000 7f903759e700 1 --2- 172.21.15.77:0/164113537 >> v2:172.21.15.77:3300/0 conn(0x7f90380c4e70 0x7f9038069b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:05.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.185+0000 7f903759e700 1 --2- 172.21.15.77:0/164113537 >> v2:172.21.15.103:3300/0 conn(0x7f903815a950 0x7f90380b1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:05.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.185+0000 7f903759e700 1 -- 172.21.15.77:0/164113537 >> 172.21.15.77:0/164113537 conn(0x7f90380ce260 msgr2=0x7f90380ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:05.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.185+0000 7f903759e700 1 -- 172.21.15.77:0/164113537 shutdown_connections 2023-07-24T05:47:05.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.185+0000 7f903759e700 1 -- 172.21.15.77:0/164113537 wait complete. 2023-07-24T05:47:05.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.189+0000 7f903759e700 1 Processor -- start 2023-07-24T05:47:05.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.189+0000 7f903759e700 1 -- start start 2023-07-24T05:47:05.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.193+0000 7f903759e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f903806a050 0x7f90381500b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:05.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.193+0000 7f903759e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f90380c4e70 0x7f9038158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:05.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.193+0000 7f903759e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f903815a950 0x7f90381470c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:05.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.193+0000 7f903759e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903809a830 con 0x7f903815a950 2023-07-24T05:47:05.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.193+0000 7f903759e700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90381443c0 con 0x7f903806a050 2023-07-24T05:47:05.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.193+0000 7f903759e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90381505f0 con 0x7f90380c4e70 2023-07-24T05:47:05.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.193+0000 7f9036d9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f903815a950 0x7f90381470c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:05.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.193+0000 7f9036d9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f903815a950 0x7f90381470c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35056/0 (socket says 172.21.15.77:35056) 2023-07-24T05:47:05.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.193+0000 7f9036d9d700 1 -- 172.21.15.77:0/1004634887 learned_addr learned my addr 172.21.15.77:0/1004634887 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:05.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.193+0000 7f903659c700 1 --2- 172.21.15.77:0/1004634887 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f903806a050 0x7f90381500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:05.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.193+0000 7f902dd9b700 1 --2- 172.21.15.77:0/1004634887 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f90380c4e70 0x7f9038158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:05.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.193+0000 7f9036d9d700 1 -- 172.21.15.77:0/1004634887 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f90380c4e70 msgr2=0x7f9038158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:05.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.193+0000 7f9036d9d700 1 --2- 172.21.15.77:0/1004634887 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f90380c4e70 0x7f9038158680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:05.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.193+0000 7f9036d9d700 1 -- 172.21.15.77:0/1004634887 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f903806a050 msgr2=0x7f90381500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:05.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.193+0000 7f9036d9d700 1 --2- 172.21.15.77:0/1004634887 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f903806a050 0x7f90381500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:05.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.193+0000 7f9036d9d700 1 -- 172.21.15.77:0/1004634887 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9020009570 con 0x7f903815a950 2023-07-24T05:47:05.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.193+0000 7f9036d9d700 1 --2- 172.21.15.77:0/1004634887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f903815a950 0x7f90381470c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9030014040 tx=0x7f9030004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:05.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.193+0000 7f902f7fe700 1 -- 172.21.15.77:0/1004634887 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90300048b0 con 0x7f903815a950 2023-07-24T05:47:05.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.193+0000 7f902f7fe700 1 -- 172.21.15.77:0/1004634887 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9030020070 con 0x7f903815a950 2023-07-24T05:47:05.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.193+0000 7f902f7fe700 1 -- 172.21.15.77:0/1004634887 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90300276c0 con 0x7f903815a950 2023-07-24T05:47:05.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.193+0000 7f903759e700 1 -- 172.21.15.77:0/1004634887 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9030009a70 con 0x7f903815a950 2023-07-24T05:47:05.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.193+0000 7f903759e700 1 -- 172.21.15.77:0/1004634887 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f903809a450 con 0x7f903815a950 2023-07-24T05:47:05.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.197+0000 7f903759e700 1 -- 172.21.15.77:0/1004634887 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f903806bd40 con 0x7f903815a950 2023-07-24T05:47:05.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.197+0000 7f902f7fe700 1 -- 172.21.15.77:0/1004634887 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9030012430 con 0x7f903815a950 2023-07-24T05:47:05.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.201+0000 7f902f7fe700 1 --2- 172.21.15.77:0/1004634887 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f90180662f0 0x7f90180687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:05.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.201+0000 7f902f7fe700 1 -- 172.21.15.77:0/1004634887 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9030022070 con 0x7f903815a950 2023-07-24T05:47:05.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.201+0000 7f903659c700 1 --2- 172.21.15.77:0/1004634887 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f90180662f0 0x7f90180687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:05.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.201+0000 7f903659c700 1 --2- 172.21.15.77:0/1004634887 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f90180662f0 0x7f90180687b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9028009bf0 tx=0x7f9028009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:05.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.205+0000 7f902f7fe700 1 -- 172.21.15.77:0/1004634887 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9030052c30 con 0x7f903815a950 2023-07-24T05:47:05.378 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.373+0000 7f903759e700 1 -- 172.21.15.77:0/1004634887 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f903809a970 con 0x7f903815a950 2023-07-24T05:47:05.379 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.373+0000 7f902f7fe700 1 -- 172.21.15.77:0/1004634887 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f903002c020 con 0x7f903815a950 2023-07-24T05:47:05.379 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-07-24T05:47:05.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.377+0000 7f903759e700 1 -- 172.21.15.77:0/1004634887 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f90180662f0 msgr2=0x7f90180687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:05.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.377+0000 7f903759e700 1 --2- 172.21.15.77:0/1004634887 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f90180662f0 0x7f90180687b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9028009bf0 tx=0x7f9028009240 comp rx=0 tx=0).stop 2023-07-24T05:47:05.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.377+0000 7f903759e700 1 -- 172.21.15.77:0/1004634887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f903815a950 msgr2=0x7f90381470c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:05.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.377+0000 7f903759e700 1 --2- 172.21.15.77:0/1004634887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f903815a950 0x7f90381470c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9030014040 tx=0x7f9030004af0 comp rx=0 tx=0).stop 2023-07-24T05:47:05.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.377+0000 7f903759e700 1 -- 172.21.15.77:0/1004634887 shutdown_connections 2023-07-24T05:47:05.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.377+0000 7f903759e700 1 --2- 172.21.15.77:0/1004634887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f903815a950 0x7f90381470c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:05.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.377+0000 7f903759e700 1 --2- 172.21.15.77:0/1004634887 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f90180662f0 0x7f90180687b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:05.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.377+0000 7f903759e700 1 --2- 172.21.15.77:0/1004634887 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f90380c4e70 0x7f9038158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:05.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.377+0000 7f903759e700 1 --2- 172.21.15.77:0/1004634887 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f903806a050 0x7f90381500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:05.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.377+0000 7f903759e700 1 -- 172.21.15.77:0/1004634887 >> 172.21.15.77:0/1004634887 conn(0x7f90380ce260 msgr2=0x7f90380b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:05.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.377+0000 7f903759e700 1 -- 172.21.15.77:0/1004634887 shutdown_connections 2023-07-24T05:47:05.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.377+0000 7f903759e700 1 -- 172.21.15.77:0/1004634887 wait complete. 2023-07-24T05:47:05.407 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-24T05:47:05.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.585+0000 7fe58fe11700 1 Processor -- start 2023-07-24T05:47:05.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.585+0000 7fe58fe11700 1 -- start start 2023-07-24T05:47:05.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.589+0000 7fe58fe11700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe58806afc0 0x7fe5880b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:05.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.589+0000 7fe58fe11700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe5880d2fc0 0x7fe5880d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:05.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.589+0000 7fe58fe11700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe588160fa0 con 0x7fe58815db20 2023-07-24T05:47:05.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.589+0000 7fe58fe11700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5880d0360 con 0x7fe5880d2fc0 2023-07-24T05:47:05.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.589+0000 7fe58fe11700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5880b20b0 con 0x7fe58806afc0 2023-07-24T05:47:05.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.589+0000 7fe58dbad700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe58806afc0 0x7fe5880b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:05.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.589+0000 7fe58e3ae700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe5880d2fc0 0x7fe5880d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:05.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.589+0000 7fe58d3ac700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fe58815db20 0x7fe5880d28b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.77:35058/0 (socket says 172.21.15.77:35058) 2023-07-24T05:47:05.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.589+0000 7fe58d3ac700 1 -- 172.21.15.77:0/4272075588 learned_addr learned my addr 172.21.15.77:0/4272075588 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:05.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.589+0000 7fe58dbad700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe58806afc0 0x7fe5880b1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.77:58700/0 (socket says 172.21.15.77:58700) 2023-07-24T05:47:05.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.589+0000 7fe58dbad700 1 -- 172.21.15.77:0/4272075588 >> v2:172.21.15.103:3300/0 conn(0x7fe5880d2fc0 msgr2=0x7fe5880d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:05.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.589+0000 7fe58dbad700 1 --2- 172.21.15.77:0/4272075588 >> v2:172.21.15.103:3300/0 conn(0x7fe5880d2fc0 0x7fe5880d1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:05.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.589+0000 7fe58dbad700 1 -- 172.21.15.77:0/4272075588 >> v1:172.21.15.103:6789/0 conn(0x7fe58815db20 legacy=0x7fe5880d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:05.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.589+0000 7fe58cbab700 1 -- 172.21.15.77:0/4272075588 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1679744142 0 0) 0x7fe588160fa0 con 0x7fe58815db20 2023-07-24T05:47:05.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.589+0000 7fe58dbad700 1 -- 172.21.15.77:0/4272075588 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe588160670 con 0x7fe58806afc0 2023-07-24T05:47:05.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.589+0000 7fe58dbad700 1 --2- 172.21.15.77:0/4272075588 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe58806afc0 0x7fe5880b1a20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe584009850 tx=0x7fe584009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf1a16cb9737cc2f server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:05.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.589+0000 7fe58cbab700 1 -- 172.21.15.77:0/4272075588 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe584011830 con 0x7fe58806afc0 2023-07-24T05:47:05.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.589+0000 7fe58cbab700 1 -- 172.21.15.77:0/4272075588 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe584011990 con 0x7fe58806afc0 2023-07-24T05:47:05.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.589+0000 7fe58cbab700 1 -- 172.21.15.77:0/4272075588 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe584011d40 con 0x7fe58806afc0 2023-07-24T05:47:05.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.593+0000 7fe58fe11700 1 -- 172.21.15.77:0/4272075588 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe58806afc0 msgr2=0x7fe5880b1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:05.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.593+0000 7fe58fe11700 1 --2- 172.21.15.77:0/4272075588 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe58806afc0 0x7fe5880b1a20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe584009850 tx=0x7fe584009b60 comp rx=0 tx=0).stop 2023-07-24T05:47:05.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.593+0000 7fe58fe11700 1 -- 172.21.15.77:0/4272075588 shutdown_connections 2023-07-24T05:47:05.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.593+0000 7fe58fe11700 1 --2- 172.21.15.77:0/4272075588 >> v2:172.21.15.103:3300/0 conn(0x7fe5880d2fc0 0x7fe5880d1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:05.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.593+0000 7fe58fe11700 1 --2- 172.21.15.77:0/4272075588 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe58806afc0 0x7fe5880b1a20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:05.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.593+0000 7fe58fe11700 1 -- 172.21.15.77:0/4272075588 >> 172.21.15.77:0/4272075588 conn(0x7fe58809bc20 msgr2=0x7fe5880b7920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:05.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.593+0000 7fe58fe11700 1 -- 172.21.15.77:0/4272075588 shutdown_connections 2023-07-24T05:47:05.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.593+0000 7fe58fe11700 1 -- 172.21.15.77:0/4272075588 wait complete. 2023-07-24T05:47:05.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.597+0000 7fe58fe11700 1 Processor -- start 2023-07-24T05:47:05.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.597+0000 7fe58fe11700 1 -- start start 2023-07-24T05:47:05.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.597+0000 7fe58fe11700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe58806afc0 0x7fe5881f5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:05.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.597+0000 7fe58fe11700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5880d2fc0 0x7fe588150e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:05.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.597+0000 7fe58fe11700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe58815db20 0x7fe5880ca520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:05.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.597+0000 7fe58fe11700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe588151390 con 0x7fe5880d2fc0 2023-07-24T05:47:05.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.597+0000 7fe58fe11700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5880caa60 con 0x7fe58815db20 2023-07-24T05:47:05.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.597+0000 7fe58fe11700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5880d0920 con 0x7fe58806afc0 2023-07-24T05:47:05.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.597+0000 7fe58d3ac700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5880d2fc0 0x7fe588150e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:05.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.597+0000 7fe58d3ac700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5880d2fc0 0x7fe588150e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35062/0 (socket says 172.21.15.77:35062) 2023-07-24T05:47:05.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.597+0000 7fe58d3ac700 1 -- 172.21.15.77:0/3963095304 learned_addr learned my addr 172.21.15.77:0/3963095304 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:05.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.597+0000 7fe58dbad700 1 --2- 172.21.15.77:0/3963095304 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe58806afc0 0x7fe5881f5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:05.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.597+0000 7fe58e3ae700 1 --2- 172.21.15.77:0/3963095304 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe58815db20 0x7fe5880ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:05.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.597+0000 7fe58d3ac700 1 -- 172.21.15.77:0/3963095304 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe58806afc0 msgr2=0x7fe5881f5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:05.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.597+0000 7fe58d3ac700 1 --2- 172.21.15.77:0/3963095304 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe58806afc0 0x7fe5881f5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:05.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.597+0000 7fe58d3ac700 1 -- 172.21.15.77:0/3963095304 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe58815db20 msgr2=0x7fe5880ca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:05.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.597+0000 7fe58d3ac700 1 --2- 172.21.15.77:0/3963095304 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe58815db20 0x7fe5880ca520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:05.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.597+0000 7fe58d3ac700 1 -- 172.21.15.77:0/3963095304 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5840094b0 con 0x7fe5880d2fc0 2023-07-24T05:47:05.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.597+0000 7fe58d3ac700 1 --2- 172.21.15.77:0/3963095304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5880d2fc0 0x7fe588150e50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe57800c4e0 tx=0x7fe57800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:05.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.601+0000 7fe57e7fc700 1 -- 172.21.15.77:0/3963095304 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe578004ca0 con 0x7fe5880d2fc0 2023-07-24T05:47:05.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.601+0000 7fe57e7fc700 1 -- 172.21.15.77:0/3963095304 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe578004e20 con 0x7fe5880d2fc0 2023-07-24T05:47:05.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.601+0000 7fe58fe11700 1 -- 172.21.15.77:0/3963095304 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5880d0c00 con 0x7fe5880d2fc0 2023-07-24T05:47:05.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.601+0000 7fe57e7fc700 1 -- 172.21.15.77:0/3963095304 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe578007310 con 0x7fe5880d2fc0 2023-07-24T05:47:05.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.601+0000 7fe58fe11700 1 -- 172.21.15.77:0/3963095304 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5880d11c0 con 0x7fe5880d2fc0 2023-07-24T05:47:05.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.601+0000 7fe58fe11700 1 -- 172.21.15.77:0/3963095304 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5880b3a30 con 0x7fe5880d2fc0 2023-07-24T05:47:05.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.601+0000 7fe57e7fc700 1 -- 172.21.15.77:0/3963095304 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe578007470 con 0x7fe5880d2fc0 2023-07-24T05:47:05.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.605+0000 7fe57e7fc700 1 --2- 172.21.15.77:0/3963095304 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe56c0662f0 0x7fe56c0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:05.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.605+0000 7fe57e7fc700 1 -- 172.21.15.77:0/3963095304 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe578083bc0 con 0x7fe5880d2fc0 2023-07-24T05:47:05.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.605+0000 7fe58dbad700 1 --2- 172.21.15.77:0/3963095304 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe56c0662f0 0x7fe56c0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:05.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.605+0000 7fe58dbad700 1 --2- 172.21.15.77:0/3963095304 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe56c0662f0 0x7fe56c0687b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe5840090b0 tx=0x7fe584008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:05.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.609+0000 7fe57e7fc700 1 -- 172.21.15.77:0/3963095304 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe578050da0 con 0x7fe5880d2fc0 2023-07-24T05:47:05.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.777+0000 7fe58fe11700 1 -- 172.21.15.77:0/3963095304 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe58804df10 con 0x7fe5880d2fc0 2023-07-24T05:47:05.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.777+0000 7fe57e7fc700 1 -- 172.21.15.77:0/3963095304 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe578007720 con 0x7fe5880d2fc0 2023-07-24T05:47:05.784 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-07-24T05:47:05.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.781+0000 7fe58fe11700 1 -- 172.21.15.77:0/3963095304 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe56c0662f0 msgr2=0x7fe56c0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:05.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.781+0000 7fe58fe11700 1 --2- 172.21.15.77:0/3963095304 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe56c0662f0 0x7fe56c0687b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe5840090b0 tx=0x7fe584008030 comp rx=0 tx=0).stop 2023-07-24T05:47:05.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.781+0000 7fe58fe11700 1 -- 172.21.15.77:0/3963095304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5880d2fc0 msgr2=0x7fe588150e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:05.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.781+0000 7fe58fe11700 1 --2- 172.21.15.77:0/3963095304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5880d2fc0 0x7fe588150e50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe57800c4e0 tx=0x7fe57800c7f0 comp rx=0 tx=0).stop 2023-07-24T05:47:05.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.781+0000 7fe58fe11700 1 -- 172.21.15.77:0/3963095304 shutdown_connections 2023-07-24T05:47:05.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.781+0000 7fe58fe11700 1 --2- 172.21.15.77:0/3963095304 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe58815db20 0x7fe5880ca520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:05.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.781+0000 7fe58fe11700 1 --2- 172.21.15.77:0/3963095304 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe5880d2fc0 0x7fe588150e50 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:05.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.781+0000 7fe58fe11700 1 --2- 172.21.15.77:0/3963095304 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe56c0662f0 0x7fe56c0687b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:05.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.781+0000 7fe58fe11700 1 --2- 172.21.15.77:0/3963095304 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe58806afc0 0x7fe5881f5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:05.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.781+0000 7fe58fe11700 1 -- 172.21.15.77:0/3963095304 >> 172.21.15.77:0/3963095304 conn(0x7fe58809bc20 msgr2=0x7fe58815f480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:05.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.781+0000 7fe58fe11700 1 -- 172.21.15.77:0/3963095304 shutdown_connections 2023-07-24T05:47:05.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.781+0000 7fe58fe11700 1 -- 172.21.15.77:0/3963095304 wait complete. 2023-07-24T05:47:05.816 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-07-24T05:47:05.817 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-07-24T05:47:05.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.981+0000 7fddd24f4700 1 Processor -- start 2023-07-24T05:47:05.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.981+0000 7fddd24f4700 1 -- start start 2023-07-24T05:47:05.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.985+0000 7fddd24f4700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fddcc160d20 0x7fddcc0adba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:05.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.985+0000 7fddd24f4700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddcc0af170 con 0x7fddcc0b17a0 2023-07-24T05:47:05.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.985+0000 7fddd24f4700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddcc0ae5f0 con 0x7fddcc0ae0e0 2023-07-24T05:47:05.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.985+0000 7fddd24f4700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc0ae8d0 con 0x7fddcc160d20 2023-07-24T05:47:05.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.985+0000 7fddd1cf3700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fddcc0b17a0 0x7fddcc0af700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55188/0 (socket says 172.21.15.77:55188) 2023-07-24T05:47:05.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.985+0000 7fddd1cf3700 1 -- 172.21.15.77:0/2395015300 learned_addr learned my addr 172.21.15.77:0/2395015300 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:05.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.985+0000 7fddd14f2700 1 --2- 172.21.15.77:0/2395015300 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fddcc160d20 0x7fddcc0adba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:05.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.985+0000 7fddc3fff700 1 -- 172.21.15.77:0/2395015300 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3998444997 0 0) 0x7fddcc0af170 con 0x7fddcc0b17a0 2023-07-24T05:47:05.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.985+0000 7fddc3fff700 1 -- 172.21.15.77:0/2395015300 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddb80035d0 con 0x7fddcc0b17a0 2023-07-24T05:47:05.991 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.985+0000 7fddc3fff700 1 -- 172.21.15.77:0/2395015300 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1967051609 0 0) 0x7fddcc0ae5f0 con 0x7fddcc0ae0e0 2023-07-24T05:47:05.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.985+0000 7fddc3fff700 1 -- 172.21.15.77:0/2395015300 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddcc0af170 con 0x7fddcc0ae0e0 2023-07-24T05:47:05.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.985+0000 7fddd14f2700 1 -- 172.21.15.77:0/2395015300 >> v1:172.21.15.103:6789/0 conn(0x7fddcc0ae0e0 legacy=0x7fddcc0b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:05.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.985+0000 7fddd14f2700 1 -- 172.21.15.77:0/2395015300 >> v1:172.21.15.77:6789/0 conn(0x7fddcc0b17a0 legacy=0x7fddcc0af700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:05.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.985+0000 7fddd14f2700 1 -- 172.21.15.77:0/2395015300 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddcc0aebb0 con 0x7fddcc160d20 2023-07-24T05:47:05.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.985+0000 7fddd14f2700 1 --2- 172.21.15.77:0/2395015300 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fddcc160d20 0x7fddcc0adba0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fddc8009880 tx=0x7fddc8009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f902e65076b59654 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:05.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.985+0000 7fddc3fff700 1 -- 172.21.15.77:0/2395015300 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc8011830 con 0x7fddcc160d20 2023-07-24T05:47:05.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.985+0000 7fddc3fff700 1 -- 172.21.15.77:0/2395015300 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc8011990 con 0x7fddcc160d20 2023-07-24T05:47:05.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.985+0000 7fddc3fff700 1 -- 172.21.15.77:0/2395015300 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc8011d20 con 0x7fddcc160d20 2023-07-24T05:47:05.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.989+0000 7fddd24f4700 1 -- 172.21.15.77:0/2395015300 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fddcc160d20 msgr2=0x7fddcc0adba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:05.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.989+0000 7fddd24f4700 1 --2- 172.21.15.77:0/2395015300 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fddcc160d20 0x7fddcc0adba0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fddc8009880 tx=0x7fddc8009b90 comp rx=0 tx=0).stop 2023-07-24T05:47:05.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.989+0000 7fddd24f4700 1 -- 172.21.15.77:0/2395015300 shutdown_connections 2023-07-24T05:47:05.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.989+0000 7fddd24f4700 1 --2- 172.21.15.77:0/2395015300 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fddcc160d20 0x7fddcc0adba0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:05.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.989+0000 7fddd24f4700 1 -- 172.21.15.77:0/2395015300 >> 172.21.15.77:0/2395015300 conn(0x7fddcc0cacc0 msgr2=0x7fddcc0cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:05.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.989+0000 7fddd24f4700 1 -- 172.21.15.77:0/2395015300 shutdown_connections 2023-07-24T05:47:05.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.989+0000 7fddd24f4700 1 -- 172.21.15.77:0/2395015300 wait complete. 2023-07-24T05:47:05.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.989+0000 7fddd24f4700 1 Processor -- start 2023-07-24T05:47:05.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.989+0000 7fddd24f4700 1 -- start start 2023-07-24T05:47:05.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.993+0000 7fddd24f4700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddcc0ae0e0 0x7fddcc099e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:05.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.993+0000 7fddd24f4700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fddcc0b17a0 0x7fddcc0c2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:05.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.993+0000 7fddd24f4700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddcc160d20 0x7fddcc06bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:05.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.993+0000 7fddd24f4700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc09a350 con 0x7fddcc160d20 2023-07-24T05:47:05.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.993+0000 7fddd24f4700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc162150 con 0x7fddcc0ae0e0 2023-07-24T05:47:05.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.993+0000 7fddd24f4700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddcc15fd50 con 0x7fddcc0b17a0 2023-07-24T05:47:05.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.993+0000 7fddd1cf3700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddcc160d20 0x7fddcc06bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:05.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.993+0000 7fddd1cf3700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddcc160d20 0x7fddcc06bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35066/0 (socket says 172.21.15.77:35066) 2023-07-24T05:47:05.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.993+0000 7fddd1cf3700 1 -- 172.21.15.77:0/3999647379 learned_addr learned my addr 172.21.15.77:0/3999647379 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:06.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.993+0000 7fddd0cf1700 1 --2- 172.21.15.77:0/3999647379 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fddcc0b17a0 0x7fddcc0c2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:06.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.993+0000 7fddd14f2700 1 --2- 172.21.15.77:0/3999647379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddcc0ae0e0 0x7fddcc099e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:06.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.993+0000 7fddd1cf3700 1 -- 172.21.15.77:0/3999647379 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fddcc0b17a0 msgr2=0x7fddcc0c2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:06.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.993+0000 7fddd1cf3700 1 --2- 172.21.15.77:0/3999647379 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fddcc0b17a0 0x7fddcc0c2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:06.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.993+0000 7fddd1cf3700 1 -- 172.21.15.77:0/3999647379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddcc0ae0e0 msgr2=0x7fddcc099e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:06.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.993+0000 7fddd1cf3700 1 --2- 172.21.15.77:0/3999647379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddcc0ae0e0 0x7fddcc099e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:06.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.993+0000 7fddd1cf3700 1 -- 172.21.15.77:0/3999647379 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc80094b0 con 0x7fddcc160d20 2023-07-24T05:47:06.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.993+0000 7fddd1cf3700 1 --2- 172.21.15.77:0/3999647379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddcc160d20 0x7fddcc06bb60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fddc400cba0 tx=0x7fddc400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:06.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.993+0000 7fddc1ffb700 1 -- 172.21.15.77:0/3999647379 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc400a7e0 con 0x7fddcc160d20 2023-07-24T05:47:06.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.993+0000 7fddc1ffb700 1 -- 172.21.15.77:0/3999647379 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc400a940 con 0x7fddcc160d20 2023-07-24T05:47:06.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.993+0000 7fddc1ffb700 1 -- 172.21.15.77:0/3999647379 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc400acd0 con 0x7fddcc160d20 2023-07-24T05:47:06.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.993+0000 7fddd24f4700 1 -- 172.21.15.77:0/3999647379 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddcc0c2780 con 0x7fddcc160d20 2023-07-24T05:47:06.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.993+0000 7fddd24f4700 1 -- 172.21.15.77:0/3999647379 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddcc0c2c90 con 0x7fddcc160d20 2023-07-24T05:47:06.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.997+0000 7fddd24f4700 1 -- 172.21.15.77:0/3999647379 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddcc1622c0 con 0x7fddcc160d20 2023-07-24T05:47:06.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.997+0000 7fddc1ffb700 1 -- 172.21.15.77:0/3999647379 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fddc401b3b0 con 0x7fddcc160d20 2023-07-24T05:47:06.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:05.997+0000 7fddc1ffb700 1 --2- 172.21.15.77:0/3999647379 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fddb00662f0 0x7fddb00687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:06.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.001+0000 7fddc1ffb700 1 -- 172.21.15.77:0/3999647379 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fddc4083b30 con 0x7fddcc160d20 2023-07-24T05:47:06.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.001+0000 7fddd14f2700 1 --2- 172.21.15.77:0/3999647379 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fddb00662f0 0x7fddb00687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:06.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.001+0000 7fddd14f2700 1 --2- 172.21.15.77:0/3999647379 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fddb00662f0 0x7fddb00687b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fddc80090b0 tx=0x7fddc801c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:06.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.005+0000 7fddc1ffb700 1 -- 172.21.15.77:0/3999647379 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fddcc1622c0 con 0x7fddcc160d20 2023-07-24T05:47:06.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.233+0000 7fddd24f4700 1 -- 172.21.15.77:0/3999647379 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7fddcc1622c0 con 0x7fddcc160d20 2023-07-24T05:47:06.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.689+0000 7fddc1ffb700 1 -- 172.21.15.77:0/3999647379 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v79) v1 ==== 147+0+0 (secure 0 0 0) 0x7fddcc1622c0 con 0x7fddcc160d20 2023-07-24T05:47:06.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.693+0000 7fddd24f4700 1 -- 172.21.15.77:0/3999647379 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fddb00662f0 msgr2=0x7fddb00687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:06.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.693+0000 7fddd24f4700 1 --2- 172.21.15.77:0/3999647379 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fddb00662f0 0x7fddb00687b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fddc80090b0 tx=0x7fddc801c040 comp rx=0 tx=0).stop 2023-07-24T05:47:06.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.693+0000 7fddd24f4700 1 -- 172.21.15.77:0/3999647379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddcc160d20 msgr2=0x7fddcc06bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:06.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.693+0000 7fddd24f4700 1 --2- 172.21.15.77:0/3999647379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddcc160d20 0x7fddcc06bb60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fddc400cba0 tx=0x7fddc400cc80 comp rx=0 tx=0).stop 2023-07-24T05:47:06.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.693+0000 7fddd24f4700 1 -- 172.21.15.77:0/3999647379 shutdown_connections 2023-07-24T05:47:06.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.693+0000 7fddd24f4700 1 --2- 172.21.15.77:0/3999647379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fddcc160d20 0x7fddcc06bb60 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:06.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.693+0000 7fddd24f4700 1 --2- 172.21.15.77:0/3999647379 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fddb00662f0 0x7fddb00687b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:06.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.693+0000 7fddd24f4700 1 --2- 172.21.15.77:0/3999647379 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fddcc0b17a0 0x7fddcc0c2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:06.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.693+0000 7fddd24f4700 1 --2- 172.21.15.77:0/3999647379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fddcc0ae0e0 0x7fddcc099e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:06.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.693+0000 7fddd24f4700 1 -- 172.21.15.77:0/3999647379 >> 172.21.15.77:0/3999647379 conn(0x7fddcc0cacc0 msgr2=0x7fddcc06cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:06.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.693+0000 7fddd24f4700 1 -- 172.21.15.77:0/3999647379 shutdown_connections 2023-07-24T05:47:06.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.693+0000 7fddd24f4700 1 -- 172.21.15.77:0/3999647379 wait complete. 2023-07-24T05:47:06.720 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-24T05:47:06.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.889+0000 7f01e1c16700 1 Processor -- start 2023-07-24T05:47:06.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.889+0000 7f01e1c16700 1 -- start start 2023-07-24T05:47:06.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.889+0000 7f01e1c16700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f01dc0a4580 0x7f01dc06fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:06.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.889+0000 7f01e1c16700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01dc069b10 0x7f01dc069fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:06.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.889+0000 7f01e1c16700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01dc0adc40 con 0x7f01dc0b13c0 2023-07-24T05:47:06.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.889+0000 7f01e1c16700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01dc06a4e0 con 0x7f01dc0a4580 2023-07-24T05:47:06.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.889+0000 7f01e1c16700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01dc0adee0 con 0x7f01dc069b10 2023-07-24T05:47:06.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.889+0000 7f01e0c14700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f01dc0b13c0 0x7f01dc06adf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55198/0 (socket says 172.21.15.77:55198) 2023-07-24T05:47:06.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.889+0000 7f01e0c14700 1 -- 172.21.15.77:0/1888451251 learned_addr learned my addr 172.21.15.77:0/1888451251 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:06.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.889+0000 7f01dbfff700 1 --2- 172.21.15.77:0/1888451251 >> v2:172.21.15.77:3300/0 conn(0x7f01dc0a4580 0x7f01dc06fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:06.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.889+0000 7f01e1415700 1 --2- 172.21.15.77:0/1888451251 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01dc069b10 0x7f01dc069fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:06.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.893+0000 7f01dbfff700 1 -- 172.21.15.77:0/1888451251 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01dc069b10 msgr2=0x7f01dc069fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:06.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.893+0000 7f01dbfff700 1 --2- 172.21.15.77:0/1888451251 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01dc069b10 0x7f01dc069fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:06.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.893+0000 7f01db7fe700 1 -- 172.21.15.77:0/1888451251 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3252707865 0 0) 0x7f01dc0adc40 con 0x7f01dc0b13c0 2023-07-24T05:47:06.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.893+0000 7f01dbfff700 1 -- 172.21.15.77:0/1888451251 >> v1:172.21.15.77:6789/0 conn(0x7f01dc0b13c0 legacy=0x7f01dc06adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:06.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.893+0000 7f01dbfff700 1 -- 172.21.15.77:0/1888451251 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01dc0ae1c0 con 0x7f01dc0a4580 2023-07-24T05:47:06.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.893+0000 7f01dbfff700 1 --2- 172.21.15.77:0/1888451251 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01dc0a4580 0x7f01dc06fbe0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f01cc009850 tx=0x7f01cc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cb0899c21754902 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:06.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.893+0000 7f01db7fe700 1 -- 172.21.15.77:0/1888451251 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc011830 con 0x7f01dc0a4580 2023-07-24T05:47:06.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.893+0000 7f01db7fe700 1 -- 172.21.15.77:0/1888451251 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01cc011990 con 0x7f01dc0a4580 2023-07-24T05:47:06.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.893+0000 7f01db7fe700 1 -- 172.21.15.77:0/1888451251 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01cc011d40 con 0x7f01dc0a4580 2023-07-24T05:47:06.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.893+0000 7f01e1c16700 1 -- 172.21.15.77:0/1888451251 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01dc0a4580 msgr2=0x7f01dc06fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:06.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.893+0000 7f01e1c16700 1 --2- 172.21.15.77:0/1888451251 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01dc0a4580 0x7f01dc06fbe0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f01cc009850 tx=0x7f01cc009b60 comp rx=0 tx=0).stop 2023-07-24T05:47:06.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.893+0000 7f01e1c16700 1 -- 172.21.15.77:0/1888451251 shutdown_connections 2023-07-24T05:47:06.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.893+0000 7f01e1c16700 1 --2- 172.21.15.77:0/1888451251 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01dc069b10 0x7f01dc069fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:06.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.893+0000 7f01e1c16700 1 --2- 172.21.15.77:0/1888451251 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01dc0a4580 0x7f01dc06fbe0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:06.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.893+0000 7f01e1c16700 1 -- 172.21.15.77:0/1888451251 >> 172.21.15.77:0/1888451251 conn(0x7f01dc0cacc0 msgr2=0x7f01dc0cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:06.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.893+0000 7f01e1c16700 1 -- 172.21.15.77:0/1888451251 shutdown_connections 2023-07-24T05:47:06.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.893+0000 7f01e1c16700 1 -- 172.21.15.77:0/1888451251 wait complete. 2023-07-24T05:47:06.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.897+0000 7f01e1c16700 1 Processor -- start 2023-07-24T05:47:06.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.897+0000 7f01e1c16700 1 -- start start 2023-07-24T05:47:06.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.897+0000 7f01e1c16700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01dc069b10 0x7f01dc0cd690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:06.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.897+0000 7f01e1c16700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01dc0a4580 0x7f01dc158a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:06.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.897+0000 7f01e1c16700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01dc0b13c0 0x7f01dc1f2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:06.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.897+0000 7f01e1c16700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01dc0cbe10 con 0x7f01dc0b13c0 2023-07-24T05:47:06.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.897+0000 7f01e1c16700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01dc158fd0 con 0x7f01dc069b10 2023-07-24T05:47:06.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.897+0000 7f01e1c16700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01dc1f3350 con 0x7f01dc0a4580 2023-07-24T05:47:06.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.897+0000 7f01e1415700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01dc0b13c0 0x7f01dc1f2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:06.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.897+0000 7f01e1415700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01dc0b13c0 0x7f01dc1f2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35080/0 (socket says 172.21.15.77:35080) 2023-07-24T05:47:06.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.897+0000 7f01e1415700 1 -- 172.21.15.77:0/966921526 learned_addr learned my addr 172.21.15.77:0/966921526 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:06.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.897+0000 7f01dbfff700 1 --2- 172.21.15.77:0/966921526 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01dc0a4580 0x7f01dc158a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:06.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.897+0000 7f01e0c14700 1 --2- 172.21.15.77:0/966921526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01dc069b10 0x7f01dc0cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:06.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.897+0000 7f01e1415700 1 -- 172.21.15.77:0/966921526 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01dc0a4580 msgr2=0x7f01dc158a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:06.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.897+0000 7f01e1415700 1 --2- 172.21.15.77:0/966921526 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01dc0a4580 0x7f01dc158a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:06.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.897+0000 7f01e1415700 1 -- 172.21.15.77:0/966921526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01dc069b10 msgr2=0x7f01dc0cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:06.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.897+0000 7f01e1415700 1 --2- 172.21.15.77:0/966921526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01dc069b10 0x7f01dc0cd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:06.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.897+0000 7f01e1415700 1 -- 172.21.15.77:0/966921526 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01cc0094b0 con 0x7f01dc0b13c0 2023-07-24T05:47:06.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.897+0000 7f01dbfff700 1 --2- 172.21.15.77:0/966921526 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01dc0a4580 0x7f01dc158a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:06.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.901+0000 7f01e1415700 1 --2- 172.21.15.77:0/966921526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01dc0b13c0 0x7f01dc1f2e10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f01c400e820 tx=0x7f01c400ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:06.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.901+0000 7f01d97fa700 1 -- 172.21.15.77:0/966921526 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c40095c0 con 0x7f01dc0b13c0 2023-07-24T05:47:06.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.901+0000 7f01d97fa700 1 -- 172.21.15.77:0/966921526 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c4013680 con 0x7f01dc0b13c0 2023-07-24T05:47:06.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.901+0000 7f01d97fa700 1 -- 172.21.15.77:0/966921526 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c4013a10 con 0x7f01dc0b13c0 2023-07-24T05:47:06.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.901+0000 7f01e1c16700 1 -- 172.21.15.77:0/966921526 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01dc0cdc70 con 0x7f01dc0b13c0 2023-07-24T05:47:06.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.901+0000 7f01e1c16700 1 -- 172.21.15.77:0/966921526 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01dc0cc340 con 0x7f01dc0b13c0 2023-07-24T05:47:06.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.901+0000 7f01e1c16700 1 -- 172.21.15.77:0/966921526 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01dc072490 con 0x7f01dc0b13c0 2023-07-24T05:47:06.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.901+0000 7f01d97fa700 1 -- 172.21.15.77:0/966921526 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f01c4013b70 con 0x7f01dc0b13c0 2023-07-24T05:47:06.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.905+0000 7f01d97fa700 1 --2- 172.21.15.77:0/966921526 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f01bc0662f0 0x7f01bc0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:06.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.905+0000 7f01d97fa700 1 -- 172.21.15.77:0/966921526 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f01c4083ff0 con 0x7f01dc0b13c0 2023-07-24T05:47:06.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.905+0000 7f01e0c14700 1 --2- 172.21.15.77:0/966921526 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f01bc0662f0 0x7f01bc0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:06.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.905+0000 7f01e0c14700 1 --2- 172.21.15.77:0/966921526 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f01bc0662f0 0x7f01bc0687b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f01d40012e0 tx=0x7f01d4001970 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:06.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:06.909+0000 7f01d97fa700 1 -- 172.21.15.77:0/966921526 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f01c4054bc0 con 0x7f01dc0b13c0 2023-07-24T05:47:07.089 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.085+0000 7f01e1c16700 1 -- 172.21.15.77:0/966921526 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01dc06d960 con 0x7f01dc0b13c0 2023-07-24T05:47:07.092 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.085+0000 7f01d97fa700 1 -- 172.21.15.77:0/966921526 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20204 (secure 0 0 0) 0x7f01c4021090 con 0x7f01dc0b13c0 2023-07-24T05:47:07.093 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:47:07.093 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":27,"fsid":"5aed5f7b-fb55-4d95-9c02-c6adbb1677b4","created":"2023-07-24T05:45:39.639731+0000","modified":"2023-07-24T05:46:48.442117+0000","last_up_change":"2023-07-24T05:45:52.319670+0000","last_in_change":"2023-07-24T05:45:43.643277+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-24T05:45:52.610430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-24T05:45:52.773787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-24T05:45:58.121732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-24T05:45:59.368726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-24T05:46:03.032057+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ffa0d496-461a-4053-b764-0627d969521b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6812","nonce":825987196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6817","nonce":825987196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6831","nonce":825987196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6824","nonce":825987196}]},"public_addr":"172.21.15.77:6812/825987196","cluster_addr":"172.21.15.77:6817/825987196","heartbeat_back_addr":"172.21.15.77:6831/825987196","heartbeat_front_addr":"172.21.15.77:6824/825987196","state":["exists","up"]},{"osd":1,"uuid":"9f595e5e-5c43-49bc-8ce4-ee70575c90da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6801","nonce":4133026815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6803","nonce":4133026815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6807","nonce":4133026815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6805","nonce":4133026815}]},"public_addr":"172.21.15.77:6801/4133026815","cluster_addr":"172.21.15.77:6803/4133026815","heartbeat_back_addr":"172.21.15.77:6807/4133026815","heartbeat_front_addr":"172.21.15.77:6805/4133026815","state":["exists","up"]},{"osd":2,"uuid":"2ac177aa-4d7d-4262-bd54-d2b9f29f4c3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6811","nonce":2394142159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6819","nonce":2394142159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6830","nonce":2394142159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6825","nonce":2394142159}]},"public_addr":"172.21.15.77:6811/2394142159","cluster_addr":"172.21.15.77:6819/2394142159","heartbeat_back_addr":"172.21.15.77:6830/2394142159","heartbeat_front_addr":"172.21.15.77:6825/2394142159","state":["exists","up"]},{"osd":3,"uuid":"17d7a251-19e8-484c-8172-a578ab3da153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6813","nonce":1492113982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6818","nonce":1492113982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6829","nonce":1492113982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6823","nonce":1492113982}]},"public_addr":"172.21.15.77:6813/1492113982","cluster_addr":"172.21.15.77:6818/1492113982","heartbeat_back_addr":"172.21.15.77:6829/1492113982","heartbeat_front_addr":"172.21.15.77:6823/1492113982","state":["exists","up"]},{"osd":4,"uuid":"bf63ca05-f06d-4e0f-ac44-2a416c70b919","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6825","nonce":1080481057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6827","nonce":1080481057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6831","nonce":1080481057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6829","nonce":1080481057}]},"public_addr":"172.21.15.103:6825/1080481057","cluster_addr":"172.21.15.103:6827/1080481057","heartbeat_back_addr":"172.21.15.103:6831/1080481057","heartbeat_front_addr":"172.21.15.103:6829/1080481057","state":["exists","up"]},{"osd":5,"uuid":"65a11a35-9e9f-4b3c-9fe3-b658d62b9318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6811","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6813","nonce":2756677504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6818","nonce":2756677504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6823","nonce":2756677504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6821","nonce":2756677504}]},"public_addr":"172.21.15.103:6813/2756677504","cluster_addr":"172.21.15.103:6818/2756677504","heartbeat_back_addr":"172.21.15.103:6823/2756677504","heartbeat_front_addr":"172.21.15.103:6821/2756677504","state":["exists","up"]},{"osd":6,"uuid":"750c1f87-686c-40b4-94a1-1a299dc78f3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6809","nonce":568977764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6812","nonce":568977764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6819","nonce":568977764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6815","nonce":568977764}]},"public_addr":"172.21.15.103:6809/568977764","cluster_addr":"172.21.15.103:6812/568977764","heartbeat_back_addr":"172.21.15.103:6819/568977764","heartbeat_front_addr":"172.21.15.103:6815/568977764","state":["exists","up"]},{"osd":7,"uuid":"d5fe4fb6-2e09-4158-885b-403803c85822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6801","nonce":1074557176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6803","nonce":1074557176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6807","nonce":1074557176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6805","nonce":1074557176}]},"public_addr":"172.21.15.103:6801/1074557176","cluster_addr":"172.21.15.103:6803/1074557176","heartbeat_back_addr":"172.21.15.103:6807/1074557176","heartbeat_front_addr":"172.21.15.103:6805/1074557176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.631032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.154109+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.398587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.679089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.311218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.353726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.314372+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.126212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1d","mappings":[{"from":3,"to":2}]},{"pgid":"4.31","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-24T05:47:07.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.089+0000 7f01e1c16700 1 -- 172.21.15.77:0/966921526 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f01bc0662f0 msgr2=0x7f01bc0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:07.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.089+0000 7f01e1c16700 1 --2- 172.21.15.77:0/966921526 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f01bc0662f0 0x7f01bc0687b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f01d40012e0 tx=0x7f01d4001970 comp rx=0 tx=0).stop 2023-07-24T05:47:07.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.089+0000 7f01e1c16700 1 -- 172.21.15.77:0/966921526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01dc0b13c0 msgr2=0x7f01dc1f2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:07.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.089+0000 7f01e1c16700 1 --2- 172.21.15.77:0/966921526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01dc0b13c0 0x7f01dc1f2e10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f01c400e820 tx=0x7f01c400ebe0 comp rx=0 tx=0).stop 2023-07-24T05:47:07.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.093+0000 7f01e1c16700 1 -- 172.21.15.77:0/966921526 shutdown_connections 2023-07-24T05:47:07.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.093+0000 7f01e1c16700 1 --2- 172.21.15.77:0/966921526 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01dc0b13c0 0x7f01dc1f2e10 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:07.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.093+0000 7f01e1c16700 1 --2- 172.21.15.77:0/966921526 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f01bc0662f0 0x7f01bc0687b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:07.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.093+0000 7f01e1c16700 1 --2- 172.21.15.77:0/966921526 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f01dc0a4580 0x7f01dc158a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:07.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.093+0000 7f01e1c16700 1 --2- 172.21.15.77:0/966921526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f01dc069b10 0x7f01dc0cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:07.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.093+0000 7f01e1c16700 1 -- 172.21.15.77:0/966921526 >> 172.21.15.77:0/966921526 conn(0x7f01dc0cacc0 msgr2=0x7f01dc06fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:07.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.093+0000 7f01e1c16700 1 -- 172.21.15.77:0/966921526 shutdown_connections 2023-07-24T05:47:07.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.093+0000 7f01e1c16700 1 -- 172.21.15.77:0/966921526 wait complete. 2023-07-24T05:47:07.121 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-24T05:45:52.610430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-24T05:45:52.773787+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-24T05:45:58.121732+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-24T05:45:59.368726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-24T05:46:03.032057+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-24T05:47:07.122 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-24T05:47:07.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.289+0000 7f97012b5700 1 Processor -- start 2023-07-24T05:47:07.297 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.289+0000 7f97012b5700 1 -- start start 2023-07-24T05:47:07.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.293+0000 7f97012b5700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f96fc06afc0 0x7f96fc0b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:07.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.293+0000 7f97012b5700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f96fc15db20 0x7f96fc0d28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:07.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.293+0000 7f97012b5700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96fc160fa0 con 0x7f96fc0d2df0 2023-07-24T05:47:07.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.293+0000 7f97012b5700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96fc0d3280 con 0x7f96fc15db20 2023-07-24T05:47:07.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.293+0000 7f97012b5700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96fc0d0360 con 0x7f96fc06afc0 2023-07-24T05:47:07.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.293+0000 7f96fb7fe700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f96fc0d2df0 0x7f96fc0d1520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55208/0 (socket says 172.21.15.77:55208) 2023-07-24T05:47:07.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.293+0000 7f96fb7fe700 1 -- 172.21.15.77:0/3339159846 learned_addr learned my addr 172.21.15.77:0/3339159846 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:07.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.293+0000 7f96f3fff700 1 --2- 172.21.15.77:0/3339159846 >> v2:172.21.15.77:3300/0 conn(0x7f96fc15db20 0x7f96fc0d28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:07.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.293+0000 7f96faffd700 1 --2- 172.21.15.77:0/3339159846 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f96fc06afc0 0x7f96fc0b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:07.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.293+0000 7f96fa7fc700 1 -- 172.21.15.77:0/3339159846 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3751207821 0 0) 0x7f96fc160fa0 con 0x7f96fc0d2df0 2023-07-24T05:47:07.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.293+0000 7f96fa7fc700 1 -- 172.21.15.77:0/3339159846 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96e80035d0 con 0x7f96fc0d2df0 2023-07-24T05:47:07.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.293+0000 7f96f3fff700 1 -- 172.21.15.77:0/3339159846 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f96fc06afc0 msgr2=0x7f96fc0b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:07.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.293+0000 7f96f3fff700 1 --2- 172.21.15.77:0/3339159846 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f96fc06afc0 0x7f96fc0b1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:07.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.293+0000 7f96f3fff700 1 -- 172.21.15.77:0/3339159846 >> v1:172.21.15.77:6789/0 conn(0x7f96fc0d2df0 legacy=0x7f96fc0d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:07.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.293+0000 7f96f3fff700 1 -- 172.21.15.77:0/3339159846 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96fc0b20b0 con 0x7f96fc15db20 2023-07-24T05:47:07.301 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.293+0000 7f96f3fff700 1 --2- 172.21.15.77:0/3339159846 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96fc15db20 0x7f96fc0d28b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f96e4009850 tx=0x7f96e4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97b1962b39301238 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:07.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.297+0000 7f96fa7fc700 1 -- 172.21.15.77:0/3339159846 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e4011830 con 0x7f96fc15db20 2023-07-24T05:47:07.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.297+0000 7f96fa7fc700 1 -- 172.21.15.77:0/3339159846 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e4011990 con 0x7f96fc15db20 2023-07-24T05:47:07.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.297+0000 7f96fa7fc700 1 -- 172.21.15.77:0/3339159846 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e4011d40 con 0x7f96fc15db20 2023-07-24T05:47:07.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.297+0000 7f97012b5700 1 -- 172.21.15.77:0/3339159846 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96fc15db20 msgr2=0x7f96fc0d28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:07.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.297+0000 7f97012b5700 1 --2- 172.21.15.77:0/3339159846 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96fc15db20 0x7f96fc0d28b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f96e4009850 tx=0x7f96e4009b60 comp rx=0 tx=0).stop 2023-07-24T05:47:07.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.297+0000 7f97012b5700 1 -- 172.21.15.77:0/3339159846 shutdown_connections 2023-07-24T05:47:07.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.297+0000 7f97012b5700 1 --2- 172.21.15.77:0/3339159846 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96fc15db20 0x7f96fc0d28b0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:07.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.297+0000 7f97012b5700 1 --2- 172.21.15.77:0/3339159846 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f96fc06afc0 0x7f96fc0b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:07.303 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.297+0000 7f97012b5700 1 -- 172.21.15.77:0/3339159846 >> 172.21.15.77:0/3339159846 conn(0x7f96fc09bc20 msgr2=0x7f96fc0b7920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:07.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.297+0000 7f97012b5700 1 -- 172.21.15.77:0/3339159846 shutdown_connections 2023-07-24T05:47:07.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.297+0000 7f97012b5700 1 -- 172.21.15.77:0/3339159846 wait complete. 2023-07-24T05:47:07.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.297+0000 7f97012b5700 1 Processor -- start 2023-07-24T05:47:07.304 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.297+0000 7f97012b5700 1 -- start start 2023-07-24T05:47:07.305 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.301+0000 7f97012b5700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96fc06afc0 0x7f96fc1568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:07.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.301+0000 7f97012b5700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96fc0d2df0 0x7f96fc0b4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:07.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.301+0000 7f97012b5700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f96fc15db20 0x7f96fc15f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:07.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.301+0000 7f97012b5700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96fc0b52e0 con 0x7f96fc06afc0 2023-07-24T05:47:07.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.301+0000 7f97012b5700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96fc0c65f0 con 0x7f96fc0d2df0 2023-07-24T05:47:07.306 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.301+0000 7f97012b5700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96fc0c68d0 con 0x7f96fc15db20 2023-07-24T05:47:07.307 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.301+0000 7f96faffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96fc06afc0 0x7f96fc1568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:07.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.301+0000 7f96faffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96fc06afc0 0x7f96fc1568b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35094/0 (socket says 172.21.15.77:35094) 2023-07-24T05:47:07.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.301+0000 7f96faffd700 1 -- 172.21.15.77:0/2069031140 learned_addr learned my addr 172.21.15.77:0/2069031140 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:07.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.301+0000 7f96fb7fe700 1 --2- 172.21.15.77:0/2069031140 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f96fc15db20 0x7f96fc15f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:07.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.301+0000 7f96f3fff700 1 --2- 172.21.15.77:0/2069031140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96fc0d2df0 0x7f96fc0b4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:07.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.301+0000 7f96faffd700 1 -- 172.21.15.77:0/2069031140 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f96fc15db20 msgr2=0x7f96fc15f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:07.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.301+0000 7f96faffd700 1 --2- 172.21.15.77:0/2069031140 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f96fc15db20 0x7f96fc15f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:07.308 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.301+0000 7f96faffd700 1 -- 172.21.15.77:0/2069031140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96fc0d2df0 msgr2=0x7f96fc0b4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:07.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.301+0000 7f96faffd700 1 --2- 172.21.15.77:0/2069031140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96fc0d2df0 0x7f96fc0b4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:07.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.301+0000 7f96faffd700 1 -- 172.21.15.77:0/2069031140 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e40094b0 con 0x7f96fc06afc0 2023-07-24T05:47:07.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.301+0000 7f96f3fff700 1 --2- 172.21.15.77:0/2069031140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96fc0d2df0 0x7f96fc0b4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:47:07.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.301+0000 7f96fb7fe700 1 --2- 172.21.15.77:0/2069031140 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f96fc15db20 0x7f96fc15f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:47:07.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.301+0000 7f96faffd700 1 --2- 172.21.15.77:0/2069031140 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96fc06afc0 0x7f96fc1568b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f96ec00e9d0 tx=0x7f96ec00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:07.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.301+0000 7f96f37fe700 1 -- 172.21.15.77:0/2069031140 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ec009720 con 0x7f96fc06afc0 2023-07-24T05:47:07.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.301+0000 7f96f37fe700 1 -- 172.21.15.77:0/2069031140 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96ec00c850 con 0x7f96fc06afc0 2023-07-24T05:47:07.309 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.301+0000 7f96f37fe700 1 -- 172.21.15.77:0/2069031140 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ec00cbc0 con 0x7f96fc06afc0 2023-07-24T05:47:07.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.301+0000 7f97012b5700 1 -- 172.21.15.77:0/2069031140 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96fc0b45a0 con 0x7f96fc06afc0 2023-07-24T05:47:07.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.301+0000 7f97012b5700 1 -- 172.21.15.77:0/2069031140 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96fc15f6d0 con 0x7f96fc06afc0 2023-07-24T05:47:07.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.305+0000 7f97012b5700 1 -- 172.21.15.77:0/2069031140 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96fc04df10 con 0x7f96fc06afc0 2023-07-24T05:47:07.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.305+0000 7f96f37fe700 1 -- 172.21.15.77:0/2069031140 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f96ec00cd20 con 0x7f96fc06afc0 2023-07-24T05:47:07.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.305+0000 7f96f37fe700 1 --2- 172.21.15.77:0/2069031140 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f96dc066320 0x7f96dc0687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:07.311 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.305+0000 7f96f37fe700 1 -- 172.21.15.77:0/2069031140 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f96ec084140 con 0x7f96fc06afc0 2023-07-24T05:47:07.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.305+0000 7f96f3fff700 1 --2- 172.21.15.77:0/2069031140 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f96dc066320 0x7f96dc0687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:07.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.309+0000 7f96f3fff700 1 --2- 172.21.15.77:0/2069031140 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f96dc066320 0x7f96dc0687e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f96fc157130 tx=0x7f96e4008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:07.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.313+0000 7f96f37fe700 1 -- 172.21.15.77:0/2069031140 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f96ec054d10 con 0x7f96fc06afc0 2023-07-24T05:47:07.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.485+0000 7f97012b5700 1 -- 172.21.15.77:0/2069031140 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f96fc0c6a40 con 0x7f96fc06afc0 2023-07-24T05:47:07.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.485+0000 7f96f37fe700 1 -- 172.21.15.77:0/2069031140 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f96ec0548a0 con 0x7f96fc06afc0 2023-07-24T05:47:07.491 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-07-24T05:47:07.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.489+0000 7f97012b5700 1 -- 172.21.15.77:0/2069031140 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f96dc066320 msgr2=0x7f96dc0687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:07.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.489+0000 7f97012b5700 1 --2- 172.21.15.77:0/2069031140 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f96dc066320 0x7f96dc0687e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f96fc157130 tx=0x7f96e4008030 comp rx=0 tx=0).stop 2023-07-24T05:47:07.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.489+0000 7f97012b5700 1 -- 172.21.15.77:0/2069031140 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96fc06afc0 msgr2=0x7f96fc1568b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:07.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.489+0000 7f97012b5700 1 --2- 172.21.15.77:0/2069031140 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96fc06afc0 0x7f96fc1568b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f96ec00e9d0 tx=0x7f96ec00ed90 comp rx=0 tx=0).stop 2023-07-24T05:47:07.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.489+0000 7f97012b5700 1 -- 172.21.15.77:0/2069031140 shutdown_connections 2023-07-24T05:47:07.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.489+0000 7f97012b5700 1 --2- 172.21.15.77:0/2069031140 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f96dc066320 0x7f96dc0687e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:07.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.489+0000 7f97012b5700 1 --2- 172.21.15.77:0/2069031140 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f96fc15db20 0x7f96fc15f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:07.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.489+0000 7f97012b5700 1 --2- 172.21.15.77:0/2069031140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96fc0d2df0 0x7f96fc0b4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:07.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.489+0000 7f97012b5700 1 --2- 172.21.15.77:0/2069031140 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96fc06afc0 0x7f96fc1568b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:07.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.489+0000 7f97012b5700 1 -- 172.21.15.77:0/2069031140 >> 172.21.15.77:0/2069031140 conn(0x7f96fc09bc20 msgr2=0x7f96fc0b7920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:07.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.489+0000 7f97012b5700 1 -- 172.21.15.77:0/2069031140 shutdown_connections 2023-07-24T05:47:07.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.489+0000 7f97012b5700 1 -- 172.21.15.77:0/2069031140 wait complete. 2023-07-24T05:47:07.516 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-24T05:47:07.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.689+0000 7f00d6ea2700 1 Processor -- start 2023-07-24T05:47:07.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.689+0000 7f00d6ea2700 1 -- start start 2023-07-24T05:47:07.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.693+0000 7f00d6ea2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f00d0158e80 0x7f00d015d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:07.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.693+0000 7f00d6ea2700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00d0071840 0x7f00d0069b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:07.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.693+0000 7f00d6ea2700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00d00704f0 con 0x7f00d00c9710 2023-07-24T05:47:07.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.693+0000 7f00d6ea2700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00d015da50 con 0x7f00d0158e80 2023-07-24T05:47:07.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.693+0000 7f00d6ea2700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d00c9bf0 con 0x7f00d0071840 2023-07-24T05:47:07.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.693+0000 7f00d543f700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00d0071840 0x7f00d0069b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:07.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.693+0000 7f00d4c3e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f00d0158e80 0x7f00d015d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:07.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.693+0000 7f00d4c3e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f00d0158e80 0x7f00d015d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:54722/0 (socket says 172.21.15.77:54722) 2023-07-24T05:47:07.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.693+0000 7f00d4c3e700 1 -- 172.21.15.77:0/1357500609 learned_addr learned my addr 172.21.15.77:0/1357500609 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:07.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.693+0000 7f00d543f700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00d0071840 0x7f00d0069b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.77:58772/0 (socket says 172.21.15.77:58772) 2023-07-24T05:47:07.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.693+0000 7f00cffff700 1 --1- 172.21.15.77:0/1357500609 >> v1:172.21.15.103:6789/0 conn(0x7f00d00c9710 0x7f00d0071130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.77:35088/0 (socket says 172.21.15.77:35088) 2023-07-24T05:47:07.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.693+0000 7f00d4c3e700 1 -- 172.21.15.77:0/1357500609 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00d0071840 msgr2=0x7f00d0069b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:07.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.693+0000 7f00d4c3e700 1 --2- 172.21.15.77:0/1357500609 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00d0071840 0x7f00d0069b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:07.700 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.693+0000 7f00d4c3e700 1 -- 172.21.15.77:0/1357500609 >> v1:172.21.15.103:6789/0 conn(0x7f00d00c9710 legacy=0x7f00d0071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:07.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.693+0000 7f00d4c3e700 1 -- 172.21.15.77:0/1357500609 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d00c9ed0 con 0x7f00d0158e80 2023-07-24T05:47:07.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.693+0000 7f00d4c3e700 1 --2- 172.21.15.77:0/1357500609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00d0158e80 0x7f00d015d510 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f00c4009910 tx=0x7f00c4009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c835245c90fb3617 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:07.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.697+0000 7f00cf7fe700 1 -- 172.21.15.77:0/1357500609 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c400f8a0 con 0x7f00d0158e80 2023-07-24T05:47:07.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.697+0000 7f00cf7fe700 1 -- 172.21.15.77:0/1357500609 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c400fa00 con 0x7f00d0158e80 2023-07-24T05:47:07.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.697+0000 7f00cf7fe700 1 -- 172.21.15.77:0/1357500609 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c400fdb0 con 0x7f00d0158e80 2023-07-24T05:47:07.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.697+0000 7f00d6ea2700 1 -- 172.21.15.77:0/1357500609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00d0158e80 msgr2=0x7f00d015d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:07.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.697+0000 7f00d6ea2700 1 --2- 172.21.15.77:0/1357500609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00d0158e80 0x7f00d015d510 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f00c4009910 tx=0x7f00c4009c20 comp rx=0 tx=0).stop 2023-07-24T05:47:07.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.697+0000 7f00d6ea2700 1 -- 172.21.15.77:0/1357500609 shutdown_connections 2023-07-24T05:47:07.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.697+0000 7f00d6ea2700 1 --2- 172.21.15.77:0/1357500609 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00d0071840 0x7f00d0069b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:07.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.697+0000 7f00d6ea2700 1 --2- 172.21.15.77:0/1357500609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00d0158e80 0x7f00d015d510 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:07.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.697+0000 7f00d6ea2700 1 -- 172.21.15.77:0/1357500609 >> 172.21.15.77:0/1357500609 conn(0x7f00d00ce890 msgr2=0x7f00d00cec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:07.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.697+0000 7f00d6ea2700 1 -- 172.21.15.77:0/1357500609 shutdown_connections 2023-07-24T05:47:07.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.697+0000 7f00d6ea2700 1 -- 172.21.15.77:0/1357500609 wait complete. 2023-07-24T05:47:07.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.701+0000 7f00d6ea2700 1 Processor -- start 2023-07-24T05:47:07.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.701+0000 7f00d6ea2700 1 -- start start 2023-07-24T05:47:07.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.701+0000 7f00d6ea2700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00d0071840 0x7f00d0157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:07.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.701+0000 7f00d6ea2700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00d00c9710 0x7f00d00c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:07.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.701+0000 7f00d6ea2700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00d0158e80 0x7f00d015a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:07.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.701+0000 7f00d6ea2700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d0157190 con 0x7f00d0158e80 2023-07-24T05:47:07.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.701+0000 7f00d6ea2700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d0157450 con 0x7f00d0071840 2023-07-24T05:47:07.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.701+0000 7f00d6ea2700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d0157730 con 0x7f00d00c9710 2023-07-24T05:47:07.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.705+0000 7f00d543f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00d0158e80 0x7f00d015a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:07.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.705+0000 7f00d4c3e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00d0071840 0x7f00d0157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:07.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.705+0000 7f00d543f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00d0158e80 0x7f00d015a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35096/0 (socket says 172.21.15.77:35096) 2023-07-24T05:47:07.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.705+0000 7f00d543f700 1 -- 172.21.15.77:0/3242199708 learned_addr learned my addr 172.21.15.77:0/3242199708 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:07.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.705+0000 7f00d4c3e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00d0071840 0x7f00d0157f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:54730/0 (socket says 172.21.15.77:54730) 2023-07-24T05:47:07.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.705+0000 7f00cffff700 1 --2- 172.21.15.77:0/3242199708 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00d00c9710 0x7f00d00c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:07.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.705+0000 7f00d543f700 1 -- 172.21.15.77:0/3242199708 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00d00c9710 msgr2=0x7f00d00c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:07.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.705+0000 7f00d543f700 1 --2- 172.21.15.77:0/3242199708 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00d00c9710 0x7f00d00c7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:07.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.705+0000 7f00d543f700 1 -- 172.21.15.77:0/3242199708 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00d0071840 msgr2=0x7f00d0157f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:07.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.705+0000 7f00d543f700 1 --2- 172.21.15.77:0/3242199708 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00d0071840 0x7f00d0157f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:07.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.705+0000 7f00d543f700 1 -- 172.21.15.77:0/3242199708 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c4009570 con 0x7f00d0158e80 2023-07-24T05:47:07.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.705+0000 7f00d4c3e700 1 --2- 172.21.15.77:0/3242199708 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00d0071840 0x7f00d0157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:47:07.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.705+0000 7f00cffff700 1 --2- 172.21.15.77:0/3242199708 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00d00c9710 0x7f00d00c7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:07.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.705+0000 7f00d543f700 1 --2- 172.21.15.77:0/3242199708 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00d0158e80 0x7f00d015a760 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f00c8009e50 tx=0x7f00c80074d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:07.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.705+0000 7f00cd7fa700 1 -- 172.21.15.77:0/3242199708 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c8003e50 con 0x7f00d0158e80 2023-07-24T05:47:07.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.705+0000 7f00cd7fa700 1 -- 172.21.15.77:0/3242199708 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c8010040 con 0x7f00d0158e80 2023-07-24T05:47:07.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.705+0000 7f00cd7fa700 1 -- 172.21.15.77:0/3242199708 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c8007c20 con 0x7f00d0158e80 2023-07-24T05:47:07.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.705+0000 7f00d6ea2700 1 -- 172.21.15.77:0/3242199708 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00d0157a10 con 0x7f00d0158e80 2023-07-24T05:47:07.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.705+0000 7f00d6ea2700 1 -- 172.21.15.77:0/3242199708 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00d00c8390 con 0x7f00d0158e80 2023-07-24T05:47:07.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.705+0000 7f00d6ea2700 1 -- 172.21.15.77:0/3242199708 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00d0066ed0 con 0x7f00d0158e80 2023-07-24T05:47:07.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.709+0000 7f00cd7fa700 1 -- 172.21.15.77:0/3242199708 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f00c8004030 con 0x7f00d0158e80 2023-07-24T05:47:07.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.709+0000 7f00cd7fa700 1 --2- 172.21.15.77:0/3242199708 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f00b40662f0 0x7f00b40687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:07.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.709+0000 7f00cd7fa700 1 -- 172.21.15.77:0/3242199708 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f00c8083e60 con 0x7f00d0158e80 2023-07-24T05:47:07.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.713+0000 7f00d4c3e700 1 --2- 172.21.15.77:0/3242199708 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f00b40662f0 0x7f00b40687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:07.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.713+0000 7f00d4c3e700 1 --2- 172.21.15.77:0/3242199708 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f00b40662f0 0x7f00b40687b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f00c4000c00 tx=0x7f00c401b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:07.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.717+0000 7f00cd7fa700 1 -- 172.21.15.77:0/3242199708 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f00c8054a40 con 0x7f00d0158e80 2023-07-24T05:47:07.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.889+0000 7f00d6ea2700 1 -- 172.21.15.77:0/3242199708 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f00d00702d0 con 0x7f00d0158e80 2023-07-24T05:47:07.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.889+0000 7f00cd7fa700 1 -- 172.21.15.77:0/3242199708 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f00c80190a0 con 0x7f00d0158e80 2023-07-24T05:47:07.896 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 8 2023-07-24T05:47:07.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.893+0000 7f00d6ea2700 1 -- 172.21.15.77:0/3242199708 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f00b40662f0 msgr2=0x7f00b40687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:07.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.893+0000 7f00d6ea2700 1 --2- 172.21.15.77:0/3242199708 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f00b40662f0 0x7f00b40687b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f00c4000c00 tx=0x7f00c401b040 comp rx=0 tx=0).stop 2023-07-24T05:47:07.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.893+0000 7f00d6ea2700 1 -- 172.21.15.77:0/3242199708 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00d0158e80 msgr2=0x7f00d015a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:07.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.893+0000 7f00d6ea2700 1 --2- 172.21.15.77:0/3242199708 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00d0158e80 0x7f00d015a760 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f00c8009e50 tx=0x7f00c80074d0 comp rx=0 tx=0).stop 2023-07-24T05:47:07.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.893+0000 7f00d6ea2700 1 -- 172.21.15.77:0/3242199708 shutdown_connections 2023-07-24T05:47:07.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.893+0000 7f00d6ea2700 1 --2- 172.21.15.77:0/3242199708 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00d0158e80 0x7f00d015a760 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:07.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.893+0000 7f00d6ea2700 1 --2- 172.21.15.77:0/3242199708 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f00b40662f0 0x7f00b40687b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:07.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.893+0000 7f00d6ea2700 1 --2- 172.21.15.77:0/3242199708 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00d00c9710 0x7f00d00c7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:07.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.893+0000 7f00d6ea2700 1 --2- 172.21.15.77:0/3242199708 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00d0071840 0x7f00d0157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:07.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.893+0000 7f00d6ea2700 1 -- 172.21.15.77:0/3242199708 >> 172.21.15.77:0/3242199708 conn(0x7f00d00ce890 msgr2=0x7f00d00b1970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:07.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.893+0000 7f00d6ea2700 1 -- 172.21.15.77:0/3242199708 shutdown_connections 2023-07-24T05:47:07.902 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:07.893+0000 7f00d6ea2700 1 -- 172.21.15.77:0/3242199708 wait complete. 2023-07-24T05:47:07.922 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-24T05:47:08.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.089+0000 7ff56d282700 1 Processor -- start 2023-07-24T05:47:08.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.093+0000 7ff56d282700 1 -- start start 2023-07-24T05:47:08.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.093+0000 7ff56d282700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff56806b9f0 0x7ff56806bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:08.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.093+0000 7ff56d282700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff5680ccf20 0x7ff56806ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:08.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.093+0000 7ff56d282700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff56806d450 con 0x7ff56806b160 2023-07-24T05:47:08.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.093+0000 7ff56d282700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5680ad710 con 0x7ff56806b9f0 2023-07-24T05:47:08.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.093+0000 7ff56d282700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5680cca20 con 0x7ff5680ccf20 2023-07-24T05:47:08.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.093+0000 7ff566ffd700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff56806b9f0 0x7ff56806bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:08.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.093+0000 7ff566ffd700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff56806b9f0 0x7ff56806bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35100/0 (socket says 172.21.15.77:35100) 2023-07-24T05:47:08.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.093+0000 7ff5677fe700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7ff56806b160 0x7ff56815da70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55216/0 (socket says 172.21.15.77:55216) 2023-07-24T05:47:08.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.093+0000 7ff566ffd700 1 -- 172.21.15.77:0/3969249488 learned_addr learned my addr 172.21.15.77:0/3969249488 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:08.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.093+0000 7ff55ffff700 1 --2- 172.21.15.77:0/3969249488 >> v2:172.21.15.103:3300/0 conn(0x7ff5680ccf20 0x7ff56806ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:08.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.093+0000 7ff566ffd700 1 -- 172.21.15.77:0/3969249488 >> v2:172.21.15.103:3300/0 conn(0x7ff5680ccf20 msgr2=0x7ff56806ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:08.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.093+0000 7ff566ffd700 1 --2- 172.21.15.77:0/3969249488 >> v2:172.21.15.103:3300/0 conn(0x7ff5680ccf20 0x7ff56806ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:08.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.093+0000 7ff566ffd700 1 -- 172.21.15.77:0/3969249488 >> v1:172.21.15.77:6789/0 conn(0x7ff56806b160 legacy=0x7ff56815da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:08.101 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.093+0000 7ff566ffd700 1 -- 172.21.15.77:0/3969249488 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56806d6a0 con 0x7ff56806b9f0 2023-07-24T05:47:08.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.093+0000 7ff5667fc700 1 -- 172.21.15.77:0/3969249488 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2991183445 0 0) 0x7ff56806d450 con 0x7ff56806b160 2023-07-24T05:47:08.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.097+0000 7ff566ffd700 1 --2- 172.21.15.77:0/3969249488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff56806b9f0 0x7ff56806bdd0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff5680b44d0 tx=0x7ff558009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e986896d593e1af server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:08.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.097+0000 7ff5667fc700 1 -- 172.21.15.77:0/3969249488 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff558005e50 con 0x7ff56806b9f0 2023-07-24T05:47:08.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.097+0000 7ff5667fc700 1 -- 172.21.15.77:0/3969249488 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff558006030 con 0x7ff56806b9f0 2023-07-24T05:47:08.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.097+0000 7ff5667fc700 1 -- 172.21.15.77:0/3969249488 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5580063c0 con 0x7ff56806b9f0 2023-07-24T05:47:08.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.097+0000 7ff56d282700 1 -- 172.21.15.77:0/3969249488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff56806b9f0 msgr2=0x7ff56806bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:08.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.097+0000 7ff56d282700 1 --2- 172.21.15.77:0/3969249488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff56806b9f0 0x7ff56806bdd0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff5680b44d0 tx=0x7ff558009bf0 comp rx=0 tx=0).stop 2023-07-24T05:47:08.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.097+0000 7ff56d282700 1 -- 172.21.15.77:0/3969249488 shutdown_connections 2023-07-24T05:47:08.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.097+0000 7ff56d282700 1 --2- 172.21.15.77:0/3969249488 >> v2:172.21.15.103:3300/0 conn(0x7ff5680ccf20 0x7ff56806ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:08.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.097+0000 7ff56d282700 1 --2- 172.21.15.77:0/3969249488 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff56806b9f0 0x7ff56806bdd0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:08.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.097+0000 7ff56d282700 1 -- 172.21.15.77:0/3969249488 >> 172.21.15.77:0/3969249488 conn(0x7ff5680ce440 msgr2=0x7ff5680ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:08.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.097+0000 7ff56d282700 1 -- 172.21.15.77:0/3969249488 shutdown_connections 2023-07-24T05:47:08.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.097+0000 7ff56d282700 1 -- 172.21.15.77:0/3969249488 wait complete. 2023-07-24T05:47:08.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.101+0000 7ff56d282700 1 Processor -- start 2023-07-24T05:47:08.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.101+0000 7ff56d282700 1 -- start start 2023-07-24T05:47:08.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.101+0000 7ff56d282700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff56806b9f0 0x7ff5681e3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:08.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.101+0000 7ff56d282700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5680ccf20 0x7ff5681e0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:08.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.101+0000 7ff56d282700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5681e4df0 0x7ff5680ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:08.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.101+0000 7ff56d282700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5681e49d0 con 0x7ff5680ccf20 2023-07-24T05:47:08.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.101+0000 7ff56d282700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5681e3d50 con 0x7ff5681e4df0 2023-07-24T05:47:08.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.101+0000 7ff56d282700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5681e4030 con 0x7ff56806b9f0 2023-07-24T05:47:08.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.101+0000 7ff55ffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5680ccf20 0x7ff5681e0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:08.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.101+0000 7ff55ffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5680ccf20 0x7ff5681e0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35108/0 (socket says 172.21.15.77:35108) 2023-07-24T05:47:08.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.101+0000 7ff55ffff700 1 -- 172.21.15.77:0/494542700 learned_addr learned my addr 172.21.15.77:0/494542700 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:08.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.101+0000 7ff5677fe700 1 --2- 172.21.15.77:0/494542700 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5681e4df0 0x7ff5680ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:08.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.101+0000 7ff566ffd700 1 --2- 172.21.15.77:0/494542700 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff56806b9f0 0x7ff5681e3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:08.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.101+0000 7ff55ffff700 1 -- 172.21.15.77:0/494542700 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff56806b9f0 msgr2=0x7ff5681e3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:08.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.101+0000 7ff55ffff700 1 --2- 172.21.15.77:0/494542700 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff56806b9f0 0x7ff5681e3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:08.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.101+0000 7ff55ffff700 1 -- 172.21.15.77:0/494542700 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5681e4df0 msgr2=0x7ff5680ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:08.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.101+0000 7ff55ffff700 1 --2- 172.21.15.77:0/494542700 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5681e4df0 0x7ff5680ca1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:08.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.101+0000 7ff55ffff700 1 -- 172.21.15.77:0/494542700 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff558009520 con 0x7ff5680ccf20 2023-07-24T05:47:08.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.101+0000 7ff55ffff700 1 --2- 172.21.15.77:0/494542700 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5680ccf20 0x7ff5681e0c10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff55000e840 tx=0x7ff55000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:08.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.101+0000 7ff55f7fe700 1 -- 172.21.15.77:0/494542700 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5500095a0 con 0x7ff5680ccf20 2023-07-24T05:47:08.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.101+0000 7ff55f7fe700 1 -- 172.21.15.77:0/494542700 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff55000c690 con 0x7ff5680ccf20 2023-07-24T05:47:08.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.101+0000 7ff55f7fe700 1 -- 172.21.15.77:0/494542700 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55000ca00 con 0x7ff5680ccf20 2023-07-24T05:47:08.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.101+0000 7ff56d282700 1 -- 172.21.15.77:0/494542700 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5681e4310 con 0x7ff5680ccf20 2023-07-24T05:47:08.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.101+0000 7ff56d282700 1 -- 172.21.15.77:0/494542700 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5681e1150 con 0x7ff5680ccf20 2023-07-24T05:47:08.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.105+0000 7ff56d282700 1 -- 172.21.15.77:0/494542700 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff56804df10 con 0x7ff5680ccf20 2023-07-24T05:47:08.112 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.105+0000 7ff55f7fe700 1 -- 172.21.15.77:0/494542700 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff55000cb60 con 0x7ff5680ccf20 2023-07-24T05:47:08.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.109+0000 7ff55f7fe700 1 --2- 172.21.15.77:0/494542700 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff5480662f0 0x7ff5480687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:08.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.109+0000 7ff55f7fe700 1 -- 172.21.15.77:0/494542700 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff550084020 con 0x7ff5680ccf20 2023-07-24T05:47:08.113 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.109+0000 7ff566ffd700 1 --2- 172.21.15.77:0/494542700 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff5480662f0 0x7ff5480687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:08.114 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.109+0000 7ff566ffd700 1 --2- 172.21.15.77:0/494542700 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff5480662f0 0x7ff5480687b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff558009c30 tx=0x7ff558008070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:08.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.113+0000 7ff55f7fe700 1 -- 172.21.15.77:0/494542700 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff550051200 con 0x7ff5680ccf20 2023-07-24T05:47:08.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.289+0000 7ff56d282700 1 -- 172.21.15.77:0/494542700 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff5680ac9d0 con 0x7ff5680ccf20 2023-07-24T05:47:08.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.289+0000 7ff55f7fe700 1 -- 172.21.15.77:0/494542700 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff550054820 con 0x7ff5680ccf20 2023-07-24T05:47:08.296 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-07-24T05:47:08.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.293+0000 7ff56d282700 1 -- 172.21.15.77:0/494542700 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff5480662f0 msgr2=0x7ff5480687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:08.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.293+0000 7ff56d282700 1 --2- 172.21.15.77:0/494542700 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff5480662f0 0x7ff5480687b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff558009c30 tx=0x7ff558008070 comp rx=0 tx=0).stop 2023-07-24T05:47:08.298 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.293+0000 7ff56d282700 1 -- 172.21.15.77:0/494542700 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5680ccf20 msgr2=0x7ff5681e0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:08.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.293+0000 7ff56d282700 1 --2- 172.21.15.77:0/494542700 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5680ccf20 0x7ff5681e0c10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff55000e840 tx=0x7ff55000ec00 comp rx=0 tx=0).stop 2023-07-24T05:47:08.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.293+0000 7ff56d282700 1 -- 172.21.15.77:0/494542700 shutdown_connections 2023-07-24T05:47:08.299 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.293+0000 7ff56d282700 1 --2- 172.21.15.77:0/494542700 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5681e4df0 0x7ff5680ca1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:08.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.293+0000 7ff56d282700 1 --2- 172.21.15.77:0/494542700 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff5680ccf20 0x7ff5681e0c10 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:08.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.293+0000 7ff56d282700 1 --2- 172.21.15.77:0/494542700 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff5480662f0 0x7ff5480687b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:08.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.293+0000 7ff56d282700 1 --2- 172.21.15.77:0/494542700 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff56806b9f0 0x7ff5681e3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:08.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.293+0000 7ff56d282700 1 -- 172.21.15.77:0/494542700 >> 172.21.15.77:0/494542700 conn(0x7ff5680ce440 msgr2=0x7ff5680addd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:08.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.293+0000 7ff56d282700 1 -- 172.21.15.77:0/494542700 shutdown_connections 2023-07-24T05:47:08.300 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.293+0000 7ff56d282700 1 -- 172.21.15.77:0/494542700 wait complete. 2023-07-24T05:47:08.320 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-24T05:47:08.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.493+0000 7f5b83289700 1 Processor -- start 2023-07-24T05:47:08.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.493+0000 7f5b83289700 1 -- start start 2023-07-24T05:47:08.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.497+0000 7f5b83289700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5b7c15cb60 0x7f5b7c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:08.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.497+0000 7f5b83289700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5b7c06b260 0x7f5b7c0d3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:08.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.497+0000 7f5b83289700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5b7c160730 0x7f5b7c160b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:08.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.497+0000 7f5b83289700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b7c1610a0 con 0x7f5b7c15cb60 2023-07-24T05:47:08.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.497+0000 7f5b83289700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b7c0b5f50 con 0x7f5b7c06b260 2023-07-24T05:47:08.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.497+0000 7f5b83289700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c0b6230 con 0x7f5b7c160730 2023-07-24T05:47:08.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.497+0000 7f5b81025700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5b7c15cb60 0x7f5b7c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:08.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.497+0000 7f5b81025700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5b7c15cb60 0x7f5b7c06d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35112/0 (socket says 172.21.15.77:35112) 2023-07-24T05:47:08.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.497+0000 7f5b81025700 1 -- 172.21.15.77:0/3209185626 learned_addr learned my addr 172.21.15.77:0/3209185626 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:08.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.497+0000 7f5b80824700 1 --2- 172.21.15.77:0/3209185626 >> v2:172.21.15.103:3300/0 conn(0x7f5b7c06b260 0x7f5b7c0d3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:08.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.497+0000 7f5b81826700 1 --2- 172.21.15.77:0/3209185626 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5b7c160730 0x7f5b7c160b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:08.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.497+0000 7f5b81025700 1 -- 172.21.15.77:0/3209185626 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5b7c160730 msgr2=0x7f5b7c160b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:08.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.497+0000 7f5b81025700 1 --2- 172.21.15.77:0/3209185626 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5b7c160730 0x7f5b7c160b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:08.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.497+0000 7f5b81025700 1 -- 172.21.15.77:0/3209185626 >> v2:172.21.15.103:3300/0 conn(0x7f5b7c06b260 msgr2=0x7f5b7c0d3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:08.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.497+0000 7f5b81025700 1 --2- 172.21.15.77:0/3209185626 >> v2:172.21.15.103:3300/0 conn(0x7f5b7c06b260 0x7f5b7c0d3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:08.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.497+0000 7f5b81025700 1 -- 172.21.15.77:0/3209185626 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b7c06ad40 con 0x7f5b7c15cb60 2023-07-24T05:47:08.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.497+0000 7f5b81025700 1 --2- 172.21.15.77:0/3209185626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b7c15cb60 0x7f5b7c06d380 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c08d070 tx=0x7f5b78009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d41924692ce9ab66 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:08.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.501+0000 7f5b73fff700 1 -- 172.21.15.77:0/3209185626 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b78011830 con 0x7f5b7c15cb60 2023-07-24T05:47:08.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.501+0000 7f5b73fff700 1 -- 172.21.15.77:0/3209185626 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b78011990 con 0x7f5b7c15cb60 2023-07-24T05:47:08.506 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.501+0000 7f5b73fff700 1 -- 172.21.15.77:0/3209185626 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b78011d20 con 0x7f5b7c15cb60 2023-07-24T05:47:08.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.501+0000 7f5b83289700 1 -- 172.21.15.77:0/3209185626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b7c15cb60 msgr2=0x7f5b7c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:08.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.501+0000 7f5b83289700 1 --2- 172.21.15.77:0/3209185626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b7c15cb60 0x7f5b7c06d380 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c08d070 tx=0x7f5b78009bf0 comp rx=0 tx=0).stop 2023-07-24T05:47:08.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.501+0000 7f5b83289700 1 -- 172.21.15.77:0/3209185626 shutdown_connections 2023-07-24T05:47:08.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.501+0000 7f5b83289700 1 --2- 172.21.15.77:0/3209185626 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5b7c160730 0x7f5b7c160b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:08.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.501+0000 7f5b83289700 1 --2- 172.21.15.77:0/3209185626 >> v2:172.21.15.103:3300/0 conn(0x7f5b7c06b260 0x7f5b7c0d3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:08.507 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.501+0000 7f5b83289700 1 --2- 172.21.15.77:0/3209185626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b7c15cb60 0x7f5b7c06d380 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:08.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.501+0000 7f5b83289700 1 -- 172.21.15.77:0/3209185626 >> 172.21.15.77:0/3209185626 conn(0x7f5b7c09bb70 msgr2=0x7f5b7c0b57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:08.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.501+0000 7f5b83289700 1 -- 172.21.15.77:0/3209185626 shutdown_connections 2023-07-24T05:47:08.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.501+0000 7f5b83289700 1 -- 172.21.15.77:0/3209185626 wait complete. 2023-07-24T05:47:08.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.505+0000 7f5b83289700 1 Processor -- start 2023-07-24T05:47:08.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.505+0000 7f5b83289700 1 -- start start 2023-07-24T05:47:08.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.505+0000 7f5b83289700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5b7c15cb60 0x7f5b7c0c6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:08.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.505+0000 7f5b83289700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b7c160730 0x7f5b7c0c6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:08.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.505+0000 7f5b83289700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b7c1f3400 0x7f5b7c0cc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:08.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.505+0000 7f5b83289700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c0c70f0 con 0x7f5b7c160730 2023-07-24T05:47:08.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.505+0000 7f5b83289700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c1e9360 con 0x7f5b7c1f3400 2023-07-24T05:47:08.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.505+0000 7f5b83289700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c1e8a30 con 0x7f5b7c15cb60 2023-07-24T05:47:08.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.505+0000 7f5b80824700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b7c160730 0x7f5b7c0c6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:08.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.505+0000 7f5b80824700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b7c160730 0x7f5b7c0c6380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35114/0 (socket says 172.21.15.77:35114) 2023-07-24T05:47:08.512 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.505+0000 7f5b80824700 1 -- 172.21.15.77:0/775985021 learned_addr learned my addr 172.21.15.77:0/775985021 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:08.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.505+0000 7f5b81025700 1 --2- 172.21.15.77:0/775985021 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5b7c15cb60 0x7f5b7c0c6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:08.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.505+0000 7f5b81826700 1 --2- 172.21.15.77:0/775985021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b7c1f3400 0x7f5b7c0cc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:08.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.505+0000 7f5b80824700 1 -- 172.21.15.77:0/775985021 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5b7c15cb60 msgr2=0x7f5b7c0c6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:08.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.505+0000 7f5b80824700 1 --2- 172.21.15.77:0/775985021 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5b7c15cb60 0x7f5b7c0c6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:08.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.505+0000 7f5b80824700 1 -- 172.21.15.77:0/775985021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b7c1f3400 msgr2=0x7f5b7c0cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:08.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.505+0000 7f5b80824700 1 --2- 172.21.15.77:0/775985021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b7c1f3400 0x7f5b7c0cc070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:08.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.505+0000 7f5b80824700 1 -- 172.21.15.77:0/775985021 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b78009570 con 0x7f5b7c160730 2023-07-24T05:47:08.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.505+0000 7f5b81826700 1 --2- 172.21.15.77:0/775985021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b7c1f3400 0x7f5b7c0cc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:08.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.505+0000 7f5b80824700 1 --2- 172.21.15.77:0/775985021 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b7c160730 0x7f5b7c0c6380 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c00e7c0 tx=0x7f5b6c00ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:08.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.505+0000 7f5b71ffb700 1 -- 172.21.15.77:0/775985021 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c013680 con 0x7f5b7c160730 2023-07-24T05:47:08.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.505+0000 7f5b71ffb700 1 -- 172.21.15.77:0/775985021 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6c0137e0 con 0x7f5b7c160730 2023-07-24T05:47:08.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.505+0000 7f5b71ffb700 1 -- 172.21.15.77:0/775985021 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c013b90 con 0x7f5b7c160730 2023-07-24T05:47:08.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.505+0000 7f5b83289700 1 -- 172.21.15.77:0/775985021 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b7c1e8d10 con 0x7f5b7c160730 2023-07-24T05:47:08.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.509+0000 7f5b83289700 1 -- 172.21.15.77:0/775985021 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b7c0c68c0 con 0x7f5b7c160730 2023-07-24T05:47:08.515 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.509+0000 7f5b83289700 1 -- 172.21.15.77:0/775985021 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b7c1f2000 con 0x7f5b7c160730 2023-07-24T05:47:08.516 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.509+0000 7f5b71ffb700 1 -- 172.21.15.77:0/775985021 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5b6c013cf0 con 0x7f5b7c160730 2023-07-24T05:47:08.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.513+0000 7f5b71ffb700 1 --2- 172.21.15.77:0/775985021 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f5b600662f0 0x7f5b600687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:08.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.513+0000 7f5b71ffb700 1 -- 172.21.15.77:0/775985021 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5b6c083ec0 con 0x7f5b7c160730 2023-07-24T05:47:08.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.513+0000 7f5b81025700 1 --2- 172.21.15.77:0/775985021 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f5b600662f0 0x7f5b600687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:08.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.513+0000 7f5b81025700 1 --2- 172.21.15.77:0/775985021 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f5b600662f0 0x7f5b600687b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5b78000c00 tx=0x7f5b78008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:08.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.521+0000 7f5b71ffb700 1 -- 172.21.15.77:0/775985021 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5b7c1f2000 con 0x7f5b7c160730 2023-07-24T05:47:08.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.693+0000 7f5b83289700 1 -- 172.21.15.77:0/775985021 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5b7c1f2000 con 0x7f5b7c160730 2023-07-24T05:47:08.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.697+0000 7f5b71ffb700 1 -- 172.21.15.77:0/775985021 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5b7c1f2000 con 0x7f5b7c160730 2023-07-24T05:47:08.702 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-07-24T05:47:08.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.697+0000 7f5b83289700 1 -- 172.21.15.77:0/775985021 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f5b600662f0 msgr2=0x7f5b600687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:08.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.697+0000 7f5b83289700 1 --2- 172.21.15.77:0/775985021 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f5b600662f0 0x7f5b600687b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5b78000c00 tx=0x7f5b78008030 comp rx=0 tx=0).stop 2023-07-24T05:47:08.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.697+0000 7f5b83289700 1 -- 172.21.15.77:0/775985021 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b7c160730 msgr2=0x7f5b7c0c6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:08.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.697+0000 7f5b83289700 1 --2- 172.21.15.77:0/775985021 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b7c160730 0x7f5b7c0c6380 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c00e7c0 tx=0x7f5b6c00ead0 comp rx=0 tx=0).stop 2023-07-24T05:47:08.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.701+0000 7f5b83289700 1 -- 172.21.15.77:0/775985021 shutdown_connections 2023-07-24T05:47:08.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.701+0000 7f5b83289700 1 --2- 172.21.15.77:0/775985021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5b7c1f3400 0x7f5b7c0cc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:08.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.701+0000 7f5b83289700 1 --2- 172.21.15.77:0/775985021 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5b7c160730 0x7f5b7c0c6380 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:08.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.701+0000 7f5b83289700 1 --2- 172.21.15.77:0/775985021 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f5b600662f0 0x7f5b600687b0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:08.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.701+0000 7f5b83289700 1 --2- 172.21.15.77:0/775985021 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5b7c15cb60 0x7f5b7c0c6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:08.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.701+0000 7f5b83289700 1 -- 172.21.15.77:0/775985021 >> 172.21.15.77:0/775985021 conn(0x7f5b7c09bb70 msgr2=0x7f5b7c15cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:08.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.701+0000 7f5b83289700 1 -- 172.21.15.77:0/775985021 shutdown_connections 2023-07-24T05:47:08.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.701+0000 7f5b83289700 1 -- 172.21.15.77:0/775985021 wait complete. 2023-07-24T05:47:08.725 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-24T05:47:08.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.901+0000 7f3832c1e700 1 Processor -- start 2023-07-24T05:47:08.906 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.901+0000 7f3832c1e700 1 -- start start 2023-07-24T05:47:08.907 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.901+0000 7f3832c1e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f382c06afc0 0x7f382c0b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:08.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.901+0000 7f3832c1e700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f382c0d0360 con 0x7f382c15db20 2023-07-24T05:47:08.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.901+0000 7f3832c1e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f382c160fa0 con 0x7f382c0d2fc0 2023-07-24T05:47:08.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.901+0000 7f3832c1e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382c0b20b0 con 0x7f382c06afc0 2023-07-24T05:47:08.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.901+0000 7f382bfff700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f382c15db20 0x7f382c0d28b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55232/0 (socket says 172.21.15.77:55232) 2023-07-24T05:47:08.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.901+0000 7f382bfff700 1 -- 172.21.15.77:0/1893785581 learned_addr learned my addr 172.21.15.77:0/1893785581 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:08.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.905+0000 7f38309ba700 1 --2- 172.21.15.77:0/1893785581 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f382c06afc0 0x7f382c0b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:08.909 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.905+0000 7f382b7fe700 1 -- 172.21.15.77:0/1893785581 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3259689479 0 0) 0x7f382c0d0360 con 0x7f382c15db20 2023-07-24T05:47:08.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.905+0000 7f382b7fe700 1 -- 172.21.15.77:0/1893785581 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f381c0035d0 con 0x7f382c15db20 2023-07-24T05:47:08.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.905+0000 7f38309ba700 1 -- 172.21.15.77:0/1893785581 >> v1:172.21.15.103:6789/0 conn(0x7f382c0d2fc0 legacy=0x7f382c0d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:08.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.905+0000 7f38309ba700 1 -- 172.21.15.77:0/1893785581 >> v1:172.21.15.77:6789/0 conn(0x7f382c15db20 legacy=0x7f382c0d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:08.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.905+0000 7f38309ba700 1 -- 172.21.15.77:0/1893785581 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382c160670 con 0x7f382c06afc0 2023-07-24T05:47:08.910 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.905+0000 7f38309ba700 1 --2- 172.21.15.77:0/1893785581 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f382c06afc0 0x7f382c0b1a20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3820009880 tx=0x7f3820009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f113385085634230 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:08.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.905+0000 7f382b7fe700 1 -- 172.21.15.77:0/1893785581 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3820011830 con 0x7f382c06afc0 2023-07-24T05:47:08.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.905+0000 7f382b7fe700 1 -- 172.21.15.77:0/1893785581 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3820011990 con 0x7f382c06afc0 2023-07-24T05:47:08.911 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.905+0000 7f382b7fe700 1 -- 172.21.15.77:0/1893785581 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3820011d00 con 0x7f382c06afc0 2023-07-24T05:47:08.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.905+0000 7f3832c1e700 1 -- 172.21.15.77:0/1893785581 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f382c06afc0 msgr2=0x7f382c0b1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:08.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.905+0000 7f3832c1e700 1 --2- 172.21.15.77:0/1893785581 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f382c06afc0 0x7f382c0b1a20 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3820009880 tx=0x7f3820009b90 comp rx=0 tx=0).stop 2023-07-24T05:47:08.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.905+0000 7f3832c1e700 1 -- 172.21.15.77:0/1893785581 shutdown_connections 2023-07-24T05:47:08.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.905+0000 7f3832c1e700 1 --2- 172.21.15.77:0/1893785581 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f382c06afc0 0x7f382c0b1a20 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:08.912 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.905+0000 7f3832c1e700 1 -- 172.21.15.77:0/1893785581 >> 172.21.15.77:0/1893785581 conn(0x7f382c09bc20 msgr2=0x7f382c0b7920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:08.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.905+0000 7f3832c1e700 1 -- 172.21.15.77:0/1893785581 shutdown_connections 2023-07-24T05:47:08.913 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.905+0000 7f3832c1e700 1 -- 172.21.15.77:0/1893785581 wait complete. 2023-07-24T05:47:08.914 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.909+0000 7f3832c1e700 1 Processor -- start 2023-07-24T05:47:08.915 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.909+0000 7f3832c1e700 1 -- start start 2023-07-24T05:47:08.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.909+0000 7f3832c1e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f382c06afc0 0x7f382c0d0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:08.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.909+0000 7f3832c1e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f382c0d2fc0 0x7f382c0d1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:08.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.909+0000 7f3832c1e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f382c15db20 0x7f382c0c7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:08.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.909+0000 7f3832c1e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382c0cf350 con 0x7f382c15db20 2023-07-24T05:47:08.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.909+0000 7f3832c1e700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382c0d2330 con 0x7f382c0d2fc0 2023-07-24T05:47:08.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.909+0000 7f3832c1e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382c0c79f0 con 0x7f382c06afc0 2023-07-24T05:47:08.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.909+0000 7f38311bb700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f382c15db20 0x7f382c0c7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:08.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.913+0000 7f38311bb700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f382c15db20 0x7f382c0c7050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35122/0 (socket says 172.21.15.77:35122) 2023-07-24T05:47:08.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.913+0000 7f38311bb700 1 -- 172.21.15.77:0/1119566310 learned_addr learned my addr 172.21.15.77:0/1119566310 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:08.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.913+0000 7f38309ba700 1 --2- 172.21.15.77:0/1119566310 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f382c06afc0 0x7f382c0d0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:08.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.913+0000 7f382bfff700 1 --2- 172.21.15.77:0/1119566310 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f382c0d2fc0 0x7f382c0d1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:08.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.913+0000 7f38311bb700 1 -- 172.21.15.77:0/1119566310 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f382c06afc0 msgr2=0x7f382c0d0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:08.918 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.913+0000 7f38311bb700 1 --2- 172.21.15.77:0/1119566310 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f382c06afc0 0x7f382c0d0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:08.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.913+0000 7f38311bb700 1 -- 172.21.15.77:0/1119566310 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f382c0d2fc0 msgr2=0x7f382c0d1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:08.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.913+0000 7f38311bb700 1 --2- 172.21.15.77:0/1119566310 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f382c0d2fc0 0x7f382c0d1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:08.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.913+0000 7f38311bb700 1 -- 172.21.15.77:0/1119566310 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38200094b0 con 0x7f382c15db20 2023-07-24T05:47:08.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.913+0000 7f38311bb700 1 --2- 172.21.15.77:0/1119566310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f382c15db20 0x7f382c0c7050 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f382400cc50 tx=0x7f382400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:08.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.913+0000 7f38297fa700 1 -- 172.21.15.77:0/1119566310 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3824003c20 con 0x7f382c15db20 2023-07-24T05:47:08.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.913+0000 7f38297fa700 1 -- 172.21.15.77:0/1119566310 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3824003d80 con 0x7f382c15db20 2023-07-24T05:47:08.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.913+0000 7f3832c1e700 1 -- 172.21.15.77:0/1119566310 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f382c0cf5a0 con 0x7f382c15db20 2023-07-24T05:47:08.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.913+0000 7f38297fa700 1 -- 172.21.15.77:0/1119566310 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382400aab0 con 0x7f382c15db20 2023-07-24T05:47:08.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.913+0000 7f3832c1e700 1 -- 172.21.15.77:0/1119566310 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f382c0cfb60 con 0x7f382c15db20 2023-07-24T05:47:08.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.913+0000 7f3832c1e700 1 -- 172.21.15.77:0/1119566310 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f382c04df10 con 0x7f382c15db20 2023-07-24T05:47:08.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.917+0000 7f38297fa700 1 -- 172.21.15.77:0/1119566310 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f382400ac10 con 0x7f382c15db20 2023-07-24T05:47:08.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.917+0000 7f38297fa700 1 --2- 172.21.15.77:0/1119566310 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f38100662f0 0x7f38100687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:08.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.917+0000 7f38297fa700 1 -- 172.21.15.77:0/1119566310 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3824083fe0 con 0x7f382c15db20 2023-07-24T05:47:08.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.917+0000 7f38309ba700 1 --2- 172.21.15.77:0/1119566310 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f38100662f0 0x7f38100687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:08.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.921+0000 7f38309ba700 1 --2- 172.21.15.77:0/1119566310 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f38100662f0 0x7f38100687b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f38200090b0 tx=0x7f3820010000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:08.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:08.925+0000 7f38297fa700 1 -- 172.21.15.77:0/1119566310 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3824051120 con 0x7f382c15db20 2023-07-24T05:47:09.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.101+0000 7f3832c1e700 1 -- 172.21.15.77:0/1119566310 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f382c0d3540 con 0x7f382c15db20 2023-07-24T05:47:09.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.101+0000 7f38297fa700 1 -- 172.21.15.77:0/1119566310 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3824054740 con 0x7f382c15db20 2023-07-24T05:47:09.106 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-07-24T05:47:09.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.101+0000 7f3832c1e700 1 -- 172.21.15.77:0/1119566310 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f38100662f0 msgr2=0x7f38100687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:09.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.101+0000 7f3832c1e700 1 --2- 172.21.15.77:0/1119566310 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f38100662f0 0x7f38100687b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f38200090b0 tx=0x7f3820010000 comp rx=0 tx=0).stop 2023-07-24T05:47:09.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.101+0000 7f3832c1e700 1 -- 172.21.15.77:0/1119566310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f382c15db20 msgr2=0x7f382c0c7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:09.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.101+0000 7f3832c1e700 1 --2- 172.21.15.77:0/1119566310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f382c15db20 0x7f382c0c7050 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f382400cc50 tx=0x7f382400cf60 comp rx=0 tx=0).stop 2023-07-24T05:47:09.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.101+0000 7f3832c1e700 1 -- 172.21.15.77:0/1119566310 shutdown_connections 2023-07-24T05:47:09.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.101+0000 7f3832c1e700 1 --2- 172.21.15.77:0/1119566310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f382c15db20 0x7f382c0c7050 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:09.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.101+0000 7f3832c1e700 1 --2- 172.21.15.77:0/1119566310 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f382c0d2fc0 0x7f382c0d1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:09.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.101+0000 7f3832c1e700 1 --2- 172.21.15.77:0/1119566310 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f38100662f0 0x7f38100687b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:09.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.101+0000 7f3832c1e700 1 --2- 172.21.15.77:0/1119566310 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f382c06afc0 0x7f382c0d0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:09.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.101+0000 7f3832c1e700 1 -- 172.21.15.77:0/1119566310 >> 172.21.15.77:0/1119566310 conn(0x7f382c09bc20 msgr2=0x7f382c0b54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:09.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.105+0000 7f3832c1e700 1 -- 172.21.15.77:0/1119566310 shutdown_connections 2023-07-24T05:47:09.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.105+0000 7f3832c1e700 1 -- 172.21.15.77:0/1119566310 wait complete. 2023-07-24T05:47:09.131 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-24T05:47:09.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.305+0000 7f69e79ae700 1 Processor -- start 2023-07-24T05:47:09.310 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.305+0000 7f69e79ae700 1 -- start start 2023-07-24T05:47:09.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.305+0000 7f69e79ae700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f69e0159360 0x7f69e006a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:09.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.305+0000 7f69e79ae700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69e0070a50 con 0x7f69e015cee0 2023-07-24T05:47:09.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.305+0000 7f69e79ae700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69e0070700 con 0x7f69e006b9b0 2023-07-24T05:47:09.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.305+0000 7f69e79ae700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69e006aca0 con 0x7f69e0159360 2023-07-24T05:47:09.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.309+0000 7f69e5f4b700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f69e015cee0 0x7f69e0070ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55234/0 (socket says 172.21.15.77:55234) 2023-07-24T05:47:09.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.309+0000 7f69e5f4b700 1 -- 172.21.15.77:0/2380234077 learned_addr learned my addr 172.21.15.77:0/2380234077 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:09.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.309+0000 7f69e574a700 1 --2- 172.21.15.77:0/2380234077 >> v2:172.21.15.103:3300/0 conn(0x7f69e0159360 0x7f69e006a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:09.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.309+0000 7f69d7fff700 1 -- 172.21.15.77:0/2380234077 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3901343216 0 0) 0x7f69e0070a50 con 0x7f69e015cee0 2023-07-24T05:47:09.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.309+0000 7f69d7fff700 1 -- 172.21.15.77:0/2380234077 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69cc0035d0 con 0x7f69e015cee0 2023-07-24T05:47:09.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.309+0000 7f69e574a700 1 -- 172.21.15.77:0/2380234077 >> v1:172.21.15.103:6789/0 conn(0x7f69e006b9b0 legacy=0x7f69e00ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:09.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.309+0000 7f69e574a700 1 -- 172.21.15.77:0/2380234077 >> v1:172.21.15.77:6789/0 conn(0x7f69e015cee0 legacy=0x7f69e0070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:09.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.309+0000 7f69d7fff700 1 -- 172.21.15.77:0/2380234077 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3216147802 0 0) 0x7f69cc0035d0 con 0x7f69e015cee0 2023-07-24T05:47:09.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.309+0000 7f69e574a700 1 -- 172.21.15.77:0/2380234077 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e006af80 con 0x7f69e0159360 2023-07-24T05:47:09.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.309+0000 7f69e574a700 1 --2- 172.21.15.77:0/2380234077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69e0159360 0x7f69e006a3a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f69dc009850 tx=0x7f69dc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7f60d5eb5fa966a server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:09.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.309+0000 7f69d7fff700 1 -- 172.21.15.77:0/2380234077 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d80019f0 con 0x7f69e0159360 2023-07-24T05:47:09.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.309+0000 7f69d7fff700 1 -- 172.21.15.77:0/2380234077 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69dc004030 con 0x7f69e0159360 2023-07-24T05:47:09.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.309+0000 7f69d7fff700 1 -- 172.21.15.77:0/2380234077 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69dc0043a0 con 0x7f69e0159360 2023-07-24T05:47:09.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.313+0000 7f69e79ae700 1 -- 172.21.15.77:0/2380234077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69e0159360 msgr2=0x7f69e006a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:09.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.313+0000 7f69e79ae700 1 --2- 172.21.15.77:0/2380234077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69e0159360 0x7f69e006a3a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f69dc009850 tx=0x7f69dc009b60 comp rx=0 tx=0).stop 2023-07-24T05:47:09.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.313+0000 7f69e79ae700 1 -- 172.21.15.77:0/2380234077 shutdown_connections 2023-07-24T05:47:09.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.313+0000 7f69e79ae700 1 --2- 172.21.15.77:0/2380234077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69e0159360 0x7f69e006a3a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:09.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.313+0000 7f69e79ae700 1 -- 172.21.15.77:0/2380234077 >> 172.21.15.77:0/2380234077 conn(0x7f69e00cb930 msgr2=0x7f69e00cbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:09.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.313+0000 7f69e79ae700 1 -- 172.21.15.77:0/2380234077 shutdown_connections 2023-07-24T05:47:09.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.313+0000 7f69e79ae700 1 -- 172.21.15.77:0/2380234077 wait complete. 2023-07-24T05:47:09.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.313+0000 7f69e79ae700 1 Processor -- start 2023-07-24T05:47:09.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.317+0000 7f69e79ae700 1 -- start start 2023-07-24T05:47:09.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.317+0000 7f69e79ae700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f69e006b9b0 0x7f69e00c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:09.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.317+0000 7f69e79ae700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69e0159360 0x7f69e00acc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:09.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.317+0000 7f69e79ae700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69e015cee0 0x7f69e0152a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:09.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.317+0000 7f69e79ae700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e015a6a0 con 0x7f69e015cee0 2023-07-24T05:47:09.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.317+0000 7f69e79ae700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e0151a80 con 0x7f69e0159360 2023-07-24T05:47:09.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.317+0000 7f69e79ae700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e00c5af0 con 0x7f69e006b9b0 2023-07-24T05:47:09.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.317+0000 7f69e5f4b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69e015cee0 0x7f69e0152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:09.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.317+0000 7f69e5f4b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69e015cee0 0x7f69e0152a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35138/0 (socket says 172.21.15.77:35138) 2023-07-24T05:47:09.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.317+0000 7f69e5f4b700 1 -- 172.21.15.77:0/3449043243 learned_addr learned my addr 172.21.15.77:0/3449043243 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:09.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.317+0000 7f69e4f49700 1 --2- 172.21.15.77:0/3449043243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69e0159360 0x7f69e00acc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:09.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.317+0000 7f69e574a700 1 --2- 172.21.15.77:0/3449043243 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f69e006b9b0 0x7f69e00c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:09.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.317+0000 7f69e5f4b700 1 -- 172.21.15.77:0/3449043243 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f69e006b9b0 msgr2=0x7f69e00c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:09.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.317+0000 7f69e5f4b700 1 --2- 172.21.15.77:0/3449043243 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f69e006b9b0 0x7f69e00c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:09.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.317+0000 7f69e5f4b700 1 -- 172.21.15.77:0/3449043243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69e0159360 msgr2=0x7f69e00acc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:09.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.317+0000 7f69e5f4b700 1 --2- 172.21.15.77:0/3449043243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69e0159360 0x7f69e00acc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:09.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.317+0000 7f69e5f4b700 1 -- 172.21.15.77:0/3449043243 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69dc0094b0 con 0x7f69e015cee0 2023-07-24T05:47:09.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.317+0000 7f69e574a700 1 --2- 172.21.15.77:0/3449043243 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f69e006b9b0 0x7f69e00c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:09.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.317+0000 7f69e4f49700 1 --2- 172.21.15.77:0/3449043243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69e0159360 0x7f69e00acc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:09.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.317+0000 7f69e5f4b700 1 --2- 172.21.15.77:0/3449043243 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69e015cee0 0x7f69e0152a40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f69d800cb60 tx=0x7f69d800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:09.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.317+0000 7f69d5ffb700 1 -- 172.21.15.77:0/3449043243 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d800aad0 con 0x7f69e015cee0 2023-07-24T05:47:09.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.317+0000 7f69e79ae700 1 -- 172.21.15.77:0/3449043243 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e015bdd0 con 0x7f69e015cee0 2023-07-24T05:47:09.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.317+0000 7f69d5ffb700 1 -- 172.21.15.77:0/3449043243 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d800ac50 con 0x7f69e015cee0 2023-07-24T05:47:09.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.317+0000 7f69d5ffb700 1 -- 172.21.15.77:0/3449043243 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d80070d0 con 0x7f69e015cee0 2023-07-24T05:47:09.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.317+0000 7f69e79ae700 1 -- 172.21.15.77:0/3449043243 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69e015c390 con 0x7f69e015cee0 2023-07-24T05:47:09.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.321+0000 7f69e79ae700 1 -- 172.21.15.77:0/3449043243 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69e004df10 con 0x7f69e015cee0 2023-07-24T05:47:09.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.321+0000 7f69d5ffb700 1 -- 172.21.15.77:0/3449043243 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f69d8007230 con 0x7f69e015cee0 2023-07-24T05:47:09.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.321+0000 7f69d5ffb700 1 --2- 172.21.15.77:0/3449043243 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f69c40662f0 0x7f69c40687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:09.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.325+0000 7f69d5ffb700 1 -- 172.21.15.77:0/3449043243 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f69d8083a60 con 0x7f69e015cee0 2023-07-24T05:47:09.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.325+0000 7f69e574a700 1 --2- 172.21.15.77:0/3449043243 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f69c40662f0 0x7f69c40687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:09.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.325+0000 7f69e574a700 1 --2- 172.21.15.77:0/3449043243 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f69c40662f0 0x7f69c40687b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f69dc0090b0 tx=0x7f69dc008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:09.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.329+0000 7f69d5ffb700 1 -- 172.21.15.77:0/3449043243 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f69d8050bc0 con 0x7f69e015cee0 2023-07-24T05:47:09.510 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.505+0000 7f69e79ae700 1 -- 172.21.15.77:0/3449043243 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f69e00cc520 con 0x7f69e015cee0 2023-07-24T05:47:09.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.513+0000 7f69d5ffb700 1 -- 172.21.15.77:0/3449043243 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f69d80541e0 con 0x7f69e015cee0 2023-07-24T05:47:09.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.517+0000 7f69e79ae700 1 -- 172.21.15.77:0/3449043243 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f69c40662f0 msgr2=0x7f69c40687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:09.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.517+0000 7f69e79ae700 1 --2- 172.21.15.77:0/3449043243 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f69c40662f0 0x7f69c40687b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f69dc0090b0 tx=0x7f69dc008030 comp rx=0 tx=0).stop 2023-07-24T05:47:09.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.517+0000 7f69e79ae700 1 -- 172.21.15.77:0/3449043243 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69e015cee0 msgr2=0x7f69e0152a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:09.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.517+0000 7f69e79ae700 1 --2- 172.21.15.77:0/3449043243 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69e015cee0 0x7f69e0152a40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f69d800cb60 tx=0x7f69d800cf20 comp rx=0 tx=0).stop 2023-07-24T05:47:09.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.517+0000 7f69e79ae700 1 -- 172.21.15.77:0/3449043243 shutdown_connections 2023-07-24T05:47:09.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.517+0000 7f69e79ae700 1 --2- 172.21.15.77:0/3449043243 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69e015cee0 0x7f69e0152a40 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:09.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.517+0000 7f69e79ae700 1 --2- 172.21.15.77:0/3449043243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69e0159360 0x7f69e00acc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:09.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.517+0000 7f69e79ae700 1 --2- 172.21.15.77:0/3449043243 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f69c40662f0 0x7f69c40687b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:09.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.517+0000 7f69e79ae700 1 --2- 172.21.15.77:0/3449043243 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f69e006b9b0 0x7f69e00c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:09.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.517+0000 7f69e79ae700 1 -- 172.21.15.77:0/3449043243 >> 172.21.15.77:0/3449043243 conn(0x7f69e00cb930 msgr2=0x7f69e00ce160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:09.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.517+0000 7f69e79ae700 1 -- 172.21.15.77:0/3449043243 shutdown_connections 2023-07-24T05:47:09.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.517+0000 7f69e79ae700 1 -- 172.21.15.77:0/3449043243 wait complete. 2023-07-24T05:47:09.544 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-24T05:47:09.545 DEBUG:teuthology.orchestra.run.smithi077:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-24T05:47:09.587 DEBUG:teuthology.orchestra.run.smithi103:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-24T05:47:09.626 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-24T05:47:09.626 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-07-24T05:47:09.626 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-24T05:47:09.644 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-07-24T05:47:09.645 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-24T05:47:09.710 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-24T05:47:09.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.917+0000 7f1c389ca700 1 Processor -- start 2023-07-24T05:47:09.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.917+0000 7f1c389ca700 1 -- start start 2023-07-24T05:47:09.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.921+0000 7f1c389ca700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1c340a4580 0x7f1c3406fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:09.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.921+0000 7f1c389ca700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c340adc40 con 0x7f1c34069b10 2023-07-24T05:47:09.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.921+0000 7f1c389ca700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c340adee0 con 0x7f1c340b13c0 2023-07-24T05:47:09.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.921+0000 7f1c389ca700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c340ae1c0 con 0x7f1c340a4580 2023-07-24T05:47:09.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.921+0000 7f1c33fff700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f1c34069b10 0x7f1c340af9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55238/0 (socket says 172.21.15.77:55238) 2023-07-24T05:47:09.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.921+0000 7f1c33fff700 1 -- 172.21.15.77:0/2483491323 learned_addr learned my addr 172.21.15.77:0/2483491323 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:09.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.921+0000 7f1c2bfff700 1 --2- 172.21.15.77:0/2483491323 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1c340a4580 0x7f1c3406fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:09.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.921+0000 7f1c32ffd700 1 -- 172.21.15.77:0/2483491323 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 200863048 0 0) 0x7f1c340adc40 con 0x7f1c34069b10 2023-07-24T05:47:09.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.921+0000 7f1c32ffd700 1 -- 172.21.15.77:0/2483491323 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c200035d0 con 0x7f1c34069b10 2023-07-24T05:47:09.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.921+0000 7f1c32ffd700 1 -- 172.21.15.77:0/2483491323 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 722248894 0 0) 0x7f1c340adee0 con 0x7f1c340b13c0 2023-07-24T05:47:09.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.921+0000 7f1c32ffd700 1 -- 172.21.15.77:0/2483491323 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c340adc40 con 0x7f1c340b13c0 2023-07-24T05:47:09.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.921+0000 7f1c32ffd700 1 -- 172.21.15.77:0/2483491323 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1207831666 0 0) 0x7f1c200035d0 con 0x7f1c34069b10 2023-07-24T05:47:09.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.921+0000 7f1c2bfff700 1 -- 172.21.15.77:0/2483491323 >> v1:172.21.15.103:6789/0 conn(0x7f1c340b13c0 legacy=0x7f1c3406adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:09.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.921+0000 7f1c2bfff700 1 -- 172.21.15.77:0/2483491323 >> v1:172.21.15.77:6789/0 conn(0x7f1c34069b10 legacy=0x7f1c340af9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:09.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.921+0000 7f1c2bfff700 1 -- 172.21.15.77:0/2483491323 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c340ae4a0 con 0x7f1c340a4580 2023-07-24T05:47:09.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.925+0000 7f1c2bfff700 1 --2- 172.21.15.77:0/2483491323 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1c340a4580 0x7f1c3406fbe0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c009880 tx=0x7f1c1c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1811a763fdfc18e server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:09.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.925+0000 7f1c32ffd700 1 -- 172.21.15.77:0/2483491323 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c0019f0 con 0x7f1c340a4580 2023-07-24T05:47:09.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.925+0000 7f1c32ffd700 1 -- 172.21.15.77:0/2483491323 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c1c004030 con 0x7f1c340a4580 2023-07-24T05:47:09.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.925+0000 7f1c32ffd700 1 -- 172.21.15.77:0/2483491323 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c0043c0 con 0x7f1c340a4580 2023-07-24T05:47:09.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.925+0000 7f1c389ca700 1 -- 172.21.15.77:0/2483491323 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1c340a4580 msgr2=0x7f1c3406fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:09.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.925+0000 7f1c389ca700 1 --2- 172.21.15.77:0/2483491323 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1c340a4580 0x7f1c3406fbe0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c009880 tx=0x7f1c1c009b90 comp rx=0 tx=0).stop 2023-07-24T05:47:09.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.925+0000 7f1c389ca700 1 -- 172.21.15.77:0/2483491323 shutdown_connections 2023-07-24T05:47:09.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.925+0000 7f1c389ca700 1 --2- 172.21.15.77:0/2483491323 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1c340a4580 0x7f1c3406fbe0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:09.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.925+0000 7f1c389ca700 1 -- 172.21.15.77:0/2483491323 >> 172.21.15.77:0/2483491323 conn(0x7f1c340cacc0 msgr2=0x7f1c340cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:09.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.925+0000 7f1c389ca700 1 -- 172.21.15.77:0/2483491323 shutdown_connections 2023-07-24T05:47:09.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.925+0000 7f1c389ca700 1 -- 172.21.15.77:0/2483491323 wait complete. 2023-07-24T05:47:09.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.929+0000 7f1c389ca700 1 Processor -- start 2023-07-24T05:47:09.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.929+0000 7f1c389ca700 1 -- start start 2023-07-24T05:47:09.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.929+0000 7f1c389ca700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c34069b10 0x7f1c341583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:09.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.929+0000 7f1c389ca700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1c340a4580 0x7f1c340c9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:09.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.929+0000 7f1c389ca700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c340b13c0 0x7f1c340c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:09.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.929+0000 7f1c389ca700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c341588f0 con 0x7f1c34069b10 2023-07-24T05:47:09.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.929+0000 7f1c389ca700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3406cd40 con 0x7f1c340b13c0 2023-07-24T05:47:09.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.929+0000 7f1c389ca700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3406d020 con 0x7f1c340a4580 2023-07-24T05:47:09.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.929+0000 7f1c337fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c34069b10 0x7f1c341583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:09.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.929+0000 7f1c337fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c34069b10 0x7f1c341583b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35144/0 (socket says 172.21.15.77:35144) 2023-07-24T05:47:09.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.929+0000 7f1c337fe700 1 -- 172.21.15.77:0/2136203094 learned_addr learned my addr 172.21.15.77:0/2136203094 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:09.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.929+0000 7f1c2bfff700 1 --2- 172.21.15.77:0/2136203094 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1c340a4580 0x7f1c340c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:09.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.929+0000 7f1c33fff700 1 --2- 172.21.15.77:0/2136203094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c340b13c0 0x7f1c340c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:09.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.929+0000 7f1c337fe700 1 -- 172.21.15.77:0/2136203094 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1c340a4580 msgr2=0x7f1c340c9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:09.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.929+0000 7f1c337fe700 1 --2- 172.21.15.77:0/2136203094 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1c340a4580 0x7f1c340c9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:09.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.929+0000 7f1c337fe700 1 -- 172.21.15.77:0/2136203094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c340b13c0 msgr2=0x7f1c340c9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:09.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.929+0000 7f1c337fe700 1 --2- 172.21.15.77:0/2136203094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c340b13c0 0x7f1c340c9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:09.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.929+0000 7f1c337fe700 1 -- 172.21.15.77:0/2136203094 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c1c0094b0 con 0x7f1c34069b10 2023-07-24T05:47:09.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.929+0000 7f1c33fff700 1 --2- 172.21.15.77:0/2136203094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c340b13c0 0x7f1c340c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:09.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.929+0000 7f1c337fe700 1 --2- 172.21.15.77:0/2136203094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c34069b10 0x7f1c341583b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1c2400c730 tx=0x7f1c2400ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:09.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.929+0000 7f1c30ff9700 1 -- 172.21.15.77:0/2136203094 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c240052d0 con 0x7f1c34069b10 2023-07-24T05:47:09.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.929+0000 7f1c30ff9700 1 -- 172.21.15.77:0/2136203094 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c24005450 con 0x7f1c34069b10 2023-07-24T05:47:09.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.929+0000 7f1c389ca700 1 -- 172.21.15.77:0/2136203094 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c3415d310 con 0x7f1c34069b10 2023-07-24T05:47:09.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.929+0000 7f1c30ff9700 1 -- 172.21.15.77:0/2136203094 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c240038e0 con 0x7f1c34069b10 2023-07-24T05:47:09.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.933+0000 7f1c389ca700 1 -- 172.21.15.77:0/2136203094 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c34159be0 con 0x7f1c34069b10 2023-07-24T05:47:09.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.933+0000 7f1c389ca700 1 -- 172.21.15.77:0/2136203094 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c3415d830 con 0x7f1c34069b10 2023-07-24T05:47:09.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.933+0000 7f1c30ff9700 1 -- 172.21.15.77:0/2136203094 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1c24003a40 con 0x7f1c34069b10 2023-07-24T05:47:09.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.937+0000 7f1c30ff9700 1 --2- 172.21.15.77:0/2136203094 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f1c140662f0 0x7f1c140687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:09.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.937+0000 7f1c30ff9700 1 -- 172.21.15.77:0/2136203094 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1c24083510 con 0x7f1c34069b10 2023-07-24T05:47:09.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.937+0000 7f1c2bfff700 1 --2- 172.21.15.77:0/2136203094 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f1c140662f0 0x7f1c140687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:09.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.937+0000 7f1c2bfff700 1 --2- 172.21.15.77:0/2136203094 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f1c140662f0 0x7f1c140687b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c0090b0 tx=0x7f1c1c010000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:09.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:09.941+0000 7f1c30ff9700 1 -- 172.21.15.77:0/2136203094 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1c3415d830 con 0x7f1c34069b10 2023-07-24T05:47:10.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.117+0000 7f1c389ca700 1 -- 172.21.15.77:0/2136203094 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c3415d830 con 0x7f1c34069b10 2023-07-24T05:47:10.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.121+0000 7f1c30ff9700 1 -- 172.21.15.77:0/2136203094 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20204 (secure 0 0 0) 0x7f1c3415d830 con 0x7f1c34069b10 2023-07-24T05:47:10.127 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:47:10.127 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":27,"fsid":"5aed5f7b-fb55-4d95-9c02-c6adbb1677b4","created":"2023-07-24T05:45:39.639731+0000","modified":"2023-07-24T05:46:48.442117+0000","last_up_change":"2023-07-24T05:45:52.319670+0000","last_in_change":"2023-07-24T05:45:43.643277+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-24T05:45:52.610430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-24T05:45:52.773787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-24T05:45:58.121732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-24T05:45:59.368726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-24T05:46:03.032057+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ffa0d496-461a-4053-b764-0627d969521b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6812","nonce":825987196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6817","nonce":825987196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6831","nonce":825987196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6824","nonce":825987196}]},"public_addr":"172.21.15.77:6812/825987196","cluster_addr":"172.21.15.77:6817/825987196","heartbeat_back_addr":"172.21.15.77:6831/825987196","heartbeat_front_addr":"172.21.15.77:6824/825987196","state":["exists","up"]},{"osd":1,"uuid":"9f595e5e-5c43-49bc-8ce4-ee70575c90da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6801","nonce":4133026815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6803","nonce":4133026815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6807","nonce":4133026815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6805","nonce":4133026815}]},"public_addr":"172.21.15.77:6801/4133026815","cluster_addr":"172.21.15.77:6803/4133026815","heartbeat_back_addr":"172.21.15.77:6807/4133026815","heartbeat_front_addr":"172.21.15.77:6805/4133026815","state":["exists","up"]},{"osd":2,"uuid":"2ac177aa-4d7d-4262-bd54-d2b9f29f4c3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6811","nonce":2394142159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6819","nonce":2394142159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6830","nonce":2394142159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6825","nonce":2394142159}]},"public_addr":"172.21.15.77:6811/2394142159","cluster_addr":"172.21.15.77:6819/2394142159","heartbeat_back_addr":"172.21.15.77:6830/2394142159","heartbeat_front_addr":"172.21.15.77:6825/2394142159","state":["exists","up"]},{"osd":3,"uuid":"17d7a251-19e8-484c-8172-a578ab3da153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6813","nonce":1492113982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6818","nonce":1492113982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6829","nonce":1492113982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6823","nonce":1492113982}]},"public_addr":"172.21.15.77:6813/1492113982","cluster_addr":"172.21.15.77:6818/1492113982","heartbeat_back_addr":"172.21.15.77:6829/1492113982","heartbeat_front_addr":"172.21.15.77:6823/1492113982","state":["exists","up"]},{"osd":4,"uuid":"bf63ca05-f06d-4e0f-ac44-2a416c70b919","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6825","nonce":1080481057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6827","nonce":1080481057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6831","nonce":1080481057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6829","nonce":1080481057}]},"public_addr":"172.21.15.103:6825/1080481057","cluster_addr":"172.21.15.103:6827/1080481057","heartbeat_back_addr":"172.21.15.103:6831/1080481057","heartbeat_front_addr":"172.21.15.103:6829/1080481057","state":["exists","up"]},{"osd":5,"uuid":"65a11a35-9e9f-4b3c-9fe3-b658d62b9318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6811","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6813","nonce":2756677504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6818","nonce":2756677504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6823","nonce":2756677504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6821","nonce":2756677504}]},"public_addr":"172.21.15.103:6813/2756677504","cluster_addr":"172.21.15.103:6818/2756677504","heartbeat_back_addr":"172.21.15.103:6823/2756677504","heartbeat_front_addr":"172.21.15.103:6821/2756677504","state":["exists","up"]},{"osd":6,"uuid":"750c1f87-686c-40b4-94a1-1a299dc78f3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6809","nonce":568977764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6812","nonce":568977764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6819","nonce":568977764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6815","nonce":568977764}]},"public_addr":"172.21.15.103:6809/568977764","cluster_addr":"172.21.15.103:6812/568977764","heartbeat_back_addr":"172.21.15.103:6819/568977764","heartbeat_front_addr":"172.21.15.103:6815/568977764","state":["exists","up"]},{"osd":7,"uuid":"d5fe4fb6-2e09-4158-885b-403803c85822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6801","nonce":1074557176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6803","nonce":1074557176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6807","nonce":1074557176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6805","nonce":1074557176}]},"public_addr":"172.21.15.103:6801/1074557176","cluster_addr":"172.21.15.103:6803/1074557176","heartbeat_back_addr":"172.21.15.103:6807/1074557176","heartbeat_front_addr":"172.21.15.103:6805/1074557176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.631032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.154109+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.398587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.679089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.311218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.353726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.314372+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.126212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1d","mappings":[{"from":3,"to":2}]},{"pgid":"4.31","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-24T05:47:10.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.125+0000 7f1c389ca700 1 -- 172.21.15.77:0/2136203094 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f1c140662f0 msgr2=0x7f1c140687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.125+0000 7f1c389ca700 1 --2- 172.21.15.77:0/2136203094 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f1c140662f0 0x7f1c140687b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c0090b0 tx=0x7f1c1c010000 comp rx=0 tx=0).stop 2023-07-24T05:47:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.125+0000 7f1c389ca700 1 -- 172.21.15.77:0/2136203094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c34069b10 msgr2=0x7f1c341583b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.125+0000 7f1c389ca700 1 --2- 172.21.15.77:0/2136203094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c34069b10 0x7f1c341583b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1c2400c730 tx=0x7f1c2400ca40 comp rx=0 tx=0).stop 2023-07-24T05:47:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.125+0000 7f1c389ca700 1 -- 172.21.15.77:0/2136203094 shutdown_connections 2023-07-24T05:47:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.125+0000 7f1c389ca700 1 --2- 172.21.15.77:0/2136203094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c340b13c0 0x7f1c340c9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.125+0000 7f1c389ca700 1 --2- 172.21.15.77:0/2136203094 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f1c140662f0 0x7f1c140687b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:10.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.125+0000 7f1c389ca700 1 --2- 172.21.15.77:0/2136203094 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1c340a4580 0x7f1c340c9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:10.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.125+0000 7f1c389ca700 1 --2- 172.21.15.77:0/2136203094 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c34069b10 0x7f1c341583b0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:10.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.125+0000 7f1c389ca700 1 -- 172.21.15.77:0/2136203094 >> 172.21.15.77:0/2136203094 conn(0x7f1c340cacc0 msgr2=0x7f1c34070bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:10.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.125+0000 7f1c389ca700 1 -- 172.21.15.77:0/2136203094 shutdown_connections 2023-07-24T05:47:10.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.125+0000 7f1c389ca700 1 -- 172.21.15.77:0/2136203094 wait complete. 2023-07-24T05:47:10.153 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-24T05:45:52.610430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-24T05:45:52.773787+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-24T05:45:58.121732+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-24T05:45:59.368726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-24T05:46:03.032057+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-24T05:47:10.154 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-24T05:47:10.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.329+0000 7fa3a15ae700 1 Processor -- start 2023-07-24T05:47:10.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.333+0000 7fa3a15ae700 1 -- start start 2023-07-24T05:47:10.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.333+0000 7fa3a15ae700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa39c15c890 0x7fa39c0b6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:10.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.333+0000 7fa3a15ae700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa39c0b7d00 0x7fa39c0b8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:10.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.333+0000 7fa3a15ae700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa39c0ce7d0 con 0x7fa39c0cf830 2023-07-24T05:47:10.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.333+0000 7fa3a15ae700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa39c0d0920 con 0x7fa39c0b7d00 2023-07-24T05:47:10.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.333+0000 7fa3a15ae700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c0cea70 con 0x7fa39c15c890 2023-07-24T05:47:10.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.333+0000 7fa39bfff700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fa39c0cf830 0x7fa39c0cfcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55252/0 (socket says 172.21.15.77:55252) 2023-07-24T05:47:10.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.333+0000 7fa39bfff700 1 -- 172.21.15.77:0/2748244566 learned_addr learned my addr 172.21.15.77:0/2748244566 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:10.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.333+0000 7fa39a7fc700 1 --2- 172.21.15.77:0/2748244566 >> v2:172.21.15.77:3300/0 conn(0x7fa39c0b7d00 0x7fa39c0b8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:10.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.333+0000 7fa39affd700 1 --2- 172.21.15.77:0/2748244566 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa39c15c890 0x7fa39c0b6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:10.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.333+0000 7fa399ffb700 1 -- 172.21.15.77:0/2748244566 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2377593592 0 0) 0x7fa39c0ce7d0 con 0x7fa39c0cf830 2023-07-24T05:47:10.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.333+0000 7fa399ffb700 1 -- 172.21.15.77:0/2748244566 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3840035d0 con 0x7fa39c0cf830 2023-07-24T05:47:10.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.333+0000 7fa39a7fc700 1 -- 172.21.15.77:0/2748244566 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa39c15c890 msgr2=0x7fa39c0b6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:10.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.333+0000 7fa39a7fc700 1 --2- 172.21.15.77:0/2748244566 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa39c15c890 0x7fa39c0b6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:10.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.333+0000 7fa39a7fc700 1 -- 172.21.15.77:0/2748244566 >> v1:172.21.15.77:6789/0 conn(0x7fa39c0cf830 legacy=0x7fa39c0cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:10.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.333+0000 7fa39a7fc700 1 -- 172.21.15.77:0/2748244566 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39c0ced50 con 0x7fa39c0b7d00 2023-07-24T05:47:10.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.337+0000 7fa39a7fc700 1 --2- 172.21.15.77:0/2748244566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa39c0b7d00 0x7fa39c0b8160 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa390009850 tx=0x7fa390009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45582569a6a11ab9 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:10.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.337+0000 7fa399ffb700 1 -- 172.21.15.77:0/2748244566 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa390011830 con 0x7fa39c0b7d00 2023-07-24T05:47:10.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.337+0000 7fa399ffb700 1 -- 172.21.15.77:0/2748244566 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa390011990 con 0x7fa39c0b7d00 2023-07-24T05:47:10.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.337+0000 7fa399ffb700 1 -- 172.21.15.77:0/2748244566 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa390011d40 con 0x7fa39c0b7d00 2023-07-24T05:47:10.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.337+0000 7fa3a15ae700 1 -- 172.21.15.77:0/2748244566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa39c0b7d00 msgr2=0x7fa39c0b8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:10.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.337+0000 7fa3a15ae700 1 --2- 172.21.15.77:0/2748244566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa39c0b7d00 0x7fa39c0b8160 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa390009850 tx=0x7fa390009b60 comp rx=0 tx=0).stop 2023-07-24T05:47:10.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.337+0000 7fa3a15ae700 1 -- 172.21.15.77:0/2748244566 shutdown_connections 2023-07-24T05:47:10.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.337+0000 7fa3a15ae700 1 --2- 172.21.15.77:0/2748244566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa39c0b7d00 0x7fa39c0b8160 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:10.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.337+0000 7fa3a15ae700 1 --2- 172.21.15.77:0/2748244566 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa39c15c890 0x7fa39c0b6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:10.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.337+0000 7fa3a15ae700 1 -- 172.21.15.77:0/2748244566 >> 172.21.15.77:0/2748244566 conn(0x7fa39c0b5b40 msgr2=0x7fa39c0b5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:10.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.337+0000 7fa3a15ae700 1 -- 172.21.15.77:0/2748244566 shutdown_connections 2023-07-24T05:47:10.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.337+0000 7fa3a15ae700 1 -- 172.21.15.77:0/2748244566 wait complete. 2023-07-24T05:47:10.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.341+0000 7fa3a15ae700 1 Processor -- start 2023-07-24T05:47:10.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.341+0000 7fa3a15ae700 1 -- start start 2023-07-24T05:47:10.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.341+0000 7fa3a15ae700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa39c0b7d00 0x7fa39c15d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:10.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.341+0000 7fa3a15ae700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa39c0cf830 0x7fa39c15de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:10.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.341+0000 7fa3a15ae700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa39c15c890 0x7fa39c0c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:10.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.341+0000 7fa3a15ae700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c15e890 con 0x7fa39c0b7d00 2023-07-24T05:47:10.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.341+0000 7fa3a15ae700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c15e340 con 0x7fa39c0cf830 2023-07-24T05:47:10.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.341+0000 7fa3a15ae700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c0cb2c0 con 0x7fa39c15c890 2023-07-24T05:47:10.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.341+0000 7fa39affd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa39c0b7d00 0x7fa39c15d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:10.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.341+0000 7fa39affd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa39c0b7d00 0x7fa39c15d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35150/0 (socket says 172.21.15.77:35150) 2023-07-24T05:47:10.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.341+0000 7fa39affd700 1 -- 172.21.15.77:0/541098493 learned_addr learned my addr 172.21.15.77:0/541098493 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:10.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.341+0000 7fa39bfff700 1 --2- 172.21.15.77:0/541098493 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa39c15c890 0x7fa39c0c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:10.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.341+0000 7fa39a7fc700 1 --2- 172.21.15.77:0/541098493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa39c0cf830 0x7fa39c15de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:10.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.341+0000 7fa39affd700 1 -- 172.21.15.77:0/541098493 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa39c15c890 msgr2=0x7fa39c0c8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:10.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.341+0000 7fa39affd700 1 --2- 172.21.15.77:0/541098493 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa39c15c890 0x7fa39c0c8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:10.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.341+0000 7fa39affd700 1 -- 172.21.15.77:0/541098493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa39c0cf830 msgr2=0x7fa39c15de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:10.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.341+0000 7fa39affd700 1 --2- 172.21.15.77:0/541098493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa39c0cf830 0x7fa39c15de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:10.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.341+0000 7fa39affd700 1 -- 172.21.15.77:0/541098493 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3900094b0 con 0x7fa39c0b7d00 2023-07-24T05:47:10.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.345+0000 7fa39affd700 1 --2- 172.21.15.77:0/541098493 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa39c0b7d00 0x7fa39c15d8c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa38c00ea00 tx=0x7fa38c00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:10.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.345+0000 7fa3837fe700 1 -- 172.21.15.77:0/541098493 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c009720 con 0x7fa39c0b7d00 2023-07-24T05:47:10.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.345+0000 7fa3837fe700 1 -- 172.21.15.77:0/541098493 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa38c00c850 con 0x7fa39c0b7d00 2023-07-24T05:47:10.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.345+0000 7fa3a15ae700 1 -- 172.21.15.77:0/541098493 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa39c15e5b0 con 0x7fa39c0b7d00 2023-07-24T05:47:10.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.345+0000 7fa3837fe700 1 -- 172.21.15.77:0/541098493 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c00cbc0 con 0x7fa39c0b7d00 2023-07-24T05:47:10.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.345+0000 7fa3a15ae700 1 -- 172.21.15.77:0/541098493 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa39c0cb840 con 0x7fa39c0b7d00 2023-07-24T05:47:10.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.345+0000 7fa3a15ae700 1 -- 172.21.15.77:0/541098493 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa39c04df10 con 0x7fa39c0b7d00 2023-07-24T05:47:10.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.345+0000 7fa3837fe700 1 -- 172.21.15.77:0/541098493 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa38c00cd20 con 0x7fa39c0b7d00 2023-07-24T05:47:10.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.349+0000 7fa3837fe700 1 --2- 172.21.15.77:0/541098493 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa3880662f0 0x7fa3880687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:10.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.349+0000 7fa3837fe700 1 -- 172.21.15.77:0/541098493 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa38c0840d0 con 0x7fa39c0b7d00 2023-07-24T05:47:10.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.349+0000 7fa39a7fc700 1 --2- 172.21.15.77:0/541098493 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa3880662f0 0x7fa3880687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:10.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.349+0000 7fa39a7fc700 1 --2- 172.21.15.77:0/541098493 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa3880662f0 0x7fa3880687b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa3900090b0 tx=0x7fa390008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:10.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.353+0000 7fa3837fe700 1 -- 172.21.15.77:0/541098493 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa38c054d40 con 0x7fa39c0b7d00 2023-07-24T05:47:10.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.525+0000 7fa3a15ae700 1 -- 172.21.15.77:0/541098493 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa39c0d31f0 con 0x7fa39c0b7d00 2023-07-24T05:47:10.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.525+0000 7fa3837fe700 1 -- 172.21.15.77:0/541098493 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa38c0548d0 con 0x7fa39c0b7d00 2023-07-24T05:47:10.533 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-07-24T05:47:10.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.529+0000 7fa3a15ae700 1 -- 172.21.15.77:0/541098493 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa3880662f0 msgr2=0x7fa3880687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:10.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.529+0000 7fa3a15ae700 1 --2- 172.21.15.77:0/541098493 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa3880662f0 0x7fa3880687b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa3900090b0 tx=0x7fa390008030 comp rx=0 tx=0).stop 2023-07-24T05:47:10.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.529+0000 7fa3a15ae700 1 -- 172.21.15.77:0/541098493 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa39c0b7d00 msgr2=0x7fa39c15d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:10.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.529+0000 7fa3a15ae700 1 --2- 172.21.15.77:0/541098493 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa39c0b7d00 0x7fa39c15d8c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa38c00ea00 tx=0x7fa38c00edc0 comp rx=0 tx=0).stop 2023-07-24T05:47:10.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.529+0000 7fa3a15ae700 1 -- 172.21.15.77:0/541098493 shutdown_connections 2023-07-24T05:47:10.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.529+0000 7fa3a15ae700 1 --2- 172.21.15.77:0/541098493 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa3880662f0 0x7fa3880687b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:10.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.529+0000 7fa3a15ae700 1 --2- 172.21.15.77:0/541098493 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa39c15c890 0x7fa39c0c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:10.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.529+0000 7fa3a15ae700 1 --2- 172.21.15.77:0/541098493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa39c0cf830 0x7fa39c15de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:10.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.529+0000 7fa3a15ae700 1 --2- 172.21.15.77:0/541098493 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa39c0b7d00 0x7fa39c15d8c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:10.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.529+0000 7fa3a15ae700 1 -- 172.21.15.77:0/541098493 >> 172.21.15.77:0/541098493 conn(0x7fa39c0b5b40 msgr2=0x7fa39c0b9620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:10.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.533+0000 7fa3a15ae700 1 -- 172.21.15.77:0/541098493 shutdown_connections 2023-07-24T05:47:10.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.533+0000 7fa3a15ae700 1 -- 172.21.15.77:0/541098493 wait complete. 2023-07-24T05:47:10.558 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-24T05:47:10.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.733+0000 7f2ef9370700 1 Processor -- start 2023-07-24T05:47:10.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.733+0000 7f2ef9370700 1 -- start start 2023-07-24T05:47:10.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.733+0000 7f2ef9370700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2ef415c9a0 0x7f2ef406d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:10.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.733+0000 7f2ef9370700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2ef40cf5c0 0x7f2ef40cf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:10.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.733+0000 7f2ef9370700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ef40cff10 con 0x7f2ef406bb60 2023-07-24T05:47:10.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.737+0000 7f2ef9370700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef40cf170 con 0x7f2ef415c9a0 2023-07-24T05:47:10.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.737+0000 7f2ef9370700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef406b4d0 con 0x7f2ef40cf5c0 2023-07-24T05:47:10.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.737+0000 7f2ef2ffd700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2ef415c9a0 0x7f2ef406d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:10.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.737+0000 7f2ef27fc700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f2ef406bb60 0x7f2ef40d0290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55256/0 (socket says 172.21.15.77:55256) 2023-07-24T05:47:10.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.737+0000 7f2ef27fc700 1 -- 172.21.15.77:0/2146369985 learned_addr learned my addr 172.21.15.77:0/2146369985 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:10.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.737+0000 7f2ef37fe700 1 --2- 172.21.15.77:0/2146369985 >> v2:172.21.15.103:3300/0 conn(0x7f2ef40cf5c0 0x7f2ef40cf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:10.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.737+0000 7f2ef1ffb700 1 -- 172.21.15.77:0/2146369985 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3753912590 0 0) 0x7f2ef40cff10 con 0x7f2ef406bb60 2023-07-24T05:47:10.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.737+0000 7f2ef1ffb700 1 -- 172.21.15.77:0/2146369985 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2edc0035d0 con 0x7f2ef406bb60 2023-07-24T05:47:10.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.737+0000 7f2ef2ffd700 1 -- 172.21.15.77:0/2146369985 >> v2:172.21.15.103:3300/0 conn(0x7f2ef40cf5c0 msgr2=0x7f2ef40cf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:10.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.737+0000 7f2ef2ffd700 1 --2- 172.21.15.77:0/2146369985 >> v2:172.21.15.103:3300/0 conn(0x7f2ef40cf5c0 0x7f2ef40cf9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:10.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.737+0000 7f2ef2ffd700 1 -- 172.21.15.77:0/2146369985 >> v1:172.21.15.77:6789/0 conn(0x7f2ef406bb60 legacy=0x7f2ef40d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:10.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.737+0000 7f2ef2ffd700 1 -- 172.21.15.77:0/2146369985 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef406ac30 con 0x7f2ef415c9a0 2023-07-24T05:47:10.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.737+0000 7f2ef2ffd700 1 --2- 172.21.15.77:0/2146369985 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ef415c9a0 0x7f2ef406d2d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2ef406d220 tx=0x7f2ee4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=298b4bd64a139f2 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:10.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.737+0000 7f2ef1ffb700 1 -- 172.21.15.77:0/2146369985 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee4011830 con 0x7f2ef415c9a0 2023-07-24T05:47:10.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.737+0000 7f2ef1ffb700 1 -- 172.21.15.77:0/2146369985 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee4011990 con 0x7f2ef415c9a0 2023-07-24T05:47:10.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.737+0000 7f2ef1ffb700 1 -- 172.21.15.77:0/2146369985 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee4011d20 con 0x7f2ef415c9a0 2023-07-24T05:47:10.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.737+0000 7f2ef9370700 1 -- 172.21.15.77:0/2146369985 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ef415c9a0 msgr2=0x7f2ef406d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:10.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.737+0000 7f2ef9370700 1 --2- 172.21.15.77:0/2146369985 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ef415c9a0 0x7f2ef406d2d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2ef406d220 tx=0x7f2ee4009b30 comp rx=0 tx=0).stop 2023-07-24T05:47:10.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.737+0000 7f2ef9370700 1 -- 172.21.15.77:0/2146369985 shutdown_connections 2023-07-24T05:47:10.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.737+0000 7f2ef9370700 1 --2- 172.21.15.77:0/2146369985 >> v2:172.21.15.103:3300/0 conn(0x7f2ef40cf5c0 0x7f2ef40cf9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:10.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.737+0000 7f2ef9370700 1 --2- 172.21.15.77:0/2146369985 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ef415c9a0 0x7f2ef406d2d0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:10.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.737+0000 7f2ef9370700 1 -- 172.21.15.77:0/2146369985 >> 172.21.15.77:0/2146369985 conn(0x7f2ef40b5610 msgr2=0x7f2ef40b5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:10.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.741+0000 7f2ef9370700 1 -- 172.21.15.77:0/2146369985 shutdown_connections 2023-07-24T05:47:10.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.741+0000 7f2ef9370700 1 -- 172.21.15.77:0/2146369985 wait complete. 2023-07-24T05:47:10.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.741+0000 7f2ef9370700 1 Processor -- start 2023-07-24T05:47:10.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.741+0000 7f2ef9370700 1 -- start start 2023-07-24T05:47:10.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.745+0000 7f2ef9370700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ef406bb60 0x7f2ef4158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:10.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.745+0000 7f2ef9370700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2ef40cf5c0 0x7f2ef41e59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:10.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.745+0000 7f2ef9370700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ef415c9a0 0x7f2ef41e3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:10.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.745+0000 7f2ef9370700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef41e5530 con 0x7f2ef415c9a0 2023-07-24T05:47:10.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.745+0000 7f2ef9370700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef41e4920 con 0x7f2ef406bb60 2023-07-24T05:47:10.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.745+0000 7f2ef9370700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef41e4c00 con 0x7f2ef40cf5c0 2023-07-24T05:47:10.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.745+0000 7f2ef37fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ef415c9a0 0x7f2ef41e3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:10.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.745+0000 7f2ef37fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ef415c9a0 0x7f2ef41e3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35166/0 (socket says 172.21.15.77:35166) 2023-07-24T05:47:10.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.745+0000 7f2ef37fe700 1 -- 172.21.15.77:0/1619235088 learned_addr learned my addr 172.21.15.77:0/1619235088 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:10.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.745+0000 7f2ef2ffd700 1 --2- 172.21.15.77:0/1619235088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ef406bb60 0x7f2ef4158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:10.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.745+0000 7f2ef27fc700 1 --2- 172.21.15.77:0/1619235088 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2ef40cf5c0 0x7f2ef41e59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:10.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.745+0000 7f2ef37fe700 1 -- 172.21.15.77:0/1619235088 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2ef40cf5c0 msgr2=0x7f2ef41e59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:10.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.745+0000 7f2ef37fe700 1 --2- 172.21.15.77:0/1619235088 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2ef40cf5c0 0x7f2ef41e59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:10.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.745+0000 7f2ef37fe700 1 -- 172.21.15.77:0/1619235088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ef406bb60 msgr2=0x7f2ef4158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:10.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.745+0000 7f2ef37fe700 1 --2- 172.21.15.77:0/1619235088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ef406bb60 0x7f2ef4158d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:10.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.745+0000 7f2ef37fe700 1 -- 172.21.15.77:0/1619235088 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee40094b0 con 0x7f2ef415c9a0 2023-07-24T05:47:10.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.745+0000 7f2ef37fe700 1 --2- 172.21.15.77:0/1619235088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ef415c9a0 0x7f2ef41e3f40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2eec00efc0 tx=0x7f2eec00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:10.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.745+0000 7f2edb7fe700 1 -- 172.21.15.77:0/1619235088 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec009ea0 con 0x7f2ef415c9a0 2023-07-24T05:47:10.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.745+0000 7f2edb7fe700 1 -- 172.21.15.77:0/1619235088 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eec00f040 con 0x7f2ef415c9a0 2023-07-24T05:47:10.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.745+0000 7f2edb7fe700 1 -- 172.21.15.77:0/1619235088 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec014480 con 0x7f2ef415c9a0 2023-07-24T05:47:10.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.745+0000 7f2ef9370700 1 -- 172.21.15.77:0/1619235088 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef41e4ee0 con 0x7f2ef415c9a0 2023-07-24T05:47:10.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.745+0000 7f2ef9370700 1 -- 172.21.15.77:0/1619235088 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ef40c9370 con 0x7f2ef415c9a0 2023-07-24T05:47:10.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.745+0000 7f2ef9370700 1 -- 172.21.15.77:0/1619235088 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ef41e56e0 con 0x7f2ef415c9a0 2023-07-24T05:47:10.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.749+0000 7f2edb7fe700 1 -- 172.21.15.77:0/1619235088 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2eec0145e0 con 0x7f2ef415c9a0 2023-07-24T05:47:10.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.749+0000 7f2edb7fe700 1 --2- 172.21.15.77:0/1619235088 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2ee00662f0 0x7f2ee00687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:10.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.749+0000 7f2edb7fe700 1 -- 172.21.15.77:0/1619235088 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2eec084c40 con 0x7f2ef415c9a0 2023-07-24T05:47:10.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.749+0000 7f2ef2ffd700 1 --2- 172.21.15.77:0/1619235088 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2ee00662f0 0x7f2ee00687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:10.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.753+0000 7f2ef2ffd700 1 --2- 172.21.15.77:0/1619235088 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2ee00662f0 0x7f2ee00687b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4000c00 tx=0x7f2ee4008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:10.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.757+0000 7f2edb7fe700 1 -- 172.21.15.77:0/1619235088 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2ef41e56e0 con 0x7f2ef415c9a0 2023-07-24T05:47:10.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.925+0000 7f2ef9370700 1 -- 172.21.15.77:0/1619235088 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2ef4072490 con 0x7f2ef415c9a0 2023-07-24T05:47:10.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.929+0000 7f2edb7fe700 1 -- 172.21.15.77:0/1619235088 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2eec0180a0 con 0x7f2ef415c9a0 2023-07-24T05:47:10.933 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 8 2023-07-24T05:47:10.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.929+0000 7f2ef9370700 1 -- 172.21.15.77:0/1619235088 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2ee00662f0 msgr2=0x7f2ee00687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:10.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.929+0000 7f2ef9370700 1 --2- 172.21.15.77:0/1619235088 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2ee00662f0 0x7f2ee00687b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4000c00 tx=0x7f2ee4008030 comp rx=0 tx=0).stop 2023-07-24T05:47:10.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.929+0000 7f2ef9370700 1 -- 172.21.15.77:0/1619235088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ef415c9a0 msgr2=0x7f2ef41e3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:10.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.929+0000 7f2ef9370700 1 --2- 172.21.15.77:0/1619235088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ef415c9a0 0x7f2ef41e3f40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2eec00efc0 tx=0x7f2eec00c3a0 comp rx=0 tx=0).stop 2023-07-24T05:47:10.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.929+0000 7f2ef9370700 1 -- 172.21.15.77:0/1619235088 shutdown_connections 2023-07-24T05:47:10.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.929+0000 7f2ef9370700 1 --2- 172.21.15.77:0/1619235088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2ef415c9a0 0x7f2ef41e3f40 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:10.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.929+0000 7f2ef9370700 1 --2- 172.21.15.77:0/1619235088 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2ee00662f0 0x7f2ee00687b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:10.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.929+0000 7f2ef9370700 1 --2- 172.21.15.77:0/1619235088 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2ef40cf5c0 0x7f2ef41e59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:10.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.929+0000 7f2ef9370700 1 --2- 172.21.15.77:0/1619235088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ef406bb60 0x7f2ef4158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:10.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.929+0000 7f2ef9370700 1 -- 172.21.15.77:0/1619235088 >> 172.21.15.77:0/1619235088 conn(0x7f2ef40b5610 msgr2=0x7f2ef415be20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:10.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.929+0000 7f2ef9370700 1 -- 172.21.15.77:0/1619235088 shutdown_connections 2023-07-24T05:47:10.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:10.929+0000 7f2ef9370700 1 -- 172.21.15.77:0/1619235088 wait complete. 2023-07-24T05:47:10.957 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-24T05:47:11.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.125+0000 7fb0ec6a2700 1 Processor -- start 2023-07-24T05:47:11.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.125+0000 7fb0ec6a2700 1 -- start start 2023-07-24T05:47:11.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.125+0000 7fb0ec6a2700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb0e40ad930 0x7fb0e40cae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:11.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.129+0000 7fb0ec6a2700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb0e40ca420 0x7fb0e40cc010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:11.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.129+0000 7fb0ec6a2700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0e40add10 con 0x7fb0e40cb360 2023-07-24T05:47:11.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.129+0000 7fb0ec6a2700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0e40cf2f0 con 0x7fb0e40ca420 2023-07-24T05:47:11.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.129+0000 7fb0ec6a2700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e415e530 con 0x7fb0e40ad930 2023-07-24T05:47:11.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.129+0000 7fb0eac3f700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb0e40ca420 0x7fb0e40cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:11.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.129+0000 7fb0eac3f700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fb0e40ca420 0x7fb0e40cc010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35176/0 (socket says 172.21.15.77:35176) 2023-07-24T05:47:11.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.129+0000 7fb0eac3f700 1 -- 172.21.15.77:0/4045059868 learned_addr learned my addr 172.21.15.77:0/4045059868 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:11.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.129+0000 7fb0e9c3d700 1 --1- 172.21.15.77:0/4045059868 >> v1:172.21.15.77:6789/0 conn(0x7fb0e40cb360 0x7fb0e40c9d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55270/0 (socket says 172.21.15.77:55270) 2023-07-24T05:47:11.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.129+0000 7fb0ea43e700 1 --2- 172.21.15.77:0/4045059868 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb0e40ad930 0x7fb0e40cae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:11.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.129+0000 7fb0eac3f700 1 -- 172.21.15.77:0/4045059868 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb0e40ad930 msgr2=0x7fb0e40cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:11.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.129+0000 7fb0eac3f700 1 --2- 172.21.15.77:0/4045059868 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb0e40ad930 0x7fb0e40cae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:11.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.129+0000 7fb0eac3f700 1 -- 172.21.15.77:0/4045059868 >> v1:172.21.15.77:6789/0 conn(0x7fb0e40cb360 legacy=0x7fb0e40c9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:11.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.129+0000 7fb0eac3f700 1 -- 172.21.15.77:0/4045059868 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e40cb7c0 con 0x7fb0e40ca420 2023-07-24T05:47:11.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.129+0000 7fb0e943c700 1 -- 172.21.15.77:0/4045059868 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2389885659 0 0) 0x7fb0e40add10 con 0x7fb0e40cb360 2023-07-24T05:47:11.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.129+0000 7fb0eac3f700 1 --2- 172.21.15.77:0/4045059868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0e40ca420 0x7fb0e40cc010 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc009e50 tx=0x7fb0dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81bde599ad65c57 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:11.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.129+0000 7fb0e943c700 1 -- 172.21.15.77:0/4045059868 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc00e070 con 0x7fb0e40ca420 2023-07-24T05:47:11.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.129+0000 7fb0e943c700 1 -- 172.21.15.77:0/4045059868 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0dc00b9c0 con 0x7fb0e40ca420 2023-07-24T05:47:11.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.129+0000 7fb0e943c700 1 -- 172.21.15.77:0/4045059868 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc00bd70 con 0x7fb0e40ca420 2023-07-24T05:47:11.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.129+0000 7fb0ec6a2700 1 -- 172.21.15.77:0/4045059868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0e40ca420 msgr2=0x7fb0e40cc010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:11.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.129+0000 7fb0ec6a2700 1 --2- 172.21.15.77:0/4045059868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0e40ca420 0x7fb0e40cc010 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc009e50 tx=0x7fb0dc00b330 comp rx=0 tx=0).stop 2023-07-24T05:47:11.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.129+0000 7fb0ec6a2700 1 -- 172.21.15.77:0/4045059868 shutdown_connections 2023-07-24T05:47:11.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.129+0000 7fb0ec6a2700 1 --2- 172.21.15.77:0/4045059868 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0e40ca420 0x7fb0e40cc010 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:11.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.129+0000 7fb0ec6a2700 1 --2- 172.21.15.77:0/4045059868 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb0e40ad930 0x7fb0e40cae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:11.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.129+0000 7fb0ec6a2700 1 -- 172.21.15.77:0/4045059868 >> 172.21.15.77:0/4045059868 conn(0x7fb0e40ce440 msgr2=0x7fb0e40ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:11.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.133+0000 7fb0ec6a2700 1 -- 172.21.15.77:0/4045059868 shutdown_connections 2023-07-24T05:47:11.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.133+0000 7fb0ec6a2700 1 -- 172.21.15.77:0/4045059868 wait complete. 2023-07-24T05:47:11.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.137+0000 7fb0ec6a2700 1 Processor -- start 2023-07-24T05:47:11.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.137+0000 7fb0ec6a2700 1 -- start start 2023-07-24T05:47:11.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.137+0000 7fb0ec6a2700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb0e40ad930 0x7fb0e414d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:11.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.137+0000 7fb0ec6a2700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0e40ca420 0x7fb0e40c4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:11.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.137+0000 7fb0ec6a2700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0e40cb360 0x7fb0e40c4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:11.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.137+0000 7fb0ec6a2700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e41f5180 con 0x7fb0e40cb360 2023-07-24T05:47:11.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.137+0000 7fb0ec6a2700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e40add10 con 0x7fb0e40ca420 2023-07-24T05:47:11.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.137+0000 7fb0ec6a2700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e40adff0 con 0x7fb0e40ad930 2023-07-24T05:47:11.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.137+0000 7fb0eac3f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0e40cb360 0x7fb0e40c4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:11.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.137+0000 7fb0eac3f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0e40cb360 0x7fb0e40c4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35186/0 (socket says 172.21.15.77:35186) 2023-07-24T05:47:11.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.137+0000 7fb0eac3f700 1 -- 172.21.15.77:0/3417768782 learned_addr learned my addr 172.21.15.77:0/3417768782 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:11.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.137+0000 7fb0e9c3d700 1 --2- 172.21.15.77:0/3417768782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0e40ca420 0x7fb0e40c4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:11.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.137+0000 7fb0ea43e700 1 --2- 172.21.15.77:0/3417768782 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb0e40ad930 0x7fb0e414d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:11.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.137+0000 7fb0eac3f700 1 -- 172.21.15.77:0/3417768782 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb0e40ad930 msgr2=0x7fb0e414d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:11.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.137+0000 7fb0eac3f700 1 --2- 172.21.15.77:0/3417768782 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb0e40ad930 0x7fb0e414d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:11.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.137+0000 7fb0eac3f700 1 -- 172.21.15.77:0/3417768782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0e40ca420 msgr2=0x7fb0e40c4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:11.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.137+0000 7fb0eac3f700 1 --2- 172.21.15.77:0/3417768782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0e40ca420 0x7fb0e40c4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:11.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.137+0000 7fb0eac3f700 1 -- 172.21.15.77:0/3417768782 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0dc009b30 con 0x7fb0e40cb360 2023-07-24T05:47:11.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.137+0000 7fb0eac3f700 1 --2- 172.21.15.77:0/3417768782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0e40cb360 0x7fb0e40c4680 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc00b730 tx=0x7fb0dc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:11.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.141+0000 7fb0daffd700 1 -- 172.21.15.77:0/3417768782 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc0048b0 con 0x7fb0e40cb360 2023-07-24T05:47:11.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.141+0000 7fb0daffd700 1 -- 172.21.15.77:0/3417768782 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0dc0099b0 con 0x7fb0e40cb360 2023-07-24T05:47:11.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.141+0000 7fb0daffd700 1 -- 172.21.15.77:0/3417768782 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc01c680 con 0x7fb0e40cb360 2023-07-24T05:47:11.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.141+0000 7fb0ec6a2700 1 -- 172.21.15.77:0/3417768782 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0e40ae2d0 con 0x7fb0e40cb360 2023-07-24T05:47:11.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.141+0000 7fb0ec6a2700 1 -- 172.21.15.77:0/3417768782 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0e40b0720 con 0x7fb0e40cb360 2023-07-24T05:47:11.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.141+0000 7fb0ec6a2700 1 -- 172.21.15.77:0/3417768782 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0e40b02a0 con 0x7fb0e40cb360 2023-07-24T05:47:11.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.145+0000 7fb0daffd700 1 -- 172.21.15.77:0/3417768782 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb0dc01c7e0 con 0x7fb0e40cb360 2023-07-24T05:47:11.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.145+0000 7fb0daffd700 1 --2- 172.21.15.77:0/3417768782 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb0c80662f0 0x7fb0c80687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:11.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.145+0000 7fb0daffd700 1 -- 172.21.15.77:0/3417768782 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb0dc085b80 con 0x7fb0e40cb360 2023-07-24T05:47:11.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.145+0000 7fb0ea43e700 1 --2- 172.21.15.77:0/3417768782 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb0c80662f0 0x7fb0c80687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:11.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.149+0000 7fb0ea43e700 1 --2- 172.21.15.77:0/3417768782 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb0c80662f0 0x7fb0c80687b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb0e0006fd0 tx=0x7fb0e0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:11.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.149+0000 7fb0daffd700 1 -- 172.21.15.77:0/3417768782 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb0e40b02a0 con 0x7fb0e40cb360 2023-07-24T05:47:11.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.321+0000 7fb0ec6a2700 1 -- 172.21.15.77:0/3417768782 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb0e40b02a0 con 0x7fb0e40cb360 2023-07-24T05:47:11.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.321+0000 7fb0daffd700 1 -- 172.21.15.77:0/3417768782 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb0e40b02a0 con 0x7fb0e40cb360 2023-07-24T05:47:11.329 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-07-24T05:47:11.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.325+0000 7fb0ec6a2700 1 -- 172.21.15.77:0/3417768782 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb0c80662f0 msgr2=0x7fb0c80687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:11.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.325+0000 7fb0ec6a2700 1 --2- 172.21.15.77:0/3417768782 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb0c80662f0 0x7fb0c80687b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb0e0006fd0 tx=0x7fb0e0008040 comp rx=0 tx=0).stop 2023-07-24T05:47:11.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.325+0000 7fb0ec6a2700 1 -- 172.21.15.77:0/3417768782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0e40cb360 msgr2=0x7fb0e40c4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:11.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.325+0000 7fb0ec6a2700 1 --2- 172.21.15.77:0/3417768782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0e40cb360 0x7fb0e40c4680 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc00b730 tx=0x7fb0dc004af0 comp rx=0 tx=0).stop 2023-07-24T05:47:11.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.325+0000 7fb0ec6a2700 1 -- 172.21.15.77:0/3417768782 shutdown_connections 2023-07-24T05:47:11.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.325+0000 7fb0ec6a2700 1 --2- 172.21.15.77:0/3417768782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb0e40cb360 0x7fb0e40c4680 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:11.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.325+0000 7fb0ec6a2700 1 --2- 172.21.15.77:0/3417768782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb0e40ca420 0x7fb0e40c4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:11.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.325+0000 7fb0ec6a2700 1 --2- 172.21.15.77:0/3417768782 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb0c80662f0 0x7fb0c80687b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:11.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.325+0000 7fb0ec6a2700 1 --2- 172.21.15.77:0/3417768782 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb0e40ad930 0x7fb0e414d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:11.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.325+0000 7fb0ec6a2700 1 -- 172.21.15.77:0/3417768782 >> 172.21.15.77:0/3417768782 conn(0x7fb0e40ce440 msgr2=0x7fb0e40ac800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:11.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.325+0000 7fb0ec6a2700 1 -- 172.21.15.77:0/3417768782 shutdown_connections 2023-07-24T05:47:11.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.325+0000 7fb0ec6a2700 1 -- 172.21.15.77:0/3417768782 wait complete. 2023-07-24T05:47:11.351 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-24T05:47:11.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.521+0000 7f3c4623c700 1 Processor -- start 2023-07-24T05:47:11.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.521+0000 7f3c4623c700 1 -- start start 2023-07-24T05:47:11.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.525+0000 7f3c4623c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3c4006bb60 0x7f3c4006d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:11.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.525+0000 7f3c4623c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c400cf5c0 0x7f3c400cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:11.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.525+0000 7f3c4623c700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c400cff30 con 0x7f3c4015c9a0 2023-07-24T05:47:11.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.525+0000 7f3c4623c700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c400cf170 con 0x7f3c4006bb60 2023-07-24T05:47:11.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.525+0000 7f3c4623c700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4006b4d0 con 0x7f3c400cf5c0 2023-07-24T05:47:11.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.525+0000 7f3c4523a700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f3c4015c9a0 0x7f3c400d0290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55278/0 (socket says 172.21.15.77:55278) 2023-07-24T05:47:11.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.525+0000 7f3c4523a700 1 -- 172.21.15.77:0/3500178948 learned_addr learned my addr 172.21.15.77:0/3500178948 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:11.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.525+0000 7f3c45a3b700 1 --2- 172.21.15.77:0/3500178948 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c400cf5c0 0x7f3c400cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:11.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.525+0000 7f3c44a39700 1 --2- 172.21.15.77:0/3500178948 >> v2:172.21.15.103:3300/0 conn(0x7f3c4006bb60 0x7f3c4006d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:11.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.529+0000 7f3c44a39700 1 -- 172.21.15.77:0/3500178948 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c400cf5c0 msgr2=0x7f3c400cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:11.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.529+0000 7f3c44a39700 1 --2- 172.21.15.77:0/3500178948 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c400cf5c0 0x7f3c400cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:11.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.529+0000 7f3c44a39700 1 -- 172.21.15.77:0/3500178948 >> v1:172.21.15.77:6789/0 conn(0x7f3c4015c9a0 legacy=0x7f3c400d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:11.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.529+0000 7f3c44a39700 1 -- 172.21.15.77:0/3500178948 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c4006ac30 con 0x7f3c4006bb60 2023-07-24T05:47:11.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.529+0000 7f3c37fff700 1 -- 172.21.15.77:0/3500178948 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 989978899 0 0) 0x7f3c400cff30 con 0x7f3c4015c9a0 2023-07-24T05:47:11.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.529+0000 7f3c44a39700 1 --2- 172.21.15.77:0/3500178948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c4006bb60 0x7f3c4006d2d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3c30009850 tx=0x7f3c30009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6df67c6aeb19d4c server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:11.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.529+0000 7f3c37fff700 1 -- 172.21.15.77:0/3500178948 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c30011830 con 0x7f3c4006bb60 2023-07-24T05:47:11.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.529+0000 7f3c37fff700 1 -- 172.21.15.77:0/3500178948 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c30011990 con 0x7f3c4006bb60 2023-07-24T05:47:11.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.529+0000 7f3c37fff700 1 -- 172.21.15.77:0/3500178948 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c30011d40 con 0x7f3c4006bb60 2023-07-24T05:47:11.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.529+0000 7f3c4623c700 1 -- 172.21.15.77:0/3500178948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c4006bb60 msgr2=0x7f3c4006d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:11.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.529+0000 7f3c4623c700 1 --2- 172.21.15.77:0/3500178948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c4006bb60 0x7f3c4006d2d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3c30009850 tx=0x7f3c30009b60 comp rx=0 tx=0).stop 2023-07-24T05:47:11.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.529+0000 7f3c4623c700 1 -- 172.21.15.77:0/3500178948 shutdown_connections 2023-07-24T05:47:11.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.529+0000 7f3c4623c700 1 --2- 172.21.15.77:0/3500178948 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c400cf5c0 0x7f3c400cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:11.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.529+0000 7f3c4623c700 1 --2- 172.21.15.77:0/3500178948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c4006bb60 0x7f3c4006d2d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:11.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.529+0000 7f3c4623c700 1 -- 172.21.15.77:0/3500178948 >> 172.21.15.77:0/3500178948 conn(0x7f3c400b5610 msgr2=0x7f3c400b5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:11.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.529+0000 7f3c4623c700 1 -- 172.21.15.77:0/3500178948 shutdown_connections 2023-07-24T05:47:11.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.529+0000 7f3c4623c700 1 -- 172.21.15.77:0/3500178948 wait complete. 2023-07-24T05:47:11.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.533+0000 7f3c4623c700 1 Processor -- start 2023-07-24T05:47:11.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.533+0000 7f3c4623c700 1 -- start start 2023-07-24T05:47:11.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.533+0000 7f3c4623c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c4006bb60 0x7f3c401f34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:11.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.533+0000 7f3c4623c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c400cf5c0 0x7f3c401f2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:11.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.533+0000 7f3c4623c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c4015c9a0 0x7f3c400b3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:11.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.533+0000 7f3c4623c700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c400c7350 con 0x7f3c4006bb60 2023-07-24T05:47:11.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.533+0000 7f3c4623c700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c400c75f0 con 0x7f3c4015c9a0 2023-07-24T05:47:11.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.533+0000 7f3c4623c700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c400c78d0 con 0x7f3c400cf5c0 2023-07-24T05:47:11.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.533+0000 7f3c4523a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c4006bb60 0x7f3c401f34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:11.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.533+0000 7f3c4523a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c4006bb60 0x7f3c401f34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35192/0 (socket says 172.21.15.77:35192) 2023-07-24T05:47:11.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.533+0000 7f3c4523a700 1 -- 172.21.15.77:0/499508583 learned_addr learned my addr 172.21.15.77:0/499508583 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:11.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.533+0000 7f3c44a39700 1 --2- 172.21.15.77:0/499508583 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c400cf5c0 0x7f3c401f2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:11.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.533+0000 7f3c45a3b700 1 --2- 172.21.15.77:0/499508583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c4015c9a0 0x7f3c400b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:11.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.533+0000 7f3c4523a700 1 -- 172.21.15.77:0/499508583 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c400cf5c0 msgr2=0x7f3c401f2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:11.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.533+0000 7f3c4523a700 1 --2- 172.21.15.77:0/499508583 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c400cf5c0 0x7f3c401f2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:11.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.533+0000 7f3c4523a700 1 -- 172.21.15.77:0/499508583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c4015c9a0 msgr2=0x7f3c400b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:11.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.533+0000 7f3c4523a700 1 --2- 172.21.15.77:0/499508583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c4015c9a0 0x7f3c400b3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:11.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.533+0000 7f3c4523a700 1 -- 172.21.15.77:0/499508583 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c300094b0 con 0x7f3c4006bb60 2023-07-24T05:47:11.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.533+0000 7f3c45a3b700 1 --2- 172.21.15.77:0/499508583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c4015c9a0 0x7f3c400b3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:47:11.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.533+0000 7f3c4523a700 1 --2- 172.21.15.77:0/499508583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c4006bb60 0x7f3c401f34a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c00c4e0 tx=0x7f3c3c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:11.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.533+0000 7f3c35ffb700 1 -- 172.21.15.77:0/499508583 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c004ca0 con 0x7f3c4006bb60 2023-07-24T05:47:11.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.537+0000 7f3c35ffb700 1 -- 172.21.15.77:0/499508583 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3c004e20 con 0x7f3c4006bb60 2023-07-24T05:47:11.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.537+0000 7f3c35ffb700 1 -- 172.21.15.77:0/499508583 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c007310 con 0x7f3c4006bb60 2023-07-24T05:47:11.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.537+0000 7f3c4623c700 1 -- 172.21.15.77:0/499508583 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c400c7bb0 con 0x7f3c4006bb60 2023-07-24T05:47:11.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.537+0000 7f3c4623c700 1 -- 172.21.15.77:0/499508583 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c401f39e0 con 0x7f3c4006bb60 2023-07-24T05:47:11.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.537+0000 7f3c4623c700 1 -- 172.21.15.77:0/499508583 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c40072490 con 0x7f3c4006bb60 2023-07-24T05:47:11.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.537+0000 7f3c35ffb700 1 -- 172.21.15.77:0/499508583 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3c3c007470 con 0x7f3c4006bb60 2023-07-24T05:47:11.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.541+0000 7f3c35ffb700 1 --2- 172.21.15.77:0/499508583 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3c240662f0 0x7f3c240687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:11.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.541+0000 7f3c35ffb700 1 -- 172.21.15.77:0/499508583 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3c3c083b90 con 0x7f3c4006bb60 2023-07-24T05:47:11.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.541+0000 7f3c44a39700 1 --2- 172.21.15.77:0/499508583 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3c240662f0 0x7f3c240687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:11.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.541+0000 7f3c44a39700 1 --2- 172.21.15.77:0/499508583 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3c240662f0 0x7f3c240687b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3c300090b0 tx=0x7f3c30008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:11.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.549+0000 7f3c35ffb700 1 -- 172.21.15.77:0/499508583 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3c3c050d70 con 0x7f3c4006bb60 2023-07-24T05:47:11.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.721+0000 7f3c4623c700 1 -- 172.21.15.77:0/499508583 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3c400cfe80 con 0x7f3c4006bb60 2023-07-24T05:47:11.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.721+0000 7f3c35ffb700 1 -- 172.21.15.77:0/499508583 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3c3c007720 con 0x7f3c4006bb60 2023-07-24T05:47:11.728 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-07-24T05:47:11.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.725+0000 7f3c4623c700 1 -- 172.21.15.77:0/499508583 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3c240662f0 msgr2=0x7f3c240687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:11.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.725+0000 7f3c4623c700 1 --2- 172.21.15.77:0/499508583 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3c240662f0 0x7f3c240687b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3c300090b0 tx=0x7f3c30008030 comp rx=0 tx=0).stop 2023-07-24T05:47:11.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.725+0000 7f3c4623c700 1 -- 172.21.15.77:0/499508583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c4006bb60 msgr2=0x7f3c401f34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:11.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.725+0000 7f3c4623c700 1 --2- 172.21.15.77:0/499508583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c4006bb60 0x7f3c401f34a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c00c4e0 tx=0x7f3c3c00c7f0 comp rx=0 tx=0).stop 2023-07-24T05:47:11.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.725+0000 7f3c4623c700 1 -- 172.21.15.77:0/499508583 shutdown_connections 2023-07-24T05:47:11.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.725+0000 7f3c4623c700 1 --2- 172.21.15.77:0/499508583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3c4015c9a0 0x7f3c400b3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:11.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.725+0000 7f3c4623c700 1 --2- 172.21.15.77:0/499508583 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3c240662f0 0x7f3c240687b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:11.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.725+0000 7f3c4623c700 1 --2- 172.21.15.77:0/499508583 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3c400cf5c0 0x7f3c401f2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:11.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.725+0000 7f3c4623c700 1 --2- 172.21.15.77:0/499508583 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3c4006bb60 0x7f3c401f34a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:11.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.725+0000 7f3c4623c700 1 -- 172.21.15.77:0/499508583 >> 172.21.15.77:0/499508583 conn(0x7f3c400b5610 msgr2=0x7f3c400d0270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:11.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.725+0000 7f3c4623c700 1 -- 172.21.15.77:0/499508583 shutdown_connections 2023-07-24T05:47:11.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.725+0000 7f3c4623c700 1 -- 172.21.15.77:0/499508583 wait complete. 2023-07-24T05:47:11.753 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-24T05:47:11.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.917+0000 7f2d5e71d700 1 Processor -- start 2023-07-24T05:47:11.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.921+0000 7f2d5e71d700 1 -- start start 2023-07-24T05:47:11.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.921+0000 7f2d5e71d700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2d5806a520 0x7f2d580b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:11.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.921+0000 7f2d5e71d700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d5806cf70 con 0x7f2d580aaf50 2023-07-24T05:47:11.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.921+0000 7f2d5e71d700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d5806db10 con 0x7f2d580abb10 2023-07-24T05:47:11.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.921+0000 7f2d5e71d700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d580ac400 con 0x7f2d5806a520 2023-07-24T05:47:11.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.921+0000 7f2d5d71b700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f2d580aaf50 0x7f2d580ab330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55290/0 (socket says 172.21.15.77:55290) 2023-07-24T05:47:11.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.921+0000 7f2d5d71b700 1 -- 172.21.15.77:0/1740426748 learned_addr learned my addr 172.21.15.77:0/1740426748 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:11.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.921+0000 7f2d5df1c700 1 --2- 172.21.15.77:0/1740426748 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2d5806a520 0x7f2d580b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:11.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.921+0000 7f2d4ffff700 1 -- 172.21.15.77:0/1740426748 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 805588586 0 0) 0x7f2d5806db10 con 0x7f2d580abb10 2023-07-24T05:47:11.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.921+0000 7f2d4ffff700 1 -- 172.21.15.77:0/1740426748 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d440035d0 con 0x7f2d580abb10 2023-07-24T05:47:11.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.921+0000 7f2d4ffff700 1 -- 172.21.15.77:0/1740426748 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3594283783 0 0) 0x7f2d5806cf70 con 0x7f2d580aaf50 2023-07-24T05:47:11.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.921+0000 7f2d4ffff700 1 -- 172.21.15.77:0/1740426748 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d5806db10 con 0x7f2d580aaf50 2023-07-24T05:47:11.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.925+0000 7f2d5df1c700 1 -- 172.21.15.77:0/1740426748 >> v1:172.21.15.103:6789/0 conn(0x7f2d580abb10 legacy=0x7f2d5806d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:11.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.925+0000 7f2d5df1c700 1 -- 172.21.15.77:0/1740426748 >> v1:172.21.15.77:6789/0 conn(0x7f2d580aaf50 legacy=0x7f2d580ab330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:11.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.925+0000 7f2d5df1c700 1 -- 172.21.15.77:0/1740426748 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d5806a9d0 con 0x7f2d5806a520 2023-07-24T05:47:11.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.925+0000 7f2d5df1c700 1 --2- 172.21.15.77:0/1740426748 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2d5806a520 0x7f2d580b10b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2d50009880 tx=0x7f2d50009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=334c59c4e60279dd server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:11.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.925+0000 7f2d4ffff700 1 -- 172.21.15.77:0/1740426748 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d50011830 con 0x7f2d5806a520 2023-07-24T05:47:11.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.925+0000 7f2d4ffff700 1 -- 172.21.15.77:0/1740426748 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d50011990 con 0x7f2d5806a520 2023-07-24T05:47:11.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.925+0000 7f2d4ffff700 1 -- 172.21.15.77:0/1740426748 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d50011d20 con 0x7f2d5806a520 2023-07-24T05:47:11.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.925+0000 7f2d5e71d700 1 -- 172.21.15.77:0/1740426748 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2d5806a520 msgr2=0x7f2d580b10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:11.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.925+0000 7f2d5e71d700 1 --2- 172.21.15.77:0/1740426748 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2d5806a520 0x7f2d580b10b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2d50009880 tx=0x7f2d50009b90 comp rx=0 tx=0).stop 2023-07-24T05:47:11.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.925+0000 7f2d5e71d700 1 -- 172.21.15.77:0/1740426748 shutdown_connections 2023-07-24T05:47:11.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.925+0000 7f2d5e71d700 1 --2- 172.21.15.77:0/1740426748 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2d5806a520 0x7f2d580b10b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:11.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.925+0000 7f2d5e71d700 1 -- 172.21.15.77:0/1740426748 >> 172.21.15.77:0/1740426748 conn(0x7f2d580ce260 msgr2=0x7f2d580ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:11.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.925+0000 7f2d5e71d700 1 -- 172.21.15.77:0/1740426748 shutdown_connections 2023-07-24T05:47:11.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.925+0000 7f2d5e71d700 1 -- 172.21.15.77:0/1740426748 wait complete. 2023-07-24T05:47:11.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.929+0000 7f2d5e71d700 1 Processor -- start 2023-07-24T05:47:11.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.929+0000 7f2d5e71d700 1 -- start start 2023-07-24T05:47:11.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.929+0000 7f2d5e71d700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2d5806a520 0x7f2d5815a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:11.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.929+0000 7f2d5e71d700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d580aaf50 0x7f2d580c6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:11.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.929+0000 7f2d5e71d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d580abb10 0x7f2d580c7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:11.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.929+0000 7f2d5e71d700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5815a8b0 con 0x7f2d580abb10 2023-07-24T05:47:11.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.929+0000 7f2d5e71d700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d580aecb0 con 0x7f2d580aaf50 2023-07-24T05:47:11.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.929+0000 7f2d5e71d700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d580c7c50 con 0x7f2d5806a520 2023-07-24T05:47:11.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.929+0000 7f2d5df1c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d580abb10 0x7f2d580c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:11.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.929+0000 7f2d5df1c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d580abb10 0x7f2d580c7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35200/0 (socket says 172.21.15.77:35200) 2023-07-24T05:47:11.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.929+0000 7f2d5df1c700 1 -- 172.21.15.77:0/2412355742 learned_addr learned my addr 172.21.15.77:0/2412355742 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:11.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.929+0000 7f2d5cf1a700 1 --2- 172.21.15.77:0/2412355742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d580aaf50 0x7f2d580c6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:11.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.929+0000 7f2d5d71b700 1 --2- 172.21.15.77:0/2412355742 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2d5806a520 0x7f2d5815a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:11.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.933+0000 7f2d5df1c700 1 -- 172.21.15.77:0/2412355742 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2d5806a520 msgr2=0x7f2d5815a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:11.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.933+0000 7f2d5df1c700 1 --2- 172.21.15.77:0/2412355742 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2d5806a520 0x7f2d5815a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:11.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.933+0000 7f2d5df1c700 1 -- 172.21.15.77:0/2412355742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d580aaf50 msgr2=0x7f2d580c6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:11.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.933+0000 7f2d5df1c700 1 --2- 172.21.15.77:0/2412355742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d580aaf50 0x7f2d580c6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:11.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.933+0000 7f2d5df1c700 1 -- 172.21.15.77:0/2412355742 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d500094b0 con 0x7f2d580abb10 2023-07-24T05:47:11.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.933+0000 7f2d5df1c700 1 --2- 172.21.15.77:0/2412355742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d580abb10 0x7f2d580c7430 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2d500090b0 tx=0x7f2d50004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:11.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.933+0000 7f2d4dffb700 1 -- 172.21.15.77:0/2412355742 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5001a8c0 con 0x7f2d580abb10 2023-07-24T05:47:11.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.933+0000 7f2d4dffb700 1 -- 172.21.15.77:0/2412355742 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5001e070 con 0x7f2d580abb10 2023-07-24T05:47:11.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.933+0000 7f2d5e71d700 1 -- 172.21.15.77:0/2412355742 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d580c7ef0 con 0x7f2d580abb10 2023-07-24T05:47:11.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.933+0000 7f2d4dffb700 1 -- 172.21.15.77:0/2412355742 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5001ac40 con 0x7f2d580abb10 2023-07-24T05:47:11.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.933+0000 7f2d5e71d700 1 -- 172.21.15.77:0/2412355742 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d580c7970 con 0x7f2d580abb10 2023-07-24T05:47:11.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.933+0000 7f2d5e71d700 1 -- 172.21.15.77:0/2412355742 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d580ac760 con 0x7f2d580abb10 2023-07-24T05:47:11.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.937+0000 7f2d4dffb700 1 -- 172.21.15.77:0/2412355742 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2d50024400 con 0x7f2d580abb10 2023-07-24T05:47:11.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.937+0000 7f2d4dffb700 1 --2- 172.21.15.77:0/2412355742 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2d3c0662f0 0x7f2d3c0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:11.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.937+0000 7f2d4dffb700 1 -- 172.21.15.77:0/2412355742 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2d50084fb0 con 0x7f2d580abb10 2023-07-24T05:47:11.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.937+0000 7f2d5d71b700 1 --2- 172.21.15.77:0/2412355742 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2d3c0662f0 0x7f2d3c0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:11.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.937+0000 7f2d5d71b700 1 --2- 172.21.15.77:0/2412355742 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2d3c0662f0 0x7f2d3c0687b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2d54005cb0 tx=0x7f2d54009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:11.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:11.945+0000 7f2d4dffb700 1 -- 172.21.15.77:0/2412355742 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2d500520f0 con 0x7f2d580abb10 2023-07-24T05:47:12.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.117+0000 7f2d5e71d700 1 -- 172.21.15.77:0/2412355742 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2d58072490 con 0x7f2d580abb10 2023-07-24T05:47:12.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.117+0000 7f2d4dffb700 1 -- 172.21.15.77:0/2412355742 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2d500200a0 con 0x7f2d580abb10 2023-07-24T05:47:12.123 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-07-24T05:47:12.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.121+0000 7f2d5e71d700 1 -- 172.21.15.77:0/2412355742 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2d3c0662f0 msgr2=0x7f2d3c0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:12.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.121+0000 7f2d5e71d700 1 --2- 172.21.15.77:0/2412355742 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2d3c0662f0 0x7f2d3c0687b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2d54005cb0 tx=0x7f2d54009040 comp rx=0 tx=0).stop 2023-07-24T05:47:12.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.121+0000 7f2d5e71d700 1 -- 172.21.15.77:0/2412355742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d580abb10 msgr2=0x7f2d580c7430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:12.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.121+0000 7f2d5e71d700 1 --2- 172.21.15.77:0/2412355742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d580abb10 0x7f2d580c7430 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2d500090b0 tx=0x7f2d50004770 comp rx=0 tx=0).stop 2023-07-24T05:47:12.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.121+0000 7f2d5e71d700 1 -- 172.21.15.77:0/2412355742 shutdown_connections 2023-07-24T05:47:12.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.121+0000 7f2d5e71d700 1 --2- 172.21.15.77:0/2412355742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2d580abb10 0x7f2d580c7430 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:12.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.121+0000 7f2d5e71d700 1 --2- 172.21.15.77:0/2412355742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d580aaf50 0x7f2d580c6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:12.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.121+0000 7f2d5e71d700 1 --2- 172.21.15.77:0/2412355742 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2d3c0662f0 0x7f2d3c0687b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:12.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.121+0000 7f2d5e71d700 1 --2- 172.21.15.77:0/2412355742 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2d5806a520 0x7f2d5815a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:12.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.121+0000 7f2d5e71d700 1 -- 172.21.15.77:0/2412355742 >> 172.21.15.77:0/2412355742 conn(0x7f2d580ce260 msgr2=0x7f2d580c8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:12.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.121+0000 7f2d5e71d700 1 -- 172.21.15.77:0/2412355742 shutdown_connections 2023-07-24T05:47:12.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.121+0000 7f2d5e71d700 1 -- 172.21.15.77:0/2412355742 wait complete. 2023-07-24T05:47:12.151 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-24T05:47:12.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.321+0000 7fc2cc990700 1 Processor -- start 2023-07-24T05:47:12.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.321+0000 7fc2cc990700 1 -- start start 2023-07-24T05:47:12.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.325+0000 7fc2cc990700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc2c80d2a50 0x7fc2c806a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:12.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.325+0000 7fc2cc990700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2c80cfd40 con 0x7fc2c815c960 2023-07-24T05:47:12.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.325+0000 7fc2cc990700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2c80ceee0 con 0x7fc2c80d25f0 2023-07-24T05:47:12.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.325+0000 7fc2cc990700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2c806dac0 con 0x7fc2c80d2a50 2023-07-24T05:47:12.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.325+0000 7fc2c759e700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc2c80d2a50 0x7fc2c806a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:12.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.325+0000 7fc2c6d9d700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fc2c815c960 0x7fc2c806d3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55296/0 (socket says 172.21.15.77:55296) 2023-07-24T05:47:12.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.325+0000 7fc2c6d9d700 1 -- 172.21.15.77:0/3260402442 learned_addr learned my addr 172.21.15.77:0/3260402442 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:12.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.325+0000 7fc2c759e700 1 -- 172.21.15.77:0/3260402442 >> v1:172.21.15.103:6789/0 conn(0x7fc2c80d25f0 legacy=0x7fc2c8069b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:12.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.325+0000 7fc2c5d9b700 1 -- 172.21.15.77:0/3260402442 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4202448605 0 0) 0x7fc2c80cfd40 con 0x7fc2c815c960 2023-07-24T05:47:12.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.325+0000 7fc2c759e700 1 -- 172.21.15.77:0/3260402442 >> v1:172.21.15.77:6789/0 conn(0x7fc2c815c960 legacy=0x7fc2c806d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:12.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.325+0000 7fc2c759e700 1 -- 172.21.15.77:0/3260402442 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c80cf130 con 0x7fc2c80d2a50 2023-07-24T05:47:12.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.325+0000 7fc2c759e700 1 --2- 172.21.15.77:0/3260402442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2c80d2a50 0x7fc2c806a220 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0009d90 tx=0x7fc2c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c53a0c9fb743719 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:12.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.329+0000 7fc2c5d9b700 1 -- 172.21.15.77:0/3260402442 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c000e070 con 0x7fc2c80d2a50 2023-07-24T05:47:12.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.329+0000 7fc2c5d9b700 1 -- 172.21.15.77:0/3260402442 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c000bbd0 con 0x7fc2c80d2a50 2023-07-24T05:47:12.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.329+0000 7fc2c5d9b700 1 -- 172.21.15.77:0/3260402442 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c0012430 con 0x7fc2c80d2a50 2023-07-24T05:47:12.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.329+0000 7fc2cc990700 1 -- 172.21.15.77:0/3260402442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2c80d2a50 msgr2=0x7fc2c806a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:12.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.329+0000 7fc2cc990700 1 --2- 172.21.15.77:0/3260402442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2c80d2a50 0x7fc2c806a220 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0009d90 tx=0x7fc2c000b330 comp rx=0 tx=0).stop 2023-07-24T05:47:12.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.329+0000 7fc2cc990700 1 -- 172.21.15.77:0/3260402442 shutdown_connections 2023-07-24T05:47:12.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.329+0000 7fc2cc990700 1 --2- 172.21.15.77:0/3260402442 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2c80d2a50 0x7fc2c806a220 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:12.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.329+0000 7fc2cc990700 1 -- 172.21.15.77:0/3260402442 >> 172.21.15.77:0/3260402442 conn(0x7fc2c80b7600 msgr2=0x7fc2c80b79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:12.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.329+0000 7fc2cc990700 1 -- 172.21.15.77:0/3260402442 shutdown_connections 2023-07-24T05:47:12.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.329+0000 7fc2cc990700 1 -- 172.21.15.77:0/3260402442 wait complete. 2023-07-24T05:47:12.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.329+0000 7fc2cc990700 1 Processor -- start 2023-07-24T05:47:12.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.329+0000 7fc2cc990700 1 -- start start 2023-07-24T05:47:12.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.333+0000 7fc2cc990700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2c80d25f0 0x7fc2c80b1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:12.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.333+0000 7fc2cc990700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2c80d2a50 0x7fc2c815e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:12.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.333+0000 7fc2cc990700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc2c815c960 0x7fc2c815cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:12.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.333+0000 7fc2cc990700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c80b1240 con 0x7fc2c80d2a50 2023-07-24T05:47:12.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.333+0000 7fc2cc990700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c80b21d0 con 0x7fc2c80d25f0 2023-07-24T05:47:12.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.333+0000 7fc2cc990700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c80b3b20 con 0x7fc2c815c960 2023-07-24T05:47:12.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.333+0000 7fc2c659c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2c80d2a50 0x7fc2c815e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:12.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.333+0000 7fc2c659c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2c80d2a50 0x7fc2c815e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35212/0 (socket says 172.21.15.77:35212) 2023-07-24T05:47:12.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.333+0000 7fc2c659c700 1 -- 172.21.15.77:0/315378645 learned_addr learned my addr 172.21.15.77:0/315378645 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:12.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.333+0000 7fc2c6d9d700 1 --2- 172.21.15.77:0/315378645 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2c80d25f0 0x7fc2c80b1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:12.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.333+0000 7fc2c759e700 1 --2- 172.21.15.77:0/315378645 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc2c815c960 0x7fc2c815cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:12.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.333+0000 7fc2c659c700 1 -- 172.21.15.77:0/315378645 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc2c815c960 msgr2=0x7fc2c815cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:12.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.333+0000 7fc2c659c700 1 --2- 172.21.15.77:0/315378645 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc2c815c960 0x7fc2c815cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:12.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.333+0000 7fc2c659c700 1 -- 172.21.15.77:0/315378645 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2c80d25f0 msgr2=0x7fc2c80b1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:12.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.333+0000 7fc2c659c700 1 --2- 172.21.15.77:0/315378645 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2c80d25f0 0x7fc2c80b1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:12.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.333+0000 7fc2c659c700 1 -- 172.21.15.77:0/315378645 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c0009a70 con 0x7fc2c80d2a50 2023-07-24T05:47:12.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.333+0000 7fc2c659c700 1 --2- 172.21.15.77:0/315378645 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2c80d2a50 0x7fc2c815e330 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc00c500 tx=0x7fc2bc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:12.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.333+0000 7fc2af7fe700 1 -- 172.21.15.77:0/315378645 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc0052d0 con 0x7fc2c80d2a50 2023-07-24T05:47:12.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.333+0000 7fc2af7fe700 1 -- 172.21.15.77:0/315378645 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2bc005430 con 0x7fc2c80d2a50 2023-07-24T05:47:12.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.333+0000 7fc2cc990700 1 -- 172.21.15.77:0/315378645 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2c815d800 con 0x7fc2c80d2a50 2023-07-24T05:47:12.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.333+0000 7fc2af7fe700 1 -- 172.21.15.77:0/315378645 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc0055a0 con 0x7fc2c80d2a50 2023-07-24T05:47:12.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.333+0000 7fc2cc990700 1 -- 172.21.15.77:0/315378645 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2c80b1490 con 0x7fc2c80d2a50 2023-07-24T05:47:12.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.337+0000 7fc2cc990700 1 -- 172.21.15.77:0/315378645 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2c815dd20 con 0x7fc2c80d2a50 2023-07-24T05:47:12.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.337+0000 7fc2af7fe700 1 -- 172.21.15.77:0/315378645 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc2bc0038e0 con 0x7fc2c80d2a50 2023-07-24T05:47:12.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.337+0000 7fc2af7fe700 1 --2- 172.21.15.77:0/315378645 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc2b40662f0 0x7fc2b40687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:12.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.337+0000 7fc2af7fe700 1 -- 172.21.15.77:0/315378645 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc2bc0834c0 con 0x7fc2c80d2a50 2023-07-24T05:47:12.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.341+0000 7fc2c6d9d700 1 --2- 172.21.15.77:0/315378645 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc2b40662f0 0x7fc2b40687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:12.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.341+0000 7fc2c6d9d700 1 --2- 172.21.15.77:0/315378645 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc2b40662f0 0x7fc2b40687b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8000f60 tx=0x7fc2b8007c60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:12.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.345+0000 7fc2af7fe700 1 -- 172.21.15.77:0/315378645 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc2bc050600 con 0x7fc2c80d2a50 2023-07-24T05:47:12.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.529+0000 7fc2cc990700 1 -- 172.21.15.77:0/315378645 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc2c80cf9a0 con 0x7fc2c80d2a50 2023-07-24T05:47:12.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.529+0000 7fc2af7fe700 1 -- 172.21.15.77:0/315378645 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc2bc053c20 con 0x7fc2c80d2a50 2023-07-24T05:47:12.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.533+0000 7fc2cc990700 1 -- 172.21.15.77:0/315378645 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc2b40662f0 msgr2=0x7fc2b40687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:12.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.533+0000 7fc2cc990700 1 --2- 172.21.15.77:0/315378645 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc2b40662f0 0x7fc2b40687b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8000f60 tx=0x7fc2b8007c60 comp rx=0 tx=0).stop 2023-07-24T05:47:12.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.533+0000 7fc2cc990700 1 -- 172.21.15.77:0/315378645 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2c80d2a50 msgr2=0x7fc2c815e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:12.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.533+0000 7fc2cc990700 1 --2- 172.21.15.77:0/315378645 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2c80d2a50 0x7fc2c815e330 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc00c500 tx=0x7fc2bc00c8c0 comp rx=0 tx=0).stop 2023-07-24T05:47:12.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.533+0000 7fc2cc990700 1 -- 172.21.15.77:0/315378645 shutdown_connections 2023-07-24T05:47:12.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.533+0000 7fc2cc990700 1 --2- 172.21.15.77:0/315378645 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc2b40662f0 0x7fc2b40687b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:12.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.533+0000 7fc2cc990700 1 --2- 172.21.15.77:0/315378645 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc2c815c960 0x7fc2c815cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:12.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.533+0000 7fc2cc990700 1 --2- 172.21.15.77:0/315378645 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc2c80d2a50 0x7fc2c815e330 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:12.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.533+0000 7fc2cc990700 1 --2- 172.21.15.77:0/315378645 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2c80d25f0 0x7fc2c80b1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:12.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.533+0000 7fc2cc990700 1 -- 172.21.15.77:0/315378645 >> 172.21.15.77:0/315378645 conn(0x7fc2c80b7600 msgr2=0x7fc2c80d0210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:12.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.533+0000 7fc2cc990700 1 -- 172.21.15.77:0/315378645 shutdown_connections 2023-07-24T05:47:12.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.533+0000 7fc2cc990700 1 -- 172.21.15.77:0/315378645 wait complete. 2023-07-24T05:47:12.542 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2023-07-24T05:47:12.561 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-07-24T05:47:12.561 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-24T05:47:12.578 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-24T05:47:12.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.789+0000 7f9d05889700 1 Processor -- start 2023-07-24T05:47:12.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.789+0000 7f9d05889700 1 -- start start 2023-07-24T05:47:12.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.789+0000 7f9d05889700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9d00160d20 0x7f9d000adba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:12.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.789+0000 7f9d05889700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d000af170 con 0x7f9d000b17a0 2023-07-24T05:47:12.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.789+0000 7f9d05889700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d000ae5f0 con 0x7f9d000ae0e0 2023-07-24T05:47:12.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.789+0000 7f9d05889700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d000ae8d0 con 0x7f9d00160d20 2023-07-24T05:47:12.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.789+0000 7f9cff7fe700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f9d000b17a0 0x7f9d000af700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55306/0 (socket says 172.21.15.77:55306) 2023-07-24T05:47:12.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.789+0000 7f9cff7fe700 1 -- 172.21.15.77:0/3592843694 learned_addr learned my addr 172.21.15.77:0/3592843694 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:12.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.789+0000 7f9cfeffd700 1 --2- 172.21.15.77:0/3592843694 >> v2:172.21.15.77:3300/0 conn(0x7f9d00160d20 0x7f9d000adba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:12.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.793+0000 7f9cfdffb700 1 -- 172.21.15.77:0/3592843694 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2523855357 0 0) 0x7f9d000af170 con 0x7f9d000b17a0 2023-07-24T05:47:12.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.793+0000 7f9cfdffb700 1 -- 172.21.15.77:0/3592843694 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ce80035d0 con 0x7f9d000b17a0 2023-07-24T05:47:12.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.793+0000 7f9cfeffd700 1 -- 172.21.15.77:0/3592843694 >> v1:172.21.15.103:6789/0 conn(0x7f9d000ae0e0 legacy=0x7f9d000b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:12.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.793+0000 7f9cfdffb700 1 -- 172.21.15.77:0/3592843694 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3605290508 0 0) 0x7f9d000ae5f0 con 0x7f9d000ae0e0 2023-07-24T05:47:12.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.793+0000 7f9cfeffd700 1 -- 172.21.15.77:0/3592843694 >> v1:172.21.15.77:6789/0 conn(0x7f9d000b17a0 legacy=0x7f9d000af700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:12.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.793+0000 7f9cfeffd700 1 -- 172.21.15.77:0/3592843694 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d000aebb0 con 0x7f9d00160d20 2023-07-24T05:47:12.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.793+0000 7f9cfeffd700 1 --2- 172.21.15.77:0/3592843694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d00160d20 0x7f9d000adba0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0009850 tx=0x7f9cf0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87785bef3fd83696 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:12.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.793+0000 7f9cfdffb700 1 -- 172.21.15.77:0/3592843694 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf0011830 con 0x7f9d00160d20 2023-07-24T05:47:12.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.793+0000 7f9cfdffb700 1 -- 172.21.15.77:0/3592843694 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf0011990 con 0x7f9d00160d20 2023-07-24T05:47:12.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.793+0000 7f9cfdffb700 1 -- 172.21.15.77:0/3592843694 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf0011d40 con 0x7f9d00160d20 2023-07-24T05:47:12.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.793+0000 7f9d05889700 1 -- 172.21.15.77:0/3592843694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d00160d20 msgr2=0x7f9d000adba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:12.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.793+0000 7f9d05889700 1 --2- 172.21.15.77:0/3592843694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d00160d20 0x7f9d000adba0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0009850 tx=0x7f9cf0009b60 comp rx=0 tx=0).stop 2023-07-24T05:47:12.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.793+0000 7f9d05889700 1 -- 172.21.15.77:0/3592843694 shutdown_connections 2023-07-24T05:47:12.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.793+0000 7f9d05889700 1 --2- 172.21.15.77:0/3592843694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d00160d20 0x7f9d000adba0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:12.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.793+0000 7f9d05889700 1 -- 172.21.15.77:0/3592843694 >> 172.21.15.77:0/3592843694 conn(0x7f9d000cacc0 msgr2=0x7f9d000cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:12.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.793+0000 7f9d05889700 1 -- 172.21.15.77:0/3592843694 shutdown_connections 2023-07-24T05:47:12.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.793+0000 7f9d05889700 1 -- 172.21.15.77:0/3592843694 wait complete. 2023-07-24T05:47:12.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.797+0000 7f9d05889700 1 Processor -- start 2023-07-24T05:47:12.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.797+0000 7f9d05889700 1 -- start start 2023-07-24T05:47:12.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.797+0000 7f9d05889700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9d000ae0e0 0x7f9d0014edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:12.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.797+0000 7f9d05889700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d000b17a0 0x7f9d001f7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:12.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.797+0000 7f9d05889700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d00160d20 0x7f9d00163a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:12.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.797+0000 7f9d05889700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d00163fc0 con 0x7f9d00160d20 2023-07-24T05:47:12.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.797+0000 7f9d05889700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d00164260 con 0x7f9d000b17a0 2023-07-24T05:47:12.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.797+0000 7f9d05889700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d000c2690 con 0x7f9d000ae0e0 2023-07-24T05:47:12.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.797+0000 7f9cff7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d00160d20 0x7f9d00163a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:12.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.801+0000 7f9cff7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d00160d20 0x7f9d00163a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35226/0 (socket says 172.21.15.77:35226) 2023-07-24T05:47:12.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.801+0000 7f9cff7fe700 1 -- 172.21.15.77:0/3628398738 learned_addr learned my addr 172.21.15.77:0/3628398738 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:12.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.801+0000 7f9cfeffd700 1 --2- 172.21.15.77:0/3628398738 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9d000ae0e0 0x7f9d0014edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:12.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.801+0000 7f9cfe7fc700 1 --2- 172.21.15.77:0/3628398738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d000b17a0 0x7f9d001f7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:12.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.801+0000 7f9cff7fe700 1 -- 172.21.15.77:0/3628398738 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9d000ae0e0 msgr2=0x7f9d0014edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:12.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.801+0000 7f9cff7fe700 1 --2- 172.21.15.77:0/3628398738 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9d000ae0e0 0x7f9d0014edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:12.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.801+0000 7f9cff7fe700 1 -- 172.21.15.77:0/3628398738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d000b17a0 msgr2=0x7f9d001f7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:12.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.801+0000 7f9cff7fe700 1 --2- 172.21.15.77:0/3628398738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d000b17a0 0x7f9d001f7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:12.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.801+0000 7f9cff7fe700 1 -- 172.21.15.77:0/3628398738 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf00094b0 con 0x7f9d00160d20 2023-07-24T05:47:12.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.801+0000 7f9cff7fe700 1 --2- 172.21.15.77:0/3628398738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d00160d20 0x7f9d00163a80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9cf800cb40 tx=0x7f9cf800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:12.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.801+0000 7f9ce7fff700 1 -- 172.21.15.77:0/3628398738 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf8007500 con 0x7f9d00160d20 2023-07-24T05:47:12.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.801+0000 7f9ce7fff700 1 -- 172.21.15.77:0/3628398738 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf8007660 con 0x7f9d00160d20 2023-07-24T05:47:12.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.801+0000 7f9ce7fff700 1 -- 172.21.15.77:0/3628398738 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf80079f0 con 0x7f9d00160d20 2023-07-24T05:47:12.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.801+0000 7f9d05889700 1 -- 172.21.15.77:0/3628398738 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d000c2970 con 0x7f9d00160d20 2023-07-24T05:47:12.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.801+0000 7f9d05889700 1 -- 172.21.15.77:0/3628398738 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d00161370 con 0x7f9d00160d20 2023-07-24T05:47:12.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.801+0000 7f9d05889700 1 -- 172.21.15.77:0/3628398738 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d00072490 con 0x7f9d00160d20 2023-07-24T05:47:12.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.805+0000 7f9ce7fff700 1 -- 172.21.15.77:0/3628398738 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9cf801b3b0 con 0x7f9d00160d20 2023-07-24T05:47:12.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.805+0000 7f9ce7fff700 1 --2- 172.21.15.77:0/3628398738 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f9cec0662f0 0x7f9cec0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:12.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.805+0000 7f9ce7fff700 1 -- 172.21.15.77:0/3628398738 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9cf8083a60 con 0x7f9d00160d20 2023-07-24T05:47:12.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.805+0000 7f9cfeffd700 1 --2- 172.21.15.77:0/3628398738 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f9cec0662f0 0x7f9cec0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:12.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.809+0000 7f9cfeffd700 1 --2- 172.21.15.77:0/3628398738 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f9cec0662f0 0x7f9cec0687b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9cf00090b0 tx=0x7f9cf001c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:12.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.813+0000 7f9ce7fff700 1 -- 172.21.15.77:0/3628398738 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9cf8050bc0 con 0x7f9d00160d20 2023-07-24T05:47:12.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.993+0000 7f9d05889700 1 -- 172.21.15.77:0/3628398738 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d0006acd0 con 0x7f9d00160d20 2023-07-24T05:47:13.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.993+0000 7f9ce7fff700 1 -- 172.21.15.77:0/3628398738 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20204 (secure 0 0 0) 0x7f9cf80541e0 con 0x7f9d00160d20 2023-07-24T05:47:13.001 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:47:13.001 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":27,"fsid":"5aed5f7b-fb55-4d95-9c02-c6adbb1677b4","created":"2023-07-24T05:45:39.639731+0000","modified":"2023-07-24T05:46:48.442117+0000","last_up_change":"2023-07-24T05:45:52.319670+0000","last_in_change":"2023-07-24T05:45:43.643277+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-24T05:45:52.610430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-24T05:45:52.773787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-24T05:45:58.121732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-24T05:45:59.368726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-24T05:46:03.032057+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ffa0d496-461a-4053-b764-0627d969521b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6812","nonce":825987196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6817","nonce":825987196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6831","nonce":825987196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6824","nonce":825987196}]},"public_addr":"172.21.15.77:6812/825987196","cluster_addr":"172.21.15.77:6817/825987196","heartbeat_back_addr":"172.21.15.77:6831/825987196","heartbeat_front_addr":"172.21.15.77:6824/825987196","state":["exists","up"]},{"osd":1,"uuid":"9f595e5e-5c43-49bc-8ce4-ee70575c90da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6801","nonce":4133026815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6803","nonce":4133026815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6807","nonce":4133026815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6805","nonce":4133026815}]},"public_addr":"172.21.15.77:6801/4133026815","cluster_addr":"172.21.15.77:6803/4133026815","heartbeat_back_addr":"172.21.15.77:6807/4133026815","heartbeat_front_addr":"172.21.15.77:6805/4133026815","state":["exists","up"]},{"osd":2,"uuid":"2ac177aa-4d7d-4262-bd54-d2b9f29f4c3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6811","nonce":2394142159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6819","nonce":2394142159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6830","nonce":2394142159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6825","nonce":2394142159}]},"public_addr":"172.21.15.77:6811/2394142159","cluster_addr":"172.21.15.77:6819/2394142159","heartbeat_back_addr":"172.21.15.77:6830/2394142159","heartbeat_front_addr":"172.21.15.77:6825/2394142159","state":["exists","up"]},{"osd":3,"uuid":"17d7a251-19e8-484c-8172-a578ab3da153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6813","nonce":1492113982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6818","nonce":1492113982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6829","nonce":1492113982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6823","nonce":1492113982}]},"public_addr":"172.21.15.77:6813/1492113982","cluster_addr":"172.21.15.77:6818/1492113982","heartbeat_back_addr":"172.21.15.77:6829/1492113982","heartbeat_front_addr":"172.21.15.77:6823/1492113982","state":["exists","up"]},{"osd":4,"uuid":"bf63ca05-f06d-4e0f-ac44-2a416c70b919","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6825","nonce":1080481057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6827","nonce":1080481057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6831","nonce":1080481057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6829","nonce":1080481057}]},"public_addr":"172.21.15.103:6825/1080481057","cluster_addr":"172.21.15.103:6827/1080481057","heartbeat_back_addr":"172.21.15.103:6831/1080481057","heartbeat_front_addr":"172.21.15.103:6829/1080481057","state":["exists","up"]},{"osd":5,"uuid":"65a11a35-9e9f-4b3c-9fe3-b658d62b9318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6811","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6813","nonce":2756677504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6818","nonce":2756677504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6823","nonce":2756677504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6821","nonce":2756677504}]},"public_addr":"172.21.15.103:6813/2756677504","cluster_addr":"172.21.15.103:6818/2756677504","heartbeat_back_addr":"172.21.15.103:6823/2756677504","heartbeat_front_addr":"172.21.15.103:6821/2756677504","state":["exists","up"]},{"osd":6,"uuid":"750c1f87-686c-40b4-94a1-1a299dc78f3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6809","nonce":568977764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6812","nonce":568977764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6819","nonce":568977764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6815","nonce":568977764}]},"public_addr":"172.21.15.103:6809/568977764","cluster_addr":"172.21.15.103:6812/568977764","heartbeat_back_addr":"172.21.15.103:6819/568977764","heartbeat_front_addr":"172.21.15.103:6815/568977764","state":["exists","up"]},{"osd":7,"uuid":"d5fe4fb6-2e09-4158-885b-403803c85822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6801","nonce":1074557176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6803","nonce":1074557176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6807","nonce":1074557176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6805","nonce":1074557176}]},"public_addr":"172.21.15.103:6801/1074557176","cluster_addr":"172.21.15.103:6803/1074557176","heartbeat_back_addr":"172.21.15.103:6807/1074557176","heartbeat_front_addr":"172.21.15.103:6805/1074557176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.631032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.154109+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.398587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.679089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.311218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.353726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.314372+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.126212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1d","mappings":[{"from":3,"to":2}]},{"pgid":"4.31","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-24T05:47:13.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.997+0000 7f9d05889700 1 -- 172.21.15.77:0/3628398738 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f9cec0662f0 msgr2=0x7f9cec0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:13.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.997+0000 7f9d05889700 1 --2- 172.21.15.77:0/3628398738 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f9cec0662f0 0x7f9cec0687b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9cf00090b0 tx=0x7f9cf001c040 comp rx=0 tx=0).stop 2023-07-24T05:47:13.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.997+0000 7f9d05889700 1 -- 172.21.15.77:0/3628398738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d00160d20 msgr2=0x7f9d00163a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:13.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.997+0000 7f9d05889700 1 --2- 172.21.15.77:0/3628398738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d00160d20 0x7f9d00163a80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f9cf800cb40 tx=0x7f9cf800cb70 comp rx=0 tx=0).stop 2023-07-24T05:47:13.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.997+0000 7f9d05889700 1 -- 172.21.15.77:0/3628398738 shutdown_connections 2023-07-24T05:47:13.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.997+0000 7f9d05889700 1 --2- 172.21.15.77:0/3628398738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d00160d20 0x7f9d00163a80 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:13.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.997+0000 7f9d05889700 1 --2- 172.21.15.77:0/3628398738 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d000b17a0 0x7f9d001f7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:13.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.997+0000 7f9d05889700 1 --2- 172.21.15.77:0/3628398738 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f9cec0662f0 0x7f9cec0687b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:13.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.997+0000 7f9d05889700 1 --2- 172.21.15.77:0/3628398738 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9d000ae0e0 0x7f9d0014edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:13.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:12.997+0000 7f9d05889700 1 -- 172.21.15.77:0/3628398738 >> 172.21.15.77:0/3628398738 conn(0x7f9d000cacc0 msgr2=0x7f9d001601a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:13.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.001+0000 7f9d05889700 1 -- 172.21.15.77:0/3628398738 shutdown_connections 2023-07-24T05:47:13.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.001+0000 7f9d05889700 1 -- 172.21.15.77:0/3628398738 wait complete. 2023-07-24T05:47:13.027 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-24T05:45:52.610430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-24T05:45:52.773787+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-24T05:45:58.121732+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-24T05:45:59.368726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-24T05:46:03.032057+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-24T05:47:13.028 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-24T05:47:13.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.201+0000 7ff79adf6700 1 Processor -- start 2023-07-24T05:47:13.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.201+0000 7ff79adf6700 1 -- start start 2023-07-24T05:47:13.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.201+0000 7ff79adf6700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff79415c870 0x7ff7940cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:13.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.201+0000 7ff79adf6700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff79415cc50 0x7ff7940b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:13.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.201+0000 7ff79adf6700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7ff79406a520 0x7ff7940b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:13.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.201+0000 7ff79adf6700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7940cf520 con 0x7ff79415c870 2023-07-24T05:47:13.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.201+0000 7ff79adf6700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff79406aaa0 con 0x7ff79406a520 2023-07-24T05:47:13.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.201+0000 7ff79adf6700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff79406ad80 con 0x7ff79415cc50 2023-07-24T05:47:13.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.201+0000 7ff799df4700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff79415c870 0x7ff7940cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:13.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.201+0000 7ff799df4700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff79415c870 0x7ff7940cefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59880/0 (socket says 172.21.15.77:59880) 2023-07-24T05:47:13.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.201+0000 7ff799df4700 1 -- 172.21.15.77:0/3993152164 learned_addr learned my addr 172.21.15.77:0/3993152164 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:13.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.201+0000 7ff79a5f5700 1 --2- 172.21.15.77:0/3993152164 >> v2:172.21.15.103:3300/0 conn(0x7ff79406a520 0x7ff7940b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:13.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.205+0000 7ff7995f3700 1 --2- 172.21.15.77:0/3993152164 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff79415cc50 0x7ff7940b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:13.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.205+0000 7ff799df4700 1 -- 172.21.15.77:0/3993152164 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff79415cc50 msgr2=0x7ff7940b1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:13.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.205+0000 7ff799df4700 1 --2- 172.21.15.77:0/3993152164 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff79415cc50 0x7ff7940b1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:13.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.205+0000 7ff799df4700 1 -- 172.21.15.77:0/3993152164 >> v2:172.21.15.103:3300/0 conn(0x7ff79406a520 msgr2=0x7ff7940b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:13.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.205+0000 7ff799df4700 1 --2- 172.21.15.77:0/3993152164 >> v2:172.21.15.103:3300/0 conn(0x7ff79406a520 0x7ff7940b2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:13.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.205+0000 7ff799df4700 1 -- 172.21.15.77:0/3993152164 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff79406b060 con 0x7ff79415c870 2023-07-24T05:47:13.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.205+0000 7ff799df4700 1 --2- 172.21.15.77:0/3993152164 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff79415c870 0x7ff7940cefe0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff7940cffe0 tx=0x7ff790009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7820650acd1399a5 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:13.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.205+0000 7ff798df2700 1 -- 172.21.15.77:0/3993152164 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff790005e50 con 0x7ff79415c870 2023-07-24T05:47:13.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.205+0000 7ff798df2700 1 -- 172.21.15.77:0/3993152164 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff790006030 con 0x7ff79415c870 2023-07-24T05:47:13.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.205+0000 7ff798df2700 1 -- 172.21.15.77:0/3993152164 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7900063c0 con 0x7ff79415c870 2023-07-24T05:47:13.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.205+0000 7ff79adf6700 1 -- 172.21.15.77:0/3993152164 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff79415c870 msgr2=0x7ff7940cefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:13.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.205+0000 7ff79adf6700 1 --2- 172.21.15.77:0/3993152164 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff79415c870 0x7ff7940cefe0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff7940cffe0 tx=0x7ff790009bf0 comp rx=0 tx=0).stop 2023-07-24T05:47:13.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.205+0000 7ff79adf6700 1 -- 172.21.15.77:0/3993152164 shutdown_connections 2023-07-24T05:47:13.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.205+0000 7ff79adf6700 1 --2- 172.21.15.77:0/3993152164 >> v2:172.21.15.103:3300/0 conn(0x7ff79406a520 0x7ff7940b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:13.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.205+0000 7ff79adf6700 1 --2- 172.21.15.77:0/3993152164 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff79415cc50 0x7ff7940b1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:13.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.205+0000 7ff79adf6700 1 --2- 172.21.15.77:0/3993152164 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff79415c870 0x7ff7940cefe0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:13.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.205+0000 7ff79adf6700 1 -- 172.21.15.77:0/3993152164 >> 172.21.15.77:0/3993152164 conn(0x7ff794089f80 msgr2=0x7ff79409b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:13.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.205+0000 7ff79adf6700 1 -- 172.21.15.77:0/3993152164 shutdown_connections 2023-07-24T05:47:13.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.205+0000 7ff79adf6700 1 -- 172.21.15.77:0/3993152164 wait complete. 2023-07-24T05:47:13.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.209+0000 7ff79adf6700 1 Processor -- start 2023-07-24T05:47:13.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.209+0000 7ff79adf6700 1 -- start start 2023-07-24T05:47:13.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.209+0000 7ff79adf6700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff79406a520 0x7ff7940afc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:13.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.209+0000 7ff79adf6700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff79415c870 0x7ff7940d0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:13.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.209+0000 7ff79adf6700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff79415cc50 0x7ff7940ca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:13.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.209+0000 7ff79adf6700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff79414fe80 con 0x7ff79406a520 2023-07-24T05:47:13.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.209+0000 7ff79adf6700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7940d0ff0 con 0x7ff79415cc50 2023-07-24T05:47:13.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.209+0000 7ff79adf6700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7940caf20 con 0x7ff79415c870 2023-07-24T05:47:13.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.209+0000 7ff799df4700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff79406a520 0x7ff7940afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:13.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.209+0000 7ff799df4700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff79406a520 0x7ff7940afc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59890/0 (socket says 172.21.15.77:59890) 2023-07-24T05:47:13.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.209+0000 7ff799df4700 1 -- 172.21.15.77:0/255409527 learned_addr learned my addr 172.21.15.77:0/255409527 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:13.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.209+0000 7ff79a5f5700 1 --2- 172.21.15.77:0/255409527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff79415cc50 0x7ff7940ca9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:13.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.209+0000 7ff7995f3700 1 --2- 172.21.15.77:0/255409527 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff79415c870 0x7ff7940d0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:13.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.213+0000 7ff799df4700 1 -- 172.21.15.77:0/255409527 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff79415c870 msgr2=0x7ff7940d0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:13.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.213+0000 7ff799df4700 1 --2- 172.21.15.77:0/255409527 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff79415c870 0x7ff7940d0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:13.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.213+0000 7ff799df4700 1 -- 172.21.15.77:0/255409527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff79415cc50 msgr2=0x7ff7940ca9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:13.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.213+0000 7ff799df4700 1 --2- 172.21.15.77:0/255409527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff79415cc50 0x7ff7940ca9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:13.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.213+0000 7ff799df4700 1 -- 172.21.15.77:0/255409527 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff790009520 con 0x7ff79406a520 2023-07-24T05:47:13.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.213+0000 7ff799df4700 1 --2- 172.21.15.77:0/255409527 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff79406a520 0x7ff7940afc90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff7940b5250 tx=0x7ff790004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:13.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.213+0000 7ff78a7fc700 1 -- 172.21.15.77:0/255409527 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff790004050 con 0x7ff79406a520 2023-07-24T05:47:13.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.213+0000 7ff78a7fc700 1 -- 172.21.15.77:0/255409527 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7900041b0 con 0x7ff79406a520 2023-07-24T05:47:13.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.213+0000 7ff79adf6700 1 -- 172.21.15.77:0/255409527 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7940cb110 con 0x7ff79406a520 2023-07-24T05:47:13.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.213+0000 7ff78a7fc700 1 -- 172.21.15.77:0/255409527 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff790004560 con 0x7ff79406a520 2023-07-24T05:47:13.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.213+0000 7ff79adf6700 1 -- 172.21.15.77:0/255409527 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7940cb6d0 con 0x7ff79406a520 2023-07-24T05:47:13.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.213+0000 7ff79adf6700 1 -- 172.21.15.77:0/255409527 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff79406c250 con 0x7ff79406a520 2023-07-24T05:47:13.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.217+0000 7ff78a7fc700 1 -- 172.21.15.77:0/255409527 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff790022070 con 0x7ff79406a520 2023-07-24T05:47:13.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.217+0000 7ff78a7fc700 1 --2- 172.21.15.77:0/255409527 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff7780662f0 0x7ff7780687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:13.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.217+0000 7ff78a7fc700 1 -- 172.21.15.77:0/255409527 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff7900857a0 con 0x7ff79406a520 2023-07-24T05:47:13.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.217+0000 7ff7995f3700 1 --2- 172.21.15.77:0/255409527 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff7780662f0 0x7ff7780687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:13.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.217+0000 7ff7995f3700 1 --2- 172.21.15.77:0/255409527 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff7780662f0 0x7ff7780687b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff794159d00 tx=0x7ff784008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:13.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.221+0000 7ff78a7fc700 1 -- 172.21.15.77:0/255409527 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff7900528e0 con 0x7ff79406a520 2023-07-24T05:47:13.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.393+0000 7ff79adf6700 1 -- 172.21.15.77:0/255409527 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff794072490 con 0x7ff79406a520 2023-07-24T05:47:13.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.393+0000 7ff78a7fc700 1 -- 172.21.15.77:0/255409527 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff790055f00 con 0x7ff79406a520 2023-07-24T05:47:13.400 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-07-24T05:47:13.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.397+0000 7ff79adf6700 1 -- 172.21.15.77:0/255409527 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff7780662f0 msgr2=0x7ff7780687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:13.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.397+0000 7ff79adf6700 1 --2- 172.21.15.77:0/255409527 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff7780662f0 0x7ff7780687b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff794159d00 tx=0x7ff784008040 comp rx=0 tx=0).stop 2023-07-24T05:47:13.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.397+0000 7ff79adf6700 1 -- 172.21.15.77:0/255409527 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff79406a520 msgr2=0x7ff7940afc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:13.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.397+0000 7ff79adf6700 1 --2- 172.21.15.77:0/255409527 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff79406a520 0x7ff7940afc90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff7940b5250 tx=0x7ff790004770 comp rx=0 tx=0).stop 2023-07-24T05:47:13.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.397+0000 7ff79adf6700 1 -- 172.21.15.77:0/255409527 shutdown_connections 2023-07-24T05:47:13.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.397+0000 7ff79adf6700 1 --2- 172.21.15.77:0/255409527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff79415cc50 0x7ff7940ca9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:13.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.397+0000 7ff79adf6700 1 --2- 172.21.15.77:0/255409527 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff7780662f0 0x7ff7780687b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:13.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.397+0000 7ff79adf6700 1 --2- 172.21.15.77:0/255409527 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff79415c870 0x7ff7940d0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:13.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.397+0000 7ff79adf6700 1 --2- 172.21.15.77:0/255409527 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff79406a520 0x7ff7940afc90 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:13.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.397+0000 7ff79adf6700 1 -- 172.21.15.77:0/255409527 >> 172.21.15.77:0/255409527 conn(0x7ff794089f80 msgr2=0x7ff7940ce9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:13.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.397+0000 7ff79adf6700 1 -- 172.21.15.77:0/255409527 shutdown_connections 2023-07-24T05:47:13.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.401+0000 7ff79adf6700 1 -- 172.21.15.77:0/255409527 wait complete. 2023-07-24T05:47:13.425 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-24T05:47:13.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.593+0000 7f912b8ca700 1 Processor -- start 2023-07-24T05:47:13.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.593+0000 7f912b8ca700 1 -- start start 2023-07-24T05:47:13.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.593+0000 7f912b8ca700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9124161140 0x7f91240c1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:13.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.593+0000 7f912b8ca700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f91240c1950 0x7f91240ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:13.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.593+0000 7f912b8ca700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91240c1db0 con 0x7f91240cd130 2023-07-24T05:47:13.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.593+0000 7f912b8ca700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9124069d20 con 0x7f91240c1950 2023-07-24T05:47:13.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.593+0000 7f912b8ca700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91240cd980 con 0x7f9124161140 2023-07-24T05:47:13.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.597+0000 7f9128e65700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f91240c1950 0x7f91240ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:13.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.597+0000 7f9129e67700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f91240cd130 0x7f91240cae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44232/0 (socket says 172.21.15.77:44232) 2023-07-24T05:47:13.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.597+0000 7f9129e67700 1 -- 172.21.15.77:0/3594831579 learned_addr learned my addr 172.21.15.77:0/3594831579 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:13.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.597+0000 7f9129666700 1 --2- 172.21.15.77:0/3594831579 >> v2:172.21.15.103:3300/0 conn(0x7f9124161140 0x7f91240c1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:13.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.597+0000 7f9128e65700 1 -- 172.21.15.77:0/3594831579 >> v2:172.21.15.103:3300/0 conn(0x7f9124161140 msgr2=0x7f91240c1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:13.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.597+0000 7f9128e65700 1 --2- 172.21.15.77:0/3594831579 >> v2:172.21.15.103:3300/0 conn(0x7f9124161140 0x7f91240c1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:13.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.597+0000 7f9128e65700 1 -- 172.21.15.77:0/3594831579 >> v1:172.21.15.77:6789/0 conn(0x7f91240cd130 legacy=0x7f91240cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:13.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.597+0000 7f9128e65700 1 -- 172.21.15.77:0/3594831579 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91240cdc60 con 0x7f91240c1950 2023-07-24T05:47:13.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.597+0000 7f911bfff700 1 -- 172.21.15.77:0/3594831579 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 916615116 0 0) 0x7f91240c1db0 con 0x7f91240cd130 2023-07-24T05:47:13.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.597+0000 7f9128e65700 1 --2- 172.21.15.77:0/3594831579 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91240c1950 0x7f91240ccbf0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f91240cf540 tx=0x7f9114009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cf8e5443d46bfdc server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:13.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.597+0000 7f911bfff700 1 -- 172.21.15.77:0/3594831579 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9114011830 con 0x7f91240c1950 2023-07-24T05:47:13.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.597+0000 7f911bfff700 1 -- 172.21.15.77:0/3594831579 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9114011990 con 0x7f91240c1950 2023-07-24T05:47:13.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.597+0000 7f911bfff700 1 -- 172.21.15.77:0/3594831579 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9114011d20 con 0x7f91240c1950 2023-07-24T05:47:13.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.597+0000 7f912b8ca700 1 -- 172.21.15.77:0/3594831579 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91240c1950 msgr2=0x7f91240ccbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:13.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.597+0000 7f912b8ca700 1 --2- 172.21.15.77:0/3594831579 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91240c1950 0x7f91240ccbf0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f91240cf540 tx=0x7f9114009b30 comp rx=0 tx=0).stop 2023-07-24T05:47:13.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.601+0000 7f912b8ca700 1 -- 172.21.15.77:0/3594831579 shutdown_connections 2023-07-24T05:47:13.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.601+0000 7f912b8ca700 1 --2- 172.21.15.77:0/3594831579 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91240c1950 0x7f91240ccbf0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:13.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.601+0000 7f912b8ca700 1 --2- 172.21.15.77:0/3594831579 >> v2:172.21.15.103:3300/0 conn(0x7f9124161140 0x7f91240c1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:13.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.601+0000 7f912b8ca700 1 -- 172.21.15.77:0/3594831579 >> 172.21.15.77:0/3594831579 conn(0x7f91240ce440 msgr2=0x7f91240ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:13.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.601+0000 7f912b8ca700 1 -- 172.21.15.77:0/3594831579 shutdown_connections 2023-07-24T05:47:13.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.601+0000 7f912b8ca700 1 -- 172.21.15.77:0/3594831579 wait complete. 2023-07-24T05:47:13.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.601+0000 7f912b8ca700 1 Processor -- start 2023-07-24T05:47:13.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.601+0000 7f912b8ca700 1 -- start start 2023-07-24T05:47:13.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.605+0000 7f912b8ca700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f91240c1950 0x7f91241ea7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:13.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.605+0000 7f912b8ca700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91240cd130 0x7f91241eace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:13.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.605+0000 7f912b8ca700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9124161140 0x7f91240c6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:13.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.605+0000 7f912b8ca700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91240c7cb0 con 0x7f9124161140 2023-07-24T05:47:13.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.605+0000 7f912b8ca700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91240c7f90 con 0x7f91240cd130 2023-07-24T05:47:13.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.605+0000 7f912b8ca700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91241f7790 con 0x7f91240c1950 2023-07-24T05:47:13.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.605+0000 7f9129e67700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9124161140 0x7f91240c6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:13.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.605+0000 7f9129e67700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9124161140 0x7f91240c6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59904/0 (socket says 172.21.15.77:59904) 2023-07-24T05:47:13.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.605+0000 7f9129e67700 1 -- 172.21.15.77:0/2476253116 learned_addr learned my addr 172.21.15.77:0/2476253116 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:13.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.605+0000 7f9129666700 1 --2- 172.21.15.77:0/2476253116 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f91240c1950 0x7f91241ea7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:13.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.605+0000 7f9128e65700 1 --2- 172.21.15.77:0/2476253116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91240cd130 0x7f91241eace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:13.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.605+0000 7f9129e67700 1 -- 172.21.15.77:0/2476253116 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f91240c1950 msgr2=0x7f91241ea7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:13.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.605+0000 7f9129e67700 1 --2- 172.21.15.77:0/2476253116 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f91240c1950 0x7f91241ea7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:13.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.605+0000 7f9129e67700 1 -- 172.21.15.77:0/2476253116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91240cd130 msgr2=0x7f91241eace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:13.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.605+0000 7f9129e67700 1 --2- 172.21.15.77:0/2476253116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91240cd130 0x7f91241eace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:13.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.605+0000 7f9129e67700 1 -- 172.21.15.77:0/2476253116 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91140094b0 con 0x7f9124161140 2023-07-24T05:47:13.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.605+0000 7f9129e67700 1 --2- 172.21.15.77:0/2476253116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9124161140 0x7f91240c6fc0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f911c00cca0 tx=0x7f911c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:13.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.605+0000 7f9119ffb700 1 -- 172.21.15.77:0/2476253116 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911c00ab70 con 0x7f9124161140 2023-07-24T05:47:13.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.605+0000 7f9119ffb700 1 -- 172.21.15.77:0/2476253116 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911c00acd0 con 0x7f9124161140 2023-07-24T05:47:13.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.605+0000 7f912b8ca700 1 -- 172.21.15.77:0/2476253116 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91241f7a70 con 0x7f9124161140 2023-07-24T05:47:13.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.605+0000 7f9119ffb700 1 -- 172.21.15.77:0/2476253116 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911c007310 con 0x7f9124161140 2023-07-24T05:47:13.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.605+0000 7f912b8ca700 1 -- 172.21.15.77:0/2476253116 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9124163dc0 con 0x7f9124161140 2023-07-24T05:47:13.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.609+0000 7f912b8ca700 1 -- 172.21.15.77:0/2476253116 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91241f7cb0 con 0x7f9124161140 2023-07-24T05:47:13.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.609+0000 7f9119ffb700 1 -- 172.21.15.77:0/2476253116 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f911c007470 con 0x7f9124161140 2023-07-24T05:47:13.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.609+0000 7f9119ffb700 1 --2- 172.21.15.77:0/2476253116 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f91080662f0 0x7f91080687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:13.616 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.609+0000 7f9119ffb700 1 -- 172.21.15.77:0/2476253116 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f911c083bf0 con 0x7f9124161140 2023-07-24T05:47:13.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.613+0000 7f9129666700 1 --2- 172.21.15.77:0/2476253116 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f91080662f0 0x7f91080687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:13.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.613+0000 7f9129666700 1 --2- 172.21.15.77:0/2476253116 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f91080662f0 0x7f91080687b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9120009be0 tx=0x7f91200091c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:13.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.617+0000 7f9119ffb700 1 -- 172.21.15.77:0/2476253116 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f91241f7cb0 con 0x7f9124161140 2023-07-24T05:47:13.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.789+0000 7f912b8ca700 1 -- 172.21.15.77:0/2476253116 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f91241f7cb0 con 0x7f9124161140 2023-07-24T05:47:13.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.789+0000 7f9119ffb700 1 -- 172.21.15.77:0/2476253116 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f91241f7cb0 con 0x7f9124161140 2023-07-24T05:47:13.796 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 8 2023-07-24T05:47:13.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.793+0000 7f912b8ca700 1 -- 172.21.15.77:0/2476253116 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f91080662f0 msgr2=0x7f91080687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:13.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.793+0000 7f912b8ca700 1 --2- 172.21.15.77:0/2476253116 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f91080662f0 0x7f91080687b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9120009be0 tx=0x7f91200091c0 comp rx=0 tx=0).stop 2023-07-24T05:47:13.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.793+0000 7f912b8ca700 1 -- 172.21.15.77:0/2476253116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9124161140 msgr2=0x7f91240c6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:13.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.793+0000 7f912b8ca700 1 --2- 172.21.15.77:0/2476253116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9124161140 0x7f91240c6fc0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f911c00cca0 tx=0x7f911c00a060 comp rx=0 tx=0).stop 2023-07-24T05:47:13.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.793+0000 7f912b8ca700 1 -- 172.21.15.77:0/2476253116 shutdown_connections 2023-07-24T05:47:13.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.793+0000 7f912b8ca700 1 --2- 172.21.15.77:0/2476253116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9124161140 0x7f91240c6fc0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:13.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.793+0000 7f912b8ca700 1 --2- 172.21.15.77:0/2476253116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f91240cd130 0x7f91241eace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:13.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.793+0000 7f912b8ca700 1 --2- 172.21.15.77:0/2476253116 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f91080662f0 0x7f91080687b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:13.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.793+0000 7f912b8ca700 1 --2- 172.21.15.77:0/2476253116 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f91240c1950 0x7f91241ea7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:13.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.793+0000 7f912b8ca700 1 -- 172.21.15.77:0/2476253116 >> 172.21.15.77:0/2476253116 conn(0x7f91240ce440 msgr2=0x7f91240ca250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:13.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.793+0000 7f912b8ca700 1 -- 172.21.15.77:0/2476253116 shutdown_connections 2023-07-24T05:47:13.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.793+0000 7f912b8ca700 1 -- 172.21.15.77:0/2476253116 wait complete. 2023-07-24T05:47:13.819 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-24T05:47:13.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.989+0000 7f73b573a700 1 Processor -- start 2023-07-24T05:47:13.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.989+0000 7f73b573a700 1 -- start start 2023-07-24T05:47:13.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.993+0000 7f73b573a700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f73b006afc0 0x7f73b00b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:13.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.993+0000 7f73b573a700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73b00d0360 con 0x7f73b015db20 2023-07-24T05:47:13.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.993+0000 7f73b573a700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73b0160fa0 con 0x7f73b00d2fc0 2023-07-24T05:47:13.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.993+0000 7f73b573a700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73b00b20b0 con 0x7f73b006afc0 2023-07-24T05:47:13.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.993+0000 7f73ae7fc700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f73b015db20 0x7f73b00d28b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44238/0 (socket says 172.21.15.77:44238) 2023-07-24T05:47:13.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.993+0000 7f73ae7fc700 1 -- 172.21.15.77:0/1698686464 learned_addr learned my addr 172.21.15.77:0/1698686464 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:13.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.993+0000 7f73aeffd700 1 --2- 172.21.15.77:0/1698686464 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f73b006afc0 0x7f73b00b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:13.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.993+0000 7f73adffb700 1 -- 172.21.15.77:0/1698686464 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 25118014 0 0) 0x7f73b00d0360 con 0x7f73b015db20 2023-07-24T05:47:14.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.993+0000 7f73adffb700 1 -- 172.21.15.77:0/1698686464 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73980035d0 con 0x7f73b015db20 2023-07-24T05:47:14.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.993+0000 7f73aeffd700 1 -- 172.21.15.77:0/1698686464 >> v1:172.21.15.103:6789/0 conn(0x7f73b00d2fc0 legacy=0x7f73b00d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:14.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.993+0000 7f73aeffd700 1 -- 172.21.15.77:0/1698686464 >> v1:172.21.15.77:6789/0 conn(0x7f73b015db20 legacy=0x7f73b00d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:14.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.993+0000 7f73aeffd700 1 -- 172.21.15.77:0/1698686464 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b0160670 con 0x7f73b006afc0 2023-07-24T05:47:14.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.993+0000 7f73aeffd700 1 --2- 172.21.15.77:0/1698686464 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f73b006afc0 0x7f73b00b1a20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f73a0009880 tx=0x7f73a0009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77f2fa04022ed97 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:14.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.993+0000 7f73adffb700 1 -- 172.21.15.77:0/1698686464 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a0011830 con 0x7f73b006afc0 2023-07-24T05:47:14.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.993+0000 7f73adffb700 1 -- 172.21.15.77:0/1698686464 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a0011990 con 0x7f73b006afc0 2023-07-24T05:47:14.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.993+0000 7f73adffb700 1 -- 172.21.15.77:0/1698686464 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a0011d20 con 0x7f73b006afc0 2023-07-24T05:47:14.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.997+0000 7f73b573a700 1 -- 172.21.15.77:0/1698686464 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f73b006afc0 msgr2=0x7f73b00b1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:14.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.997+0000 7f73b573a700 1 --2- 172.21.15.77:0/1698686464 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f73b006afc0 0x7f73b00b1a20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f73a0009880 tx=0x7f73a0009b90 comp rx=0 tx=0).stop 2023-07-24T05:47:14.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.997+0000 7f73b573a700 1 -- 172.21.15.77:0/1698686464 shutdown_connections 2023-07-24T05:47:14.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.997+0000 7f73b573a700 1 --2- 172.21.15.77:0/1698686464 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f73b006afc0 0x7f73b00b1a20 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:14.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.997+0000 7f73b573a700 1 -- 172.21.15.77:0/1698686464 >> 172.21.15.77:0/1698686464 conn(0x7f73b009bc20 msgr2=0x7f73b00b7920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:14.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.997+0000 7f73b573a700 1 -- 172.21.15.77:0/1698686464 shutdown_connections 2023-07-24T05:47:14.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:13.997+0000 7f73b573a700 1 -- 172.21.15.77:0/1698686464 wait complete. 2023-07-24T05:47:14.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.001+0000 7f73b573a700 1 Processor -- start 2023-07-24T05:47:14.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.001+0000 7f73b573a700 1 -- start start 2023-07-24T05:47:14.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.001+0000 7f73b573a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73b006afc0 0x7f73b00c9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:14.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.001+0000 7f73b573a700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f73b00d2fc0 0x7f73b0152de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:14.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.001+0000 7f73b573a700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73b015db20 0x7f73b01545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:14.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.001+0000 7f73b573a700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b00d28e0 con 0x7f73b006afc0 2023-07-24T05:47:14.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.001+0000 7f73b573a700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b00b23a0 con 0x7f73b015db20 2023-07-24T05:47:14.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.001+0000 7f73b573a700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73b00b2680 con 0x7f73b00d2fc0 2023-07-24T05:47:14.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.001+0000 7f73aeffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73b006afc0 0x7f73b00c9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:14.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.001+0000 7f73aeffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73b006afc0 0x7f73b00c9d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59906/0 (socket says 172.21.15.77:59906) 2023-07-24T05:47:14.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.001+0000 7f73aeffd700 1 -- 172.21.15.77:0/3131294912 learned_addr learned my addr 172.21.15.77:0/3131294912 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:14.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.001+0000 7f73ae7fc700 1 --2- 172.21.15.77:0/3131294912 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f73b00d2fc0 0x7f73b0152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:14.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.001+0000 7f73af7fe700 1 --2- 172.21.15.77:0/3131294912 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73b015db20 0x7f73b01545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:14.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.001+0000 7f73aeffd700 1 -- 172.21.15.77:0/3131294912 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f73b00d2fc0 msgr2=0x7f73b0152de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:14.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.001+0000 7f73aeffd700 1 --2- 172.21.15.77:0/3131294912 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f73b00d2fc0 0x7f73b0152de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:14.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.001+0000 7f73aeffd700 1 -- 172.21.15.77:0/3131294912 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73b015db20 msgr2=0x7f73b01545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:14.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.001+0000 7f73aeffd700 1 --2- 172.21.15.77:0/3131294912 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73b015db20 0x7f73b01545e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:14.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.001+0000 7f73aeffd700 1 -- 172.21.15.77:0/3131294912 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a00094b0 con 0x7f73b006afc0 2023-07-24T05:47:14.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.005+0000 7f73aeffd700 1 --2- 172.21.15.77:0/3131294912 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73b006afc0 0x7f73b00c9d60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f73a0013040 tx=0x7f73a0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:14.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.005+0000 7f73977fe700 1 -- 172.21.15.77:0/3131294912 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a00038c0 con 0x7f73b006afc0 2023-07-24T05:47:14.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.005+0000 7f73977fe700 1 -- 172.21.15.77:0/3131294912 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a0003a40 con 0x7f73b006afc0 2023-07-24T05:47:14.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.005+0000 7f73b573a700 1 -- 172.21.15.77:0/3131294912 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73b00b2960 con 0x7f73b006afc0 2023-07-24T05:47:14.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.005+0000 7f73977fe700 1 -- 172.21.15.77:0/3131294912 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a0003df0 con 0x7f73b006afc0 2023-07-24T05:47:14.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.005+0000 7f73b573a700 1 -- 172.21.15.77:0/3131294912 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73b00b2f20 con 0x7f73b006afc0 2023-07-24T05:47:14.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.005+0000 7f73b573a700 1 -- 172.21.15.77:0/3131294912 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73b004df10 con 0x7f73b006afc0 2023-07-24T05:47:14.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.009+0000 7f73977fe700 1 -- 172.21.15.77:0/3131294912 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f73a001b400 con 0x7f73b006afc0 2023-07-24T05:47:14.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.009+0000 7f73977fe700 1 --2- 172.21.15.77:0/3131294912 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f739c0662f0 0x7f739c0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:14.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.009+0000 7f73977fe700 1 -- 172.21.15.77:0/3131294912 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f73a0085580 con 0x7f73b006afc0 2023-07-24T05:47:14.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.009+0000 7f73ae7fc700 1 --2- 172.21.15.77:0/3131294912 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f739c0662f0 0x7f739c0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:14.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.009+0000 7f73ae7fc700 1 --2- 172.21.15.77:0/3131294912 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f739c0662f0 0x7f739c0687b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f73b00c93f0 tx=0x7f73a4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:14.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.013+0000 7f73977fe700 1 -- 172.21.15.77:0/3131294912 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f73a0052760 con 0x7f73b006afc0 2023-07-24T05:47:14.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.205+0000 7f73b573a700 1 -- 172.21.15.77:0/3131294912 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f73b00d3540 con 0x7f73b006afc0 2023-07-24T05:47:14.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.205+0000 7f73977fe700 1 -- 172.21.15.77:0/3131294912 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f73a0055d80 con 0x7f73b006afc0 2023-07-24T05:47:14.210 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-07-24T05:47:14.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.205+0000 7f73b573a700 1 -- 172.21.15.77:0/3131294912 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f739c0662f0 msgr2=0x7f739c0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:14.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.205+0000 7f73b573a700 1 --2- 172.21.15.77:0/3131294912 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f739c0662f0 0x7f739c0687b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f73b00c93f0 tx=0x7f73a4009040 comp rx=0 tx=0).stop 2023-07-24T05:47:14.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.205+0000 7f73b573a700 1 -- 172.21.15.77:0/3131294912 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73b006afc0 msgr2=0x7f73b00c9d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:14.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.205+0000 7f73b573a700 1 --2- 172.21.15.77:0/3131294912 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73b006afc0 0x7f73b00c9d60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f73a0013040 tx=0x7f73a0004770 comp rx=0 tx=0).stop 2023-07-24T05:47:14.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.205+0000 7f73b573a700 1 -- 172.21.15.77:0/3131294912 shutdown_connections 2023-07-24T05:47:14.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.205+0000 7f73b573a700 1 --2- 172.21.15.77:0/3131294912 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f73b015db20 0x7f73b01545e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:14.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.205+0000 7f73b573a700 1 --2- 172.21.15.77:0/3131294912 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f739c0662f0 0x7f739c0687b0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:14.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.205+0000 7f73b573a700 1 --2- 172.21.15.77:0/3131294912 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f73b00d2fc0 0x7f73b0152de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:14.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.205+0000 7f73b573a700 1 --2- 172.21.15.77:0/3131294912 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f73b006afc0 0x7f73b00c9d60 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:14.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.205+0000 7f73b573a700 1 -- 172.21.15.77:0/3131294912 >> 172.21.15.77:0/3131294912 conn(0x7f73b009bc20 msgr2=0x7f73b00afe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:14.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.209+0000 7f73b573a700 1 -- 172.21.15.77:0/3131294912 shutdown_connections 2023-07-24T05:47:14.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.209+0000 7f73b573a700 1 -- 172.21.15.77:0/3131294912 wait complete. 2023-07-24T05:47:14.233 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-24T05:47:14.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.401+0000 7f212f4df700 1 Processor -- start 2023-07-24T05:47:14.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.401+0000 7f212f4df700 1 -- start start 2023-07-24T05:47:14.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.405+0000 7f212f4df700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f21280ccf20 0x7f212806bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:14.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.405+0000 7f212f4df700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f21280ada10 0x7f212806fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:14.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.405+0000 7f212f4df700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f212806d450 con 0x7f212806b9f0 2023-07-24T05:47:14.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.405+0000 7f212f4df700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21280ad710 con 0x7f21280ada10 2023-07-24T05:47:14.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.405+0000 7f212f4df700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21280cca20 con 0x7f21280ccf20 2023-07-24T05:47:14.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.405+0000 7f212d27b700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f212806b9f0 0x7f212806ac20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44242/0 (socket says 172.21.15.77:44242) 2023-07-24T05:47:14.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.405+0000 7f212d27b700 1 -- 172.21.15.77:0/1250069109 learned_addr learned my addr 172.21.15.77:0/1250069109 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:14.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.405+0000 7f212da7c700 1 --2- 172.21.15.77:0/1250069109 >> v2:172.21.15.77:3300/0 conn(0x7f21280ada10 0x7f212806fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:14.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.405+0000 7f212ca7a700 1 --2- 172.21.15.77:0/1250069109 >> v2:172.21.15.103:3300/0 conn(0x7f21280ccf20 0x7f212806bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:14.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.405+0000 7f212da7c700 1 -- 172.21.15.77:0/1250069109 >> v2:172.21.15.103:3300/0 conn(0x7f21280ccf20 msgr2=0x7f212806bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:14.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.405+0000 7f212da7c700 1 --2- 172.21.15.77:0/1250069109 >> v2:172.21.15.103:3300/0 conn(0x7f21280ccf20 0x7f212806bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:14.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.405+0000 7f212da7c700 1 -- 172.21.15.77:0/1250069109 >> v1:172.21.15.77:6789/0 conn(0x7f212806b9f0 legacy=0x7f212806ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:14.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.405+0000 7f211ffff700 1 -- 172.21.15.77:0/1250069109 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 579429873 0 0) 0x7f212806d450 con 0x7f212806b9f0 2023-07-24T05:47:14.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.405+0000 7f212da7c700 1 -- 172.21.15.77:0/1250069109 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f212806b330 con 0x7f21280ada10 2023-07-24T05:47:14.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.409+0000 7f212da7c700 1 --2- 172.21.15.77:0/1250069109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21280ada10 0x7f212806fe50 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f21280ce360 tx=0x7f212000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=624c03e94ffd585 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:14.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.409+0000 7f211ffff700 1 -- 172.21.15.77:0/1250069109 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212000e070 con 0x7f21280ada10 2023-07-24T05:47:14.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.409+0000 7f211ffff700 1 -- 172.21.15.77:0/1250069109 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212000bb20 con 0x7f21280ada10 2023-07-24T05:47:14.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.409+0000 7f211ffff700 1 -- 172.21.15.77:0/1250069109 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2120012430 con 0x7f21280ada10 2023-07-24T05:47:14.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.409+0000 7f212f4df700 1 -- 172.21.15.77:0/1250069109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21280ada10 msgr2=0x7f212806fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:14.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.409+0000 7f212f4df700 1 --2- 172.21.15.77:0/1250069109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21280ada10 0x7f212806fe50 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f21280ce360 tx=0x7f212000b330 comp rx=0 tx=0).stop 2023-07-24T05:47:14.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.409+0000 7f212f4df700 1 -- 172.21.15.77:0/1250069109 shutdown_connections 2023-07-24T05:47:14.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.409+0000 7f212f4df700 1 --2- 172.21.15.77:0/1250069109 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21280ada10 0x7f212806fe50 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:14.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.409+0000 7f212f4df700 1 --2- 172.21.15.77:0/1250069109 >> v2:172.21.15.103:3300/0 conn(0x7f21280ccf20 0x7f212806bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:14.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.409+0000 7f212f4df700 1 -- 172.21.15.77:0/1250069109 >> 172.21.15.77:0/1250069109 conn(0x7f21280ce440 msgr2=0x7f21280ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:14.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.409+0000 7f212f4df700 1 -- 172.21.15.77:0/1250069109 shutdown_connections 2023-07-24T05:47:14.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.409+0000 7f212f4df700 1 -- 172.21.15.77:0/1250069109 wait complete. 2023-07-24T05:47:14.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.413+0000 7f212f4df700 1 Processor -- start 2023-07-24T05:47:14.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.413+0000 7f212f4df700 1 -- start start 2023-07-24T05:47:14.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.413+0000 7f212f4df700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f212806b9f0 0x7f2128098160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:14.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.413+0000 7f212f4df700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21280ada10 0x7f21280ac310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:14.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.413+0000 7f212f4df700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21280ccf20 0x7f212815e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:14.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.413+0000 7f212f4df700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21280c62c0 con 0x7f212806b9f0 2023-07-24T05:47:14.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.413+0000 7f212f4df700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21280c56b0 con 0x7f21280ccf20 2023-07-24T05:47:14.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.413+0000 7f212f4df700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21280c5990 con 0x7f21280ada10 2023-07-24T05:47:14.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.413+0000 7f212d27b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f212806b9f0 0x7f2128098160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:14.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.413+0000 7f212d27b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f212806b9f0 0x7f2128098160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59932/0 (socket says 172.21.15.77:59932) 2023-07-24T05:47:14.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.413+0000 7f212d27b700 1 -- 172.21.15.77:0/963252664 learned_addr learned my addr 172.21.15.77:0/963252664 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:14.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.413+0000 7f212ca7a700 1 --2- 172.21.15.77:0/963252664 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21280ada10 0x7f21280ac310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:14.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.413+0000 7f212da7c700 1 --2- 172.21.15.77:0/963252664 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21280ccf20 0x7f212815e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:14.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.413+0000 7f212d27b700 1 -- 172.21.15.77:0/963252664 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21280ada10 msgr2=0x7f21280ac310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:14.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.413+0000 7f212d27b700 1 --2- 172.21.15.77:0/963252664 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21280ada10 0x7f21280ac310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:14.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.413+0000 7f212d27b700 1 -- 172.21.15.77:0/963252664 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21280ccf20 msgr2=0x7f212815e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:14.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.413+0000 7f212d27b700 1 --2- 172.21.15.77:0/963252664 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21280ccf20 0x7f212815e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:14.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.413+0000 7f212d27b700 1 -- 172.21.15.77:0/963252664 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2120009a70 con 0x7f212806b9f0 2023-07-24T05:47:14.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.413+0000 7f212da7c700 1 --2- 172.21.15.77:0/963252664 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21280ccf20 0x7f212815e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:14.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.413+0000 7f212d27b700 1 --2- 172.21.15.77:0/963252664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f212806b9f0 0x7f2128098160 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f212400c520 tx=0x7f212400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:14.422 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.417+0000 7f211dffb700 1 -- 172.21.15.77:0/963252664 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21240074e0 con 0x7f212806b9f0 2023-07-24T05:47:14.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.417+0000 7f211dffb700 1 -- 172.21.15.77:0/963252664 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2124007640 con 0x7f212806b9f0 2023-07-24T05:47:14.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.417+0000 7f212f4df700 1 -- 172.21.15.77:0/963252664 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21280c5c70 con 0x7f212806b9f0 2023-07-24T05:47:14.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.417+0000 7f211dffb700 1 -- 172.21.15.77:0/963252664 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2124005a70 con 0x7f212806b9f0 2023-07-24T05:47:14.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.417+0000 7f212f4df700 1 -- 172.21.15.77:0/963252664 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21280986a0 con 0x7f212806b9f0 2023-07-24T05:47:14.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.417+0000 7f212f4df700 1 -- 172.21.15.77:0/963252664 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21280c5470 con 0x7f212806b9f0 2023-07-24T05:47:14.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.417+0000 7f211dffb700 1 -- 172.21.15.77:0/963252664 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2124005bd0 con 0x7f212806b9f0 2023-07-24T05:47:14.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.421+0000 7f211dffb700 1 --2- 172.21.15.77:0/963252664 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f210c066320 0x7f210c0687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:14.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.421+0000 7f211dffb700 1 -- 172.21.15.77:0/963252664 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2124083530 con 0x7f212806b9f0 2023-07-24T05:47:14.426 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.421+0000 7f212ca7a700 1 --2- 172.21.15.77:0/963252664 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f210c066320 0x7f210c0687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:14.428 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.421+0000 7f212ca7a700 1 --2- 172.21.15.77:0/963252664 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f210c066320 0x7f210c0687e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f212809c3a0 tx=0x7f2118009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:14.432 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.425+0000 7f211dffb700 1 -- 172.21.15.77:0/963252664 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f21280c5470 con 0x7f212806b9f0 2023-07-24T05:47:14.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.597+0000 7f212f4df700 1 -- 172.21.15.77:0/963252664 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f21280c5470 con 0x7f212806b9f0 2023-07-24T05:47:14.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.601+0000 7f211dffb700 1 -- 172.21.15.77:0/963252664 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f21280c5470 con 0x7f212806b9f0 2023-07-24T05:47:14.605 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-07-24T05:47:14.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.601+0000 7f212f4df700 1 -- 172.21.15.77:0/963252664 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f210c066320 msgr2=0x7f210c0687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:14.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.601+0000 7f212f4df700 1 --2- 172.21.15.77:0/963252664 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f210c066320 0x7f210c0687e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f212809c3a0 tx=0x7f2118009240 comp rx=0 tx=0).stop 2023-07-24T05:47:14.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.601+0000 7f212f4df700 1 -- 172.21.15.77:0/963252664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f212806b9f0 msgr2=0x7f2128098160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:14.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.601+0000 7f212f4df700 1 --2- 172.21.15.77:0/963252664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f212806b9f0 0x7f2128098160 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f212400c520 tx=0x7f212400c830 comp rx=0 tx=0).stop 2023-07-24T05:47:14.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.601+0000 7f212f4df700 1 -- 172.21.15.77:0/963252664 shutdown_connections 2023-07-24T05:47:14.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.601+0000 7f212f4df700 1 --2- 172.21.15.77:0/963252664 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21280ccf20 0x7f212815e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:14.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.601+0000 7f212f4df700 1 --2- 172.21.15.77:0/963252664 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f210c066320 0x7f210c0687e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:14.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.601+0000 7f212f4df700 1 --2- 172.21.15.77:0/963252664 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21280ada10 0x7f21280ac310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:14.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.601+0000 7f212f4df700 1 --2- 172.21.15.77:0/963252664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f212806b9f0 0x7f2128098160 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:14.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.601+0000 7f212f4df700 1 -- 172.21.15.77:0/963252664 >> 172.21.15.77:0/963252664 conn(0x7f21280ce440 msgr2=0x7f21280af690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:14.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.601+0000 7f212f4df700 1 -- 172.21.15.77:0/963252664 shutdown_connections 2023-07-24T05:47:14.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.601+0000 7f212f4df700 1 -- 172.21.15.77:0/963252664 wait complete. 2023-07-24T05:47:14.629 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-24T05:47:14.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.809+0000 7fbe8b651700 1 Processor -- start 2023-07-24T05:47:14.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.809+0000 7fbe8b651700 1 -- start start 2023-07-24T05:47:14.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.809+0000 7fbe8b651700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbe840c1b20 0x7fbe840ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:14.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.809+0000 7fbe8b651700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbe840cd130 0x7fbe8406a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:14.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.813+0000 7fbe8b651700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe84069d20 con 0x7fbe84161140 2023-07-24T05:47:14.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.813+0000 7fbe8b651700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe840cd980 con 0x7fbe840c1b20 2023-07-24T05:47:14.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.813+0000 7fbe8b651700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe840cdc60 con 0x7fbe840cd130 2023-07-24T05:47:14.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.813+0000 7fbe88bec700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fbe840c1b20 0x7fbe840ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:14.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.813+0000 7fbe893ed700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fbe84161140 0x7fbe840c1410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44252/0 (socket says 172.21.15.77:44252) 2023-07-24T05:47:14.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.813+0000 7fbe893ed700 1 -- 172.21.15.77:0/326747547 learned_addr learned my addr 172.21.15.77:0/326747547 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:14.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.813+0000 7fbe89bee700 1 --2- 172.21.15.77:0/326747547 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbe840cd130 0x7fbe8406a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:14.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.813+0000 7fbe88bec700 1 -- 172.21.15.77:0/326747547 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbe840cd130 msgr2=0x7fbe8406a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:14.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.813+0000 7fbe88bec700 1 --2- 172.21.15.77:0/326747547 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbe840cd130 0x7fbe8406a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:14.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.813+0000 7fbe88bec700 1 -- 172.21.15.77:0/326747547 >> v1:172.21.15.77:6789/0 conn(0x7fbe84161140 legacy=0x7fbe840c1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:14.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.813+0000 7fbe88bec700 1 -- 172.21.15.77:0/326747547 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe840cdf40 con 0x7fbe840c1b20 2023-07-24T05:47:14.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.813+0000 7fbe88bec700 1 --2- 172.21.15.77:0/326747547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe840c1b20 0x7fbe840ccbf0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbe74009850 tx=0x7fbe74009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7b1d9f39bf46b18 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:14.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.813+0000 7fbe7bfff700 1 -- 172.21.15.77:0/326747547 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe74011830 con 0x7fbe840c1b20 2023-07-24T05:47:14.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.813+0000 7fbe7bfff700 1 -- 172.21.15.77:0/326747547 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe74011990 con 0x7fbe840c1b20 2023-07-24T05:47:14.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.813+0000 7fbe7bfff700 1 -- 172.21.15.77:0/326747547 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe74011d40 con 0x7fbe840c1b20 2023-07-24T05:47:14.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.813+0000 7fbe8b651700 1 -- 172.21.15.77:0/326747547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe840c1b20 msgr2=0x7fbe840ccbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:14.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.813+0000 7fbe8b651700 1 --2- 172.21.15.77:0/326747547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe840c1b20 0x7fbe840ccbf0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbe74009850 tx=0x7fbe74009b60 comp rx=0 tx=0).stop 2023-07-24T05:47:14.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.813+0000 7fbe8b651700 1 -- 172.21.15.77:0/326747547 shutdown_connections 2023-07-24T05:47:14.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.813+0000 7fbe8b651700 1 --2- 172.21.15.77:0/326747547 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbe840cd130 0x7fbe8406a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:14.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.813+0000 7fbe8b651700 1 --2- 172.21.15.77:0/326747547 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe840c1b20 0x7fbe840ccbf0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:14.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.813+0000 7fbe8b651700 1 -- 172.21.15.77:0/326747547 >> 172.21.15.77:0/326747547 conn(0x7fbe840ce440 msgr2=0x7fbe840ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:14.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.813+0000 7fbe8b651700 1 -- 172.21.15.77:0/326747547 shutdown_connections 2023-07-24T05:47:14.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.813+0000 7fbe8b651700 1 -- 172.21.15.77:0/326747547 wait complete. 2023-07-24T05:47:14.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.817+0000 7fbe8b651700 1 Processor -- start 2023-07-24T05:47:14.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.817+0000 7fbe8b651700 1 -- start start 2023-07-24T05:47:14.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.817+0000 7fbe8b651700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe840c1b20 0x7fbe841543c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:14.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.817+0000 7fbe8b651700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe840cd130 0x7fbe840ae720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:14.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.817+0000 7fbe8b651700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbe84161140 0x7fbe841f9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:14.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.817+0000 7fbe8b651700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe84162a80 con 0x7fbe840c1b20 2023-07-24T05:47:14.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.817+0000 7fbe8b651700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe840aec60 con 0x7fbe840cd130 2023-07-24T05:47:14.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.817+0000 7fbe8b651700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe841fae10 con 0x7fbe84161140 2023-07-24T05:47:14.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.817+0000 7fbe893ed700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe840c1b20 0x7fbe841543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:14.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.817+0000 7fbe893ed700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe840c1b20 0x7fbe841543c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59956/0 (socket says 172.21.15.77:59956) 2023-07-24T05:47:14.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.817+0000 7fbe893ed700 1 -- 172.21.15.77:0/2037741342 learned_addr learned my addr 172.21.15.77:0/2037741342 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:14.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.817+0000 7fbe89bee700 1 --2- 172.21.15.77:0/2037741342 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbe84161140 0x7fbe841f9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:14.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.817+0000 7fbe88bec700 1 --2- 172.21.15.77:0/2037741342 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe840cd130 0x7fbe840ae720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:14.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.821+0000 7fbe893ed700 1 -- 172.21.15.77:0/2037741342 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbe84161140 msgr2=0x7fbe841f9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:14.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.821+0000 7fbe893ed700 1 --2- 172.21.15.77:0/2037741342 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbe84161140 0x7fbe841f9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:14.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.821+0000 7fbe893ed700 1 -- 172.21.15.77:0/2037741342 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe840cd130 msgr2=0x7fbe840ae720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:14.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.821+0000 7fbe893ed700 1 --2- 172.21.15.77:0/2037741342 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe840cd130 0x7fbe840ae720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:14.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.821+0000 7fbe893ed700 1 -- 172.21.15.77:0/2037741342 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe740094b0 con 0x7fbe840c1b20 2023-07-24T05:47:14.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.821+0000 7fbe88bec700 1 --2- 172.21.15.77:0/2037741342 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe840cd130 0x7fbe840ae720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:47:14.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.821+0000 7fbe893ed700 1 --2- 172.21.15.77:0/2037741342 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe840c1b20 0x7fbe841543c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbe8000c500 tx=0x7fbe8000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:14.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.821+0000 7fbe79ffb700 1 -- 172.21.15.77:0/2037741342 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe800074e0 con 0x7fbe840c1b20 2023-07-24T05:47:14.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.821+0000 7fbe79ffb700 1 -- 172.21.15.77:0/2037741342 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe80007640 con 0x7fbe840c1b20 2023-07-24T05:47:14.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.821+0000 7fbe79ffb700 1 -- 172.21.15.77:0/2037741342 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe80005a90 con 0x7fbe840c1b20 2023-07-24T05:47:14.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.821+0000 7fbe8b651700 1 -- 172.21.15.77:0/2037741342 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe841fa850 con 0x7fbe840c1b20 2023-07-24T05:47:14.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.821+0000 7fbe8b651700 1 -- 172.21.15.77:0/2037741342 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe841626a0 con 0x7fbe840c1b20 2023-07-24T05:47:14.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.821+0000 7fbe8b651700 1 -- 172.21.15.77:0/2037741342 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe8404df10 con 0x7fbe840c1b20 2023-07-24T05:47:14.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.825+0000 7fbe79ffb700 1 -- 172.21.15.77:0/2037741342 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbe80005bf0 con 0x7fbe840c1b20 2023-07-24T05:47:14.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.825+0000 7fbe79ffb700 1 --2- 172.21.15.77:0/2037741342 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fbe680662f0 0x7fbe680687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:14.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.825+0000 7fbe79ffb700 1 -- 172.21.15.77:0/2037741342 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbe800835f0 con 0x7fbe840c1b20 2023-07-24T05:47:14.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.825+0000 7fbe88bec700 1 --2- 172.21.15.77:0/2037741342 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fbe680662f0 0x7fbe680687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:14.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.825+0000 7fbe88bec700 1 --2- 172.21.15.77:0/2037741342 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fbe680662f0 0x7fbe680687b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbe841f9e60 tx=0x7fbe74008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:14.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:14.833+0000 7fbe79ffb700 1 -- 172.21.15.77:0/2037741342 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbe80050730 con 0x7fbe840c1b20 2023-07-24T05:47:15.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.005+0000 7fbe8b651700 1 -- 172.21.15.77:0/2037741342 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fbe840c1510 con 0x7fbe840c1b20 2023-07-24T05:47:15.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.005+0000 7fbe79ffb700 1 -- 172.21.15.77:0/2037741342 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbe80053d50 con 0x7fbe840c1b20 2023-07-24T05:47:15.012 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-07-24T05:47:15.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.009+0000 7fbe8b651700 1 -- 172.21.15.77:0/2037741342 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fbe680662f0 msgr2=0x7fbe680687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:15.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.009+0000 7fbe8b651700 1 --2- 172.21.15.77:0/2037741342 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fbe680662f0 0x7fbe680687b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbe841f9e60 tx=0x7fbe74008030 comp rx=0 tx=0).stop 2023-07-24T05:47:15.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.009+0000 7fbe8b651700 1 -- 172.21.15.77:0/2037741342 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe840c1b20 msgr2=0x7fbe841543c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:15.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.009+0000 7fbe8b651700 1 --2- 172.21.15.77:0/2037741342 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe840c1b20 0x7fbe841543c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbe8000c500 tx=0x7fbe8000c8c0 comp rx=0 tx=0).stop 2023-07-24T05:47:15.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.009+0000 7fbe8b651700 1 -- 172.21.15.77:0/2037741342 shutdown_connections 2023-07-24T05:47:15.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.009+0000 7fbe8b651700 1 --2- 172.21.15.77:0/2037741342 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fbe680662f0 0x7fbe680687b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:15.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.009+0000 7fbe8b651700 1 --2- 172.21.15.77:0/2037741342 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fbe84161140 0x7fbe841f9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:15.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.009+0000 7fbe8b651700 1 --2- 172.21.15.77:0/2037741342 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbe840cd130 0x7fbe840ae720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:15.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.009+0000 7fbe8b651700 1 --2- 172.21.15.77:0/2037741342 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbe840c1b20 0x7fbe841543c0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:15.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.009+0000 7fbe8b651700 1 -- 172.21.15.77:0/2037741342 >> 172.21.15.77:0/2037741342 conn(0x7fbe840ce440 msgr2=0x7fbe8406aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:15.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.009+0000 7fbe8b651700 1 -- 172.21.15.77:0/2037741342 shutdown_connections 2023-07-24T05:47:15.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.009+0000 7fbe8b651700 1 -- 172.21.15.77:0/2037741342 wait complete. 2023-07-24T05:47:15.036 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-24T05:47:15.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.205+0000 7f6dbae97700 1 Processor -- start 2023-07-24T05:47:15.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.205+0000 7f6dbae97700 1 -- start start 2023-07-24T05:47:15.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.209+0000 7f6dbae97700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6db415e4c0 0x7f6db415e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:15.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.209+0000 7f6dbae97700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6db40ca940 0x7f6db40cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:15.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.209+0000 7f6dbae97700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6db406bb60 con 0x7f6db406cac0 2023-07-24T05:47:15.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.209+0000 7f6dbae97700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6db415ee90 con 0x7f6db415e4c0 2023-07-24T05:47:15.215 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.209+0000 7f6dbae97700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db415f380 con 0x7f6db40ca940 2023-07-24T05:47:15.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.209+0000 7f6dabfff700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6db415e4c0 0x7f6db415e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:15.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.209+0000 7f6dabfff700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6db415e4c0 0x7f6db415e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59958/0 (socket says 172.21.15.77:59958) 2023-07-24T05:47:15.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.209+0000 7f6dabfff700 1 -- 172.21.15.77:0/1792581844 learned_addr learned my addr 172.21.15.77:0/1792581844 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:15.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.209+0000 7f6db9434700 1 --2- 172.21.15.77:0/1792581844 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6db40ca940 0x7f6db40cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:15.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.209+0000 7f6dabfff700 1 -- 172.21.15.77:0/1792581844 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6db40ca940 msgr2=0x7f6db40cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:15.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.209+0000 7f6dabfff700 1 --2- 172.21.15.77:0/1792581844 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6db40ca940 0x7f6db40cadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:15.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.209+0000 7f6dabfff700 1 -- 172.21.15.77:0/1792581844 >> v1:172.21.15.103:6789/0 conn(0x7f6db406cac0 legacy=0x7f6db406cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:15.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.209+0000 7f6dabfff700 1 -- 172.21.15.77:0/1792581844 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db415f0a0 con 0x7f6db415e4c0 2023-07-24T05:47:15.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.209+0000 7f6dab7fe700 1 -- 172.21.15.77:0/1792581844 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1582156873 0 0) 0x7f6db406bb60 con 0x7f6db406cac0 2023-07-24T05:47:15.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.209+0000 7f6db9434700 1 --2- 172.21.15.77:0/1792581844 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6db40ca940 0x7f6db40cadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:15.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.213+0000 7f6dabfff700 1 --2- 172.21.15.77:0/1792581844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6db415e4c0 0x7f6db415e950 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6da4009910 tx=0x7f6da4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f2f6e83695145f server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:15.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.213+0000 7f6dab7fe700 1 -- 172.21.15.77:0/1792581844 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da400ba60 con 0x7f6db415e4c0 2023-07-24T05:47:15.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.213+0000 7f6dab7fe700 1 -- 172.21.15.77:0/1792581844 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da400bbc0 con 0x7f6db415e4c0 2023-07-24T05:47:15.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.213+0000 7f6dab7fe700 1 -- 172.21.15.77:0/1792581844 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da4009e60 con 0x7f6db415e4c0 2023-07-24T05:47:15.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.213+0000 7f6dbae97700 1 -- 172.21.15.77:0/1792581844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6db415e4c0 msgr2=0x7f6db415e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:15.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.213+0000 7f6dbae97700 1 --2- 172.21.15.77:0/1792581844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6db415e4c0 0x7f6db415e950 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6da4009910 tx=0x7f6da4009c20 comp rx=0 tx=0).stop 2023-07-24T05:47:15.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.213+0000 7f6dbae97700 1 -- 172.21.15.77:0/1792581844 shutdown_connections 2023-07-24T05:47:15.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.213+0000 7f6dbae97700 1 --2- 172.21.15.77:0/1792581844 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6db40ca940 0x7f6db40cadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:15.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.213+0000 7f6dbae97700 1 --2- 172.21.15.77:0/1792581844 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6db415e4c0 0x7f6db415e950 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:15.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.213+0000 7f6dbae97700 1 -- 172.21.15.77:0/1792581844 >> 172.21.15.77:0/1792581844 conn(0x7f6db40ce410 msgr2=0x7f6db40ce7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:15.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.213+0000 7f6dbae97700 1 -- 172.21.15.77:0/1792581844 shutdown_connections 2023-07-24T05:47:15.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.213+0000 7f6dbae97700 1 -- 172.21.15.77:0/1792581844 wait complete. 2023-07-24T05:47:15.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.213+0000 7f6dbae97700 1 Processor -- start 2023-07-24T05:47:15.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.213+0000 7f6dbae97700 1 -- start start 2023-07-24T05:47:15.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.217+0000 7f6dbae97700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6db406cac0 0x7f6db40af470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:15.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.217+0000 7f6dbae97700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6db40ca940 0x7f6db40b04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:15.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.217+0000 7f6dbae97700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db415e4c0 0x7f6db406b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:15.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.217+0000 7f6dbae97700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db40af9b0 con 0x7f6db40ca940 2023-07-24T05:47:15.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.217+0000 7f6dbae97700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db40c7fa0 con 0x7f6db415e4c0 2023-07-24T05:47:15.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.217+0000 7f6dbae97700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db40c7390 con 0x7f6db406cac0 2023-07-24T05:47:15.223 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.217+0000 7f6dabfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6db40ca940 0x7f6db40b04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:15.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.217+0000 7f6dabfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6db40ca940 0x7f6db40b04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59964/0 (socket says 172.21.15.77:59964) 2023-07-24T05:47:15.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.217+0000 7f6db8c33700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6db406cac0 0x7f6db40af470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:15.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.217+0000 7f6dabfff700 1 -- 172.21.15.77:0/2760324261 learned_addr learned my addr 172.21.15.77:0/2760324261 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:15.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.217+0000 7f6db9434700 1 --2- 172.21.15.77:0/2760324261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db415e4c0 0x7f6db406b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:15.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.217+0000 7f6dabfff700 1 -- 172.21.15.77:0/2760324261 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6db406cac0 msgr2=0x7f6db40af470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:15.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.217+0000 7f6dabfff700 1 --2- 172.21.15.77:0/2760324261 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6db406cac0 0x7f6db40af470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:15.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.217+0000 7f6dabfff700 1 -- 172.21.15.77:0/2760324261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db415e4c0 msgr2=0x7f6db406b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:15.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.217+0000 7f6dabfff700 1 --2- 172.21.15.77:0/2760324261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db415e4c0 0x7f6db406b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:15.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.217+0000 7f6dabfff700 1 -- 172.21.15.77:0/2760324261 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da4009570 con 0x7f6db40ca940 2023-07-24T05:47:15.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.217+0000 7f6dabfff700 1 --2- 172.21.15.77:0/2760324261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6db40ca940 0x7f6db40b04d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6da4009c60 tx=0x7f6da4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:15.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.217+0000 7f6da97fa700 1 -- 172.21.15.77:0/2760324261 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da4004220 con 0x7f6db40ca940 2023-07-24T05:47:15.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.217+0000 7f6da97fa700 1 -- 172.21.15.77:0/2760324261 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da401f070 con 0x7f6db40ca940 2023-07-24T05:47:15.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.217+0000 7f6dbae97700 1 -- 172.21.15.77:0/2760324261 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6db40c7670 con 0x7f6db40ca940 2023-07-24T05:47:15.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.217+0000 7f6da97fa700 1 -- 172.21.15.77:0/2760324261 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da40045a0 con 0x7f6db40ca940 2023-07-24T05:47:15.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.217+0000 7f6dbae97700 1 -- 172.21.15.77:0/2760324261 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6db40c7c30 con 0x7f6db40ca940 2023-07-24T05:47:15.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.221+0000 7f6dbae97700 1 -- 172.21.15.77:0/2760324261 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6db404df10 con 0x7f6db40ca940 2023-07-24T05:47:15.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.221+0000 7f6da97fa700 1 -- 172.21.15.77:0/2760324261 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6da401a700 con 0x7f6db40ca940 2023-07-24T05:47:15.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.221+0000 7f6da97fa700 1 --2- 172.21.15.77:0/2760324261 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6da00662f0 0x7f6da00687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:15.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.221+0000 7f6da97fa700 1 -- 172.21.15.77:0/2760324261 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6da4021070 con 0x7f6db40ca940 2023-07-24T05:47:15.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.221+0000 7f6db8c33700 1 --2- 172.21.15.77:0/2760324261 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6da00662f0 0x7f6da00687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:15.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.225+0000 7f6db8c33700 1 --2- 172.21.15.77:0/2760324261 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6da00662f0 0x7f6da00687b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6db0001330 tx=0x7f6db0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:15.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.229+0000 7f6da97fa700 1 -- 172.21.15.77:0/2760324261 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6da40526e0 con 0x7f6db40ca940 2023-07-24T05:47:15.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.409+0000 7f6dbae97700 1 -- 172.21.15.77:0/2760324261 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6db40c80e0 con 0x7f6db40ca940 2023-07-24T05:47:15.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.409+0000 7f6da97fa700 1 -- 172.21.15.77:0/2760324261 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6da4055d00 con 0x7f6db40ca940 2023-07-24T05:47:15.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.413+0000 7f6dbae97700 1 -- 172.21.15.77:0/2760324261 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6da00662f0 msgr2=0x7f6da00687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:15.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.413+0000 7f6dbae97700 1 --2- 172.21.15.77:0/2760324261 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6da00662f0 0x7f6da00687b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6db0001330 tx=0x7f6db0009040 comp rx=0 tx=0).stop 2023-07-24T05:47:15.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.413+0000 7f6dbae97700 1 -- 172.21.15.77:0/2760324261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6db40ca940 msgr2=0x7f6db40b04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:15.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.413+0000 7f6dbae97700 1 --2- 172.21.15.77:0/2760324261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6db40ca940 0x7f6db40b04d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6da4009c60 tx=0x7f6da4004770 comp rx=0 tx=0).stop 2023-07-24T05:47:15.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.413+0000 7f6dbae97700 1 -- 172.21.15.77:0/2760324261 shutdown_connections 2023-07-24T05:47:15.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.413+0000 7f6dbae97700 1 --2- 172.21.15.77:0/2760324261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db415e4c0 0x7f6db406b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:15.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.413+0000 7f6dbae97700 1 --2- 172.21.15.77:0/2760324261 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6db40ca940 0x7f6db40b04d0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:15.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.413+0000 7f6dbae97700 1 --2- 172.21.15.77:0/2760324261 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6da00662f0 0x7f6da00687b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:15.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.413+0000 7f6dbae97700 1 --2- 172.21.15.77:0/2760324261 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6db406cac0 0x7f6db40af470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:15.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.413+0000 7f6dbae97700 1 -- 172.21.15.77:0/2760324261 >> 172.21.15.77:0/2760324261 conn(0x7f6db40ce410 msgr2=0x7f6db415a270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:15.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.413+0000 7f6dbae97700 1 -- 172.21.15.77:0/2760324261 shutdown_connections 2023-07-24T05:47:15.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.413+0000 7f6dbae97700 1 -- 172.21.15.77:0/2760324261 wait complete. 2023-07-24T05:47:15.421 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2023-07-24T05:47:15.441 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi077.front.sepia.ceph.com... 2023-07-24T05:47:15.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:47:15.441 DEBUG:teuthology.orchestra.run.smithi077:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-07-24T05:47:15.471 INFO:teuthology.orchestra.run:waiting for 300 2023-07-24T05:47:15.472 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi077.front.sepia.ceph.com 2023-07-24T05:47:15.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:47:15.472 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-24T05:47:15.532 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2023-07-24T05:47:15.532 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-24T05:47:15.551 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2023-07-24T05:47:15.551 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-24T05:47:15.611 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-24T05:47:15.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.781+0000 7fd88df01700 1 Processor -- start 2023-07-24T05:47:15.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.781+0000 7fd88df01700 1 -- start start 2023-07-24T05:47:15.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.785+0000 7fd88df01700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd88806cac0 0x7fd88806cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:15.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.785+0000 7fd88df01700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd88815e4c0 0x7fd88815e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:15.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.785+0000 7fd88df01700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd88806bb60 con 0x7fd888069b10 2023-07-24T05:47:15.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.785+0000 7fd88df01700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd88815ee90 con 0x7fd88806cac0 2023-07-24T05:47:15.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.785+0000 7fd88df01700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd88815f380 con 0x7fd88815e4c0 2023-07-24T05:47:15.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.785+0000 7fd887fff700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd888069b10 0x7fd888069f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44262/0 (socket says 172.21.15.77:44262) 2023-07-24T05:47:15.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.785+0000 7fd887fff700 1 -- 172.21.15.77:0/128318416 learned_addr learned my addr 172.21.15.77:0/128318416 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:15.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.785+0000 7fd8877fe700 1 --2- 172.21.15.77:0/128318416 >> v2:172.21.15.77:3300/0 conn(0x7fd88806cac0 0x7fd88806cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:15.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.785+0000 7fd886ffd700 1 --2- 172.21.15.77:0/128318416 >> v2:172.21.15.103:3300/0 conn(0x7fd88815e4c0 0x7fd88815e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:15.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.785+0000 7fd8867fc700 1 -- 172.21.15.77:0/128318416 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 60570449 0 0) 0x7fd88806bb60 con 0x7fd888069b10 2023-07-24T05:47:15.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.785+0000 7fd8867fc700 1 -- 172.21.15.77:0/128318416 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8700035d0 con 0x7fd888069b10 2023-07-24T05:47:15.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.785+0000 7fd8877fe700 1 -- 172.21.15.77:0/128318416 >> v2:172.21.15.103:3300/0 conn(0x7fd88815e4c0 msgr2=0x7fd88815e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:15.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.785+0000 7fd8877fe700 1 --2- 172.21.15.77:0/128318416 >> v2:172.21.15.103:3300/0 conn(0x7fd88815e4c0 0x7fd88815e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:15.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.785+0000 7fd8877fe700 1 -- 172.21.15.77:0/128318416 >> v1:172.21.15.77:6789/0 conn(0x7fd888069b10 legacy=0x7fd888069f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:15.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.785+0000 7fd8877fe700 1 -- 172.21.15.77:0/128318416 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8880cb950 con 0x7fd88806cac0 2023-07-24T05:47:15.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.785+0000 7fd8877fe700 1 --2- 172.21.15.77:0/128318416 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd88806cac0 0x7fd88806cea0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd88806fb40 tx=0x7fd878009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=308d37f2cc743a58 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:15.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.789+0000 7fd8867fc700 1 -- 172.21.15.77:0/128318416 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd878011830 con 0x7fd88806cac0 2023-07-24T05:47:15.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.789+0000 7fd8867fc700 1 -- 172.21.15.77:0/128318416 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd878011990 con 0x7fd88806cac0 2023-07-24T05:47:15.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.789+0000 7fd8867fc700 1 -- 172.21.15.77:0/128318416 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd878011d20 con 0x7fd88806cac0 2023-07-24T05:47:15.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.789+0000 7fd88df01700 1 -- 172.21.15.77:0/128318416 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd88806cac0 msgr2=0x7fd88806cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:15.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.789+0000 7fd88df01700 1 --2- 172.21.15.77:0/128318416 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd88806cac0 0x7fd88806cea0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd88806fb40 tx=0x7fd878009b20 comp rx=0 tx=0).stop 2023-07-24T05:47:15.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.789+0000 7fd88df01700 1 -- 172.21.15.77:0/128318416 shutdown_connections 2023-07-24T05:47:15.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.789+0000 7fd88df01700 1 --2- 172.21.15.77:0/128318416 >> v2:172.21.15.103:3300/0 conn(0x7fd88815e4c0 0x7fd88815e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:15.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.789+0000 7fd88df01700 1 --2- 172.21.15.77:0/128318416 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd88806cac0 0x7fd88806cea0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:15.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.789+0000 7fd88df01700 1 -- 172.21.15.77:0/128318416 >> 172.21.15.77:0/128318416 conn(0x7fd8880ce410 msgr2=0x7fd8880ce7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:15.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.789+0000 7fd88df01700 1 -- 172.21.15.77:0/128318416 shutdown_connections 2023-07-24T05:47:15.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.789+0000 7fd88df01700 1 -- 172.21.15.77:0/128318416 wait complete. 2023-07-24T05:47:15.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.789+0000 7fd88df01700 1 Processor -- start 2023-07-24T05:47:15.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.789+0000 7fd88df01700 1 -- start start 2023-07-24T05:47:15.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.793+0000 7fd88df01700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd888069b10 0x7fd8880acce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:15.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.793+0000 7fd88df01700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd88806cac0 0x7fd888159470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:15.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.793+0000 7fd88df01700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd88815e4c0 0x7fd8880c4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:15.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.793+0000 7fd88df01700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8881599b0 con 0x7fd88815e4c0 2023-07-24T05:47:15.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.793+0000 7fd88df01700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8880abc40 con 0x7fd888069b10 2023-07-24T05:47:15.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.793+0000 7fd88df01700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8880abf20 con 0x7fd88806cac0 2023-07-24T05:47:15.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.793+0000 7fd887fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd88815e4c0 0x7fd8880c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:15.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.793+0000 7fd887fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd88815e4c0 0x7fd8880c4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59984/0 (socket says 172.21.15.77:59984) 2023-07-24T05:47:15.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.793+0000 7fd887fff700 1 -- 172.21.15.77:0/664927479 learned_addr learned my addr 172.21.15.77:0/664927479 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:15.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.793+0000 7fd8877fe700 1 --2- 172.21.15.77:0/664927479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd888069b10 0x7fd8880acce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:15.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.793+0000 7fd886ffd700 1 --2- 172.21.15.77:0/664927479 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd88806cac0 0x7fd888159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:15.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.793+0000 7fd887fff700 1 -- 172.21.15.77:0/664927479 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd88806cac0 msgr2=0x7fd888159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:15.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.793+0000 7fd887fff700 1 --2- 172.21.15.77:0/664927479 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd88806cac0 0x7fd888159470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:15.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.793+0000 7fd887fff700 1 -- 172.21.15.77:0/664927479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd888069b10 msgr2=0x7fd8880acce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:15.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.793+0000 7fd887fff700 1 --2- 172.21.15.77:0/664927479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd888069b10 0x7fd8880acce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:15.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.793+0000 7fd887fff700 1 -- 172.21.15.77:0/664927479 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd878009450 con 0x7fd88815e4c0 2023-07-24T05:47:15.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.793+0000 7fd8877fe700 1 --2- 172.21.15.77:0/664927479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd888069b10 0x7fd8880acce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:15.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.793+0000 7fd887fff700 1 --2- 172.21.15.77:0/664927479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd88815e4c0 0x7fd8880c4440 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd88000caa0 tx=0x7fd88000cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:15.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.793+0000 7fd86ffff700 1 -- 172.21.15.77:0/664927479 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88000a7b0 con 0x7fd88815e4c0 2023-07-24T05:47:15.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.793+0000 7fd86ffff700 1 -- 172.21.15.77:0/664927479 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd88000a910 con 0x7fd88815e4c0 2023-07-24T05:47:15.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.793+0000 7fd86ffff700 1 -- 172.21.15.77:0/664927479 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88000aca0 con 0x7fd88815e4c0 2023-07-24T05:47:15.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.793+0000 7fd88df01700 1 -- 172.21.15.77:0/664927479 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8880ac200 con 0x7fd88815e4c0 2023-07-24T05:47:15.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.793+0000 7fd88df01700 1 -- 172.21.15.77:0/664927479 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8880ac7c0 con 0x7fd88815e4c0 2023-07-24T05:47:15.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.797+0000 7fd88df01700 1 -- 172.21.15.77:0/664927479 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd88804df10 con 0x7fd88815e4c0 2023-07-24T05:47:15.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.797+0000 7fd86ffff700 1 -- 172.21.15.77:0/664927479 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd88001b3b0 con 0x7fd88815e4c0 2023-07-24T05:47:15.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.797+0000 7fd86ffff700 1 --2- 172.21.15.77:0/664927479 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd8740662f0 0x7fd8740687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:15.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.801+0000 7fd86ffff700 1 -- 172.21.15.77:0/664927479 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd880083ae0 con 0x7fd88815e4c0 2023-07-24T05:47:15.805 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.801+0000 7fd8877fe700 1 --2- 172.21.15.77:0/664927479 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd8740662f0 0x7fd8740687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:15.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.801+0000 7fd8877fe700 1 --2- 172.21.15.77:0/664927479 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd8740662f0 0x7fd8740687b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd878000c00 tx=0x7fd87801c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:15.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.805+0000 7fd86ffff700 1 -- 172.21.15.77:0/664927479 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd880050c20 con 0x7fd88815e4c0 2023-07-24T05:47:15.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.977+0000 7fd88df01700 1 -- 172.21.15.77:0/664927479 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8880ca130 con 0x7fd88815e4c0 2023-07-24T05:47:15.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.981+0000 7fd86ffff700 1 -- 172.21.15.77:0/664927479 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20204 (secure 0 0 0) 0x7fd880054240 con 0x7fd88815e4c0 2023-07-24T05:47:15.988 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:47:15.988 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":27,"fsid":"5aed5f7b-fb55-4d95-9c02-c6adbb1677b4","created":"2023-07-24T05:45:39.639731+0000","modified":"2023-07-24T05:46:48.442117+0000","last_up_change":"2023-07-24T05:45:52.319670+0000","last_in_change":"2023-07-24T05:45:43.643277+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-24T05:45:52.610430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-24T05:45:52.773787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-24T05:45:58.121732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-24T05:45:59.368726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-24T05:46:03.032057+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ffa0d496-461a-4053-b764-0627d969521b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6812","nonce":825987196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6817","nonce":825987196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6831","nonce":825987196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6824","nonce":825987196}]},"public_addr":"172.21.15.77:6812/825987196","cluster_addr":"172.21.15.77:6817/825987196","heartbeat_back_addr":"172.21.15.77:6831/825987196","heartbeat_front_addr":"172.21.15.77:6824/825987196","state":["exists","up"]},{"osd":1,"uuid":"9f595e5e-5c43-49bc-8ce4-ee70575c90da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6801","nonce":4133026815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6803","nonce":4133026815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6807","nonce":4133026815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6805","nonce":4133026815}]},"public_addr":"172.21.15.77:6801/4133026815","cluster_addr":"172.21.15.77:6803/4133026815","heartbeat_back_addr":"172.21.15.77:6807/4133026815","heartbeat_front_addr":"172.21.15.77:6805/4133026815","state":["exists","up"]},{"osd":2,"uuid":"2ac177aa-4d7d-4262-bd54-d2b9f29f4c3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6811","nonce":2394142159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6819","nonce":2394142159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6830","nonce":2394142159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6825","nonce":2394142159}]},"public_addr":"172.21.15.77:6811/2394142159","cluster_addr":"172.21.15.77:6819/2394142159","heartbeat_back_addr":"172.21.15.77:6830/2394142159","heartbeat_front_addr":"172.21.15.77:6825/2394142159","state":["exists","up"]},{"osd":3,"uuid":"17d7a251-19e8-484c-8172-a578ab3da153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6813","nonce":1492113982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6818","nonce":1492113982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6829","nonce":1492113982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6823","nonce":1492113982}]},"public_addr":"172.21.15.77:6813/1492113982","cluster_addr":"172.21.15.77:6818/1492113982","heartbeat_back_addr":"172.21.15.77:6829/1492113982","heartbeat_front_addr":"172.21.15.77:6823/1492113982","state":["exists","up"]},{"osd":4,"uuid":"bf63ca05-f06d-4e0f-ac44-2a416c70b919","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6825","nonce":1080481057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6827","nonce":1080481057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6831","nonce":1080481057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6829","nonce":1080481057}]},"public_addr":"172.21.15.103:6825/1080481057","cluster_addr":"172.21.15.103:6827/1080481057","heartbeat_back_addr":"172.21.15.103:6831/1080481057","heartbeat_front_addr":"172.21.15.103:6829/1080481057","state":["exists","up"]},{"osd":5,"uuid":"65a11a35-9e9f-4b3c-9fe3-b658d62b9318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6811","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6813","nonce":2756677504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6818","nonce":2756677504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6823","nonce":2756677504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6821","nonce":2756677504}]},"public_addr":"172.21.15.103:6813/2756677504","cluster_addr":"172.21.15.103:6818/2756677504","heartbeat_back_addr":"172.21.15.103:6823/2756677504","heartbeat_front_addr":"172.21.15.103:6821/2756677504","state":["exists","up"]},{"osd":6,"uuid":"750c1f87-686c-40b4-94a1-1a299dc78f3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6809","nonce":568977764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6812","nonce":568977764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6819","nonce":568977764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6815","nonce":568977764}]},"public_addr":"172.21.15.103:6809/568977764","cluster_addr":"172.21.15.103:6812/568977764","heartbeat_back_addr":"172.21.15.103:6819/568977764","heartbeat_front_addr":"172.21.15.103:6815/568977764","state":["exists","up"]},{"osd":7,"uuid":"d5fe4fb6-2e09-4158-885b-403803c85822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6801","nonce":1074557176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6803","nonce":1074557176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6807","nonce":1074557176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6805","nonce":1074557176}]},"public_addr":"172.21.15.103:6801/1074557176","cluster_addr":"172.21.15.103:6803/1074557176","heartbeat_back_addr":"172.21.15.103:6807/1074557176","heartbeat_front_addr":"172.21.15.103:6805/1074557176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.631032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.154109+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.398587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.679089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.311218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.353726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.314372+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.126212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1d","mappings":[{"from":3,"to":2}]},{"pgid":"4.31","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-24T05:47:15.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.985+0000 7fd88df01700 1 -- 172.21.15.77:0/664927479 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd8740662f0 msgr2=0x7fd8740687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:15.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.985+0000 7fd88df01700 1 --2- 172.21.15.77:0/664927479 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd8740662f0 0x7fd8740687b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd878000c00 tx=0x7fd87801c040 comp rx=0 tx=0).stop 2023-07-24T05:47:15.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.985+0000 7fd88df01700 1 -- 172.21.15.77:0/664927479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd88815e4c0 msgr2=0x7fd8880c4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:15.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.985+0000 7fd88df01700 1 --2- 172.21.15.77:0/664927479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd88815e4c0 0x7fd8880c4440 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd88000caa0 tx=0x7fd88000cb80 comp rx=0 tx=0).stop 2023-07-24T05:47:15.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.985+0000 7fd88df01700 1 -- 172.21.15.77:0/664927479 shutdown_connections 2023-07-24T05:47:15.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.985+0000 7fd88df01700 1 --2- 172.21.15.77:0/664927479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd88815e4c0 0x7fd8880c4440 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:15.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.985+0000 7fd88df01700 1 --2- 172.21.15.77:0/664927479 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd8740662f0 0x7fd8740687b0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:15.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.985+0000 7fd88df01700 1 --2- 172.21.15.77:0/664927479 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd88806cac0 0x7fd888159470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:15.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.985+0000 7fd88df01700 1 --2- 172.21.15.77:0/664927479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd888069b10 0x7fd8880acce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:15.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.985+0000 7fd88df01700 1 -- 172.21.15.77:0/664927479 >> 172.21.15.77:0/664927479 conn(0x7fd8880ce410 msgr2=0x7fd8880ce7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:15.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.989+0000 7fd88df01700 1 -- 172.21.15.77:0/664927479 shutdown_connections 2023-07-24T05:47:15.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:15.989+0000 7fd88df01700 1 -- 172.21.15.77:0/664927479 wait complete. 2023-07-24T05:47:16.013 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-24T05:45:52.610430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-24T05:45:52.773787+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-24T05:45:58.121732+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-24T05:45:59.368726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-24T05:46:03.032057+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-24T05:47:16.014 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-24T05:47:16.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.185+0000 7f8376d4c700 1 Processor -- start 2023-07-24T05:47:16.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.185+0000 7f8376d4c700 1 -- start start 2023-07-24T05:47:16.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.189+0000 7f8376d4c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f83701611b0 0x7f83700ac380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:16.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.189+0000 7f8376d4c700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83701616d0 con 0x7f83700c1230 2023-07-24T05:47:16.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.189+0000 7f8376d4c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83701619b0 con 0x7f837006d350 2023-07-24T05:47:16.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.189+0000 7f8376d4c700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83700b1d10 con 0x7f83701611b0 2023-07-24T05:47:16.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.189+0000 7f8375d4a700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f83700c1230 0x7f83700c1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44268/0 (socket says 172.21.15.77:44268) 2023-07-24T05:47:16.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.189+0000 7f8375d4a700 1 -- 172.21.15.77:0/634081422 learned_addr learned my addr 172.21.15.77:0/634081422 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:16.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.189+0000 7f8375549700 1 --2- 172.21.15.77:0/634081422 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f83701611b0 0x7f83700ac380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:16.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.189+0000 7f8374d48700 1 -- 172.21.15.77:0/634081422 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3670365532 0 0) 0x7f83701616d0 con 0x7f83700c1230 2023-07-24T05:47:16.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.189+0000 7f8374d48700 1 -- 172.21.15.77:0/634081422 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f835c0035d0 con 0x7f83700c1230 2023-07-24T05:47:16.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.189+0000 7f8374d48700 1 -- 172.21.15.77:0/634081422 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3895627132 0 0) 0x7f835c0035d0 con 0x7f83700c1230 2023-07-24T05:47:16.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.189+0000 7f8374d48700 1 -- 172.21.15.77:0/634081422 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f83701611b0 msgr2=0x7f83700ac380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:16.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.189+0000 7f8374d48700 1 --2- 172.21.15.77:0/634081422 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f83701611b0 0x7f83700ac380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:16.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.189+0000 7f8374d48700 1 -- 172.21.15.77:0/634081422 >> v1:172.21.15.103:6789/0 conn(0x7f837006d350 legacy=0x7f83700ab150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:16.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.189+0000 7f8374d48700 1 -- 172.21.15.77:0/634081422 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8370161c90 con 0x7f83700c1230 2023-07-24T05:47:16.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.189+0000 7f8374d48700 1 -- 172.21.15.77:0/634081422 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4109865209 0 0) 0x7f836c001670 con 0x7f83700c1230 2023-07-24T05:47:16.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.189+0000 7f8374d48700 1 -- 172.21.15.77:0/634081422 >> v1:172.21.15.77:6789/0 conn(0x7f83700c1230 legacy=0x7f83700c1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:16.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.189+0000 7f8374d48700 1 --2- 172.21.15.77:0/634081422 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f835c003a50 0x7f835c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:16.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.193+0000 7f8374d48700 1 --2- 172.21.15.77:0/634081422 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f835c004870 0x7f835c004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:16.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.193+0000 7f8374d48700 1 --2- 172.21.15.77:0/634081422 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f83701611b0 0x7f835c0052e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:16.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.193+0000 7f8374d48700 1 -- 172.21.15.77:0/634081422 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83700b1d10 con 0x7f835c003a50 2023-07-24T05:47:16.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.193+0000 7f8374d48700 1 -- 172.21.15.77:0/634081422 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835c00bbc0 con 0x7f835c004870 2023-07-24T05:47:16.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.193+0000 7f8374d48700 1 -- 172.21.15.77:0/634081422 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f835c00bd80 con 0x7f83701611b0 2023-07-24T05:47:16.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.193+0000 7f8375d4a700 1 --2- 172.21.15.77:0/634081422 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f835c003a50 0x7f835c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:16.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.193+0000 7f8375549700 1 --2- 172.21.15.77:0/634081422 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f835c004870 0x7f835c004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:16.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.193+0000 7f837654b700 1 --2- 172.21.15.77:0/634081422 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f83701611b0 0x7f835c0052e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:16.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.193+0000 7f8375d4a700 1 -- 172.21.15.77:0/634081422 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f83701611b0 msgr2=0x7f835c0052e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:16.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.193+0000 7f8375d4a700 1 --2- 172.21.15.77:0/634081422 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f83701611b0 0x7f835c0052e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:16.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.193+0000 7f8375d4a700 1 -- 172.21.15.77:0/634081422 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f835c004870 msgr2=0x7f835c004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:16.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.193+0000 7f8375d4a700 1 --2- 172.21.15.77:0/634081422 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f835c004870 0x7f835c004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:16.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.193+0000 7f8375d4a700 1 -- 172.21.15.77:0/634081422 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f835c0035d0 con 0x7f835c003a50 2023-07-24T05:47:16.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.193+0000 7f8375d4a700 1 --2- 172.21.15.77:0/634081422 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f835c003a50 0x7f835c003e70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f836c00c210 tx=0x7f835c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0000af6e5a358b7 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:16.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.193+0000 7f8374d48700 1 -- 172.21.15.77:0/634081422 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c007b90 con 0x7f835c003a50 2023-07-24T05:47:16.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.193+0000 7f8374d48700 1 -- 172.21.15.77:0/634081422 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836c00cd70 con 0x7f835c003a50 2023-07-24T05:47:16.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.193+0000 7f8374d48700 1 -- 172.21.15.77:0/634081422 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c005bc0 con 0x7f835c003a50 2023-07-24T05:47:16.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.193+0000 7f8376d4c700 1 -- 172.21.15.77:0/634081422 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f835c003a50 msgr2=0x7f835c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:16.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.193+0000 7f8376d4c700 1 --2- 172.21.15.77:0/634081422 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f835c003a50 0x7f835c003e70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f836c00c210 tx=0x7f835c0058a0 comp rx=0 tx=0).stop 2023-07-24T05:47:16.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.193+0000 7f837654b700 1 -- 172.21.15.77:0/634081422 reap_dead start 2023-07-24T05:47:16.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.193+0000 7f8376d4c700 1 -- 172.21.15.77:0/634081422 shutdown_connections 2023-07-24T05:47:16.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.193+0000 7f8376d4c700 1 -- 172.21.15.77:0/634081422 >> 172.21.15.77:0/634081422 conn(0x7f83700ce260 msgr2=0x7f83700ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:16.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.193+0000 7f8376d4c700 1 -- 172.21.15.77:0/634081422 shutdown_connections 2023-07-24T05:47:16.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.193+0000 7f8376d4c700 1 -- 172.21.15.77:0/634081422 wait complete. 2023-07-24T05:47:16.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.197+0000 7f8376d4c700 1 Processor -- start 2023-07-24T05:47:16.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.197+0000 7f8376d4c700 1 -- start start 2023-07-24T05:47:16.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.197+0000 7f8376d4c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83700c2500 0x7f83700c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:16.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.201+0000 7f8376d4c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f83700c28e0 0x7f83700c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:16.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.201+0000 7f8376d4c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f837015c440 0x7f837015c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:16.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.201+0000 7f8376d4c700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837015ce00 con 0x7f837015c440 2023-07-24T05:47:16.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.201+0000 7f8376d4c700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83700c5050 con 0x7f83700c2500 2023-07-24T05:47:16.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.201+0000 7f8376d4c700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83700c4a90 con 0x7f83700c28e0 2023-07-24T05:47:16.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.201+0000 7f837654b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f837015c440 0x7f837015c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:16.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.201+0000 7f837654b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f837015c440 0x7f837015c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60002/0 (socket says 172.21.15.77:60002) 2023-07-24T05:47:16.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.201+0000 7f8375d4a700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83700c2500 0x7f83700c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:16.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.201+0000 7f837654b700 1 -- 172.21.15.77:0/789730522 learned_addr learned my addr 172.21.15.77:0/789730522 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:16.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.201+0000 7f8375549700 1 --2- 172.21.15.77:0/789730522 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f83700c28e0 0x7f83700c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:16.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.201+0000 7f837654b700 1 -- 172.21.15.77:0/789730522 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f83700c28e0 msgr2=0x7f83700c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:16.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.201+0000 7f837654b700 1 --2- 172.21.15.77:0/789730522 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f83700c28e0 0x7f83700c41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:16.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.201+0000 7f837654b700 1 -- 172.21.15.77:0/789730522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83700c2500 msgr2=0x7f83700c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:16.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.201+0000 7f837654b700 1 --2- 172.21.15.77:0/789730522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83700c2500 0x7f83700c7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:16.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.201+0000 7f837654b700 1 -- 172.21.15.77:0/789730522 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83700c4d70 con 0x7f837015c440 2023-07-24T05:47:16.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.201+0000 7f837654b700 1 --2- 172.21.15.77:0/789730522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f837015c440 0x7f837015c8c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8370066ad0 tx=0x7f836800d150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:16.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.201+0000 7f83667fc700 1 -- 172.21.15.77:0/789730522 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8368003c30 con 0x7f837015c440 2023-07-24T05:47:16.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.201+0000 7f83667fc700 1 -- 172.21.15.77:0/789730522 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8368003db0 con 0x7f837015c440 2023-07-24T05:47:16.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.201+0000 7f83667fc700 1 -- 172.21.15.77:0/789730522 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836800d950 con 0x7f837015c440 2023-07-24T05:47:16.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.201+0000 7f8376d4c700 1 -- 172.21.15.77:0/789730522 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f837015e340 con 0x7f837015c440 2023-07-24T05:47:16.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.201+0000 7f8376d4c700 1 -- 172.21.15.77:0/789730522 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83700c46f0 con 0x7f837015c440 2023-07-24T05:47:16.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.205+0000 7f8376d4c700 1 -- 172.21.15.77:0/789730522 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f837015e860 con 0x7f837015c440 2023-07-24T05:47:16.210 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.205+0000 7f83667fc700 1 -- 172.21.15.77:0/789730522 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f836800dab0 con 0x7f837015c440 2023-07-24T05:47:16.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.205+0000 7f83667fc700 1 --2- 172.21.15.77:0/789730522 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f83540662f0 0x7f83540687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:16.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.205+0000 7f83667fc700 1 -- 172.21.15.77:0/789730522 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f83680841b0 con 0x7f837015c440 2023-07-24T05:47:16.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.209+0000 7f8375d4a700 1 --2- 172.21.15.77:0/789730522 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f83540662f0 0x7f83540687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:16.214 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.209+0000 7f8375d4a700 1 --2- 172.21.15.77:0/789730522 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f83540662f0 0x7f83540687b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f837002ca30 tx=0x7f836c006040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:16.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.213+0000 7f83667fc700 1 -- 172.21.15.77:0/789730522 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f837015e860 con 0x7f837015c440 2023-07-24T05:47:16.387 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.381+0000 7f8376d4c700 1 -- 172.21.15.77:0/789730522 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8370162220 con 0x7f837015c440 2023-07-24T05:47:16.388 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.381+0000 7f83667fc700 1 -- 172.21.15.77:0/789730522 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8368051260 con 0x7f837015c440 2023-07-24T05:47:16.388 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-07-24T05:47:16.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.385+0000 7f8376d4c700 1 -- 172.21.15.77:0/789730522 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f83540662f0 msgr2=0x7f83540687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:16.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.385+0000 7f8376d4c700 1 --2- 172.21.15.77:0/789730522 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f83540662f0 0x7f83540687b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f837002ca30 tx=0x7f836c006040 comp rx=0 tx=0).stop 2023-07-24T05:47:16.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.385+0000 7f8376d4c700 1 -- 172.21.15.77:0/789730522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f837015c440 msgr2=0x7f837015c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:16.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.385+0000 7f8376d4c700 1 --2- 172.21.15.77:0/789730522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f837015c440 0x7f837015c8c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8370066ad0 tx=0x7f836800d150 comp rx=0 tx=0).stop 2023-07-24T05:47:16.392 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.385+0000 7f8376d4c700 1 -- 172.21.15.77:0/789730522 shutdown_connections 2023-07-24T05:47:16.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.385+0000 7f8376d4c700 1 --2- 172.21.15.77:0/789730522 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f837015c440 0x7f837015c8c0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:16.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.385+0000 7f8376d4c700 1 --2- 172.21.15.77:0/789730522 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f83540662f0 0x7f83540687b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:16.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.385+0000 7f8376d4c700 1 --2- 172.21.15.77:0/789730522 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f83700c28e0 0x7f83700c41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:16.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.385+0000 7f8376d4c700 1 --2- 172.21.15.77:0/789730522 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83700c2500 0x7f83700c7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:16.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.385+0000 7f8376d4c700 1 -- 172.21.15.77:0/789730522 >> 172.21.15.77:0/789730522 conn(0x7f83700ce260 msgr2=0x7f837006bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:16.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.385+0000 7f8376d4c700 1 -- 172.21.15.77:0/789730522 shutdown_connections 2023-07-24T05:47:16.393 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.385+0000 7f8376d4c700 1 -- 172.21.15.77:0/789730522 wait complete. 2023-07-24T05:47:16.413 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-24T05:47:16.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.585+0000 7f96aaedf700 1 Processor -- start 2023-07-24T05:47:16.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.585+0000 7f96aaedf700 1 -- start start 2023-07-24T05:47:16.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.589+0000 7f96aaedf700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f96a415cfe0 0x7f96a40ce910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:16.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.589+0000 7f96aaedf700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f96a4070e10 0x7f96a4069ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:16.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.589+0000 7f96aaedf700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96a415d3c0 con 0x7f96a40cca80 2023-07-24T05:47:16.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.589+0000 7f96aaedf700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96a406bcc0 con 0x7f96a415cfe0 2023-07-24T05:47:16.594 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.589+0000 7f96aaedf700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a40ce370 con 0x7f96a4070e10 2023-07-24T05:47:16.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.589+0000 7f96a8c7b700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f96a415cfe0 0x7f96a40ce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:16.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.589+0000 7f96a947c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f96a4070e10 0x7f96a4069ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:16.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.589+0000 7f96a3fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f96a40cca80 0x7f96a4070700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.77:41008/0 (socket says 172.21.15.77:41008) 2023-07-24T05:47:16.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.589+0000 7f96a947c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f96a4070e10 0x7f96a4069ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.77:54550/0 (socket says 172.21.15.77:54550) 2023-07-24T05:47:16.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.589+0000 7f96a3fff700 1 -- 172.21.15.77:0/965889438 learned_addr learned my addr 172.21.15.77:0/965889438 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:16.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.589+0000 7f96a947c700 1 -- 172.21.15.77:0/965889438 >> v2:172.21.15.103:3300/0 conn(0x7f96a415cfe0 msgr2=0x7f96a40ce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:16.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.589+0000 7f96a947c700 1 --2- 172.21.15.77:0/965889438 >> v2:172.21.15.103:3300/0 conn(0x7f96a415cfe0 0x7f96a40ce910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:16.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.589+0000 7f96a947c700 1 -- 172.21.15.77:0/965889438 >> v1:172.21.15.103:6789/0 conn(0x7f96a40cca80 legacy=0x7f96a4070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:16.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.589+0000 7f96a947c700 1 -- 172.21.15.77:0/965889438 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a40cd2d0 con 0x7f96a4070e10 2023-07-24T05:47:16.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.589+0000 7f96a947c700 1 --2- 172.21.15.77:0/965889438 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f96a4070e10 0x7f96a4069ea0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f969c009d90 tx=0x7f969c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db97b6a59c552fb9 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:16.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.589+0000 7f96a37fe700 1 -- 172.21.15.77:0/965889438 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969c00e070 con 0x7f96a4070e10 2023-07-24T05:47:16.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.589+0000 7f96a37fe700 1 -- 172.21.15.77:0/965889438 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969c00bb20 con 0x7f96a4070e10 2023-07-24T05:47:16.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.589+0000 7f96a37fe700 1 -- 172.21.15.77:0/965889438 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969c012430 con 0x7f96a4070e10 2023-07-24T05:47:16.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.593+0000 7f96aaedf700 1 -- 172.21.15.77:0/965889438 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f96a4070e10 msgr2=0x7f96a4069ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:16.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.593+0000 7f96aaedf700 1 --2- 172.21.15.77:0/965889438 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f96a4070e10 0x7f96a4069ea0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f969c009d90 tx=0x7f969c00b330 comp rx=0 tx=0).stop 2023-07-24T05:47:16.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.593+0000 7f96aaedf700 1 -- 172.21.15.77:0/965889438 shutdown_connections 2023-07-24T05:47:16.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.593+0000 7f96aaedf700 1 --2- 172.21.15.77:0/965889438 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f96a4070e10 0x7f96a4069ea0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:16.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.593+0000 7f96aaedf700 1 --2- 172.21.15.77:0/965889438 >> v2:172.21.15.103:3300/0 conn(0x7f96a415cfe0 0x7f96a40ce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:16.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.593+0000 7f96aaedf700 1 -- 172.21.15.77:0/965889438 >> 172.21.15.77:0/965889438 conn(0x7f96a40cb930 msgr2=0x7f96a40cbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:16.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.593+0000 7f96aaedf700 1 -- 172.21.15.77:0/965889438 shutdown_connections 2023-07-24T05:47:16.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.593+0000 7f96aaedf700 1 -- 172.21.15.77:0/965889438 wait complete. 2023-07-24T05:47:16.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.593+0000 7f96aaedf700 1 Processor -- start 2023-07-24T05:47:16.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.593+0000 7f96aaedf700 1 -- start start 2023-07-24T05:47:16.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.597+0000 7f96aaedf700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96a4070e10 0x7f96a40c5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:16.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.597+0000 7f96aaedf700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96a40cca80 0x7f96a406ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:16.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.597+0000 7f96aaedf700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f96a415cfe0 0x7f96a414fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:16.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.597+0000 7f96aaedf700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a415d9e0 con 0x7f96a40cca80 2023-07-24T05:47:16.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.597+0000 7f96aaedf700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a415dcc0 con 0x7f96a4070e10 2023-07-24T05:47:16.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.597+0000 7f96aaedf700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a415dfa0 con 0x7f96a415cfe0 2023-07-24T05:47:16.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.597+0000 7f96a3fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96a40cca80 0x7f96a406ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:16.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.597+0000 7f96a3fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96a40cca80 0x7f96a406ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60012/0 (socket says 172.21.15.77:60012) 2023-07-24T05:47:16.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.597+0000 7f96a3fff700 1 -- 172.21.15.77:0/3207393371 learned_addr learned my addr 172.21.15.77:0/3207393371 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:16.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.597+0000 7f96a947c700 1 --2- 172.21.15.77:0/3207393371 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f96a415cfe0 0x7f96a414fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:16.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.597+0000 7f96a8c7b700 1 --2- 172.21.15.77:0/3207393371 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96a4070e10 0x7f96a40c5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:16.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.597+0000 7f96a3fff700 1 -- 172.21.15.77:0/3207393371 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f96a415cfe0 msgr2=0x7f96a414fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:16.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.597+0000 7f96a3fff700 1 --2- 172.21.15.77:0/3207393371 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f96a415cfe0 0x7f96a414fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:16.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.597+0000 7f96a3fff700 1 -- 172.21.15.77:0/3207393371 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96a4070e10 msgr2=0x7f96a40c5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:16.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.597+0000 7f96a3fff700 1 --2- 172.21.15.77:0/3207393371 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96a4070e10 0x7f96a40c5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:16.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.597+0000 7f96a3fff700 1 -- 172.21.15.77:0/3207393371 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f969c009a70 con 0x7f96a40cca80 2023-07-24T05:47:16.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.597+0000 7f96a3fff700 1 --2- 172.21.15.77:0/3207393371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96a40cca80 0x7f96a406ac50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9690001eb0 tx=0x7f969000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:16.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.597+0000 7f96a17fa700 1 -- 172.21.15.77:0/3207393371 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9690005d90 con 0x7f96a40cca80 2023-07-24T05:47:16.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.597+0000 7f96a17fa700 1 -- 172.21.15.77:0/3207393371 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96900070d0 con 0x7f96a40cca80 2023-07-24T05:47:16.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.597+0000 7f96a17fa700 1 -- 172.21.15.77:0/3207393371 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9690007440 con 0x7f96a40cca80 2023-07-24T05:47:16.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.597+0000 7f96aaedf700 1 -- 172.21.15.77:0/3207393371 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96a415e280 con 0x7f96a40cca80 2023-07-24T05:47:16.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.597+0000 7f96aaedf700 1 -- 172.21.15.77:0/3207393371 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96a415a390 con 0x7f96a40cca80 2023-07-24T05:47:16.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.601+0000 7f96aaedf700 1 -- 172.21.15.77:0/3207393371 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96a415e7a0 con 0x7f96a40cca80 2023-07-24T05:47:16.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.601+0000 7f96a17fa700 1 -- 172.21.15.77:0/3207393371 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f96900075a0 con 0x7f96a40cca80 2023-07-24T05:47:16.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.605+0000 7f96a17fa700 1 --2- 172.21.15.77:0/3207393371 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f96880662f0 0x7f96880687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:16.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.605+0000 7f96a17fa700 1 -- 172.21.15.77:0/3207393371 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9690083430 con 0x7f96a40cca80 2023-07-24T05:47:16.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.605+0000 7f96a8c7b700 1 --2- 172.21.15.77:0/3207393371 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f96880662f0 0x7f96880687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:16.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.605+0000 7f96a8c7b700 1 --2- 172.21.15.77:0/3207393371 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f96880662f0 0x7f96880687b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9698009b80 tx=0x7f9698008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:16.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.613+0000 7f96a17fa700 1 -- 172.21.15.77:0/3207393371 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f96a415e7a0 con 0x7f96a40cca80 2023-07-24T05:47:16.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.785+0000 7f96aaedf700 1 -- 172.21.15.77:0/3207393371 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f96a415e7a0 con 0x7f96a40cca80 2023-07-24T05:47:16.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.785+0000 7f96a17fa700 1 -- 172.21.15.77:0/3207393371 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f96a415e7a0 con 0x7f96a40cca80 2023-07-24T05:47:16.791 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 8 2023-07-24T05:47:16.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.789+0000 7f96aaedf700 1 -- 172.21.15.77:0/3207393371 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f96880662f0 msgr2=0x7f96880687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:16.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.789+0000 7f96aaedf700 1 --2- 172.21.15.77:0/3207393371 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f96880662f0 0x7f96880687b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9698009b80 tx=0x7f9698008040 comp rx=0 tx=0).stop 2023-07-24T05:47:16.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.789+0000 7f96aaedf700 1 -- 172.21.15.77:0/3207393371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96a40cca80 msgr2=0x7f96a406ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:16.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.789+0000 7f96aaedf700 1 --2- 172.21.15.77:0/3207393371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96a40cca80 0x7f96a406ac50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9690001eb0 tx=0x7f969000c860 comp rx=0 tx=0).stop 2023-07-24T05:47:16.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.789+0000 7f96aaedf700 1 -- 172.21.15.77:0/3207393371 shutdown_connections 2023-07-24T05:47:16.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.789+0000 7f96aaedf700 1 --2- 172.21.15.77:0/3207393371 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f96880662f0 0x7f96880687b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:16.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.789+0000 7f96aaedf700 1 --2- 172.21.15.77:0/3207393371 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f96a415cfe0 0x7f96a414fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:16.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.789+0000 7f96aaedf700 1 --2- 172.21.15.77:0/3207393371 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96a40cca80 0x7f96a406ac50 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:16.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.789+0000 7f96aaedf700 1 --2- 172.21.15.77:0/3207393371 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96a4070e10 0x7f96a40c5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:16.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.789+0000 7f96aaedf700 1 -- 172.21.15.77:0/3207393371 >> 172.21.15.77:0/3207393371 conn(0x7f96a40cb930 msgr2=0x7f96a40ae9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:16.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.789+0000 7f96aaedf700 1 -- 172.21.15.77:0/3207393371 shutdown_connections 2023-07-24T05:47:16.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.789+0000 7f96aaedf700 1 -- 172.21.15.77:0/3207393371 wait complete. 2023-07-24T05:47:16.816 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-24T05:47:16.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.989+0000 7f434e003700 1 Processor -- start 2023-07-24T05:47:16.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.989+0000 7f434e003700 1 -- start start 2023-07-24T05:47:16.998 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.993+0000 7f434e003700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4348159840 0x7f434806bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:16.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.993+0000 7f434e003700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f43480ca2d0 0x7f43480ced80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:16.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.993+0000 7f434e003700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f434806fc50 0x7f43480700e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:16.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.993+0000 7f434e003700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f434806daa0 con 0x7f434806fc50 2023-07-24T05:47:16.999 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.993+0000 7f434e003700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f434806c1d0 con 0x7f4348159840 2023-07-24T05:47:17.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.993+0000 7f434e003700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43480ca730 con 0x7f43480ca2d0 2023-07-24T05:47:17.000 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.993+0000 7f434c800700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f43480ca2d0 0x7f43480ced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:17.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.993+0000 7f434d802700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f434806fc50 0x7f43480700e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:17.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.993+0000 7f434c800700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f43480ca2d0 0x7f43480ced80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.77:54558/0 (socket says 172.21.15.77:54558) 2023-07-24T05:47:17.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.993+0000 7f434c800700 1 -- 172.21.15.77:0/1864518511 learned_addr learned my addr 172.21.15.77:0/1864518511 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:17.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.993+0000 7f434d001700 1 --2- 172.21.15.77:0/1864518511 >> v2:172.21.15.103:3300/0 conn(0x7f4348159840 0x7f434806bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:17.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.993+0000 7f434c800700 1 -- 172.21.15.77:0/1864518511 >> v2:172.21.15.103:3300/0 conn(0x7f4348159840 msgr2=0x7f434806bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:17.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.993+0000 7f434c800700 1 --2- 172.21.15.77:0/1864518511 >> v2:172.21.15.103:3300/0 conn(0x7f4348159840 0x7f434806bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:17.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.993+0000 7f434c800700 1 -- 172.21.15.77:0/1864518511 >> v2:172.21.15.77:3300/0 conn(0x7f434806fc50 msgr2=0x7f43480700e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:17.001 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.993+0000 7f434c800700 1 --2- 172.21.15.77:0/1864518511 >> v2:172.21.15.77:3300/0 conn(0x7f434806fc50 0x7f43480700e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:17.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.993+0000 7f434c800700 1 -- 172.21.15.77:0/1864518511 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43480c92c0 con 0x7f43480ca2d0 2023-07-24T05:47:17.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.993+0000 7f434d802700 1 --2- 172.21.15.77:0/1864518511 >> v2:172.21.15.77:3300/0 conn(0x7f434806fc50 0x7f43480700e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:47:17.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.997+0000 7f434c800700 1 --2- 172.21.15.77:0/1864518511 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f43480ca2d0 0x7f43480ced80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4348078d20 tx=0x7f4338009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eebf0be0c6521e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:17.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.997+0000 7f433ffff700 1 -- 172.21.15.77:0/1864518511 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4338011830 con 0x7f43480ca2d0 2023-07-24T05:47:17.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.997+0000 7f433ffff700 1 -- 172.21.15.77:0/1864518511 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4338011990 con 0x7f43480ca2d0 2023-07-24T05:47:17.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.997+0000 7f433ffff700 1 -- 172.21.15.77:0/1864518511 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4338011d40 con 0x7f43480ca2d0 2023-07-24T05:47:17.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.997+0000 7f434e003700 1 -- 172.21.15.77:0/1864518511 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f43480ca2d0 msgr2=0x7f43480ced80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:17.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.997+0000 7f434e003700 1 --2- 172.21.15.77:0/1864518511 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f43480ca2d0 0x7f43480ced80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4348078d20 tx=0x7f4338009c20 comp rx=0 tx=0).stop 2023-07-24T05:47:17.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.997+0000 7f434e003700 1 -- 172.21.15.77:0/1864518511 shutdown_connections 2023-07-24T05:47:17.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.997+0000 7f434e003700 1 --2- 172.21.15.77:0/1864518511 >> v2:172.21.15.77:3300/0 conn(0x7f434806fc50 0x7f43480700e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:17.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.997+0000 7f434e003700 1 --2- 172.21.15.77:0/1864518511 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f43480ca2d0 0x7f43480ced80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:17.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.997+0000 7f434e003700 1 --2- 172.21.15.77:0/1864518511 >> v2:172.21.15.103:3300/0 conn(0x7f4348159840 0x7f434806bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:17.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.997+0000 7f434e003700 1 -- 172.21.15.77:0/1864518511 >> 172.21.15.77:0/1864518511 conn(0x7f43480ce260 msgr2=0x7f43480ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:17.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.997+0000 7f434e003700 1 -- 172.21.15.77:0/1864518511 shutdown_connections 2023-07-24T05:47:17.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:16.997+0000 7f434e003700 1 -- 172.21.15.77:0/1864518511 wait complete. 2023-07-24T05:47:17.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.001+0000 7f434e003700 1 Processor -- start 2023-07-24T05:47:17.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.001+0000 7f434e003700 1 -- start start 2023-07-24T05:47:17.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.001+0000 7f434e003700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f434806fc50 0x7f43480c1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:17.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.001+0000 7f434e003700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f43480ca2d0 0x7f434814a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:17.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.001+0000 7f434e003700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4348159840 0x7f434815bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:17.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.001+0000 7f434e003700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43480c22d0 con 0x7f434806fc50 2023-07-24T05:47:17.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.001+0000 7f434e003700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f434815a870 con 0x7f4348159840 2023-07-24T05:47:17.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.001+0000 7f434e003700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f434815ab50 con 0x7f43480ca2d0 2023-07-24T05:47:17.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.001+0000 7f434d001700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f434806fc50 0x7f43480c1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:17.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.001+0000 7f434d001700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f434806fc50 0x7f43480c1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60034/0 (socket says 172.21.15.77:60034) 2023-07-24T05:47:17.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.001+0000 7f434d001700 1 -- 172.21.15.77:0/4147005816 learned_addr learned my addr 172.21.15.77:0/4147005816 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:17.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.001+0000 7f434d802700 1 --2- 172.21.15.77:0/4147005816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4348159840 0x7f434815bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:17.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.001+0000 7f434c800700 1 --2- 172.21.15.77:0/4147005816 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f43480ca2d0 0x7f434814a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:17.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.001+0000 7f434d001700 1 -- 172.21.15.77:0/4147005816 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f43480ca2d0 msgr2=0x7f434814a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:17.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.001+0000 7f434d001700 1 --2- 172.21.15.77:0/4147005816 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f43480ca2d0 0x7f434814a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:17.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.001+0000 7f434d001700 1 -- 172.21.15.77:0/4147005816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4348159840 msgr2=0x7f434815bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:17.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.001+0000 7f434d001700 1 --2- 172.21.15.77:0/4147005816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4348159840 0x7f434815bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:17.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.001+0000 7f434d001700 1 -- 172.21.15.77:0/4147005816 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4340009a70 con 0x7f434806fc50 2023-07-24T05:47:17.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.001+0000 7f434d001700 1 --2- 172.21.15.77:0/4147005816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f434806fc50 0x7f43480c1d90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f434400e760 tx=0x7f434400ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:17.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.005+0000 7f433dffb700 1 -- 172.21.15.77:0/4147005816 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4344013610 con 0x7f434806fc50 2023-07-24T05:47:17.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.005+0000 7f433dffb700 1 -- 172.21.15.77:0/4147005816 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4344013770 con 0x7f434806fc50 2023-07-24T05:47:17.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.005+0000 7f434e003700 1 -- 172.21.15.77:0/4147005816 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4338009570 con 0x7f434806fc50 2023-07-24T05:47:17.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.005+0000 7f433dffb700 1 -- 172.21.15.77:0/4147005816 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4344013ae0 con 0x7f434806fc50 2023-07-24T05:47:17.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.005+0000 7f434e003700 1 -- 172.21.15.77:0/4147005816 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f434815b110 con 0x7f434806fc50 2023-07-24T05:47:17.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.005+0000 7f434e003700 1 -- 172.21.15.77:0/4147005816 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4348072490 con 0x7f434806fc50 2023-07-24T05:47:17.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.009+0000 7f433dffb700 1 -- 172.21.15.77:0/4147005816 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4344013c40 con 0x7f434806fc50 2023-07-24T05:47:17.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.009+0000 7f433dffb700 1 --2- 172.21.15.77:0/4147005816 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f432c0662f0 0x7f432c0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:17.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.009+0000 7f433dffb700 1 -- 172.21.15.77:0/4147005816 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4344083b40 con 0x7f434806fc50 2023-07-24T05:47:17.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.009+0000 7f434c800700 1 --2- 172.21.15.77:0/4147005816 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f432c0662f0 0x7f432c0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:17.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.013+0000 7f434c800700 1 --2- 172.21.15.77:0/4147005816 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f432c0662f0 0x7f432c0687b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4338014040 tx=0x7f4338008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:17.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.017+0000 7f433dffb700 1 -- 172.21.15.77:0/4147005816 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4344054720 con 0x7f434806fc50 2023-07-24T05:47:17.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.189+0000 7f434e003700 1 -- 172.21.15.77:0/4147005816 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f434806b090 con 0x7f434806fc50 2023-07-24T05:47:17.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.189+0000 7f433dffb700 1 -- 172.21.15.77:0/4147005816 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f43440542b0 con 0x7f434806fc50 2023-07-24T05:47:17.196 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-07-24T05:47:17.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.193+0000 7f434e003700 1 -- 172.21.15.77:0/4147005816 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f432c0662f0 msgr2=0x7f432c0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:17.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.193+0000 7f434e003700 1 --2- 172.21.15.77:0/4147005816 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f432c0662f0 0x7f432c0687b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4338014040 tx=0x7f4338008030 comp rx=0 tx=0).stop 2023-07-24T05:47:17.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.193+0000 7f434e003700 1 -- 172.21.15.77:0/4147005816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f434806fc50 msgr2=0x7f43480c1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:17.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.193+0000 7f434e003700 1 --2- 172.21.15.77:0/4147005816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f434806fc50 0x7f43480c1d90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f434400e760 tx=0x7f434400ea70 comp rx=0 tx=0).stop 2023-07-24T05:47:17.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.193+0000 7f434e003700 1 -- 172.21.15.77:0/4147005816 shutdown_connections 2023-07-24T05:47:17.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.193+0000 7f434e003700 1 --2- 172.21.15.77:0/4147005816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4348159840 0x7f434815bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:17.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.193+0000 7f434e003700 1 --2- 172.21.15.77:0/4147005816 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f432c0662f0 0x7f432c0687b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:17.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.193+0000 7f434e003700 1 --2- 172.21.15.77:0/4147005816 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f43480ca2d0 0x7f434814a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:17.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.193+0000 7f434e003700 1 --2- 172.21.15.77:0/4147005816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f434806fc50 0x7f43480c1d90 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:17.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.193+0000 7f434e003700 1 -- 172.21.15.77:0/4147005816 >> 172.21.15.77:0/4147005816 conn(0x7f43480ce260 msgr2=0x7f43480cbe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:17.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.193+0000 7f434e003700 1 -- 172.21.15.77:0/4147005816 shutdown_connections 2023-07-24T05:47:17.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.193+0000 7f434e003700 1 -- 172.21.15.77:0/4147005816 wait complete. 2023-07-24T05:47:17.221 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-24T05:47:17.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.389+0000 7f20bd370700 1 Processor -- start 2023-07-24T05:47:17.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.389+0000 7f20bd370700 1 -- start start 2023-07-24T05:47:17.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.393+0000 7f20bd370700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f20b806afc0 0x7f20b80b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:17.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.393+0000 7f20bd370700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f20b815db20 0x7f20b80d28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:17.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.393+0000 7f20bd370700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20b8160fa0 con 0x7f20b80d2df0 2023-07-24T05:47:17.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.393+0000 7f20bd370700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20b80d3280 con 0x7f20b806afc0 2023-07-24T05:47:17.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.393+0000 7f20bd370700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b80d0360 con 0x7f20b815db20 2023-07-24T05:47:17.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.393+0000 7f20b6ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f20b806afc0 0x7f20b80b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:17.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.393+0000 7f20b67fc700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f20b815db20 0x7f20b80d28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:17.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.393+0000 7f20b77fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f20b80d2df0 0x7f20b80d1520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.77:41018/0 (socket says 172.21.15.77:41018) 2023-07-24T05:47:17.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.393+0000 7f20b77fe700 1 -- 172.21.15.77:0/986177943 learned_addr learned my addr 172.21.15.77:0/986177943 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:17.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.397+0000 7f20b67fc700 1 -- 172.21.15.77:0/986177943 >> v2:172.21.15.103:3300/0 conn(0x7f20b806afc0 msgr2=0x7f20b80b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:17.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.397+0000 7f20b67fc700 1 --2- 172.21.15.77:0/986177943 >> v2:172.21.15.103:3300/0 conn(0x7f20b806afc0 0x7f20b80b1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:17.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.397+0000 7f20b67fc700 1 -- 172.21.15.77:0/986177943 >> v1:172.21.15.103:6789/0 conn(0x7f20b80d2df0 legacy=0x7f20b80d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:17.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.397+0000 7f20b67fc700 1 -- 172.21.15.77:0/986177943 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b80b20b0 con 0x7f20b815db20 2023-07-24T05:47:17.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.397+0000 7f20b67fc700 1 --2- 172.21.15.77:0/986177943 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f20b815db20 0x7f20b80d28b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f20ac009850 tx=0x7f20ac009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15d01ec2cde70565 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:17.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.397+0000 7f20b5ffb700 1 -- 172.21.15.77:0/986177943 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ac011830 con 0x7f20b815db20 2023-07-24T05:47:17.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.397+0000 7f20b5ffb700 1 -- 172.21.15.77:0/986177943 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20ac011990 con 0x7f20b815db20 2023-07-24T05:47:17.403 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.397+0000 7f20b5ffb700 1 -- 172.21.15.77:0/986177943 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ac011d40 con 0x7f20b815db20 2023-07-24T05:47:17.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.397+0000 7f20bd370700 1 -- 172.21.15.77:0/986177943 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f20b815db20 msgr2=0x7f20b80d28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:17.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.397+0000 7f20bd370700 1 --2- 172.21.15.77:0/986177943 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f20b815db20 0x7f20b80d28b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f20ac009850 tx=0x7f20ac009b60 comp rx=0 tx=0).stop 2023-07-24T05:47:17.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.397+0000 7f20bd370700 1 -- 172.21.15.77:0/986177943 shutdown_connections 2023-07-24T05:47:17.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.397+0000 7f20bd370700 1 --2- 172.21.15.77:0/986177943 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f20b815db20 0x7f20b80d28b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:17.404 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.397+0000 7f20bd370700 1 --2- 172.21.15.77:0/986177943 >> v2:172.21.15.103:3300/0 conn(0x7f20b806afc0 0x7f20b80b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:17.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.397+0000 7f20bd370700 1 -- 172.21.15.77:0/986177943 >> 172.21.15.77:0/986177943 conn(0x7f20b809bc20 msgr2=0x7f20b80b7920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:17.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.397+0000 7f20bd370700 1 -- 172.21.15.77:0/986177943 shutdown_connections 2023-07-24T05:47:17.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.397+0000 7f20bd370700 1 -- 172.21.15.77:0/986177943 wait complete. 2023-07-24T05:47:17.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.401+0000 7f20bd370700 1 Processor -- start 2023-07-24T05:47:17.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.401+0000 7f20bd370700 1 -- start start 2023-07-24T05:47:17.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.401+0000 7f20bd370700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f20b806afc0 0x7f20b80d2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:17.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.401+0000 7f20bd370700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20b80d2df0 0x7f20b8155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:17.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.401+0000 7f20bd370700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20b815db20 0x7f20b8156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:17.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.401+0000 7f20bd370700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b81f6400 con 0x7f20b80d2df0 2023-07-24T05:47:17.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.401+0000 7f20bd370700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b81f6120 con 0x7f20b815db20 2023-07-24T05:47:17.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.401+0000 7f20bd370700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b80d0670 con 0x7f20b806afc0 2023-07-24T05:47:17.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.401+0000 7f20b67fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20b80d2df0 0x7f20b8155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:17.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.401+0000 7f20b67fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20b80d2df0 0x7f20b8155c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60050/0 (socket says 172.21.15.77:60050) 2023-07-24T05:47:17.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.401+0000 7f20b67fc700 1 -- 172.21.15.77:0/1158096979 learned_addr learned my addr 172.21.15.77:0/1158096979 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:17.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.401+0000 7f20b6ffd700 1 --2- 172.21.15.77:0/1158096979 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f20b806afc0 0x7f20b80d2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:17.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.401+0000 7f20b77fe700 1 --2- 172.21.15.77:0/1158096979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20b815db20 0x7f20b8156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:17.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.401+0000 7f20b67fc700 1 -- 172.21.15.77:0/1158096979 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f20b806afc0 msgr2=0x7f20b80d2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:17.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.401+0000 7f20b67fc700 1 --2- 172.21.15.77:0/1158096979 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f20b806afc0 0x7f20b80d2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:17.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.401+0000 7f20b67fc700 1 -- 172.21.15.77:0/1158096979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20b815db20 msgr2=0x7f20b8156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:17.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.401+0000 7f20b67fc700 1 --2- 172.21.15.77:0/1158096979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20b815db20 0x7f20b8156180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:17.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.401+0000 7f20b67fc700 1 -- 172.21.15.77:0/1158096979 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20ac0094b0 con 0x7f20b80d2df0 2023-07-24T05:47:17.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.401+0000 7f20b77fe700 1 --2- 172.21.15.77:0/1158096979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20b815db20 0x7f20b8156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:17.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.405+0000 7f20b67fc700 1 --2- 172.21.15.77:0/1158096979 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20b80d2df0 0x7f20b8155c40 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f20b80d04a0 tx=0x7f20ac004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:17.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.405+0000 7f209f7fe700 1 -- 172.21.15.77:0/1158096979 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ac004480 con 0x7f20b80d2df0 2023-07-24T05:47:17.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.405+0000 7f209f7fe700 1 -- 172.21.15.77:0/1158096979 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20ac01f070 con 0x7f20b80d2df0 2023-07-24T05:47:17.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.405+0000 7f20bd370700 1 -- 172.21.15.77:0/1158096979 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20b80d0950 con 0x7f20b80d2df0 2023-07-24T05:47:17.411 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.405+0000 7f209f7fe700 1 -- 172.21.15.77:0/1158096979 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ac003900 con 0x7f20b80d2df0 2023-07-24T05:47:17.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.405+0000 7f20bd370700 1 -- 172.21.15.77:0/1158096979 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20b80d2a90 con 0x7f20b80d2df0 2023-07-24T05:47:17.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.405+0000 7f20bd370700 1 -- 172.21.15.77:0/1158096979 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20b80d04d0 con 0x7f20b80d2df0 2023-07-24T05:47:17.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.405+0000 7f209f7fe700 1 -- 172.21.15.77:0/1158096979 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f20ac021030 con 0x7f20b80d2df0 2023-07-24T05:47:17.414 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.409+0000 7f209f7fe700 1 --2- 172.21.15.77:0/1158096979 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f20a40662f0 0x7f20a40687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:17.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.409+0000 7f209f7fe700 1 -- 172.21.15.77:0/1158096979 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f20ac085480 con 0x7f20b80d2df0 2023-07-24T05:47:17.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.409+0000 7f20b6ffd700 1 --2- 172.21.15.77:0/1158096979 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f20a40662f0 0x7f20a40687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:17.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.409+0000 7f20b6ffd700 1 --2- 172.21.15.77:0/1158096979 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f20a40662f0 0x7f20a40687b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f20a8009b50 tx=0x7f20a8009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:17.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.413+0000 7f209f7fe700 1 -- 172.21.15.77:0/1158096979 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f20b80d04d0 con 0x7f20b80d2df0 2023-07-24T05:47:17.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.585+0000 7f20bd370700 1 -- 172.21.15.77:0/1158096979 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f20b80d04d0 con 0x7f20b80d2df0 2023-07-24T05:47:17.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.589+0000 7f209f7fe700 1 -- 172.21.15.77:0/1158096979 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f20b80d04d0 con 0x7f20b80d2df0 2023-07-24T05:47:17.593 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-07-24T05:47:17.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.589+0000 7f20bd370700 1 -- 172.21.15.77:0/1158096979 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f20a40662f0 msgr2=0x7f20a40687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:17.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.589+0000 7f20bd370700 1 --2- 172.21.15.77:0/1158096979 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f20a40662f0 0x7f20a40687b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f20a8009b50 tx=0x7f20a8009240 comp rx=0 tx=0).stop 2023-07-24T05:47:17.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.589+0000 7f20bd370700 1 -- 172.21.15.77:0/1158096979 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20b80d2df0 msgr2=0x7f20b8155c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:17.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.589+0000 7f20bd370700 1 --2- 172.21.15.77:0/1158096979 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20b80d2df0 0x7f20b8155c40 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f20b80d04a0 tx=0x7f20ac004770 comp rx=0 tx=0).stop 2023-07-24T05:47:17.596 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.589+0000 7f20bd370700 1 -- 172.21.15.77:0/1158096979 shutdown_connections 2023-07-24T05:47:17.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.589+0000 7f20bd370700 1 --2- 172.21.15.77:0/1158096979 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20b815db20 0x7f20b8156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:17.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.589+0000 7f20bd370700 1 --2- 172.21.15.77:0/1158096979 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20b80d2df0 0x7f20b8155c40 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:17.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.589+0000 7f20bd370700 1 --2- 172.21.15.77:0/1158096979 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f20a40662f0 0x7f20a40687b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:17.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.589+0000 7f20bd370700 1 --2- 172.21.15.77:0/1158096979 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f20b806afc0 0x7f20b80d2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:17.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.589+0000 7f20bd370700 1 -- 172.21.15.77:0/1158096979 >> 172.21.15.77:0/1158096979 conn(0x7f20b809bc20 msgr2=0x7f20b8069b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:17.597 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.589+0000 7f20bd370700 1 -- 172.21.15.77:0/1158096979 shutdown_connections 2023-07-24T05:47:17.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.589+0000 7f20bd370700 1 -- 172.21.15.77:0/1158096979 wait complete. 2023-07-24T05:47:17.619 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-24T05:47:17.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.785+0000 7f597ea61700 1 Processor -- start 2023-07-24T05:47:17.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.785+0000 7f597ea61700 1 -- start start 2023-07-24T05:47:17.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.789+0000 7f597ea61700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f597806d350 0x7f59780ac380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:17.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.789+0000 7f597ea61700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59781616d0 con 0x7f59780c1230 2023-07-24T05:47:17.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.789+0000 7f597ea61700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59781619b0 con 0x7f59781611b0 2023-07-24T05:47:17.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.789+0000 7f597ea61700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59780b1d10 con 0x7f597806d350 2023-07-24T05:47:17.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.789+0000 7f597da5f700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f59780c1230 0x7f59780c1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44270/0 (socket says 172.21.15.77:44270) 2023-07-24T05:47:17.795 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.789+0000 7f597da5f700 1 -- 172.21.15.77:0/3166757227 learned_addr learned my addr 172.21.15.77:0/3166757227 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:17.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.789+0000 7f597e260700 1 --2- 172.21.15.77:0/3166757227 >> v2:172.21.15.103:3300/0 conn(0x7f597806d350 0x7f59780ac380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:17.796 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.789+0000 7f597ca5d700 1 -- 172.21.15.77:0/3166757227 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 439800781 0 0) 0x7f59781616d0 con 0x7f59780c1230 2023-07-24T05:47:17.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.789+0000 7f597ca5d700 1 -- 172.21.15.77:0/3166757227 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59640035d0 con 0x7f59780c1230 2023-07-24T05:47:17.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.789+0000 7f597ca5d700 1 -- 172.21.15.77:0/3166757227 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2251659001 0 0) 0x7f59640035d0 con 0x7f59780c1230 2023-07-24T05:47:17.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.789+0000 7f597ca5d700 1 -- 172.21.15.77:0/3166757227 >> v2:172.21.15.103:3300/0 conn(0x7f597806d350 msgr2=0x7f59780ac380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:17.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.789+0000 7f597ca5d700 1 --2- 172.21.15.77:0/3166757227 >> v2:172.21.15.103:3300/0 conn(0x7f597806d350 0x7f59780ac380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:17.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.789+0000 7f597ca5d700 1 -- 172.21.15.77:0/3166757227 >> v1:172.21.15.103:6789/0 conn(0x7f59781611b0 legacy=0x7f59780ab150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:17.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.789+0000 7f597ca5d700 1 -- 172.21.15.77:0/3166757227 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5978161c90 con 0x7f59780c1230 2023-07-24T05:47:17.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.789+0000 7f597ca5d700 1 -- 172.21.15.77:0/3166757227 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4109865209 0 0) 0x7f5974001670 con 0x7f59780c1230 2023-07-24T05:47:17.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.789+0000 7f597ca5d700 1 -- 172.21.15.77:0/3166757227 >> v1:172.21.15.77:6789/0 conn(0x7f59780c1230 legacy=0x7f59780c1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:17.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.789+0000 7f597ca5d700 1 --2- 172.21.15.77:0/3166757227 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5964003a20 0x7f5964003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:17.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.789+0000 7f597ca5d700 1 --2- 172.21.15.77:0/3166757227 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5964004420 0x7f59640048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:17.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.789+0000 7f597ca5d700 1 --2- 172.21.15.77:0/3166757227 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5964005190 0x7f596400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:17.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.789+0000 7f597ca5d700 1 -- 172.21.15.77:0/3166757227 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59780b1d10 con 0x7f5964004420 2023-07-24T05:47:17.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.789+0000 7f597ca5d700 1 -- 172.21.15.77:0/3166757227 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596400c0d0 con 0x7f5964003a20 2023-07-24T05:47:17.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.789+0000 7f597ca5d700 1 -- 172.21.15.77:0/3166757227 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f596400c290 con 0x7f5964005190 2023-07-24T05:47:17.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.789+0000 7f597d25e700 1 --2- 172.21.15.77:0/3166757227 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5964004420 0x7f59640048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:17.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.793+0000 7f597da5f700 1 --2- 172.21.15.77:0/3166757227 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5964003a20 0x7f5964003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:17.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.793+0000 7f597e260700 1 --2- 172.21.15.77:0/3166757227 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5964005190 0x7f596400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:17.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.793+0000 7f597d25e700 1 -- 172.21.15.77:0/3166757227 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5964005190 msgr2=0x7f596400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:17.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.793+0000 7f597d25e700 1 --2- 172.21.15.77:0/3166757227 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5964005190 0x7f596400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:17.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.793+0000 7f597d25e700 1 -- 172.21.15.77:0/3166757227 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5964003a20 msgr2=0x7f5964003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:17.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.793+0000 7f597d25e700 1 --2- 172.21.15.77:0/3166757227 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5964003a20 0x7f5964003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:17.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.793+0000 7f597d25e700 1 -- 172.21.15.77:0/3166757227 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59640035d0 con 0x7f5964004420 2023-07-24T05:47:17.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.793+0000 7f597e260700 1 -- 172.21.15.77:0/3166757227 reap_dead start 2023-07-24T05:47:17.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.793+0000 7f597d25e700 1 --2- 172.21.15.77:0/3166757227 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5964004420 0x7f59640048f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5978161600 tx=0x7f59640058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b82687d372a747b8 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:17.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.793+0000 7f597ca5d700 1 -- 172.21.15.77:0/3166757227 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5968001440 con 0x7f5964004420 2023-07-24T05:47:17.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.793+0000 7f597ca5d700 1 -- 172.21.15.77:0/3166757227 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5968006aa0 con 0x7f5964004420 2023-07-24T05:47:17.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.793+0000 7f597ca5d700 1 -- 172.21.15.77:0/3166757227 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5968006e50 con 0x7f5964004420 2023-07-24T05:47:17.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.793+0000 7f597ea61700 1 -- 172.21.15.77:0/3166757227 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5964004420 msgr2=0x7f59640048f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:17.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.793+0000 7f597ea61700 1 --2- 172.21.15.77:0/3166757227 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5964004420 0x7f59640048f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5978161600 tx=0x7f59640058a0 comp rx=0 tx=0).stop 2023-07-24T05:47:17.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.793+0000 7f597ea61700 1 -- 172.21.15.77:0/3166757227 shutdown_connections 2023-07-24T05:47:17.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.793+0000 7f597ea61700 1 --2- 172.21.15.77:0/3166757227 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5964004420 0x7f59640048f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:17.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.793+0000 7f597ea61700 1 -- 172.21.15.77:0/3166757227 >> 172.21.15.77:0/3166757227 conn(0x7f59780ce260 msgr2=0x7f59780ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:17.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.793+0000 7f597ea61700 1 -- 172.21.15.77:0/3166757227 shutdown_connections 2023-07-24T05:47:17.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.793+0000 7f597ea61700 1 -- 172.21.15.77:0/3166757227 wait complete. 2023-07-24T05:47:17.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.797+0000 7f597ea61700 1 Processor -- start 2023-07-24T05:47:17.804 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.797+0000 7f597ea61700 1 -- start start 2023-07-24T05:47:17.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.801+0000 7f597ea61700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5964004420 0x7f59781f6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:17.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.801+0000 7f597ea61700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59780adca0 0x7f59780af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:17.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.801+0000 7f597ea61700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f59780af710 0x7f59780c9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:17.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.801+0000 7f597ea61700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597815e130 con 0x7f59780adca0 2023-07-24T05:47:17.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.801+0000 7f597ea61700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59780aed40 con 0x7f5964004420 2023-07-24T05:47:17.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.801+0000 7f597ea61700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59780ae130 con 0x7f59780af710 2023-07-24T05:47:17.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.801+0000 7f597d25e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59780adca0 0x7f59780af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:17.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.801+0000 7f597d25e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59780adca0 0x7f59780af1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60070/0 (socket says 172.21.15.77:60070) 2023-07-24T05:47:17.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.801+0000 7f597d25e700 1 -- 172.21.15.77:0/683495045 learned_addr learned my addr 172.21.15.77:0/683495045 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:17.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.801+0000 7f597da5f700 1 --2- 172.21.15.77:0/683495045 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5964004420 0x7f59781f6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:17.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.801+0000 7f597e260700 1 --2- 172.21.15.77:0/683495045 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f59780af710 0x7f59780c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:17.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.801+0000 7f597d25e700 1 -- 172.21.15.77:0/683495045 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f59780af710 msgr2=0x7f59780c9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:17.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.801+0000 7f597d25e700 1 --2- 172.21.15.77:0/683495045 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f59780af710 0x7f59780c9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:17.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.801+0000 7f597d25e700 1 -- 172.21.15.77:0/683495045 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5964004420 msgr2=0x7f59781f6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:17.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.801+0000 7f597d25e700 1 --2- 172.21.15.77:0/683495045 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5964004420 0x7f59781f6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:17.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.801+0000 7f597d25e700 1 -- 172.21.15.77:0/683495045 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59780ae410 con 0x7f59780adca0 2023-07-24T05:47:17.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.801+0000 7f597e260700 1 --2- 172.21.15.77:0/683495045 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f59780af710 0x7f59780c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:47:17.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.801+0000 7f597d25e700 1 --2- 172.21.15.77:0/683495045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59780adca0 0x7f59780af1d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f596400c0a0 tx=0x7f59680012b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:17.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.801+0000 7f596e7fc700 1 -- 172.21.15.77:0/683495045 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59680054d0 con 0x7f59780adca0 2023-07-24T05:47:17.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.801+0000 7f596e7fc700 1 -- 172.21.15.77:0/683495045 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5968007030 con 0x7f59780adca0 2023-07-24T05:47:17.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.801+0000 7f596e7fc700 1 -- 172.21.15.77:0/683495045 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59680073e0 con 0x7f59780adca0 2023-07-24T05:47:17.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.801+0000 7f597ea61700 1 -- 172.21.15.77:0/683495045 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59780ae6f0 con 0x7f59780adca0 2023-07-24T05:47:17.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.801+0000 7f597ea61700 1 -- 172.21.15.77:0/683495045 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59780c7820 con 0x7f59780adca0 2023-07-24T05:47:17.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.805+0000 7f597ea61700 1 -- 172.21.15.77:0/683495045 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59780c7aa0 con 0x7f59780adca0 2023-07-24T05:47:17.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.805+0000 7f596e7fc700 1 -- 172.21.15.77:0/683495045 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5968007540 con 0x7f59780adca0 2023-07-24T05:47:17.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.809+0000 7f596e7fc700 1 --2- 172.21.15.77:0/683495045 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f595c066320 0x7f595c0687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:17.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.809+0000 7f596e7fc700 1 -- 172.21.15.77:0/683495045 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5968084f30 con 0x7f59780adca0 2023-07-24T05:47:17.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.809+0000 7f597da5f700 1 --2- 172.21.15.77:0/683495045 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f595c066320 0x7f595c0687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:17.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.809+0000 7f597da5f700 1 --2- 172.21.15.77:0/683495045 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f595c066320 0x7f595c0687e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5974001eb0 tx=0x7f5974009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:17.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.813+0000 7f596e7fc700 1 -- 172.21.15.77:0/683495045 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5968051ff0 con 0x7f59780adca0 2023-07-24T05:47:17.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.985+0000 7f597ea61700 1 -- 172.21.15.77:0/683495045 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f597815e110 con 0x7f59780adca0 2023-07-24T05:47:17.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.985+0000 7f596e7fc700 1 -- 172.21.15.77:0/683495045 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5968055610 con 0x7f59780adca0 2023-07-24T05:47:17.990 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-07-24T05:47:17.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.985+0000 7f597ea61700 1 -- 172.21.15.77:0/683495045 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f595c066320 msgr2=0x7f595c0687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:17.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.985+0000 7f597ea61700 1 --2- 172.21.15.77:0/683495045 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f595c066320 0x7f595c0687e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5974001eb0 tx=0x7f5974009040 comp rx=0 tx=0).stop 2023-07-24T05:47:17.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.985+0000 7f597ea61700 1 -- 172.21.15.77:0/683495045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59780adca0 msgr2=0x7f59780af1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:17.993 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.985+0000 7f597ea61700 1 --2- 172.21.15.77:0/683495045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59780adca0 0x7f59780af1d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f596400c0a0 tx=0x7f59680012b0 comp rx=0 tx=0).stop 2023-07-24T05:47:17.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.989+0000 7f597ea61700 1 -- 172.21.15.77:0/683495045 shutdown_connections 2023-07-24T05:47:17.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.989+0000 7f597ea61700 1 --2- 172.21.15.77:0/683495045 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f595c066320 0x7f595c0687e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:17.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.989+0000 7f597ea61700 1 --2- 172.21.15.77:0/683495045 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f59780af710 0x7f59780c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:17.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.989+0000 7f597ea61700 1 --2- 172.21.15.77:0/683495045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59780adca0 0x7f59780af1d0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:17.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.989+0000 7f597ea61700 1 --2- 172.21.15.77:0/683495045 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5964004420 0x7f59781f6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:17.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.989+0000 7f597ea61700 1 -- 172.21.15.77:0/683495045 >> 172.21.15.77:0/683495045 conn(0x7f59780ce260 msgr2=0x7f597806c660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:17.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.989+0000 7f597ea61700 1 -- 172.21.15.77:0/683495045 shutdown_connections 2023-07-24T05:47:17.994 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:17.989+0000 7f597ea61700 1 -- 172.21.15.77:0/683495045 wait complete. 2023-07-24T05:47:18.014 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-24T05:47:18.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.181+0000 7ff8b4ccb700 1 Processor -- start 2023-07-24T05:47:18.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.181+0000 7ff8b4ccb700 1 -- start start 2023-07-24T05:47:18.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.181+0000 7ff8b4ccb700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff8b00b13c0 0x7ff8b006adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:18.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.181+0000 7ff8b4ccb700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff8b00a4580 0x7ff8b006fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:18.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.181+0000 7ff8b4ccb700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8b00adc40 con 0x7ff8b0069b10 2023-07-24T05:47:18.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.181+0000 7ff8b4ccb700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8b006b330 con 0x7ff8b00b13c0 2023-07-24T05:47:18.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.181+0000 7ff8b4ccb700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b00adee0 con 0x7ff8b00a4580 2023-07-24T05:47:18.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.181+0000 7ff8af7fe700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff8b00b13c0 0x7ff8b006adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:18.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.181+0000 7ff8af7fe700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff8b00b13c0 0x7ff8b006adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60082/0 (socket says 172.21.15.77:60082) 2023-07-24T05:47:18.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.181+0000 7ff8af7fe700 1 -- 172.21.15.77:0/3622146498 learned_addr learned my addr 172.21.15.77:0/3622146498 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:18.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.185+0000 7ff8af7fe700 1 -- 172.21.15.77:0/3622146498 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff8b00a4580 msgr2=0x7ff8b006fbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-24T05:47:18.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.185+0000 7ff8af7fe700 1 --2- 172.21.15.77:0/3622146498 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff8b00a4580 0x7ff8b006fbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:18.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.185+0000 7ff8af7fe700 1 -- 172.21.15.77:0/3622146498 >> v1:172.21.15.103:6789/0 conn(0x7ff8b0069b10 legacy=0x7ff8b00ae9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:18.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.185+0000 7ff8af7fe700 1 -- 172.21.15.77:0/3622146498 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b00ae1c0 con 0x7ff8b00b13c0 2023-07-24T05:47:18.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.185+0000 7ff8af7fe700 1 --2- 172.21.15.77:0/3622146498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8b00b13c0 0x7ff8b006adf0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0009910 tx=0x7ff8a0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=804604b168a63d48 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:18.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.185+0000 7ff8ae7fc700 1 -- 172.21.15.77:0/3622146498 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a0004230 con 0x7ff8b00b13c0 2023-07-24T05:47:18.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.185+0000 7ff8ae7fc700 1 -- 172.21.15.77:0/3622146498 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a0004390 con 0x7ff8b00b13c0 2023-07-24T05:47:18.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.185+0000 7ff8ae7fc700 1 -- 172.21.15.77:0/3622146498 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a0009e60 con 0x7ff8b00b13c0 2023-07-24T05:47:18.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.185+0000 7ff8b4ccb700 1 -- 172.21.15.77:0/3622146498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8b00b13c0 msgr2=0x7ff8b006adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:18.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.185+0000 7ff8b4ccb700 1 --2- 172.21.15.77:0/3622146498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8b00b13c0 0x7ff8b006adf0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0009910 tx=0x7ff8a0009c20 comp rx=0 tx=0).stop 2023-07-24T05:47:18.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.185+0000 7ff8b4ccb700 1 -- 172.21.15.77:0/3622146498 shutdown_connections 2023-07-24T05:47:18.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.185+0000 7ff8b4ccb700 1 --2- 172.21.15.77:0/3622146498 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff8b00a4580 0x7ff8b006fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:18.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.185+0000 7ff8b4ccb700 1 --2- 172.21.15.77:0/3622146498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8b00b13c0 0x7ff8b006adf0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:18.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.185+0000 7ff8b4ccb700 1 -- 172.21.15.77:0/3622146498 >> 172.21.15.77:0/3622146498 conn(0x7ff8b00cacc0 msgr2=0x7ff8b00cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:18.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.185+0000 7ff8b4ccb700 1 -- 172.21.15.77:0/3622146498 shutdown_connections 2023-07-24T05:47:18.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.185+0000 7ff8b4ccb700 1 -- 172.21.15.77:0/3622146498 wait complete. 2023-07-24T05:47:18.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.189+0000 7ff8b4ccb700 1 Processor -- start 2023-07-24T05:47:18.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.189+0000 7ff8b4ccb700 1 -- start start 2023-07-24T05:47:18.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.189+0000 7ff8b4ccb700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff8b0069b10 0x7ff8b009ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:18.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.189+0000 7ff8b4ccb700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8b00a4580 0x7ff8b00cbe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:18.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.189+0000 7ff8b4ccb700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8b00b13c0 0x7ff8b01f48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:18.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.189+0000 7ff8b4ccb700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b00cc350 con 0x7ff8b00b13c0 2023-07-24T05:47:18.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.189+0000 7ff8b4ccb700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b00cc560 con 0x7ff8b00a4580 2023-07-24T05:47:18.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.189+0000 7ff8b4ccb700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b00cc840 con 0x7ff8b0069b10 2023-07-24T05:47:18.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.193+0000 7ff8affff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8b00b13c0 0x7ff8b01f48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:18.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.193+0000 7ff8affff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8b00b13c0 0x7ff8b01f48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60088/0 (socket says 172.21.15.77:60088) 2023-07-24T05:47:18.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.193+0000 7ff8affff700 1 -- 172.21.15.77:0/1540492088 learned_addr learned my addr 172.21.15.77:0/1540492088 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:18.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.193+0000 7ff8aeffd700 1 --2- 172.21.15.77:0/1540492088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8b00a4580 0x7ff8b00cbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:18.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.193+0000 7ff8affff700 1 -- 172.21.15.77:0/1540492088 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff8b0069b10 msgr2=0x7ff8b009ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:18.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.193+0000 7ff8af7fe700 1 --2- 172.21.15.77:0/1540492088 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff8b0069b10 0x7ff8b009ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:18.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.193+0000 7ff8affff700 1 --2- 172.21.15.77:0/1540492088 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff8b0069b10 0x7ff8b009ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:18.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.193+0000 7ff8affff700 1 -- 172.21.15.77:0/1540492088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8b00a4580 msgr2=0x7ff8b00cbe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:18.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.193+0000 7ff8affff700 1 --2- 172.21.15.77:0/1540492088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8b00a4580 0x7ff8b00cbe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:18.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.193+0000 7ff8affff700 1 -- 172.21.15.77:0/1540492088 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a0009570 con 0x7ff8b00b13c0 2023-07-24T05:47:18.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.193+0000 7ff8af7fe700 1 --2- 172.21.15.77:0/1540492088 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff8b0069b10 0x7ff8b009ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:47:18.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.193+0000 7ff8affff700 1 --2- 172.21.15.77:0/1540492088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8b00b13c0 0x7ff8b01f48e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff8a800b970 tx=0x7ff8a800bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:18.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.193+0000 7ff897fff700 1 -- 172.21.15.77:0/1540492088 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a800c9b0 con 0x7ff8b00b13c0 2023-07-24T05:47:18.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.193+0000 7ff897fff700 1 -- 172.21.15.77:0/1540492088 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a800cb10 con 0x7ff8b00b13c0 2023-07-24T05:47:18.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.193+0000 7ff8b4ccb700 1 -- 172.21.15.77:0/1540492088 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8b00ccb20 con 0x7ff8b00b13c0 2023-07-24T05:47:18.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.193+0000 7ff897fff700 1 -- 172.21.15.77:0/1540492088 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a8014440 con 0x7ff8b00b13c0 2023-07-24T05:47:18.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.193+0000 7ff8b4ccb700 1 -- 172.21.15.77:0/1540492088 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b00cd0e0 con 0x7ff8b00b13c0 2023-07-24T05:47:18.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.193+0000 7ff8b4ccb700 1 -- 172.21.15.77:0/1540492088 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8b0072490 con 0x7ff8b00b13c0 2023-07-24T05:47:18.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.197+0000 7ff897fff700 1 -- 172.21.15.77:0/1540492088 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff8a801d3b0 con 0x7ff8b00b13c0 2023-07-24T05:47:18.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.197+0000 7ff897fff700 1 --2- 172.21.15.77:0/1540492088 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff89c0662f0 0x7ff89c0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:18.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.197+0000 7ff897fff700 1 -- 172.21.15.77:0/1540492088 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff8a8083ca0 con 0x7ff8b00b13c0 2023-07-24T05:47:18.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.197+0000 7ff8af7fe700 1 --2- 172.21.15.77:0/1540492088 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff89c0662f0 0x7ff89c0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:18.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.201+0000 7ff8af7fe700 1 --2- 172.21.15.77:0/1540492088 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff89c0662f0 0x7ff89c0687b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0009910 tx=0x7ff8a0008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:18.211 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.205+0000 7ff897fff700 1 -- 172.21.15.77:0/1540492088 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff8a8050de0 con 0x7ff8b00b13c0 2023-07-24T05:47:18.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.389+0000 7ff8b4ccb700 1 -- 172.21.15.77:0/1540492088 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff8b015a490 con 0x7ff8b00b13c0 2023-07-24T05:47:18.397 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.393+0000 7ff897fff700 1 -- 172.21.15.77:0/1540492088 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff8a8054400 con 0x7ff8b00b13c0 2023-07-24T05:47:18.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.393+0000 7ff8b4ccb700 1 -- 172.21.15.77:0/1540492088 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff89c0662f0 msgr2=0x7ff89c0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:18.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.393+0000 7ff8b4ccb700 1 --2- 172.21.15.77:0/1540492088 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff89c0662f0 0x7ff89c0687b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff8a0009910 tx=0x7ff8a0008030 comp rx=0 tx=0).stop 2023-07-24T05:47:18.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.393+0000 7ff8b4ccb700 1 -- 172.21.15.77:0/1540492088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8b00b13c0 msgr2=0x7ff8b01f48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:18.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.393+0000 7ff8b4ccb700 1 --2- 172.21.15.77:0/1540492088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8b00b13c0 0x7ff8b01f48e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff8a800b970 tx=0x7ff8a800bd30 comp rx=0 tx=0).stop 2023-07-24T05:47:18.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.393+0000 7ff8b4ccb700 1 -- 172.21.15.77:0/1540492088 shutdown_connections 2023-07-24T05:47:18.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.393+0000 7ff8b4ccb700 1 --2- 172.21.15.77:0/1540492088 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff8b00b13c0 0x7ff8b01f48e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:18.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.393+0000 7ff8b4ccb700 1 --2- 172.21.15.77:0/1540492088 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8b00a4580 0x7ff8b00cbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:18.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.393+0000 7ff8b4ccb700 1 --2- 172.21.15.77:0/1540492088 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff89c0662f0 0x7ff89c0687b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:18.401 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.393+0000 7ff8b4ccb700 1 --2- 172.21.15.77:0/1540492088 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff8b0069b10 0x7ff8b009ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:18.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.393+0000 7ff8b4ccb700 1 -- 172.21.15.77:0/1540492088 >> 172.21.15.77:0/1540492088 conn(0x7ff8b00cacc0 msgr2=0x7ff8b00b02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:18.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.393+0000 7ff8b4ccb700 1 -- 172.21.15.77:0/1540492088 shutdown_connections 2023-07-24T05:47:18.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.393+0000 7ff8b4ccb700 1 -- 172.21.15.77:0/1540492088 wait complete. 2023-07-24T05:47:18.402 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2023-07-24T05:47:18.419 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2023-07-24T05:47:18.419 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-24T05:47:18.439 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-24T05:47:18.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.601+0000 7f5831216700 1 Processor -- start 2023-07-24T05:47:18.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.601+0000 7f5831216700 1 -- start start 2023-07-24T05:47:18.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.601+0000 7f5831216700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f582c0b13c0 0x7f582c06adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:18.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.601+0000 7f5831216700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f582c0a4580 0x7f582c06fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:18.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.601+0000 7f5831216700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f582c0adc40 con 0x7f582c069b10 2023-07-24T05:47:18.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.601+0000 7f5831216700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f582c06b330 con 0x7f582c0b13c0 2023-07-24T05:47:18.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.601+0000 7f5831216700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f582c0adee0 con 0x7f582c0a4580 2023-07-24T05:47:18.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.605+0000 7f582bfff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f582c0b13c0 0x7f582c06adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:18.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.605+0000 7f58237fe700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f582c0a4580 0x7f582c06fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:18.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.605+0000 7f58237fe700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f582c0a4580 0x7f582c06fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.77:54626/0 (socket says 172.21.15.77:54626) 2023-07-24T05:47:18.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.605+0000 7f58237fe700 1 -- 172.21.15.77:0/3346779429 learned_addr learned my addr 172.21.15.77:0/3346779429 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:18.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.605+0000 7f582bfff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f582c0b13c0 0x7f582c06adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:47484/0 (socket says 172.21.15.77:47484) 2023-07-24T05:47:18.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.605+0000 7f58237fe700 1 -- 172.21.15.77:0/3346779429 >> v2:172.21.15.103:3300/0 conn(0x7f582c0b13c0 msgr2=0x7f582c06adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:18.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.605+0000 7f58237fe700 1 --2- 172.21.15.77:0/3346779429 >> v2:172.21.15.103:3300/0 conn(0x7f582c0b13c0 0x7f582c06adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:18.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.605+0000 7f58237fe700 1 -- 172.21.15.77:0/3346779429 >> v1:172.21.15.103:6789/0 conn(0x7f582c069b10 legacy=0x7f582c0ae9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:18.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.605+0000 7f58237fe700 1 -- 172.21.15.77:0/3346779429 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582c0ae1c0 con 0x7f582c0a4580 2023-07-24T05:47:18.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.605+0000 7f582bfff700 1 --2- 172.21.15.77:0/3346779429 >> v2:172.21.15.103:3300/0 conn(0x7f582c0b13c0 0x7f582c06adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:47:18.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.605+0000 7f58237fe700 1 --2- 172.21.15.77:0/3346779429 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f582c0a4580 0x7f582c06fbe0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5814009910 tx=0x7f5814009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7056e3b8efd0836 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:18.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.605+0000 7f582b7fe700 1 -- 172.21.15.77:0/3346779429 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5814004230 con 0x7f582c0a4580 2023-07-24T05:47:18.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.605+0000 7f582b7fe700 1 -- 172.21.15.77:0/3346779429 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5814004390 con 0x7f582c0a4580 2023-07-24T05:47:18.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.605+0000 7f582b7fe700 1 -- 172.21.15.77:0/3346779429 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58140036c0 con 0x7f582c0a4580 2023-07-24T05:47:18.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.605+0000 7f5831216700 1 -- 172.21.15.77:0/3346779429 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f582c0a4580 msgr2=0x7f582c06fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:18.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.605+0000 7f5831216700 1 --2- 172.21.15.77:0/3346779429 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f582c0a4580 0x7f582c06fbe0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5814009910 tx=0x7f5814009c20 comp rx=0 tx=0).stop 2023-07-24T05:47:18.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.605+0000 7f5831216700 1 -- 172.21.15.77:0/3346779429 shutdown_connections 2023-07-24T05:47:18.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.605+0000 7f5831216700 1 --2- 172.21.15.77:0/3346779429 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f582c0a4580 0x7f582c06fbe0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:18.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.605+0000 7f5831216700 1 --2- 172.21.15.77:0/3346779429 >> v2:172.21.15.103:3300/0 conn(0x7f582c0b13c0 0x7f582c06adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:18.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.605+0000 7f5831216700 1 -- 172.21.15.77:0/3346779429 >> 172.21.15.77:0/3346779429 conn(0x7f582c0cacc0 msgr2=0x7f582c0cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:18.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.605+0000 7f5831216700 1 -- 172.21.15.77:0/3346779429 shutdown_connections 2023-07-24T05:47:18.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.605+0000 7f5831216700 1 -- 172.21.15.77:0/3346779429 wait complete. 2023-07-24T05:47:18.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.609+0000 7f5831216700 1 Processor -- start 2023-07-24T05:47:18.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.609+0000 7f5831216700 1 -- start start 2023-07-24T05:47:18.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.613+0000 7f5831216700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f582c069b10 0x7f582c158b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:18.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.613+0000 7f5831216700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f582c0a4580 0x7f582c1f4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:18.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.613+0000 7f5831216700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f582c0b13c0 0x7f582c0989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:18.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.613+0000 7f5831216700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582c15a6d0 con 0x7f582c069b10 2023-07-24T05:47:18.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.613+0000 7f5831216700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582c15afd0 con 0x7f582c0a4580 2023-07-24T05:47:18.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.613+0000 7f5831216700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f582c15b2b0 con 0x7f582c0b13c0 2023-07-24T05:47:18.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.613+0000 7f582bfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f582c069b10 0x7f582c158b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:18.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.613+0000 7f582bfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f582c069b10 0x7f582c158b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60098/0 (socket says 172.21.15.77:60098) 2023-07-24T05:47:18.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.613+0000 7f582bfff700 1 -- 172.21.15.77:0/1022238887 learned_addr learned my addr 172.21.15.77:0/1022238887 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:18.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.613+0000 7f58237fe700 1 --2- 172.21.15.77:0/1022238887 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f582c0a4580 0x7f582c1f4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:18.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.613+0000 7f5830a15700 1 --2- 172.21.15.77:0/1022238887 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f582c0b13c0 0x7f582c0989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:18.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.613+0000 7f582bfff700 1 -- 172.21.15.77:0/1022238887 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f582c0b13c0 msgr2=0x7f582c0989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:18.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.613+0000 7f582bfff700 1 --2- 172.21.15.77:0/1022238887 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f582c0b13c0 0x7f582c0989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:18.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.613+0000 7f582bfff700 1 -- 172.21.15.77:0/1022238887 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f582c0a4580 msgr2=0x7f582c1f4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:18.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.613+0000 7f582bfff700 1 --2- 172.21.15.77:0/1022238887 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f582c0a4580 0x7f582c1f4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:18.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.613+0000 7f582bfff700 1 -- 172.21.15.77:0/1022238887 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f581c0094b0 con 0x7f582c069b10 2023-07-24T05:47:18.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.613+0000 7f5830a15700 1 --2- 172.21.15.77:0/1022238887 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f582c0b13c0 0x7f582c0989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:18.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.613+0000 7f582bfff700 1 --2- 172.21.15.77:0/1022238887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f582c069b10 0x7f582c158b30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f581c00ebe0 tx=0x7f581c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:18.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.613+0000 7f58297fa700 1 -- 172.21.15.77:0/1022238887 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c00c890 con 0x7f582c069b10 2023-07-24T05:47:18.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.613+0000 7f58297fa700 1 -- 172.21.15.77:0/1022238887 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581c00c9f0 con 0x7f582c069b10 2023-07-24T05:47:18.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.613+0000 7f58297fa700 1 -- 172.21.15.77:0/1022238887 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c00cd80 con 0x7f582c069b10 2023-07-24T05:47:18.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.613+0000 7f5831216700 1 -- 172.21.15.77:0/1022238887 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5814009570 con 0x7f582c069b10 2023-07-24T05:47:18.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.613+0000 7f5831216700 1 -- 172.21.15.77:0/1022238887 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f582c15b870 con 0x7f582c069b10 2023-07-24T05:47:18.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.617+0000 7f5831216700 1 -- 172.21.15.77:0/1022238887 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f582c0b0c20 con 0x7f582c069b10 2023-07-24T05:47:18.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.617+0000 7f58297fa700 1 -- 172.21.15.77:0/1022238887 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f581c013470 con 0x7f582c069b10 2023-07-24T05:47:18.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.617+0000 7f58297fa700 1 --2- 172.21.15.77:0/1022238887 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f58100662f0 0x7f58100687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:18.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.617+0000 7f58297fa700 1 -- 172.21.15.77:0/1022238887 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f581c084190 con 0x7f582c069b10 2023-07-24T05:47:18.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.621+0000 7f58237fe700 1 --2- 172.21.15.77:0/1022238887 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f58100662f0 0x7f58100687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:18.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.621+0000 7f58237fe700 1 --2- 172.21.15.77:0/1022238887 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f58100662f0 0x7f58100687b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5814009910 tx=0x7f5814008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:18.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.625+0000 7f58297fa700 1 -- 172.21.15.77:0/1022238887 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f581c0512d0 con 0x7f582c069b10 2023-07-24T05:47:18.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.797+0000 7f5831216700 1 -- 172.21.15.77:0/1022238887 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f582c072490 con 0x7f582c069b10 2023-07-24T05:47:18.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.797+0000 7f58297fa700 1 -- 172.21.15.77:0/1022238887 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20204 (secure 0 0 0) 0x7f581c0548f0 con 0x7f582c069b10 2023-07-24T05:47:18.803 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:47:18.804 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":27,"fsid":"5aed5f7b-fb55-4d95-9c02-c6adbb1677b4","created":"2023-07-24T05:45:39.639731+0000","modified":"2023-07-24T05:46:48.442117+0000","last_up_change":"2023-07-24T05:45:52.319670+0000","last_in_change":"2023-07-24T05:45:43.643277+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-24T05:45:52.610430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-24T05:45:52.773787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-24T05:45:58.121732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-24T05:45:59.368726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-24T05:46:03.032057+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ffa0d496-461a-4053-b764-0627d969521b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6812","nonce":825987196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6817","nonce":825987196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6831","nonce":825987196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6824","nonce":825987196}]},"public_addr":"172.21.15.77:6812/825987196","cluster_addr":"172.21.15.77:6817/825987196","heartbeat_back_addr":"172.21.15.77:6831/825987196","heartbeat_front_addr":"172.21.15.77:6824/825987196","state":["exists","up"]},{"osd":1,"uuid":"9f595e5e-5c43-49bc-8ce4-ee70575c90da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6801","nonce":4133026815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6803","nonce":4133026815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6807","nonce":4133026815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6805","nonce":4133026815}]},"public_addr":"172.21.15.77:6801/4133026815","cluster_addr":"172.21.15.77:6803/4133026815","heartbeat_back_addr":"172.21.15.77:6807/4133026815","heartbeat_front_addr":"172.21.15.77:6805/4133026815","state":["exists","up"]},{"osd":2,"uuid":"2ac177aa-4d7d-4262-bd54-d2b9f29f4c3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6811","nonce":2394142159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6819","nonce":2394142159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6830","nonce":2394142159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6825","nonce":2394142159}]},"public_addr":"172.21.15.77:6811/2394142159","cluster_addr":"172.21.15.77:6819/2394142159","heartbeat_back_addr":"172.21.15.77:6830/2394142159","heartbeat_front_addr":"172.21.15.77:6825/2394142159","state":["exists","up"]},{"osd":3,"uuid":"17d7a251-19e8-484c-8172-a578ab3da153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6813","nonce":1492113982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6818","nonce":1492113982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6829","nonce":1492113982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6823","nonce":1492113982}]},"public_addr":"172.21.15.77:6813/1492113982","cluster_addr":"172.21.15.77:6818/1492113982","heartbeat_back_addr":"172.21.15.77:6829/1492113982","heartbeat_front_addr":"172.21.15.77:6823/1492113982","state":["exists","up"]},{"osd":4,"uuid":"bf63ca05-f06d-4e0f-ac44-2a416c70b919","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6825","nonce":1080481057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6827","nonce":1080481057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6831","nonce":1080481057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6829","nonce":1080481057}]},"public_addr":"172.21.15.103:6825/1080481057","cluster_addr":"172.21.15.103:6827/1080481057","heartbeat_back_addr":"172.21.15.103:6831/1080481057","heartbeat_front_addr":"172.21.15.103:6829/1080481057","state":["exists","up"]},{"osd":5,"uuid":"65a11a35-9e9f-4b3c-9fe3-b658d62b9318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6811","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6813","nonce":2756677504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6818","nonce":2756677504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6823","nonce":2756677504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6821","nonce":2756677504}]},"public_addr":"172.21.15.103:6813/2756677504","cluster_addr":"172.21.15.103:6818/2756677504","heartbeat_back_addr":"172.21.15.103:6823/2756677504","heartbeat_front_addr":"172.21.15.103:6821/2756677504","state":["exists","up"]},{"osd":6,"uuid":"750c1f87-686c-40b4-94a1-1a299dc78f3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6809","nonce":568977764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6812","nonce":568977764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6819","nonce":568977764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6815","nonce":568977764}]},"public_addr":"172.21.15.103:6809/568977764","cluster_addr":"172.21.15.103:6812/568977764","heartbeat_back_addr":"172.21.15.103:6819/568977764","heartbeat_front_addr":"172.21.15.103:6815/568977764","state":["exists","up"]},{"osd":7,"uuid":"d5fe4fb6-2e09-4158-885b-403803c85822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6801","nonce":1074557176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6803","nonce":1074557176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6807","nonce":1074557176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6805","nonce":1074557176}]},"public_addr":"172.21.15.103:6801/1074557176","cluster_addr":"172.21.15.103:6803/1074557176","heartbeat_back_addr":"172.21.15.103:6807/1074557176","heartbeat_front_addr":"172.21.15.103:6805/1074557176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.631032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.154109+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.398587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.679089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.311218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.353726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.314372+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.126212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1d","mappings":[{"from":3,"to":2}]},{"pgid":"4.31","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-24T05:47:18.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.801+0000 7f5831216700 1 -- 172.21.15.77:0/1022238887 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f58100662f0 msgr2=0x7f58100687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:18.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.801+0000 7f5831216700 1 --2- 172.21.15.77:0/1022238887 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f58100662f0 0x7f58100687b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5814009910 tx=0x7f5814008030 comp rx=0 tx=0).stop 2023-07-24T05:47:18.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.801+0000 7f5831216700 1 -- 172.21.15.77:0/1022238887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f582c069b10 msgr2=0x7f582c158b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:18.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.801+0000 7f5831216700 1 --2- 172.21.15.77:0/1022238887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f582c069b10 0x7f582c158b30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f581c00ebe0 tx=0x7f581c00eef0 comp rx=0 tx=0).stop 2023-07-24T05:47:18.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.801+0000 7f5831216700 1 -- 172.21.15.77:0/1022238887 shutdown_connections 2023-07-24T05:47:18.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.801+0000 7f5831216700 1 --2- 172.21.15.77:0/1022238887 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f58100662f0 0x7f58100687b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:18.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.801+0000 7f5831216700 1 --2- 172.21.15.77:0/1022238887 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f582c0b13c0 0x7f582c0989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:18.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.801+0000 7f5831216700 1 --2- 172.21.15.77:0/1022238887 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f582c0a4580 0x7f582c1f4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:18.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.801+0000 7f5831216700 1 --2- 172.21.15.77:0/1022238887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f582c069b10 0x7f582c158b30 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:18.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.801+0000 7f5831216700 1 -- 172.21.15.77:0/1022238887 >> 172.21.15.77:0/1022238887 conn(0x7f582c0cacc0 msgr2=0x7f582c0aeb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:18.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.801+0000 7f5831216700 1 -- 172.21.15.77:0/1022238887 shutdown_connections 2023-07-24T05:47:18.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:18.801+0000 7f5831216700 1 -- 172.21.15.77:0/1022238887 wait complete. 2023-07-24T05:47:18.829 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-24T05:45:52.610430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-24T05:45:52.773787+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-24T05:45:58.121732+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-24T05:45:59.368726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-24T05:46:03.032057+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-24T05:47:18.830 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-24T05:47:19.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.001+0000 7f33e2cf4700 1 Processor -- start 2023-07-24T05:47:19.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.001+0000 7f33e2cf4700 1 -- start start 2023-07-24T05:47:19.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.005+0000 7f33e2cf4700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33dc15c870 0x7f33dc0cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:19.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.005+0000 7f33e2cf4700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f33dc15cc50 0x7f33dc0b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:19.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.005+0000 7f33e2cf4700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f33dc06a520 0x7f33dc0b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:19.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.005+0000 7f33e2cf4700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33dc0cf520 con 0x7f33dc15cc50 2023-07-24T05:47:19.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.005+0000 7f33e2cf4700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33dc06aaa0 con 0x7f33dc06a520 2023-07-24T05:47:19.011 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.005+0000 7f33e2cf4700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33dc06ad80 con 0x7f33dc15c870 2023-07-24T05:47:19.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.005+0000 7f33e14f1700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f33dc15cc50 0x7f33dc0b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:19.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.005+0000 7f33e14f1700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f33dc15cc50 0x7f33dc0b1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60100/0 (socket says 172.21.15.77:60100) 2023-07-24T05:47:19.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.005+0000 7f33e14f1700 1 -- 172.21.15.77:0/1825410393 learned_addr learned my addr 172.21.15.77:0/1825410393 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:19.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.005+0000 7f33e1cf2700 1 --2- 172.21.15.77:0/1825410393 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33dc15c870 0x7f33dc0cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:19.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.005+0000 7f33e24f3700 1 --2- 172.21.15.77:0/1825410393 >> v2:172.21.15.103:3300/0 conn(0x7f33dc06a520 0x7f33dc0b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:19.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.005+0000 7f33e14f1700 1 -- 172.21.15.77:0/1825410393 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33dc15c870 msgr2=0x7f33dc0cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:19.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.005+0000 7f33e14f1700 1 --2- 172.21.15.77:0/1825410393 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33dc15c870 0x7f33dc0cefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:19.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.005+0000 7f33e14f1700 1 -- 172.21.15.77:0/1825410393 >> v2:172.21.15.103:3300/0 conn(0x7f33dc06a520 msgr2=0x7f33dc0b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:19.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.005+0000 7f33e14f1700 1 --2- 172.21.15.77:0/1825410393 >> v2:172.21.15.103:3300/0 conn(0x7f33dc06a520 0x7f33dc0b2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:19.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.005+0000 7f33e14f1700 1 -- 172.21.15.77:0/1825410393 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33dc06b060 con 0x7f33dc15cc50 2023-07-24T05:47:19.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.005+0000 7f33e14f1700 1 --2- 172.21.15.77:0/1825410393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33dc15cc50 0x7f33dc0b1b20 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f33dc0cffe0 tx=0x7f33cc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc70b0d02339626 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:19.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.009+0000 7f33e0cf0700 1 -- 172.21.15.77:0/1825410393 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33cc011830 con 0x7f33dc15cc50 2023-07-24T05:47:19.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.009+0000 7f33e0cf0700 1 -- 172.21.15.77:0/1825410393 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33cc011990 con 0x7f33dc15cc50 2023-07-24T05:47:19.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.009+0000 7f33e0cf0700 1 -- 172.21.15.77:0/1825410393 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33cc011d20 con 0x7f33dc15cc50 2023-07-24T05:47:19.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.009+0000 7f33e2cf4700 1 -- 172.21.15.77:0/1825410393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33dc15cc50 msgr2=0x7f33dc0b1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:19.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.009+0000 7f33e2cf4700 1 --2- 172.21.15.77:0/1825410393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33dc15cc50 0x7f33dc0b1b20 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f33dc0cffe0 tx=0x7f33cc009bf0 comp rx=0 tx=0).stop 2023-07-24T05:47:19.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.009+0000 7f33e2cf4700 1 -- 172.21.15.77:0/1825410393 shutdown_connections 2023-07-24T05:47:19.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.009+0000 7f33e2cf4700 1 --2- 172.21.15.77:0/1825410393 >> v2:172.21.15.103:3300/0 conn(0x7f33dc06a520 0x7f33dc0b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:19.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.009+0000 7f33e2cf4700 1 --2- 172.21.15.77:0/1825410393 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33dc15cc50 0x7f33dc0b1b20 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:19.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.009+0000 7f33e2cf4700 1 --2- 172.21.15.77:0/1825410393 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33dc15c870 0x7f33dc0cefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:19.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.009+0000 7f33e2cf4700 1 -- 172.21.15.77:0/1825410393 >> 172.21.15.77:0/1825410393 conn(0x7f33dc089f80 msgr2=0x7f33dc09b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:19.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.009+0000 7f33e2cf4700 1 -- 172.21.15.77:0/1825410393 shutdown_connections 2023-07-24T05:47:19.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.009+0000 7f33e2cf4700 1 -- 172.21.15.77:0/1825410393 wait complete. 2023-07-24T05:47:19.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.009+0000 7f33e2cf4700 1 Processor -- start 2023-07-24T05:47:19.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.009+0000 7f33e2cf4700 1 -- start start 2023-07-24T05:47:19.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.013+0000 7f33e2cf4700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33dc06a520 0x7f33dc0b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:19.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.013+0000 7f33e2cf4700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33dc15c870 0x7f33dc1f5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:19.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.013+0000 7f33e2cf4700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33dc15cc50 0x7f33dc1e6a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:19.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.013+0000 7f33e2cf4700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33dc0b05e0 con 0x7f33dc06a520 2023-07-24T05:47:19.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.013+0000 7f33e2cf4700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33dc1f6160 con 0x7f33dc15c870 2023-07-24T05:47:19.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.013+0000 7f33e2cf4700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33dc0b13d0 con 0x7f33dc15cc50 2023-07-24T05:47:19.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.013+0000 7f33e1cf2700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33dc06a520 0x7f33dc0b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:19.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.013+0000 7f33e1cf2700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33dc06a520 0x7f33dc0b00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60116/0 (socket says 172.21.15.77:60116) 2023-07-24T05:47:19.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.013+0000 7f33e1cf2700 1 -- 172.21.15.77:0/3976473942 learned_addr learned my addr 172.21.15.77:0/3976473942 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:19.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.013+0000 7f33e14f1700 1 --2- 172.21.15.77:0/3976473942 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33dc15c870 0x7f33dc1f5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:19.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.013+0000 7f33e24f3700 1 --2- 172.21.15.77:0/3976473942 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33dc15cc50 0x7f33dc1e6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:19.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.013+0000 7f33e1cf2700 1 -- 172.21.15.77:0/3976473942 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33dc15cc50 msgr2=0x7f33dc1e6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:19.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.013+0000 7f33e1cf2700 1 --2- 172.21.15.77:0/3976473942 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33dc15cc50 0x7f33dc1e6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:19.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.013+0000 7f33e1cf2700 1 -- 172.21.15.77:0/3976473942 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33dc15c870 msgr2=0x7f33dc1f5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:19.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.013+0000 7f33e1cf2700 1 --2- 172.21.15.77:0/3976473942 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33dc15c870 0x7f33dc1f5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:19.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.013+0000 7f33e1cf2700 1 -- 172.21.15.77:0/3976473942 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33cc009570 con 0x7f33dc06a520 2023-07-24T05:47:19.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.013+0000 7f33e24f3700 1 --2- 172.21.15.77:0/3976473942 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33dc15cc50 0x7f33dc1e6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:19.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.013+0000 7f33e1cf2700 1 --2- 172.21.15.77:0/3976473942 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33dc06a520 0x7f33dc0b00a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f33d800e9b0 tx=0x7f33d800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:19.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.013+0000 7f33d27fc700 1 -- 172.21.15.77:0/3976473942 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d8009710 con 0x7f33dc06a520 2023-07-24T05:47:19.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.013+0000 7f33d27fc700 1 -- 172.21.15.77:0/3976473942 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d800c850 con 0x7f33dc06a520 2023-07-24T05:47:19.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.013+0000 7f33d27fc700 1 -- 172.21.15.77:0/3976473942 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d800cbc0 con 0x7f33dc06a520 2023-07-24T05:47:19.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.013+0000 7f33e2cf4700 1 -- 172.21.15.77:0/3976473942 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33dc0b07c0 con 0x7f33dc06a520 2023-07-24T05:47:19.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.013+0000 7f33e2cf4700 1 -- 172.21.15.77:0/3976473942 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33dc0b0d80 con 0x7f33dc06a520 2023-07-24T05:47:19.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.017+0000 7f33e2cf4700 1 -- 172.21.15.77:0/3976473942 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33dc072490 con 0x7f33dc06a520 2023-07-24T05:47:19.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.017+0000 7f33d27fc700 1 -- 172.21.15.77:0/3976473942 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f33d800cd20 con 0x7f33dc06a520 2023-07-24T05:47:19.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.021+0000 7f33d27fc700 1 --2- 172.21.15.77:0/3976473942 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f33c00662f0 0x7f33c00687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:19.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.021+0000 7f33d27fc700 1 -- 172.21.15.77:0/3976473942 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f33d8084420 con 0x7f33dc06a520 2023-07-24T05:47:19.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.021+0000 7f33e14f1700 1 --2- 172.21.15.77:0/3976473942 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f33c00662f0 0x7f33c00687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:19.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.021+0000 7f33e14f1700 1 --2- 172.21.15.77:0/3976473942 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f33c00662f0 0x7f33c00687b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f33cc000c00 tx=0x7f33cc008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:19.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.025+0000 7f33d27fc700 1 -- 172.21.15.77:0/3976473942 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f33d8051560 con 0x7f33dc06a520 2023-07-24T05:47:19.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.197+0000 7f33e2cf4700 1 -- 172.21.15.77:0/3976473942 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f33dc0b23c0 con 0x7f33dc06a520 2023-07-24T05:47:19.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.197+0000 7f33d27fc700 1 -- 172.21.15.77:0/3976473942 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f33d8054b80 con 0x7f33dc06a520 2023-07-24T05:47:19.205 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-07-24T05:47:19.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.201+0000 7f33e2cf4700 1 -- 172.21.15.77:0/3976473942 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f33c00662f0 msgr2=0x7f33c00687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:19.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.201+0000 7f33e2cf4700 1 --2- 172.21.15.77:0/3976473942 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f33c00662f0 0x7f33c00687b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f33cc000c00 tx=0x7f33cc008030 comp rx=0 tx=0).stop 2023-07-24T05:47:19.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.201+0000 7f33e2cf4700 1 -- 172.21.15.77:0/3976473942 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33dc06a520 msgr2=0x7f33dc0b00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:19.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.201+0000 7f33e2cf4700 1 --2- 172.21.15.77:0/3976473942 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33dc06a520 0x7f33dc0b00a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f33d800e9b0 tx=0x7f33d800ecc0 comp rx=0 tx=0).stop 2023-07-24T05:47:19.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.201+0000 7f33e2cf4700 1 -- 172.21.15.77:0/3976473942 shutdown_connections 2023-07-24T05:47:19.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.201+0000 7f33e2cf4700 1 --2- 172.21.15.77:0/3976473942 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f33c00662f0 0x7f33c00687b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:19.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.201+0000 7f33e2cf4700 1 --2- 172.21.15.77:0/3976473942 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33dc15cc50 0x7f33dc1e6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:19.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.201+0000 7f33e2cf4700 1 --2- 172.21.15.77:0/3976473942 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33dc15c870 0x7f33dc1f5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:19.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.201+0000 7f33e2cf4700 1 --2- 172.21.15.77:0/3976473942 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33dc06a520 0x7f33dc0b00a0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:19.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.201+0000 7f33e2cf4700 1 -- 172.21.15.77:0/3976473942 >> 172.21.15.77:0/3976473942 conn(0x7f33dc089f80 msgr2=0x7f33dc06bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:19.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.201+0000 7f33e2cf4700 1 -- 172.21.15.77:0/3976473942 shutdown_connections 2023-07-24T05:47:19.209 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.201+0000 7f33e2cf4700 1 -- 172.21.15.77:0/3976473942 wait complete. 2023-07-24T05:47:19.227 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-24T05:47:19.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.397+0000 7f88cd0df700 1 Processor -- start 2023-07-24T05:47:19.402 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.397+0000 7f88cd0df700 1 -- start start 2023-07-24T05:47:19.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.397+0000 7f88cd0df700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f88c806b9b0 0x7f88c8159360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:19.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.397+0000 7f88cd0df700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f88c815d5f0 0x7f88c8070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:19.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.397+0000 7f88cd0df700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88c8070a50 con 0x7f88c80ca080 2023-07-24T05:47:19.405 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.397+0000 7f88cd0df700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c81598a0 con 0x7f88c806b9b0 2023-07-24T05:47:19.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.397+0000 7f88cd0df700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c8070700 con 0x7f88c815d5f0 2023-07-24T05:47:19.406 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.401+0000 7f88c6d9d700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f88c806b9b0 0x7f88c8159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:19.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.401+0000 7f88c759e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f88c815d5f0 0x7f88c8070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:19.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.401+0000 7f88c759e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f88c815d5f0 0x7f88c8070ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:47528/0 (socket says 172.21.15.77:47528) 2023-07-24T05:47:19.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.401+0000 7f88c759e700 1 -- 172.21.15.77:0/1351314079 learned_addr learned my addr 172.21.15.77:0/1351314079 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:19.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.401+0000 7f88c6d9d700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f88c806b9b0 0x7f88c8159360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60132/0 (socket says 172.21.15.77:60132) 2023-07-24T05:47:19.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.401+0000 7f88c759e700 1 -- 172.21.15.77:0/1351314079 >> v2:172.21.15.77:3300/0 conn(0x7f88c806b9b0 msgr2=0x7f88c8159360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:19.407 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.401+0000 7f88c759e700 1 --2- 172.21.15.77:0/1351314079 >> v2:172.21.15.77:3300/0 conn(0x7f88c806b9b0 0x7f88c8159360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:19.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.401+0000 7f88c759e700 1 -- 172.21.15.77:0/1351314079 >> v1:172.21.15.103:6789/0 conn(0x7f88c80ca080 legacy=0x7f88c815cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:19.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.401+0000 7f88c759e700 1 -- 172.21.15.77:0/1351314079 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c806aca0 con 0x7f88c815d5f0 2023-07-24T05:47:19.408 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.401+0000 7f88c5d9b700 1 -- 172.21.15.77:0/1351314079 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 984670891 0 0) 0x7f88c8070a50 con 0x7f88c80ca080 2023-07-24T05:47:19.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.401+0000 7f88c759e700 1 --2- 172.21.15.77:0/1351314079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88c815d5f0 0x7f88c8070ee0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f88c806d640 tx=0x7f88c000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3b593c7bd2113d server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:19.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.401+0000 7f88c5d9b700 1 -- 172.21.15.77:0/1351314079 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c000e070 con 0x7f88c815d5f0 2023-07-24T05:47:19.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.401+0000 7f88c5d9b700 1 -- 172.21.15.77:0/1351314079 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c000b910 con 0x7f88c815d5f0 2023-07-24T05:47:19.409 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.401+0000 7f88c5d9b700 1 -- 172.21.15.77:0/1351314079 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c000bcc0 con 0x7f88c815d5f0 2023-07-24T05:47:19.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.401+0000 7f88cd0df700 1 -- 172.21.15.77:0/1351314079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88c815d5f0 msgr2=0x7f88c8070ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:19.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.401+0000 7f88cd0df700 1 --2- 172.21.15.77:0/1351314079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88c815d5f0 0x7f88c8070ee0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f88c806d640 tx=0x7f88c000b330 comp rx=0 tx=0).stop 2023-07-24T05:47:19.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.401+0000 7f88cd0df700 1 -- 172.21.15.77:0/1351314079 shutdown_connections 2023-07-24T05:47:19.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.401+0000 7f88cd0df700 1 --2- 172.21.15.77:0/1351314079 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88c815d5f0 0x7f88c8070ee0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:19.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.401+0000 7f88cd0df700 1 --2- 172.21.15.77:0/1351314079 >> v2:172.21.15.77:3300/0 conn(0x7f88c806b9b0 0x7f88c8159360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:19.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.401+0000 7f88cd0df700 1 -- 172.21.15.77:0/1351314079 >> 172.21.15.77:0/1351314079 conn(0x7f88c80cb930 msgr2=0x7f88c80cbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:19.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.405+0000 7f88cd0df700 1 -- 172.21.15.77:0/1351314079 shutdown_connections 2023-07-24T05:47:19.410 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.405+0000 7f88cd0df700 1 -- 172.21.15.77:0/1351314079 wait complete. 2023-07-24T05:47:19.412 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.405+0000 7f88cd0df700 1 Processor -- start 2023-07-24T05:47:19.413 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.409+0000 7f88cd0df700 1 -- start start 2023-07-24T05:47:19.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.409+0000 7f88cd0df700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88c806b9b0 0x7f88c81516e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:19.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.409+0000 7f88cd0df700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f88c80ca080 0x7f88c80b41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:19.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.409+0000 7f88cd0df700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88c815d5f0 0x7f88c80c5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:19.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.409+0000 7f88cd0df700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c80c6dd0 con 0x7f88c815d5f0 2023-07-24T05:47:19.415 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.409+0000 7f88cd0df700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c81528f0 con 0x7f88c806b9b0 2023-07-24T05:47:19.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.409+0000 7f88cd0df700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c80b1a70 con 0x7f88c80ca080 2023-07-24T05:47:19.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.409+0000 7f88c759e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88c815d5f0 0x7f88c80c5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:19.417 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.409+0000 7f88c759e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88c815d5f0 0x7f88c80c5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60136/0 (socket says 172.21.15.77:60136) 2023-07-24T05:47:19.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.409+0000 7f88c759e700 1 -- 172.21.15.77:0/1155923751 learned_addr learned my addr 172.21.15.77:0/1155923751 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:19.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.409+0000 7f88c6d9d700 1 --2- 172.21.15.77:0/1155923751 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88c806b9b0 0x7f88c81516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:19.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.409+0000 7f88c659c700 1 --2- 172.21.15.77:0/1155923751 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f88c80ca080 0x7f88c80b41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:19.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.409+0000 7f88c759e700 1 -- 172.21.15.77:0/1155923751 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f88c80ca080 msgr2=0x7f88c80b41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:19.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.409+0000 7f88c759e700 1 --2- 172.21.15.77:0/1155923751 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f88c80ca080 0x7f88c80b41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:19.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.409+0000 7f88c759e700 1 -- 172.21.15.77:0/1155923751 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88c806b9b0 msgr2=0x7f88c81516e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:19.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.409+0000 7f88c759e700 1 --2- 172.21.15.77:0/1155923751 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88c806b9b0 0x7f88c81516e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:19.418 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.409+0000 7f88c759e700 1 -- 172.21.15.77:0/1155923751 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c0009b30 con 0x7f88c815d5f0 2023-07-24T05:47:19.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.409+0000 7f88c6d9d700 1 --2- 172.21.15.77:0/1155923751 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88c806b9b0 0x7f88c81516e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:19.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.409+0000 7f88c759e700 1 --2- 172.21.15.77:0/1155923751 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88c815d5f0 0x7f88c80c5f80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f88c0012000 tx=0x7f88c0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:19.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.413+0000 7f88af7fe700 1 -- 172.21.15.77:0/1155923751 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c00048f0 con 0x7f88c815d5f0 2023-07-24T05:47:19.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.413+0000 7f88af7fe700 1 -- 172.21.15.77:0/1155923751 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c00099b0 con 0x7f88c815d5f0 2023-07-24T05:47:19.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.413+0000 7f88af7fe700 1 -- 172.21.15.77:0/1155923751 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c001b670 con 0x7f88c815d5f0 2023-07-24T05:47:19.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.413+0000 7f88cd0df700 1 -- 172.21.15.77:0/1155923751 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c8152b90 con 0x7f88c815d5f0 2023-07-24T05:47:19.419 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.413+0000 7f88cd0df700 1 -- 172.21.15.77:0/1155923751 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c8153150 con 0x7f88c815d5f0 2023-07-24T05:47:19.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.413+0000 7f88cd0df700 1 -- 172.21.15.77:0/1155923751 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c806b240 con 0x7f88c815d5f0 2023-07-24T05:47:19.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.417+0000 7f88af7fe700 1 -- 172.21.15.77:0/1155923751 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f88c001b7d0 con 0x7f88c815d5f0 2023-07-24T05:47:19.423 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.417+0000 7f88af7fe700 1 --2- 172.21.15.77:0/1155923751 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f88b4066320 0x7f88b40687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:19.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.417+0000 7f88af7fe700 1 -- 172.21.15.77:0/1155923751 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f88c0085520 con 0x7f88c815d5f0 2023-07-24T05:47:19.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.417+0000 7f88c6d9d700 1 --2- 172.21.15.77:0/1155923751 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f88b4066320 0x7f88b40687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:19.425 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.421+0000 7f88c6d9d700 1 --2- 172.21.15.77:0/1155923751 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f88b4066320 0x7f88b40687e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f88b8010c50 tx=0x7f88b8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:19.429 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.425+0000 7f88af7fe700 1 -- 172.21.15.77:0/1155923751 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f88c806b240 con 0x7f88c815d5f0 2023-07-24T05:47:19.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.593+0000 7f88cd0df700 1 -- 172.21.15.77:0/1155923751 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f88c806b210 con 0x7f88c815d5f0 2023-07-24T05:47:19.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.593+0000 7f88af7fe700 1 -- 172.21.15.77:0/1155923751 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f88c00561a0 con 0x7f88c815d5f0 2023-07-24T05:47:19.599 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 8 2023-07-24T05:47:19.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.597+0000 7f88cd0df700 1 -- 172.21.15.77:0/1155923751 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f88b4066320 msgr2=0x7f88b40687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:19.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.597+0000 7f88cd0df700 1 --2- 172.21.15.77:0/1155923751 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f88b4066320 0x7f88b40687e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f88b8010c50 tx=0x7f88b8008040 comp rx=0 tx=0).stop 2023-07-24T05:47:19.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.597+0000 7f88cd0df700 1 -- 172.21.15.77:0/1155923751 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88c815d5f0 msgr2=0x7f88c80c5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:19.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.597+0000 7f88cd0df700 1 --2- 172.21.15.77:0/1155923751 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88c815d5f0 0x7f88c80c5f80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f88c0012000 tx=0x7f88c0004af0 comp rx=0 tx=0).stop 2023-07-24T05:47:19.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.597+0000 7f88cd0df700 1 -- 172.21.15.77:0/1155923751 shutdown_connections 2023-07-24T05:47:19.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.597+0000 7f88cd0df700 1 --2- 172.21.15.77:0/1155923751 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88c815d5f0 0x7f88c80c5f80 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:19.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.597+0000 7f88cd0df700 1 --2- 172.21.15.77:0/1155923751 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f88b4066320 0x7f88b40687e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:19.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.597+0000 7f88cd0df700 1 --2- 172.21.15.77:0/1155923751 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f88c80ca080 0x7f88c80b41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:19.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.597+0000 7f88cd0df700 1 --2- 172.21.15.77:0/1155923751 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88c806b9b0 0x7f88c81516e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:19.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.597+0000 7f88cd0df700 1 -- 172.21.15.77:0/1155923751 >> 172.21.15.77:0/1155923751 conn(0x7f88c80cb930 msgr2=0x7f88c80aec20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:19.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.597+0000 7f88cd0df700 1 -- 172.21.15.77:0/1155923751 shutdown_connections 2023-07-24T05:47:19.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.597+0000 7f88cd0df700 1 -- 172.21.15.77:0/1155923751 wait complete. 2023-07-24T05:47:19.626 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-24T05:47:19.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.797+0000 7fe28c32d700 1 Processor -- start 2023-07-24T05:47:19.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.797+0000 7fe28c32d700 1 -- start start 2023-07-24T05:47:19.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.801+0000 7fe28c32d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe28406afc0 0x7fe2840b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:19.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.801+0000 7fe28c32d700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2840d0360 con 0x7fe28415db20 2023-07-24T05:47:19.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.801+0000 7fe28c32d700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe284160fa0 con 0x7fe2840d2fc0 2023-07-24T05:47:19.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.801+0000 7fe28c32d700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2840b20b0 con 0x7fe28406afc0 2023-07-24T05:47:19.807 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.801+0000 7fe2898c8700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fe28415db20 0x7fe2840d28b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44284/0 (socket says 172.21.15.77:44284) 2023-07-24T05:47:19.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.801+0000 7fe2898c8700 1 -- 172.21.15.77:0/1918798138 learned_addr learned my addr 172.21.15.77:0/1918798138 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:19.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.801+0000 7fe28a0c9700 1 --2- 172.21.15.77:0/1918798138 >> v2:172.21.15.103:3300/0 conn(0x7fe28406afc0 0x7fe2840b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:19.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.801+0000 7fe2890c7700 1 -- 172.21.15.77:0/1918798138 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1447205350 0 0) 0x7fe2840d0360 con 0x7fe28415db20 2023-07-24T05:47:19.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.801+0000 7fe2890c7700 1 -- 172.21.15.77:0/1918798138 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2700035d0 con 0x7fe28415db20 2023-07-24T05:47:19.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.801+0000 7fe28a0c9700 1 -- 172.21.15.77:0/1918798138 >> v1:172.21.15.103:6789/0 conn(0x7fe2840d2fc0 legacy=0x7fe2840d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:19.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.801+0000 7fe28a0c9700 1 -- 172.21.15.77:0/1918798138 >> v1:172.21.15.77:6789/0 conn(0x7fe28415db20 legacy=0x7fe2840d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:19.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.801+0000 7fe28a0c9700 1 -- 172.21.15.77:0/1918798138 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe284160670 con 0x7fe28406afc0 2023-07-24T05:47:19.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.801+0000 7fe28a0c9700 1 --2- 172.21.15.77:0/1918798138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe28406afc0 0x7fe2840b1a20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe280009850 tx=0x7fe280009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4f982e11e1c5293 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:19.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.805+0000 7fe2890c7700 1 -- 172.21.15.77:0/1918798138 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe280011830 con 0x7fe28406afc0 2023-07-24T05:47:19.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.805+0000 7fe2890c7700 1 -- 172.21.15.77:0/1918798138 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe280011990 con 0x7fe28406afc0 2023-07-24T05:47:19.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.805+0000 7fe2890c7700 1 -- 172.21.15.77:0/1918798138 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe280011d40 con 0x7fe28406afc0 2023-07-24T05:47:19.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.805+0000 7fe28c32d700 1 -- 172.21.15.77:0/1918798138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe28406afc0 msgr2=0x7fe2840b1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:19.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.805+0000 7fe28c32d700 1 --2- 172.21.15.77:0/1918798138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe28406afc0 0x7fe2840b1a20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe280009850 tx=0x7fe280009b60 comp rx=0 tx=0).stop 2023-07-24T05:47:19.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.805+0000 7fe28c32d700 1 -- 172.21.15.77:0/1918798138 shutdown_connections 2023-07-24T05:47:19.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.805+0000 7fe28c32d700 1 --2- 172.21.15.77:0/1918798138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe28406afc0 0x7fe2840b1a20 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:19.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.805+0000 7fe28c32d700 1 -- 172.21.15.77:0/1918798138 >> 172.21.15.77:0/1918798138 conn(0x7fe28409bc20 msgr2=0x7fe2840b7920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:19.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.805+0000 7fe28c32d700 1 -- 172.21.15.77:0/1918798138 shutdown_connections 2023-07-24T05:47:19.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.805+0000 7fe28c32d700 1 -- 172.21.15.77:0/1918798138 wait complete. 2023-07-24T05:47:19.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.805+0000 7fe28c32d700 1 Processor -- start 2023-07-24T05:47:19.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.805+0000 7fe28c32d700 1 -- start start 2023-07-24T05:47:19.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.809+0000 7fe28c32d700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe28406afc0 0x7fe2840b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:19.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.809+0000 7fe28c32d700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe2840d2fc0 0x7fe2840b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:19.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.809+0000 7fe28c32d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe28415db20 0x7fe2840c8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:19.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.809+0000 7fe28c32d700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2840b5240 con 0x7fe28415db20 2023-07-24T05:47:19.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.809+0000 7fe28c32d700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2841f2500 con 0x7fe28406afc0 2023-07-24T05:47:19.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.809+0000 7fe28c32d700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2841f27e0 con 0x7fe2840d2fc0 2023-07-24T05:47:19.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.809+0000 7fe28a8ca700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe28415db20 0x7fe2840c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:19.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.809+0000 7fe28a8ca700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe28415db20 0x7fe2840c8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60142/0 (socket says 172.21.15.77:60142) 2023-07-24T05:47:19.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.809+0000 7fe28a8ca700 1 -- 172.21.15.77:0/3677018828 learned_addr learned my addr 172.21.15.77:0/3677018828 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:19.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.809+0000 7fe2898c8700 1 --2- 172.21.15.77:0/3677018828 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe2840d2fc0 0x7fe2840b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:19.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.809+0000 7fe28a0c9700 1 --2- 172.21.15.77:0/3677018828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe28406afc0 0x7fe2840b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:19.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.809+0000 7fe28a8ca700 1 -- 172.21.15.77:0/3677018828 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe2840d2fc0 msgr2=0x7fe2840b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:19.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.809+0000 7fe28a8ca700 1 --2- 172.21.15.77:0/3677018828 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe2840d2fc0 0x7fe2840b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:19.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.809+0000 7fe28a8ca700 1 -- 172.21.15.77:0/3677018828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe28406afc0 msgr2=0x7fe2840b4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:19.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.809+0000 7fe28a8ca700 1 --2- 172.21.15.77:0/3677018828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe28406afc0 0x7fe2840b4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:19.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.809+0000 7fe28a8ca700 1 -- 172.21.15.77:0/3677018828 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2800094b0 con 0x7fe28415db20 2023-07-24T05:47:19.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.809+0000 7fe2898c8700 1 --2- 172.21.15.77:0/3677018828 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe2840d2fc0 0x7fe2840b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:19.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.809+0000 7fe28a8ca700 1 --2- 172.21.15.77:0/3677018828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe28415db20 0x7fe2840c8620 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe27c00cb90 tx=0x7fe27c00cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:19.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.809+0000 7fe27affd700 1 -- 172.21.15.77:0/3677018828 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c003c20 con 0x7fe28415db20 2023-07-24T05:47:19.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.809+0000 7fe27affd700 1 -- 172.21.15.77:0/3677018828 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27c003d80 con 0x7fe28415db20 2023-07-24T05:47:19.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.809+0000 7fe28c32d700 1 -- 172.21.15.77:0/3677018828 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2841f2ac0 con 0x7fe28415db20 2023-07-24T05:47:19.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.809+0000 7fe27affd700 1 -- 172.21.15.77:0/3677018828 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c00ab00 con 0x7fe28415db20 2023-07-24T05:47:19.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.809+0000 7fe28c32d700 1 -- 172.21.15.77:0/3677018828 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2841f3080 con 0x7fe28415db20 2023-07-24T05:47:19.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.813+0000 7fe28c32d700 1 -- 172.21.15.77:0/3677018828 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe28404df10 con 0x7fe28415db20 2023-07-24T05:47:19.819 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.813+0000 7fe27affd700 1 -- 172.21.15.77:0/3677018828 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe27c00ac60 con 0x7fe28415db20 2023-07-24T05:47:19.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.817+0000 7fe27affd700 1 --2- 172.21.15.77:0/3677018828 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe2680662f0 0x7fe2680687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:19.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.817+0000 7fe27affd700 1 -- 172.21.15.77:0/3677018828 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe27c083ff0 con 0x7fe28415db20 2023-07-24T05:47:19.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.817+0000 7fe28a0c9700 1 --2- 172.21.15.77:0/3677018828 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe2680662f0 0x7fe2680687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:19.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.817+0000 7fe28a0c9700 1 --2- 172.21.15.77:0/3677018828 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe2680662f0 0x7fe2680687b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe2800090b0 tx=0x7fe280008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:19.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:19.821+0000 7fe27affd700 1 -- 172.21.15.77:0/3677018828 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe27c0b4700 con 0x7fe28415db20 2023-07-24T05:47:20.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.013+0000 7fe28c32d700 1 -- 172.21.15.77:0/3677018828 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe2840d3540 con 0x7fe28415db20 2023-07-24T05:47:20.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.013+0000 7fe27affd700 1 -- 172.21.15.77:0/3677018828 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe27c051170 con 0x7fe28415db20 2023-07-24T05:47:20.018 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-07-24T05:47:20.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.013+0000 7fe28c32d700 1 -- 172.21.15.77:0/3677018828 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe2680662f0 msgr2=0x7fe2680687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:20.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.013+0000 7fe28c32d700 1 --2- 172.21.15.77:0/3677018828 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe2680662f0 0x7fe2680687b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fe2800090b0 tx=0x7fe280008030 comp rx=0 tx=0).stop 2023-07-24T05:47:20.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.013+0000 7fe28c32d700 1 -- 172.21.15.77:0/3677018828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe28415db20 msgr2=0x7fe2840c8620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:20.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.013+0000 7fe28c32d700 1 --2- 172.21.15.77:0/3677018828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe28415db20 0x7fe2840c8620 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe27c00cb90 tx=0x7fe27c00cea0 comp rx=0 tx=0).stop 2023-07-24T05:47:20.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.013+0000 7fe28c32d700 1 -- 172.21.15.77:0/3677018828 shutdown_connections 2023-07-24T05:47:20.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.013+0000 7fe28c32d700 1 --2- 172.21.15.77:0/3677018828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe28415db20 0x7fe2840c8620 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:20.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.013+0000 7fe28c32d700 1 --2- 172.21.15.77:0/3677018828 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe2680662f0 0x7fe2680687b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:20.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.013+0000 7fe28c32d700 1 --2- 172.21.15.77:0/3677018828 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe2840d2fc0 0x7fe2840b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:20.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.013+0000 7fe28c32d700 1 --2- 172.21.15.77:0/3677018828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe28406afc0 0x7fe2840b4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:20.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.013+0000 7fe28c32d700 1 -- 172.21.15.77:0/3677018828 >> 172.21.15.77:0/3677018828 conn(0x7fe28409bc20 msgr2=0x7fe2840b7920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:20.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.017+0000 7fe28c32d700 1 -- 172.21.15.77:0/3677018828 shutdown_connections 2023-07-24T05:47:20.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.017+0000 7fe28c32d700 1 -- 172.21.15.77:0/3677018828 wait complete. 2023-07-24T05:47:20.042 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-24T05:47:20.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.209+0000 7f6f8fd8d700 1 Processor -- start 2023-07-24T05:47:20.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.213+0000 7f6f8fd8d700 1 -- start start 2023-07-24T05:47:20.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.213+0000 7f6f8fd8d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6f8806afc0 0x7f6f880b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:20.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.213+0000 7f6f8fd8d700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6f8815db20 0x7f6f880d28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:20.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.213+0000 7f6f8fd8d700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f88160fa0 con 0x7f6f880d2df0 2023-07-24T05:47:20.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.213+0000 7f6f8fd8d700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f880d3260 con 0x7f6f8815db20 2023-07-24T05:47:20.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.213+0000 7f6f8fd8d700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f880d0360 con 0x7f6f8806afc0 2023-07-24T05:47:20.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.213+0000 7f6f8d328700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6f8815db20 0x7f6f880d28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:20.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.213+0000 7f6f8d328700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6f8815db20 0x7f6f880d28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60150/0 (socket says 172.21.15.77:60150) 2023-07-24T05:47:20.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.213+0000 7f6f8d328700 1 -- 172.21.15.77:0/2200779634 learned_addr learned my addr 172.21.15.77:0/2200779634 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:20.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.217+0000 7f6f8db29700 1 --2- 172.21.15.77:0/2200779634 >> v2:172.21.15.103:3300/0 conn(0x7f6f8806afc0 0x7f6f880b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:20.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.217+0000 7f6f8d328700 1 -- 172.21.15.77:0/2200779634 >> v2:172.21.15.103:3300/0 conn(0x7f6f8806afc0 msgr2=0x7f6f880b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:20.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.217+0000 7f6f8d328700 1 --2- 172.21.15.77:0/2200779634 >> v2:172.21.15.103:3300/0 conn(0x7f6f8806afc0 0x7f6f880b1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:20.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.217+0000 7f6f8d328700 1 -- 172.21.15.77:0/2200779634 >> v1:172.21.15.77:6789/0 conn(0x7f6f880d2df0 legacy=0x7f6f880d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:20.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.217+0000 7f6f8d328700 1 -- 172.21.15.77:0/2200779634 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f880b20b0 con 0x7f6f8815db20 2023-07-24T05:47:20.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.217+0000 7f6f8d328700 1 --2- 172.21.15.77:0/2200779634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f8815db20 0x7f6f880d28b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6f8806dc40 tx=0x7f6f78009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c1de1742b0390bc server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:20.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.217+0000 7f6f8cb27700 1 -- 172.21.15.77:0/2200779634 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f78011830 con 0x7f6f8815db20 2023-07-24T05:47:20.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.217+0000 7f6f8cb27700 1 -- 172.21.15.77:0/2200779634 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f78011990 con 0x7f6f8815db20 2023-07-24T05:47:20.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.217+0000 7f6f8cb27700 1 -- 172.21.15.77:0/2200779634 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f78011d40 con 0x7f6f8815db20 2023-07-24T05:47:20.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.217+0000 7f6f8fd8d700 1 -- 172.21.15.77:0/2200779634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f8815db20 msgr2=0x7f6f880d28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:20.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.217+0000 7f6f8fd8d700 1 --2- 172.21.15.77:0/2200779634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f8815db20 0x7f6f880d28b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6f8806dc40 tx=0x7f6f78009c20 comp rx=0 tx=0).stop 2023-07-24T05:47:20.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.217+0000 7f6f8fd8d700 1 -- 172.21.15.77:0/2200779634 shutdown_connections 2023-07-24T05:47:20.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.217+0000 7f6f8fd8d700 1 --2- 172.21.15.77:0/2200779634 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f8815db20 0x7f6f880d28b0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:20.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.217+0000 7f6f8fd8d700 1 --2- 172.21.15.77:0/2200779634 >> v2:172.21.15.103:3300/0 conn(0x7f6f8806afc0 0x7f6f880b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:20.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.217+0000 7f6f8fd8d700 1 -- 172.21.15.77:0/2200779634 >> 172.21.15.77:0/2200779634 conn(0x7f6f8809bc20 msgr2=0x7f6f880b7920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:20.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.217+0000 7f6f8fd8d700 1 -- 172.21.15.77:0/2200779634 shutdown_connections 2023-07-24T05:47:20.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.217+0000 7f6f8fd8d700 1 -- 172.21.15.77:0/2200779634 wait complete. 2023-07-24T05:47:20.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.221+0000 7f6f8fd8d700 1 Processor -- start 2023-07-24T05:47:20.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.221+0000 7f6f8fd8d700 1 -- start start 2023-07-24T05:47:20.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.225+0000 7f6f8fd8d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f8806afc0 0x7f6f88156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:20.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.225+0000 7f6f8fd8d700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6f880d2df0 0x7f6f880b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:20.229 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.225+0000 7f6f8fd8d700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f8815db20 0x7f6f880c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:20.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.225+0000 7f6f8fd8d700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f880b45c0 con 0x7f6f8806afc0 2023-07-24T05:47:20.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.225+0000 7f6f8fd8d700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f880b48a0 con 0x7f6f8815db20 2023-07-24T05:47:20.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.225+0000 7f6f8fd8d700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f880c9a10 con 0x7f6f880d2df0 2023-07-24T05:47:20.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.225+0000 7f6f8db29700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f8806afc0 0x7f6f88156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:20.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.225+0000 7f6f8db29700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f8806afc0 0x7f6f88156440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60152/0 (socket says 172.21.15.77:60152) 2023-07-24T05:47:20.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.225+0000 7f6f8db29700 1 -- 172.21.15.77:0/4021773202 learned_addr learned my addr 172.21.15.77:0/4021773202 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:20.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.225+0000 7f6f8d328700 1 --2- 172.21.15.77:0/4021773202 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6f880d2df0 0x7f6f880b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:20.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.225+0000 7f6f8e32a700 1 --2- 172.21.15.77:0/4021773202 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f8815db20 0x7f6f880c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:20.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.225+0000 7f6f8db29700 1 -- 172.21.15.77:0/4021773202 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6f880d2df0 msgr2=0x7f6f880b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:20.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.225+0000 7f6f8db29700 1 --2- 172.21.15.77:0/4021773202 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6f880d2df0 0x7f6f880b4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:20.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.225+0000 7f6f8db29700 1 -- 172.21.15.77:0/4021773202 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f8815db20 msgr2=0x7f6f880c6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:20.232 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.225+0000 7f6f8db29700 1 --2- 172.21.15.77:0/4021773202 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f8815db20 0x7f6f880c6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:20.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.225+0000 7f6f8db29700 1 -- 172.21.15.77:0/4021773202 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f78009570 con 0x7f6f8806afc0 2023-07-24T05:47:20.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.225+0000 7f6f8d328700 1 --2- 172.21.15.77:0/4021773202 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6f880d2df0 0x7f6f880b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:20.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.225+0000 7f6f8e32a700 1 --2- 172.21.15.77:0/4021773202 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f8815db20 0x7f6f880c6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:20.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.225+0000 7f6f8db29700 1 --2- 172.21.15.77:0/4021773202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f8806afc0 0x7f6f88156440 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6f8400ebe0 tx=0x7f6f84009e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:20.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.225+0000 7f6f7e7fc700 1 -- 172.21.15.77:0/4021773202 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f84009740 con 0x7f6f8806afc0 2023-07-24T05:47:20.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.225+0000 7f6f7e7fc700 1 -- 172.21.15.77:0/4021773202 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8400c8b0 con 0x7f6f8806afc0 2023-07-24T05:47:20.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.225+0000 7f6f7e7fc700 1 -- 172.21.15.77:0/4021773202 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8400cc40 con 0x7f6f8806afc0 2023-07-24T05:47:20.233 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.225+0000 7f6f8fd8d700 1 -- 172.21.15.77:0/4021773202 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f880c9cf0 con 0x7f6f8806afc0 2023-07-24T05:47:20.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.225+0000 7f6f8fd8d700 1 -- 172.21.15.77:0/4021773202 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f880b4200 con 0x7f6f8806afc0 2023-07-24T05:47:20.234 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.229+0000 7f6f8fd8d700 1 -- 172.21.15.77:0/4021773202 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f880ca210 con 0x7f6f8806afc0 2023-07-24T05:47:20.235 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.229+0000 7f6f7e7fc700 1 -- 172.21.15.77:0/4021773202 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6f84013470 con 0x7f6f8806afc0 2023-07-24T05:47:20.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.233+0000 7f6f7e7fc700 1 --2- 172.21.15.77:0/4021773202 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6f6c066320 0x7f6f6c0687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:20.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.233+0000 7f6f7e7fc700 1 -- 172.21.15.77:0/4021773202 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6f84084190 con 0x7f6f8806afc0 2023-07-24T05:47:20.238 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.233+0000 7f6f8d328700 1 --2- 172.21.15.77:0/4021773202 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6f6c066320 0x7f6f6c0687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:20.239 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.233+0000 7f6f8d328700 1 --2- 172.21.15.77:0/4021773202 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6f6c066320 0x7f6f6c0687e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6f78014040 tx=0x7f6f78008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:20.243 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.237+0000 7f6f7e7fc700 1 -- 172.21.15.77:0/4021773202 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6f880ca210 con 0x7f6f8806afc0 2023-07-24T05:47:20.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.409+0000 7f6f8fd8d700 1 -- 172.21.15.77:0/4021773202 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6f880ca210 con 0x7f6f8806afc0 2023-07-24T05:47:20.416 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.409+0000 7f6f7e7fc700 1 -- 172.21.15.77:0/4021773202 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6f840512d0 con 0x7f6f8806afc0 2023-07-24T05:47:20.417 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-07-24T05:47:20.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.413+0000 7f6f8fd8d700 1 -- 172.21.15.77:0/4021773202 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6f6c066320 msgr2=0x7f6f6c0687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:20.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.413+0000 7f6f8fd8d700 1 --2- 172.21.15.77:0/4021773202 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6f6c066320 0x7f6f6c0687e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6f78014040 tx=0x7f6f78008030 comp rx=0 tx=0).stop 2023-07-24T05:47:20.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.413+0000 7f6f8fd8d700 1 -- 172.21.15.77:0/4021773202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f8806afc0 msgr2=0x7f6f88156440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:20.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.413+0000 7f6f8fd8d700 1 --2- 172.21.15.77:0/4021773202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f8806afc0 0x7f6f88156440 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6f8400ebe0 tx=0x7f6f84009e00 comp rx=0 tx=0).stop 2023-07-24T05:47:20.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.413+0000 7f6f8fd8d700 1 -- 172.21.15.77:0/4021773202 shutdown_connections 2023-07-24T05:47:20.420 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.413+0000 7f6f8fd8d700 1 --2- 172.21.15.77:0/4021773202 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f8815db20 0x7f6f880c6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:20.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.413+0000 7f6f8fd8d700 1 --2- 172.21.15.77:0/4021773202 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6f6c066320 0x7f6f6c0687e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:20.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.413+0000 7f6f8fd8d700 1 --2- 172.21.15.77:0/4021773202 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6f880d2df0 0x7f6f880b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:20.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.413+0000 7f6f8fd8d700 1 --2- 172.21.15.77:0/4021773202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f8806afc0 0x7f6f88156440 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:20.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.413+0000 7f6f8fd8d700 1 -- 172.21.15.77:0/4021773202 >> 172.21.15.77:0/4021773202 conn(0x7f6f8809bc20 msgr2=0x7f6f880b54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:20.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.413+0000 7f6f8fd8d700 1 -- 172.21.15.77:0/4021773202 shutdown_connections 2023-07-24T05:47:20.421 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.413+0000 7f6f8fd8d700 1 -- 172.21.15.77:0/4021773202 wait complete. 2023-07-24T05:47:20.439 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-24T05:47:20.619 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.613+0000 7f13d7a11700 1 Processor -- start 2023-07-24T05:47:20.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.613+0000 7f13d7a11700 1 -- start start 2023-07-24T05:47:20.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.617+0000 7f13d7a11700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f13d00c2630 0x7f13d00cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:20.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.617+0000 7f13d7a11700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13d01614b0 con 0x7f13d0071310 2023-07-24T05:47:20.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.617+0000 7f13d7a11700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13d006c280 con 0x7f13d0070f30 2023-07-24T05:47:20.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.617+0000 7f13d7a11700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d00c9ca0 con 0x7f13d00c2630 2023-07-24T05:47:20.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.617+0000 7f13d5fae700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f13d0071310 0x7f13d00caa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44310/0 (socket says 172.21.15.77:44310) 2023-07-24T05:47:20.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.617+0000 7f13d5fae700 1 -- 172.21.15.77:0/4057171188 learned_addr learned my addr 172.21.15.77:0/4057171188 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:20.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.617+0000 7f13d4fac700 1 --2- 172.21.15.77:0/4057171188 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f13d00c2630 0x7f13d00cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:20.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.617+0000 7f13c7fff700 1 -- 172.21.15.77:0/4057171188 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2277784564 0 0) 0x7f13d01614b0 con 0x7f13d0071310 2023-07-24T05:47:20.624 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.617+0000 7f13c7fff700 1 -- 172.21.15.77:0/4057171188 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13bc0035d0 con 0x7f13d0071310 2023-07-24T05:47:20.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.617+0000 7f13d4fac700 1 -- 172.21.15.77:0/4057171188 >> v1:172.21.15.103:6789/0 conn(0x7f13d0070f30 legacy=0x7f13d006baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:20.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.617+0000 7f13c7fff700 1 -- 172.21.15.77:0/4057171188 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2339537668 0 0) 0x7f13d006c280 con 0x7f13d0070f30 2023-07-24T05:47:20.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.617+0000 7f13d4fac700 1 -- 172.21.15.77:0/4057171188 >> v1:172.21.15.77:6789/0 conn(0x7f13d0071310 legacy=0x7f13d00caa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:20.625 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.617+0000 7f13d4fac700 1 -- 172.21.15.77:0/4057171188 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d00c9f80 con 0x7f13d00c2630 2023-07-24T05:47:20.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.617+0000 7f13d4fac700 1 --2- 172.21.15.77:0/4057171188 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f13d00c2630 0x7f13d00cd220 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f13c0009880 tx=0x7f13c0009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=513699fc6a961264 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:20.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.617+0000 7f13c7fff700 1 -- 172.21.15.77:0/4057171188 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c0011830 con 0x7f13d00c2630 2023-07-24T05:47:20.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.617+0000 7f13c7fff700 1 -- 172.21.15.77:0/4057171188 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c0011990 con 0x7f13d00c2630 2023-07-24T05:47:20.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.617+0000 7f13c7fff700 1 -- 172.21.15.77:0/4057171188 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c0011d20 con 0x7f13d00c2630 2023-07-24T05:47:20.626 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.621+0000 7f13d7a11700 1 -- 172.21.15.77:0/4057171188 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f13d00c2630 msgr2=0x7f13d00cd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:20.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.621+0000 7f13d7a11700 1 --2- 172.21.15.77:0/4057171188 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f13d00c2630 0x7f13d00cd220 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f13c0009880 tx=0x7f13c0009b90 comp rx=0 tx=0).stop 2023-07-24T05:47:20.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.621+0000 7f13d7a11700 1 -- 172.21.15.77:0/4057171188 shutdown_connections 2023-07-24T05:47:20.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.621+0000 7f13d7a11700 1 --2- 172.21.15.77:0/4057171188 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f13d00c2630 0x7f13d00cd220 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:20.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.621+0000 7f13d7a11700 1 -- 172.21.15.77:0/4057171188 >> 172.21.15.77:0/4057171188 conn(0x7f13d00cf650 msgr2=0x7f13d00cfa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:20.627 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.621+0000 7f13d7a11700 1 -- 172.21.15.77:0/4057171188 shutdown_connections 2023-07-24T05:47:20.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.621+0000 7f13d7a11700 1 -- 172.21.15.77:0/4057171188 wait complete. 2023-07-24T05:47:20.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.625+0000 7f13d7a11700 1 Processor -- start 2023-07-24T05:47:20.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.625+0000 7f13d7a11700 1 -- start start 2023-07-24T05:47:20.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.625+0000 7f13d7a11700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13d0070f30 0x7f13d015e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:20.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.625+0000 7f13d7a11700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f13d0071310 0x7f13d00c5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:20.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.625+0000 7f13d7a11700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13d00c2630 0x7f13d01529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:20.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.625+0000 7f13d7a11700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d01f6d40 con 0x7f13d0070f30 2023-07-24T05:47:20.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.625+0000 7f13d7a11700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d00c61a0 con 0x7f13d00c2630 2023-07-24T05:47:20.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.625+0000 7f13d7a11700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d01f63a0 con 0x7f13d0071310 2023-07-24T05:47:20.632 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.625+0000 7f13d57ad700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13d0070f30 0x7f13d015e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:20.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.625+0000 7f13d57ad700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13d0070f30 0x7f13d015e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60166/0 (socket says 172.21.15.77:60166) 2023-07-24T05:47:20.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.625+0000 7f13d57ad700 1 -- 172.21.15.77:0/1426580162 learned_addr learned my addr 172.21.15.77:0/1426580162 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:20.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.625+0000 7f13d5fae700 1 --2- 172.21.15.77:0/1426580162 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13d00c2630 0x7f13d01529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:20.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.625+0000 7f13d4fac700 1 --2- 172.21.15.77:0/1426580162 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f13d0071310 0x7f13d00c5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:20.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.625+0000 7f13d57ad700 1 -- 172.21.15.77:0/1426580162 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f13d0071310 msgr2=0x7f13d00c5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:20.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.625+0000 7f13d57ad700 1 --2- 172.21.15.77:0/1426580162 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f13d0071310 0x7f13d00c5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:20.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.625+0000 7f13d57ad700 1 -- 172.21.15.77:0/1426580162 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13d00c2630 msgr2=0x7f13d01529f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:20.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.625+0000 7f13d57ad700 1 --2- 172.21.15.77:0/1426580162 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13d00c2630 0x7f13d01529f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:20.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.625+0000 7f13d57ad700 1 -- 172.21.15.77:0/1426580162 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c00094b0 con 0x7f13d0070f30 2023-07-24T05:47:20.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.625+0000 7f13d5fae700 1 --2- 172.21.15.77:0/1426580162 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13d00c2630 0x7f13d01529f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:20.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.625+0000 7f13d4fac700 1 --2- 172.21.15.77:0/1426580162 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f13d0071310 0x7f13d00c5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:20.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.625+0000 7f13d57ad700 1 --2- 172.21.15.77:0/1426580162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13d0070f30 0x7f13d015e9f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f13cc0011e0 tx=0x7f13cc00cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:20.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.625+0000 7f13c5ffb700 1 -- 172.21.15.77:0/1426580162 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13cc0054e0 con 0x7f13d0070f30 2023-07-24T05:47:20.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.625+0000 7f13c5ffb700 1 -- 172.21.15.77:0/1426580162 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13cc0036a0 con 0x7f13d0070f30 2023-07-24T05:47:20.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.625+0000 7f13d7a11700 1 -- 172.21.15.77:0/1426580162 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13d01f6680 con 0x7f13d0070f30 2023-07-24T05:47:20.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.625+0000 7f13c5ffb700 1 -- 172.21.15.77:0/1426580162 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13cc003a50 con 0x7f13d0070f30 2023-07-24T05:47:20.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.629+0000 7f13d7a11700 1 -- 172.21.15.77:0/1426580162 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13d00c5eb0 con 0x7f13d0070f30 2023-07-24T05:47:20.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.629+0000 7f13d7a11700 1 -- 172.21.15.77:0/1426580162 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13d0066ed0 con 0x7f13d0070f30 2023-07-24T05:47:20.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.629+0000 7f13c5ffb700 1 -- 172.21.15.77:0/1426580162 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f13cc003bb0 con 0x7f13d0070f30 2023-07-24T05:47:20.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.633+0000 7f13c5ffb700 1 --2- 172.21.15.77:0/1426580162 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f13b40662f0 0x7f13b40687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:20.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.633+0000 7f13c5ffb700 1 -- 172.21.15.77:0/1426580162 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f13cc083620 con 0x7f13d0070f30 2023-07-24T05:47:20.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.633+0000 7f13d4fac700 1 --2- 172.21.15.77:0/1426580162 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f13b40662f0 0x7f13b40687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:20.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.633+0000 7f13d4fac700 1 --2- 172.21.15.77:0/1426580162 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f13b40662f0 0x7f13b40687b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f13c00090b0 tx=0x7f13c001c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:20.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.637+0000 7f13c5ffb700 1 -- 172.21.15.77:0/1426580162 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f13cc0506d0 con 0x7f13d0070f30 2023-07-24T05:47:20.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.813+0000 7f13d7a11700 1 -- 172.21.15.77:0/1426580162 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f13d0071de0 con 0x7f13d0070f30 2023-07-24T05:47:20.818 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.813+0000 7f13c5ffb700 1 -- 172.21.15.77:0/1426580162 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f13cc003e60 con 0x7f13d0070f30 2023-07-24T05:47:20.819 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-07-24T05:47:20.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.817+0000 7f13d7a11700 1 -- 172.21.15.77:0/1426580162 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f13b40662f0 msgr2=0x7f13b40687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:20.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.817+0000 7f13d7a11700 1 --2- 172.21.15.77:0/1426580162 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f13b40662f0 0x7f13b40687b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f13c00090b0 tx=0x7f13c001c040 comp rx=0 tx=0).stop 2023-07-24T05:47:20.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.817+0000 7f13d7a11700 1 -- 172.21.15.77:0/1426580162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13d0070f30 msgr2=0x7f13d015e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:20.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.817+0000 7f13d7a11700 1 --2- 172.21.15.77:0/1426580162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13d0070f30 0x7f13d015e9f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f13cc0011e0 tx=0x7f13cc00cae0 comp rx=0 tx=0).stop 2023-07-24T05:47:20.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.817+0000 7f13d7a11700 1 -- 172.21.15.77:0/1426580162 shutdown_connections 2023-07-24T05:47:20.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.817+0000 7f13d7a11700 1 --2- 172.21.15.77:0/1426580162 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f13d00c2630 0x7f13d01529f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:20.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.817+0000 7f13d7a11700 1 --2- 172.21.15.77:0/1426580162 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f13b40662f0 0x7f13b40687b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:20.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.817+0000 7f13d7a11700 1 --2- 172.21.15.77:0/1426580162 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f13d0071310 0x7f13d00c5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:20.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.817+0000 7f13d7a11700 1 --2- 172.21.15.77:0/1426580162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13d0070f30 0x7f13d015e9f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:20.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.817+0000 7f13d7a11700 1 -- 172.21.15.77:0/1426580162 >> 172.21.15.77:0/1426580162 conn(0x7f13d00cf650 msgr2=0x7f13d00aef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:20.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.817+0000 7f13d7a11700 1 -- 172.21.15.77:0/1426580162 shutdown_connections 2023-07-24T05:47:20.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:20.817+0000 7f13d7a11700 1 -- 172.21.15.77:0/1426580162 wait complete. 2023-07-24T05:47:20.845 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-24T05:47:21.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.017+0000 7f4c8d2b5700 1 Processor -- start 2023-07-24T05:47:21.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.017+0000 7f4c8d2b5700 1 -- start start 2023-07-24T05:47:21.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.021+0000 7f4c8d2b5700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4c8815a990 0x7f4c881608e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:21.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.021+0000 7f4c8d2b5700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c880cc840 con 0x7f4c8806c800 2023-07-24T05:47:21.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.021+0000 7f4c8d2b5700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c880cbc30 con 0x7f4c880cccd0 2023-07-24T05:47:21.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.021+0000 7f4c8d2b5700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c880cbf10 con 0x7f4c8815a990 2023-07-24T05:47:21.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.021+0000 7f4c877fe700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f4c8806c800 0x7f4c880ce590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44322/0 (socket says 172.21.15.77:44322) 2023-07-24T05:47:21.027 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.021+0000 7f4c877fe700 1 -- 172.21.15.77:0/209828767 learned_addr learned my addr 172.21.15.77:0/209828767 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:21.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.021+0000 7f4c86ffd700 1 --2- 172.21.15.77:0/209828767 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4c8815a990 0x7f4c881608e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:21.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.021+0000 7f4c85ffb700 1 -- 172.21.15.77:0/209828767 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1336778326 0 0) 0x7f4c880cc840 con 0x7f4c8806c800 2023-07-24T05:47:21.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.021+0000 7f4c85ffb700 1 -- 172.21.15.77:0/209828767 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c700035d0 con 0x7f4c8806c800 2023-07-24T05:47:21.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.021+0000 7f4c86ffd700 1 -- 172.21.15.77:0/209828767 >> v1:172.21.15.103:6789/0 conn(0x7f4c880cccd0 legacy=0x7f4c8806c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:21.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.021+0000 7f4c86ffd700 1 -- 172.21.15.77:0/209828767 >> v1:172.21.15.77:6789/0 conn(0x7f4c8806c800 legacy=0x7f4c880ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:21.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.021+0000 7f4c86ffd700 1 -- 172.21.15.77:0/209828767 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c880cc1f0 con 0x7f4c8815a990 2023-07-24T05:47:21.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.021+0000 7f4c86ffd700 1 --2- 172.21.15.77:0/209828767 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4c8815a990 0x7f4c881608e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4c78009880 tx=0x7f4c78009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5d71199de30505a server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:21.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.025+0000 7f4c85ffb700 1 -- 172.21.15.77:0/209828767 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c78011830 con 0x7f4c8815a990 2023-07-24T05:47:21.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.025+0000 7f4c85ffb700 1 -- 172.21.15.77:0/209828767 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c78011990 con 0x7f4c8815a990 2023-07-24T05:47:21.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.025+0000 7f4c85ffb700 1 -- 172.21.15.77:0/209828767 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c78011d20 con 0x7f4c8815a990 2023-07-24T05:47:21.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.025+0000 7f4c8d2b5700 1 -- 172.21.15.77:0/209828767 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4c8815a990 msgr2=0x7f4c881608e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:21.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.025+0000 7f4c8d2b5700 1 --2- 172.21.15.77:0/209828767 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4c8815a990 0x7f4c881608e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4c78009880 tx=0x7f4c78009b90 comp rx=0 tx=0).stop 2023-07-24T05:47:21.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.025+0000 7f4c8d2b5700 1 -- 172.21.15.77:0/209828767 shutdown_connections 2023-07-24T05:47:21.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.025+0000 7f4c8d2b5700 1 --2- 172.21.15.77:0/209828767 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4c8815a990 0x7f4c881608e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:21.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.025+0000 7f4c8d2b5700 1 -- 172.21.15.77:0/209828767 >> 172.21.15.77:0/209828767 conn(0x7f4c880d0690 msgr2=0x7f4c880d0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:21.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.025+0000 7f4c8d2b5700 1 -- 172.21.15.77:0/209828767 shutdown_connections 2023-07-24T05:47:21.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.025+0000 7f4c8d2b5700 1 -- 172.21.15.77:0/209828767 wait complete. 2023-07-24T05:47:21.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.025+0000 7f4c8d2b5700 1 Processor -- start 2023-07-24T05:47:21.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.025+0000 7f4c8d2b5700 1 -- start start 2023-07-24T05:47:21.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.029+0000 7f4c8d2b5700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c8806c800 0x7f4c880c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:21.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.029+0000 7f4c8d2b5700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4c880cccd0 0x7f4c880c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:21.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.029+0000 7f4c8d2b5700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c8815a990 0x7f4c88159410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:21.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.029+0000 7f4c8d2b5700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c880ca4e0 con 0x7f4c8815a990 2023-07-24T05:47:21.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.029+0000 7f4c8d2b5700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c881f5b20 con 0x7f4c8806c800 2023-07-24T05:47:21.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.029+0000 7f4c8d2b5700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c881f5e00 con 0x7f4c880cccd0 2023-07-24T05:47:21.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.029+0000 7f4c877fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c8815a990 0x7f4c88159410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:21.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.029+0000 7f4c877fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c8815a990 0x7f4c88159410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60176/0 (socket says 172.21.15.77:60176) 2023-07-24T05:47:21.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.029+0000 7f4c877fe700 1 -- 172.21.15.77:0/3352629199 learned_addr learned my addr 172.21.15.77:0/3352629199 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:21.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.029+0000 7f4c86ffd700 1 --2- 172.21.15.77:0/3352629199 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c8806c800 0x7f4c880c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:21.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.029+0000 7f4c867fc700 1 --2- 172.21.15.77:0/3352629199 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4c880cccd0 0x7f4c880c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:21.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.029+0000 7f4c877fe700 1 -- 172.21.15.77:0/3352629199 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4c880cccd0 msgr2=0x7f4c880c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:21.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.029+0000 7f4c877fe700 1 --2- 172.21.15.77:0/3352629199 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4c880cccd0 0x7f4c880c9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:21.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.029+0000 7f4c877fe700 1 -- 172.21.15.77:0/3352629199 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c8806c800 msgr2=0x7f4c880c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:21.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.029+0000 7f4c877fe700 1 --2- 172.21.15.77:0/3352629199 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c8806c800 0x7f4c880c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:21.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.029+0000 7f4c877fe700 1 -- 172.21.15.77:0/3352629199 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c780094b0 con 0x7f4c8815a990 2023-07-24T05:47:21.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.029+0000 7f4c877fe700 1 --2- 172.21.15.77:0/3352629199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c8815a990 0x7f4c88159410 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4c8000cb40 tx=0x7f4c8000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:21.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.029+0000 7f4c6f7fe700 1 -- 172.21.15.77:0/3352629199 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8000a9e0 con 0x7f4c8815a990 2023-07-24T05:47:21.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.029+0000 7f4c6f7fe700 1 -- 172.21.15.77:0/3352629199 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c8000ab40 con 0x7f4c8815a990 2023-07-24T05:47:21.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.029+0000 7f4c8d2b5700 1 -- 172.21.15.77:0/3352629199 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c881f60e0 con 0x7f4c8815a990 2023-07-24T05:47:21.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.029+0000 7f4c6f7fe700 1 -- 172.21.15.77:0/3352629199 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8000ce60 con 0x7f4c8815a990 2023-07-24T05:47:21.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.029+0000 7f4c8d2b5700 1 -- 172.21.15.77:0/3352629199 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c881f68e0 con 0x7f4c8815a990 2023-07-24T05:47:21.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.033+0000 7f4c8d2b5700 1 -- 172.21.15.77:0/3352629199 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c881f6600 con 0x7f4c8815a990 2023-07-24T05:47:21.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.033+0000 7f4c6f7fe700 1 -- 172.21.15.77:0/3352629199 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4c8001b3b0 con 0x7f4c8815a990 2023-07-24T05:47:21.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.033+0000 7f4c6f7fe700 1 --2- 172.21.15.77:0/3352629199 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f4c740662f0 0x7f4c740687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:21.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.033+0000 7f4c6f7fe700 1 -- 172.21.15.77:0/3352629199 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4c80083c10 con 0x7f4c8815a990 2023-07-24T05:47:21.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.037+0000 7f4c86ffd700 1 --2- 172.21.15.77:0/3352629199 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f4c740662f0 0x7f4c740687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:21.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.037+0000 7f4c86ffd700 1 --2- 172.21.15.77:0/3352629199 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f4c740662f0 0x7f4c740687b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4c780090b0 tx=0x7f4c78010000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:21.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.041+0000 7f4c6f7fe700 1 -- 172.21.15.77:0/3352629199 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4c881f6600 con 0x7f4c8815a990 2023-07-24T05:47:21.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.225+0000 7f4c8d2b5700 1 -- 172.21.15.77:0/3352629199 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4c881f6600 con 0x7f4c8815a990 2023-07-24T05:47:21.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.225+0000 7f4c6f7fe700 1 -- 172.21.15.77:0/3352629199 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4c881f6600 con 0x7f4c8815a990 2023-07-24T05:47:21.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.229+0000 7f4c8d2b5700 1 -- 172.21.15.77:0/3352629199 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f4c740662f0 msgr2=0x7f4c740687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:21.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.229+0000 7f4c8d2b5700 1 --2- 172.21.15.77:0/3352629199 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f4c740662f0 0x7f4c740687b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4c780090b0 tx=0x7f4c78010000 comp rx=0 tx=0).stop 2023-07-24T05:47:21.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.229+0000 7f4c8d2b5700 1 -- 172.21.15.77:0/3352629199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c8815a990 msgr2=0x7f4c88159410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:21.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.229+0000 7f4c8d2b5700 1 --2- 172.21.15.77:0/3352629199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c8815a990 0x7f4c88159410 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4c8000cb40 tx=0x7f4c8000cc20 comp rx=0 tx=0).stop 2023-07-24T05:47:21.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.229+0000 7f4c8d2b5700 1 -- 172.21.15.77:0/3352629199 shutdown_connections 2023-07-24T05:47:21.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.229+0000 7f4c8d2b5700 1 --2- 172.21.15.77:0/3352629199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4c8815a990 0x7f4c88159410 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:21.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.229+0000 7f4c8d2b5700 1 --2- 172.21.15.77:0/3352629199 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f4c740662f0 0x7f4c740687b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:21.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.229+0000 7f4c8d2b5700 1 --2- 172.21.15.77:0/3352629199 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4c880cccd0 0x7f4c880c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:21.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.229+0000 7f4c8d2b5700 1 --2- 172.21.15.77:0/3352629199 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4c8806c800 0x7f4c880c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:21.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.229+0000 7f4c8d2b5700 1 -- 172.21.15.77:0/3352629199 >> 172.21.15.77:0/3352629199 conn(0x7f4c880d0690 msgr2=0x7f4c880afff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:21.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.229+0000 7f4c8d2b5700 1 -- 172.21.15.77:0/3352629199 shutdown_connections 2023-07-24T05:47:21.237 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.229+0000 7f4c8d2b5700 1 -- 172.21.15.77:0/3352629199 wait complete. 2023-07-24T05:47:21.239 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2023-07-24T05:47:21.257 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2023-07-24T05:47:21.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:47:21.258 DEBUG:teuthology.orchestra.run.smithi103:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-07-24T05:47:21.310 INFO:teuthology.orchestra.run:waiting for 300 2023-07-24T05:47:21.311 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi103.front.sepia.ceph.com 2023-07-24T05:47:21.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:47:21.311 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-24T05:47:21.359 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-07-24T05:47:21.360 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-24T05:47:21.377 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-07-24T05:47:21.377 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-24T05:47:21.443 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-24T05:47:21.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.653+0000 7f61de020700 1 Processor -- start 2023-07-24T05:47:21.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.657+0000 7f61de020700 1 -- start start 2023-07-24T05:47:21.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.657+0000 7f61de020700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f61d806b050 0x7f61d80ca370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:21.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.657+0000 7f61de020700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f61d80b1090 0x7f61d80b1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:21.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.657+0000 7f61de020700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d8161220 con 0x7f61d80c9f90 2023-07-24T05:47:21.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.657+0000 7f61de020700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61d815ceb0 con 0x7f61d806b050 2023-07-24T05:47:21.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.657+0000 7f61de020700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d80b1a60 con 0x7f61d80b1090 2023-07-24T05:47:21.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.657+0000 7f61dc81d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f61d806b050 0x7f61d80ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:21.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.657+0000 7f61dd81f700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f61d80b1090 0x7f61d80b1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:21.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.657+0000 7f61dc81d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f61d806b050 0x7f61d80ca370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:47614/0 (socket says 172.21.15.77:47614) 2023-07-24T05:47:21.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.657+0000 7f61dc81d700 1 -- 172.21.15.77:0/4229782736 learned_addr learned my addr 172.21.15.77:0/4229782736 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:21.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.657+0000 7f61dc81d700 1 -- 172.21.15.77:0/4229782736 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f61d80b1090 msgr2=0x7f61d80b1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:21.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.657+0000 7f61dc81d700 1 --2- 172.21.15.77:0/4229782736 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f61d80b1090 0x7f61d80b1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:21.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.657+0000 7f61dc81d700 1 -- 172.21.15.77:0/4229782736 >> v1:172.21.15.103:6789/0 conn(0x7f61d80c9f90 legacy=0x7f61d815d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:21.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.657+0000 7f61dc81d700 1 -- 172.21.15.77:0/4229782736 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d8160610 con 0x7f61d806b050 2023-07-24T05:47:21.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.661+0000 7f61dc81d700 1 --2- 172.21.15.77:0/4229782736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61d806b050 0x7f61d80ca370 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f61c8009910 tx=0x7f61c8009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7d2bd2159b547df server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:21.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.661+0000 7f61cffff700 1 -- 172.21.15.77:0/4229782736 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c8011830 con 0x7f61d806b050 2023-07-24T05:47:21.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.661+0000 7f61cffff700 1 -- 172.21.15.77:0/4229782736 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c8011990 con 0x7f61d806b050 2023-07-24T05:47:21.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.661+0000 7f61cffff700 1 -- 172.21.15.77:0/4229782736 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c8011d40 con 0x7f61d806b050 2023-07-24T05:47:21.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.661+0000 7f61de020700 1 -- 172.21.15.77:0/4229782736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61d806b050 msgr2=0x7f61d80ca370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:21.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.661+0000 7f61de020700 1 --2- 172.21.15.77:0/4229782736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61d806b050 0x7f61d80ca370 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f61c8009910 tx=0x7f61c8009c20 comp rx=0 tx=0).stop 2023-07-24T05:47:21.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.661+0000 7f61de020700 1 -- 172.21.15.77:0/4229782736 shutdown_connections 2023-07-24T05:47:21.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.661+0000 7f61de020700 1 --2- 172.21.15.77:0/4229782736 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f61d80b1090 0x7f61d80b1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:21.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.661+0000 7f61de020700 1 --2- 172.21.15.77:0/4229782736 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61d806b050 0x7f61d80ca370 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:21.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.661+0000 7f61de020700 1 -- 172.21.15.77:0/4229782736 >> 172.21.15.77:0/4229782736 conn(0x7f61d80cacc0 msgr2=0x7f61d80cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:21.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.661+0000 7f61de020700 1 -- 172.21.15.77:0/4229782736 shutdown_connections 2023-07-24T05:47:21.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.661+0000 7f61de020700 1 -- 172.21.15.77:0/4229782736 wait complete. 2023-07-24T05:47:21.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.665+0000 7f61de020700 1 Processor -- start 2023-07-24T05:47:21.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.665+0000 7f61de020700 1 -- start start 2023-07-24T05:47:21.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.665+0000 7f61de020700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61d806b050 0x7f61d815b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:21.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.665+0000 7f61de020700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f61d80b1090 0x7f61d8070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:21.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.665+0000 7f61de020700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61d80c9f90 0x7f61d80711a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:21.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.665+0000 7f61de020700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d80cdc60 con 0x7f61d806b050 2023-07-24T05:47:21.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.665+0000 7f61de020700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d80cd980 con 0x7f61d80c9f90 2023-07-24T05:47:21.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.665+0000 7f61de020700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d80adcd0 con 0x7f61d80b1090 2023-07-24T05:47:21.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.665+0000 7f61dd01e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61d806b050 0x7f61d815b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:21.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.665+0000 7f61dd01e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61d806b050 0x7f61d815b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60186/0 (socket says 172.21.15.77:60186) 2023-07-24T05:47:21.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.665+0000 7f61dd01e700 1 -- 172.21.15.77:0/4258471471 learned_addr learned my addr 172.21.15.77:0/4258471471 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:21.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.665+0000 7f61dc81d700 1 --2- 172.21.15.77:0/4258471471 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f61d80b1090 0x7f61d8070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:21.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.665+0000 7f61dd81f700 1 --2- 172.21.15.77:0/4258471471 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61d80c9f90 0x7f61d80711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:21.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.669+0000 7f61dd01e700 1 -- 172.21.15.77:0/4258471471 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f61d80b1090 msgr2=0x7f61d8070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:21.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.669+0000 7f61dd01e700 1 --2- 172.21.15.77:0/4258471471 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f61d80b1090 0x7f61d8070c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:21.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.669+0000 7f61dd01e700 1 -- 172.21.15.77:0/4258471471 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61d80c9f90 msgr2=0x7f61d80711a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:21.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.669+0000 7f61dd01e700 1 --2- 172.21.15.77:0/4258471471 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61d80c9f90 0x7f61d80711a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:21.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.669+0000 7f61dd01e700 1 -- 172.21.15.77:0/4258471471 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c8009570 con 0x7f61d806b050 2023-07-24T05:47:21.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.669+0000 7f61dd01e700 1 --2- 172.21.15.77:0/4258471471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61d806b050 0x7f61d815b1c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f61d400c500 tx=0x7f61d400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:21.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.669+0000 7f61cdffb700 1 -- 172.21.15.77:0/4258471471 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d40052d0 con 0x7f61d806b050 2023-07-24T05:47:21.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.669+0000 7f61cdffb700 1 -- 172.21.15.77:0/4258471471 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d4005430 con 0x7f61d806b050 2023-07-24T05:47:21.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.669+0000 7f61de020700 1 -- 172.21.15.77:0/4258471471 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61d80adfb0 con 0x7f61d806b050 2023-07-24T05:47:21.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.669+0000 7f61cdffb700 1 -- 172.21.15.77:0/4258471471 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d40055a0 con 0x7f61d806b050 2023-07-24T05:47:21.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.669+0000 7f61de020700 1 -- 172.21.15.77:0/4258471471 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61d80c5ac0 con 0x7f61d806b050 2023-07-24T05:47:21.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.669+0000 7f61de020700 1 -- 172.21.15.77:0/4258471471 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61d8072490 con 0x7f61d806b050 2023-07-24T05:47:21.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.673+0000 7f61cdffb700 1 -- 172.21.15.77:0/4258471471 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f61d40038e0 con 0x7f61d806b050 2023-07-24T05:47:21.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.673+0000 7f61cdffb700 1 --2- 172.21.15.77:0/4258471471 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f61bc066340 0x7f61bc068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:21.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.673+0000 7f61cdffb700 1 -- 172.21.15.77:0/4258471471 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f61d40833b0 con 0x7f61d806b050 2023-07-24T05:47:21.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.673+0000 7f61dc81d700 1 --2- 172.21.15.77:0/4258471471 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f61bc066340 0x7f61bc068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:21.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.677+0000 7f61dc81d700 1 --2- 172.21.15.77:0/4258471471 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f61bc066340 0x7f61bc068800 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f61c8000c00 tx=0x7f61c8008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:21.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.677+0000 7f61cdffb700 1 -- 172.21.15.77:0/4258471471 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f61d4050570 con 0x7f61d806b050 2023-07-24T05:47:21.855 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.849+0000 7f61de020700 1 -- 172.21.15.77:0/4258471471 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f61d806ae30 con 0x7f61d806b050 2023-07-24T05:47:21.858 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.853+0000 7f61cdffb700 1 -- 172.21.15.77:0/4258471471 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20204 (secure 0 0 0) 0x7f61d4053b90 con 0x7f61d806b050 2023-07-24T05:47:21.859 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:47:21.859 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":27,"fsid":"5aed5f7b-fb55-4d95-9c02-c6adbb1677b4","created":"2023-07-24T05:45:39.639731+0000","modified":"2023-07-24T05:46:48.442117+0000","last_up_change":"2023-07-24T05:45:52.319670+0000","last_in_change":"2023-07-24T05:45:43.643277+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-24T05:45:52.610430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-24T05:45:52.773787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-24T05:45:58.121732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-24T05:45:59.368726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-24T05:46:03.032057+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ffa0d496-461a-4053-b764-0627d969521b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6812","nonce":825987196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6817","nonce":825987196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6831","nonce":825987196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6824","nonce":825987196}]},"public_addr":"172.21.15.77:6812/825987196","cluster_addr":"172.21.15.77:6817/825987196","heartbeat_back_addr":"172.21.15.77:6831/825987196","heartbeat_front_addr":"172.21.15.77:6824/825987196","state":["exists","up"]},{"osd":1,"uuid":"9f595e5e-5c43-49bc-8ce4-ee70575c90da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6801","nonce":4133026815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6803","nonce":4133026815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6807","nonce":4133026815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6805","nonce":4133026815}]},"public_addr":"172.21.15.77:6801/4133026815","cluster_addr":"172.21.15.77:6803/4133026815","heartbeat_back_addr":"172.21.15.77:6807/4133026815","heartbeat_front_addr":"172.21.15.77:6805/4133026815","state":["exists","up"]},{"osd":2,"uuid":"2ac177aa-4d7d-4262-bd54-d2b9f29f4c3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6811","nonce":2394142159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6819","nonce":2394142159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6830","nonce":2394142159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6825","nonce":2394142159}]},"public_addr":"172.21.15.77:6811/2394142159","cluster_addr":"172.21.15.77:6819/2394142159","heartbeat_back_addr":"172.21.15.77:6830/2394142159","heartbeat_front_addr":"172.21.15.77:6825/2394142159","state":["exists","up"]},{"osd":3,"uuid":"17d7a251-19e8-484c-8172-a578ab3da153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6813","nonce":1492113982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6818","nonce":1492113982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6829","nonce":1492113982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6823","nonce":1492113982}]},"public_addr":"172.21.15.77:6813/1492113982","cluster_addr":"172.21.15.77:6818/1492113982","heartbeat_back_addr":"172.21.15.77:6829/1492113982","heartbeat_front_addr":"172.21.15.77:6823/1492113982","state":["exists","up"]},{"osd":4,"uuid":"bf63ca05-f06d-4e0f-ac44-2a416c70b919","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6825","nonce":1080481057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6827","nonce":1080481057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6831","nonce":1080481057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6829","nonce":1080481057}]},"public_addr":"172.21.15.103:6825/1080481057","cluster_addr":"172.21.15.103:6827/1080481057","heartbeat_back_addr":"172.21.15.103:6831/1080481057","heartbeat_front_addr":"172.21.15.103:6829/1080481057","state":["exists","up"]},{"osd":5,"uuid":"65a11a35-9e9f-4b3c-9fe3-b658d62b9318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6811","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6813","nonce":2756677504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6818","nonce":2756677504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6823","nonce":2756677504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6821","nonce":2756677504}]},"public_addr":"172.21.15.103:6813/2756677504","cluster_addr":"172.21.15.103:6818/2756677504","heartbeat_back_addr":"172.21.15.103:6823/2756677504","heartbeat_front_addr":"172.21.15.103:6821/2756677504","state":["exists","up"]},{"osd":6,"uuid":"750c1f87-686c-40b4-94a1-1a299dc78f3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6809","nonce":568977764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6812","nonce":568977764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6819","nonce":568977764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6815","nonce":568977764}]},"public_addr":"172.21.15.103:6809/568977764","cluster_addr":"172.21.15.103:6812/568977764","heartbeat_back_addr":"172.21.15.103:6819/568977764","heartbeat_front_addr":"172.21.15.103:6815/568977764","state":["exists","up"]},{"osd":7,"uuid":"d5fe4fb6-2e09-4158-885b-403803c85822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6801","nonce":1074557176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6803","nonce":1074557176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6807","nonce":1074557176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6805","nonce":1074557176}]},"public_addr":"172.21.15.103:6801/1074557176","cluster_addr":"172.21.15.103:6803/1074557176","heartbeat_back_addr":"172.21.15.103:6807/1074557176","heartbeat_front_addr":"172.21.15.103:6805/1074557176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.631032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.154109+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.398587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.679089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.311218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.353726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.314372+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.126212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1d","mappings":[{"from":3,"to":2}]},{"pgid":"4.31","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-24T05:47:21.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.857+0000 7f61de020700 1 -- 172.21.15.77:0/4258471471 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f61bc066340 msgr2=0x7f61bc068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:21.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.857+0000 7f61de020700 1 --2- 172.21.15.77:0/4258471471 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f61bc066340 0x7f61bc068800 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f61c8000c00 tx=0x7f61c8008030 comp rx=0 tx=0).stop 2023-07-24T05:47:21.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.857+0000 7f61de020700 1 -- 172.21.15.77:0/4258471471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61d806b050 msgr2=0x7f61d815b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:21.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.857+0000 7f61de020700 1 --2- 172.21.15.77:0/4258471471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61d806b050 0x7f61d815b1c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f61d400c500 tx=0x7f61d400c810 comp rx=0 tx=0).stop 2023-07-24T05:47:21.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.857+0000 7f61de020700 1 -- 172.21.15.77:0/4258471471 shutdown_connections 2023-07-24T05:47:21.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.857+0000 7f61de020700 1 --2- 172.21.15.77:0/4258471471 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61d80c9f90 0x7f61d80711a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:21.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.857+0000 7f61de020700 1 --2- 172.21.15.77:0/4258471471 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f61bc066340 0x7f61bc068800 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:21.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.857+0000 7f61de020700 1 --2- 172.21.15.77:0/4258471471 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f61d80b1090 0x7f61d8070c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:21.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.857+0000 7f61de020700 1 --2- 172.21.15.77:0/4258471471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f61d806b050 0x7f61d815b1c0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:21.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.857+0000 7f61de020700 1 -- 172.21.15.77:0/4258471471 >> 172.21.15.77:0/4258471471 conn(0x7f61d80cacc0 msgr2=0x7f61d806c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:21.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.857+0000 7f61de020700 1 -- 172.21.15.77:0/4258471471 shutdown_connections 2023-07-24T05:47:21.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:21.857+0000 7f61de020700 1 -- 172.21.15.77:0/4258471471 wait complete. 2023-07-24T05:47:21.883 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-24T05:45:52.610430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-24T05:45:52.773787+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-24T05:45:58.121732+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-24T05:45:59.368726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-24T05:46:03.032057+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-24T05:47:21.884 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-24T05:47:22.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.057+0000 7f881a554700 1 Processor -- start 2023-07-24T05:47:22.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.057+0000 7f881a554700 1 -- start start 2023-07-24T05:47:22.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.061+0000 7f881a554700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f88140c1b20 0x7f88140ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:22.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.061+0000 7f881a554700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f88140cd130 0x7f881406a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:22.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.061+0000 7f881a554700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8814069d20 con 0x7f8814161140 2023-07-24T05:47:22.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.061+0000 7f881a554700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88140cd980 con 0x7f88140cd130 2023-07-24T05:47:22.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.061+0000 7f881a554700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88140cdc60 con 0x7f88140c1b20 2023-07-24T05:47:22.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.061+0000 7f8813fff700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f8814161140 0x7f88140c1410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44332/0 (socket says 172.21.15.77:44332) 2023-07-24T05:47:22.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.061+0000 7f8813fff700 1 -- 172.21.15.77:0/2724535019 learned_addr learned my addr 172.21.15.77:0/2724535019 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:22.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.061+0000 7f8818af1700 1 --2- 172.21.15.77:0/2724535019 >> v2:172.21.15.103:3300/0 conn(0x7f88140cd130 0x7f881406a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:22.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.061+0000 7f880bfff700 1 --2- 172.21.15.77:0/2724535019 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f88140c1b20 0x7f88140ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:22.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.061+0000 7f88137fe700 1 -- 172.21.15.77:0/2724535019 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 834057613 0 0) 0x7f8814069d20 con 0x7f8814161140 2023-07-24T05:47:22.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.061+0000 7f88137fe700 1 -- 172.21.15.77:0/2724535019 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88000035d0 con 0x7f8814161140 2023-07-24T05:47:22.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.061+0000 7f880bfff700 1 -- 172.21.15.77:0/2724535019 >> v2:172.21.15.103:3300/0 conn(0x7f88140cd130 msgr2=0x7f881406a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:22.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.061+0000 7f880bfff700 1 --2- 172.21.15.77:0/2724535019 >> v2:172.21.15.103:3300/0 conn(0x7f88140cd130 0x7f881406a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:22.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.061+0000 7f880bfff700 1 -- 172.21.15.77:0/2724535019 >> v1:172.21.15.77:6789/0 conn(0x7f8814161140 legacy=0x7f88140c1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:22.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.061+0000 7f880bfff700 1 -- 172.21.15.77:0/2724535019 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88140cdf40 con 0x7f88140c1b20 2023-07-24T05:47:22.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.061+0000 7f880bfff700 1 --2- 172.21.15.77:0/2724535019 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f88140c1b20 0x7f88140ccbf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f87fc009850 tx=0x7f87fc009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a43edb73a48aeac server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:22.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.061+0000 7f88137fe700 1 -- 172.21.15.77:0/2724535019 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc011830 con 0x7f88140c1b20 2023-07-24T05:47:22.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.061+0000 7f88137fe700 1 -- 172.21.15.77:0/2724535019 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87fc011990 con 0x7f88140c1b20 2023-07-24T05:47:22.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.061+0000 7f88137fe700 1 -- 172.21.15.77:0/2724535019 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc011d00 con 0x7f88140c1b20 2023-07-24T05:47:22.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.065+0000 7f881a554700 1 -- 172.21.15.77:0/2724535019 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f88140c1b20 msgr2=0x7f88140ccbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:22.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.065+0000 7f881a554700 1 --2- 172.21.15.77:0/2724535019 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f88140c1b20 0x7f88140ccbf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f87fc009850 tx=0x7f87fc009b60 comp rx=0 tx=0).stop 2023-07-24T05:47:22.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.065+0000 7f881a554700 1 -- 172.21.15.77:0/2724535019 shutdown_connections 2023-07-24T05:47:22.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.065+0000 7f881a554700 1 --2- 172.21.15.77:0/2724535019 >> v2:172.21.15.103:3300/0 conn(0x7f88140cd130 0x7f881406a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:22.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.065+0000 7f881a554700 1 --2- 172.21.15.77:0/2724535019 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f88140c1b20 0x7f88140ccbf0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:22.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.065+0000 7f881a554700 1 -- 172.21.15.77:0/2724535019 >> 172.21.15.77:0/2724535019 conn(0x7f88140ce440 msgr2=0x7f88140ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:22.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.065+0000 7f881a554700 1 -- 172.21.15.77:0/2724535019 shutdown_connections 2023-07-24T05:47:22.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.065+0000 7f881a554700 1 -- 172.21.15.77:0/2724535019 wait complete. 2023-07-24T05:47:22.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.065+0000 7f881a554700 1 Processor -- start 2023-07-24T05:47:22.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.069+0000 7f881a554700 1 -- start start 2023-07-24T05:47:22.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.069+0000 7f881a554700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88140c1b20 0x7f88140974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:22.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.069+0000 7f881a554700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88140cd130 0x7f8814163da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:22.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.069+0000 7f881a554700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8814161140 0x7f88140c6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:22.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.069+0000 7f881a554700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8814097a30 con 0x7f88140c1b20 2023-07-24T05:47:22.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.069+0000 7f881a554700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88140acc70 con 0x7f88140cd130 2023-07-24T05:47:22.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.069+0000 7f881a554700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88141642e0 con 0x7f8814161140 2023-07-24T05:47:22.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.069+0000 7f8813fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88140c1b20 0x7f88140974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:22.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.069+0000 7f8813fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88140c1b20 0x7f88140974f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60190/0 (socket says 172.21.15.77:60190) 2023-07-24T05:47:22.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.069+0000 7f8813fff700 1 -- 172.21.15.77:0/3952926174 learned_addr learned my addr 172.21.15.77:0/3952926174 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:22.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.069+0000 7f880bfff700 1 --2- 172.21.15.77:0/3952926174 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88140cd130 0x7f8814163da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:22.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.069+0000 7f8818af1700 1 --2- 172.21.15.77:0/3952926174 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8814161140 0x7f88140c6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:22.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.069+0000 7f8813fff700 1 -- 172.21.15.77:0/3952926174 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8814161140 msgr2=0x7f88140c6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:22.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.069+0000 7f8813fff700 1 --2- 172.21.15.77:0/3952926174 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8814161140 0x7f88140c6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:22.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.069+0000 7f8813fff700 1 -- 172.21.15.77:0/3952926174 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88140cd130 msgr2=0x7f8814163da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:22.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.069+0000 7f8813fff700 1 --2- 172.21.15.77:0/3952926174 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88140cd130 0x7f8814163da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:22.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.069+0000 7f8813fff700 1 -- 172.21.15.77:0/3952926174 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87fc0094b0 con 0x7f88140c1b20 2023-07-24T05:47:22.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.069+0000 7f880bfff700 1 --2- 172.21.15.77:0/3952926174 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88140cd130 0x7f8814163da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:47:22.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.069+0000 7f8813fff700 1 --2- 172.21.15.77:0/3952926174 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88140c1b20 0x7f88140974f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8804001130 tx=0x7f880400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:22.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.069+0000 7f88117fa700 1 -- 172.21.15.77:0/3952926174 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8804005d90 con 0x7f88140c1b20 2023-07-24T05:47:22.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.069+0000 7f88117fa700 1 -- 172.21.15.77:0/3952926174 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88040070d0 con 0x7f88140c1b20 2023-07-24T05:47:22.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.069+0000 7f88117fa700 1 -- 172.21.15.77:0/3952926174 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8804007460 con 0x7f88140c1b20 2023-07-24T05:47:22.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.069+0000 7f881a554700 1 -- 172.21.15.77:0/3952926174 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88140ac340 con 0x7f88140c1b20 2023-07-24T05:47:22.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.069+0000 7f881a554700 1 -- 172.21.15.77:0/3952926174 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88140ac900 con 0x7f88140c1b20 2023-07-24T05:47:22.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.073+0000 7f881a554700 1 -- 172.21.15.77:0/3952926174 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f881404df10 con 0x7f88140c1b20 2023-07-24T05:47:22.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.073+0000 7f88117fa700 1 -- 172.21.15.77:0/3952926174 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f88040075c0 con 0x7f88140c1b20 2023-07-24T05:47:22.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.073+0000 7f88117fa700 1 --2- 172.21.15.77:0/3952926174 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f87f40662f0 0x7f87f40687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:22.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.077+0000 7f88117fa700 1 -- 172.21.15.77:0/3952926174 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f88040834e0 con 0x7f88140c1b20 2023-07-24T05:47:22.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.077+0000 7f880bfff700 1 --2- 172.21.15.77:0/3952926174 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f87f40662f0 0x7f87f40687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:22.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.077+0000 7f880bfff700 1 --2- 172.21.15.77:0/3952926174 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f87f40662f0 0x7f87f40687b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f88140c1af0 tx=0x7f87fc008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:22.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.081+0000 7f88117fa700 1 -- 172.21.15.77:0/3952926174 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8804050620 con 0x7f88140c1b20 2023-07-24T05:47:22.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.253+0000 7f881a554700 1 -- 172.21.15.77:0/3952926174 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f881406a6a0 con 0x7f88140c1b20 2023-07-24T05:47:22.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.253+0000 7f88117fa700 1 -- 172.21.15.77:0/3952926174 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8804053c40 con 0x7f88140c1b20 2023-07-24T05:47:22.258 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-07-24T05:47:22.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.253+0000 7f881a554700 1 -- 172.21.15.77:0/3952926174 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f87f40662f0 msgr2=0x7f87f40687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:22.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.253+0000 7f881a554700 1 --2- 172.21.15.77:0/3952926174 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f87f40662f0 0x7f87f40687b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f88140c1af0 tx=0x7f87fc008030 comp rx=0 tx=0).stop 2023-07-24T05:47:22.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.253+0000 7f881a554700 1 -- 172.21.15.77:0/3952926174 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88140c1b20 msgr2=0x7f88140974f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:22.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.253+0000 7f881a554700 1 --2- 172.21.15.77:0/3952926174 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88140c1b20 0x7f88140974f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f8804001130 tx=0x7f880400c860 comp rx=0 tx=0).stop 2023-07-24T05:47:22.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.253+0000 7f881a554700 1 -- 172.21.15.77:0/3952926174 shutdown_connections 2023-07-24T05:47:22.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.253+0000 7f881a554700 1 --2- 172.21.15.77:0/3952926174 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f87f40662f0 0x7f87f40687b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:22.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.253+0000 7f881a554700 1 --2- 172.21.15.77:0/3952926174 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8814161140 0x7f88140c6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:22.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.253+0000 7f881a554700 1 --2- 172.21.15.77:0/3952926174 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88140cd130 0x7f8814163da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:22.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.253+0000 7f881a554700 1 --2- 172.21.15.77:0/3952926174 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88140c1b20 0x7f88140974f0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:22.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.253+0000 7f881a554700 1 -- 172.21.15.77:0/3952926174 >> 172.21.15.77:0/3952926174 conn(0x7f88140ce440 msgr2=0x7f8814160270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:22.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.253+0000 7f881a554700 1 -- 172.21.15.77:0/3952926174 shutdown_connections 2023-07-24T05:47:22.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.257+0000 7f881a554700 1 -- 172.21.15.77:0/3952926174 wait complete. 2023-07-24T05:47:22.281 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-24T05:47:22.460 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.453+0000 7f210721e700 1 Processor -- start 2023-07-24T05:47:22.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.453+0000 7f210721e700 1 -- start start 2023-07-24T05:47:22.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.457+0000 7f210721e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21001571b0 0x7f210006af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:22.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.457+0000 7f210721e700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2100071640 0x7f21000ca130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:22.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.457+0000 7f210721e700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21000c9ca0 con 0x7f210006b4d0 2023-07-24T05:47:22.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.457+0000 7f210721e700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f210006bae0 con 0x7f2100071640 2023-07-24T05:47:22.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.457+0000 7f210721e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f210006bdc0 con 0x7f21001571b0 2023-07-24T05:47:22.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.457+0000 7f21057bb700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2100071640 0x7f21000ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:22.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.457+0000 7f20fffff700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f210006b4d0 0x7f2100070f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:44340/0 (socket says 172.21.15.77:44340) 2023-07-24T05:47:22.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.457+0000 7f20fffff700 1 -- 172.21.15.77:0/805612629 learned_addr learned my addr 172.21.15.77:0/805612629 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:22.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.457+0000 7f2104fba700 1 --2- 172.21.15.77:0/805612629 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21001571b0 0x7f210006af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:22.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.461+0000 7f21057bb700 1 -- 172.21.15.77:0/805612629 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21001571b0 msgr2=0x7f210006af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:22.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.461+0000 7f21057bb700 1 --2- 172.21.15.77:0/805612629 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21001571b0 0x7f210006af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:22.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.461+0000 7f21057bb700 1 -- 172.21.15.77:0/805612629 >> v1:172.21.15.77:6789/0 conn(0x7f210006b4d0 legacy=0x7f2100070f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:22.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.461+0000 7f21057bb700 1 -- 172.21.15.77:0/805612629 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f210006c0a0 con 0x7f2100071640 2023-07-24T05:47:22.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.461+0000 7f21057bb700 1 --2- 172.21.15.77:0/805612629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2100071640 0x7f21000ca130 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f20f8009d90 tx=0x7f20f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf55c3b951f5e549 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:22.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.461+0000 7f20ff7fe700 1 -- 172.21.15.77:0/805612629 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f800e070 con 0x7f2100071640 2023-07-24T05:47:22.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.461+0000 7f20ff7fe700 1 -- 172.21.15.77:0/805612629 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f800bbd0 con 0x7f2100071640 2023-07-24T05:47:22.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.461+0000 7f20ff7fe700 1 -- 172.21.15.77:0/805612629 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f8012430 con 0x7f2100071640 2023-07-24T05:47:22.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.461+0000 7f210721e700 1 -- 172.21.15.77:0/805612629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2100071640 msgr2=0x7f21000ca130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:22.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.461+0000 7f210721e700 1 --2- 172.21.15.77:0/805612629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2100071640 0x7f21000ca130 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f20f8009d90 tx=0x7f20f800b330 comp rx=0 tx=0).stop 2023-07-24T05:47:22.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.461+0000 7f210721e700 1 -- 172.21.15.77:0/805612629 shutdown_connections 2023-07-24T05:47:22.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.461+0000 7f210721e700 1 --2- 172.21.15.77:0/805612629 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2100071640 0x7f21000ca130 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:22.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.461+0000 7f210721e700 1 --2- 172.21.15.77:0/805612629 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21001571b0 0x7f210006af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:22.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.461+0000 7f210721e700 1 -- 172.21.15.77:0/805612629 >> 172.21.15.77:0/805612629 conn(0x7f21000cf650 msgr2=0x7f21000cfa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:22.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.461+0000 7f210721e700 1 -- 172.21.15.77:0/805612629 shutdown_connections 2023-07-24T05:47:22.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.461+0000 7f210721e700 1 -- 172.21.15.77:0/805612629 wait complete. 2023-07-24T05:47:22.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.461+0000 7f210721e700 1 Processor -- start 2023-07-24T05:47:22.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.461+0000 7f210721e700 1 -- start start 2023-07-24T05:47:22.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.465+0000 7f210721e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f210006b4d0 0x7f21000c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:22.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.465+0000 7f210721e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2100071640 0x7f2100152b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:22.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.465+0000 7f210721e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21001571b0 0x7f21001602b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:22.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.465+0000 7f210721e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f210015dba0 con 0x7f21001571b0 2023-07-24T05:47:22.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.465+0000 7f210721e700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f210015e0d0 con 0x7f210006b4d0 2023-07-24T05:47:22.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.465+0000 7f210721e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f210015ddf0 con 0x7f2100071640 2023-07-24T05:47:22.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.465+0000 7f21057bb700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21001571b0 0x7f21001602b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:22.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.465+0000 7f21057bb700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21001571b0 0x7f21001602b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60212/0 (socket says 172.21.15.77:60212) 2023-07-24T05:47:22.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.465+0000 7f21057bb700 1 -- 172.21.15.77:0/242340565 learned_addr learned my addr 172.21.15.77:0/242340565 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:22.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.465+0000 7f2104fba700 1 --2- 172.21.15.77:0/242340565 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f210006b4d0 0x7f21000c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:22.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.465+0000 7f20fffff700 1 --2- 172.21.15.77:0/242340565 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2100071640 0x7f2100152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:22.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.465+0000 7f21057bb700 1 -- 172.21.15.77:0/242340565 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2100071640 msgr2=0x7f2100152b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:22.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.465+0000 7f21057bb700 1 --2- 172.21.15.77:0/242340565 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2100071640 0x7f2100152b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:22.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.465+0000 7f21057bb700 1 -- 172.21.15.77:0/242340565 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f210006b4d0 msgr2=0x7f21000c90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:22.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.465+0000 7f21057bb700 1 --2- 172.21.15.77:0/242340565 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f210006b4d0 0x7f21000c90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:22.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.465+0000 7f21057bb700 1 -- 172.21.15.77:0/242340565 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f8009a70 con 0x7f21001571b0 2023-07-24T05:47:22.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.465+0000 7f21057bb700 1 --2- 172.21.15.77:0/242340565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21001571b0 0x7f21001602b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f20f8013000 tx=0x7f20f8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:22.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.465+0000 7f20fd7fa700 1 -- 172.21.15.77:0/242340565 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f8012430 con 0x7f21001571b0 2023-07-24T05:47:22.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.465+0000 7f20fd7fa700 1 -- 172.21.15.77:0/242340565 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f8020070 con 0x7f21001571b0 2023-07-24T05:47:22.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.465+0000 7f210721e700 1 -- 172.21.15.77:0/242340565 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21000c88b0 con 0x7f21001571b0 2023-07-24T05:47:22.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.465+0000 7f20fd7fa700 1 -- 172.21.15.77:0/242340565 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f8004280 con 0x7f21001571b0 2023-07-24T05:47:22.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.465+0000 7f210721e700 1 -- 172.21.15.77:0/242340565 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2100153060 con 0x7f21001571b0 2023-07-24T05:47:22.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.469+0000 7f210721e700 1 -- 172.21.15.77:0/242340565 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21000c8dd0 con 0x7f21001571b0 2023-07-24T05:47:22.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.469+0000 7f20fd7fa700 1 -- 172.21.15.77:0/242340565 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f20f80043e0 con 0x7f21001571b0 2023-07-24T05:47:22.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.473+0000 7f20fd7fa700 1 --2- 172.21.15.77:0/242340565 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f20e40662f0 0x7f20e40687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:22.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.473+0000 7f20fd7fa700 1 -- 172.21.15.77:0/242340565 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f20f8022070 con 0x7f21001571b0 2023-07-24T05:47:22.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.473+0000 7f2104fba700 1 --2- 172.21.15.77:0/242340565 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f20e40662f0 0x7f20e40687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:22.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.473+0000 7f2104fba700 1 --2- 172.21.15.77:0/242340565 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f20e40662f0 0x7f20e40687b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f20f4007a60 tx=0x7f20f4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:22.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.477+0000 7f20fd7fa700 1 -- 172.21.15.77:0/242340565 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f21000c8dd0 con 0x7f21001571b0 2023-07-24T05:47:22.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.649+0000 7f210721e700 1 -- 172.21.15.77:0/242340565 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f21000c8dd0 con 0x7f21001571b0 2023-07-24T05:47:22.657 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.653+0000 7f20fd7fa700 1 -- 172.21.15.77:0/242340565 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f21000c8dd0 con 0x7f21001571b0 2023-07-24T05:47:22.658 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 8 2023-07-24T05:47:22.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.657+0000 7f210721e700 1 -- 172.21.15.77:0/242340565 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f20e40662f0 msgr2=0x7f20e40687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:22.661 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.657+0000 7f210721e700 1 --2- 172.21.15.77:0/242340565 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f20e40662f0 0x7f20e40687b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f20f4007a60 tx=0x7f20f4008040 comp rx=0 tx=0).stop 2023-07-24T05:47:22.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.657+0000 7f210721e700 1 -- 172.21.15.77:0/242340565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21001571b0 msgr2=0x7f21001602b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:22.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.657+0000 7f210721e700 1 --2- 172.21.15.77:0/242340565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21001571b0 0x7f21001602b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f20f8013000 tx=0x7f20f8004af0 comp rx=0 tx=0).stop 2023-07-24T05:47:22.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.657+0000 7f210721e700 1 -- 172.21.15.77:0/242340565 shutdown_connections 2023-07-24T05:47:22.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.657+0000 7f210721e700 1 --2- 172.21.15.77:0/242340565 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21001571b0 0x7f21001602b0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:22.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.657+0000 7f210721e700 1 --2- 172.21.15.77:0/242340565 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f20e40662f0 0x7f20e40687b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:22.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.657+0000 7f210721e700 1 --2- 172.21.15.77:0/242340565 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2100071640 0x7f2100152b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:22.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.657+0000 7f210721e700 1 --2- 172.21.15.77:0/242340565 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f210006b4d0 0x7f21000c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:22.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.657+0000 7f210721e700 1 -- 172.21.15.77:0/242340565 >> 172.21.15.77:0/242340565 conn(0x7f21000cf650 msgr2=0x7f21000cfa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:22.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.657+0000 7f210721e700 1 -- 172.21.15.77:0/242340565 shutdown_connections 2023-07-24T05:47:22.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.657+0000 7f210721e700 1 -- 172.21.15.77:0/242340565 wait complete. 2023-07-24T05:47:22.682 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-24T05:47:22.862 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.857+0000 7fe4026d8700 1 Processor -- start 2023-07-24T05:47:22.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.857+0000 7fe4026d8700 1 -- start start 2023-07-24T05:47:22.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.861+0000 7fe4026d8700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3fc06afc0 0x7fe3fc0b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:22.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.861+0000 7fe4026d8700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe3fc15db20 0x7fe3fc0d28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:22.866 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.861+0000 7fe4026d8700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3fc160fa0 con 0x7fe3fc0d2df0 2023-07-24T05:47:22.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.861+0000 7fe4026d8700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3fc0d3280 con 0x7fe3fc15db20 2023-07-24T05:47:22.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.861+0000 7fe4026d8700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc0d0360 con 0x7fe3fc06afc0 2023-07-24T05:47:22.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.861+0000 7fe3fbfff700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3fc06afc0 0x7fe3fc0b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:22.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.861+0000 7fe3f37fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe3fc15db20 0x7fe3fc0d28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:22.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.861+0000 7fe3fbfff700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3fc06afc0 0x7fe3fc0b1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.77:54768/0 (socket says 172.21.15.77:54768) 2023-07-24T05:47:22.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.861+0000 7fe3fbfff700 1 -- 172.21.15.77:0/2320681849 learned_addr learned my addr 172.21.15.77:0/2320681849 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:22.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.861+0000 7fe3f37fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe3fc15db20 0x7fe3fc0d28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:47668/0 (socket says 172.21.15.77:47668) 2023-07-24T05:47:22.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.861+0000 7fe3fb7fe700 1 -- 172.21.15.77:0/2320681849 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1739641781 0 0) 0x7fe3fc160fa0 con 0x7fe3fc0d2df0 2023-07-24T05:47:22.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.861+0000 7fe3fbfff700 1 -- 172.21.15.77:0/2320681849 >> v2:172.21.15.103:3300/0 conn(0x7fe3fc15db20 msgr2=0x7fe3fc0d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:22.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.861+0000 7fe3fbfff700 1 --2- 172.21.15.77:0/2320681849 >> v2:172.21.15.103:3300/0 conn(0x7fe3fc15db20 0x7fe3fc0d28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:22.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.861+0000 7fe3fbfff700 1 -- 172.21.15.77:0/2320681849 >> v1:172.21.15.103:6789/0 conn(0x7fe3fc0d2df0 legacy=0x7fe3fc0d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:22.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.861+0000 7fe3fbfff700 1 -- 172.21.15.77:0/2320681849 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3fc0b20b0 con 0x7fe3fc06afc0 2023-07-24T05:47:22.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.861+0000 7fe3fbfff700 1 --2- 172.21.15.77:0/2320681849 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3fc06afc0 0x7fe3fc0b1a20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec009910 tx=0x7fe3ec009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c0ef4afa389ddd8 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:22.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.865+0000 7fe3fb7fe700 1 -- 172.21.15.77:0/2320681849 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec011830 con 0x7fe3fc06afc0 2023-07-24T05:47:22.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.865+0000 7fe3fb7fe700 1 -- 172.21.15.77:0/2320681849 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ec011990 con 0x7fe3fc06afc0 2023-07-24T05:47:22.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.865+0000 7fe3fb7fe700 1 -- 172.21.15.77:0/2320681849 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec011d40 con 0x7fe3fc06afc0 2023-07-24T05:47:22.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.865+0000 7fe4026d8700 1 -- 172.21.15.77:0/2320681849 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3fc06afc0 msgr2=0x7fe3fc0b1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:22.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.865+0000 7fe4026d8700 1 --2- 172.21.15.77:0/2320681849 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3fc06afc0 0x7fe3fc0b1a20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec009910 tx=0x7fe3ec009c20 comp rx=0 tx=0).stop 2023-07-24T05:47:22.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.865+0000 7fe4026d8700 1 -- 172.21.15.77:0/2320681849 shutdown_connections 2023-07-24T05:47:22.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.865+0000 7fe4026d8700 1 --2- 172.21.15.77:0/2320681849 >> v2:172.21.15.103:3300/0 conn(0x7fe3fc15db20 0x7fe3fc0d28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:22.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.865+0000 7fe4026d8700 1 --2- 172.21.15.77:0/2320681849 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3fc06afc0 0x7fe3fc0b1a20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:22.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.865+0000 7fe4026d8700 1 -- 172.21.15.77:0/2320681849 >> 172.21.15.77:0/2320681849 conn(0x7fe3fc09bc20 msgr2=0x7fe3fc0b7920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:22.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.865+0000 7fe4026d8700 1 -- 172.21.15.77:0/2320681849 shutdown_connections 2023-07-24T05:47:22.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.865+0000 7fe4026d8700 1 -- 172.21.15.77:0/2320681849 wait complete. 2023-07-24T05:47:22.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.865+0000 7fe4026d8700 1 Processor -- start 2023-07-24T05:47:22.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.865+0000 7fe4026d8700 1 -- start start 2023-07-24T05:47:22.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.869+0000 7fe4026d8700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3fc06afc0 0x7fe3fc150970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:22.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.869+0000 7fe4026d8700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3fc0d2df0 0x7fe3fc0ce560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:22.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.869+0000 7fe4026d8700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3fc15db20 0x7fe3fc0ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:22.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.869+0000 7fe4026d8700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc0b35e0 con 0x7fe3fc0d2df0 2023-07-24T05:47:22.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.869+0000 7fe4026d8700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc0b2960 con 0x7fe3fc15db20 2023-07-24T05:47:22.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.869+0000 7fe4026d8700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc0b2c40 con 0x7fe3fc06afc0 2023-07-24T05:47:22.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.869+0000 7fe3f37fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3fc0d2df0 0x7fe3fc0ce560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:22.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.869+0000 7fe3fbfff700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3fc06afc0 0x7fe3fc150970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:22.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.869+0000 7fe3f37fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3fc0d2df0 0x7fe3fc0ce560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60216/0 (socket says 172.21.15.77:60216) 2023-07-24T05:47:22.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.869+0000 7fe3f37fe700 1 -- 172.21.15.77:0/1315948527 learned_addr learned my addr 172.21.15.77:0/1315948527 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:22.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.869+0000 7fe400c75700 1 --2- 172.21.15.77:0/1315948527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3fc15db20 0x7fe3fc0ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:22.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.869+0000 7fe3fbfff700 1 -- 172.21.15.77:0/1315948527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3fc15db20 msgr2=0x7fe3fc0ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:22.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.869+0000 7fe3fbfff700 1 --2- 172.21.15.77:0/1315948527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3fc15db20 0x7fe3fc0ceaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:22.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.869+0000 7fe3fbfff700 1 -- 172.21.15.77:0/1315948527 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3fc0d2df0 msgr2=0x7fe3fc0ce560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:22.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.869+0000 7fe3fbfff700 1 --2- 172.21.15.77:0/1315948527 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3fc0d2df0 0x7fe3fc0ce560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:22.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.869+0000 7fe3fbfff700 1 -- 172.21.15.77:0/1315948527 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3ec009570 con 0x7fe3fc06afc0 2023-07-24T05:47:22.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.869+0000 7fe3f37fe700 1 --2- 172.21.15.77:0/1315948527 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3fc0d2df0 0x7fe3fc0ce560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:47:22.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.869+0000 7fe3fbfff700 1 --2- 172.21.15.77:0/1315948527 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3fc06afc0 0x7fe3fc150970 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc0ccf20 tx=0x7fe3ec004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:22.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.869+0000 7fe3f97fa700 1 -- 172.21.15.77:0/1315948527 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec01a8f0 con 0x7fe3fc06afc0 2023-07-24T05:47:22.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.869+0000 7fe3f97fa700 1 -- 172.21.15.77:0/1315948527 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3ec01e070 con 0x7fe3fc06afc0 2023-07-24T05:47:22.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.869+0000 7fe4026d8700 1 -- 172.21.15.77:0/1315948527 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3fc0b2f20 con 0x7fe3fc06afc0 2023-07-24T05:47:22.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.869+0000 7fe3f97fa700 1 -- 172.21.15.77:0/1315948527 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3ec01acd0 con 0x7fe3fc06afc0 2023-07-24T05:47:22.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.869+0000 7fe4026d8700 1 -- 172.21.15.77:0/1315948527 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3fc154720 con 0x7fe3fc06afc0 2023-07-24T05:47:22.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.873+0000 7fe4026d8700 1 -- 172.21.15.77:0/1315948527 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3fc04df10 con 0x7fe3fc06afc0 2023-07-24T05:47:22.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.873+0000 7fe3f97fa700 1 -- 172.21.15.77:0/1315948527 <== mon.2 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe3ec02d450 con 0x7fe3fc06afc0 2023-07-24T05:47:22.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.873+0000 7fe3f97fa700 1 --2- 172.21.15.77:0/1315948527 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe3dc0662f0 0x7fe3dc0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:22.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.873+0000 7fe3f97fa700 1 -- 172.21.15.77:0/1315948527 <== mon.2 v2:172.21.15.103:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe3ec084fb0 con 0x7fe3fc06afc0 2023-07-24T05:47:22.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.873+0000 7fe3f37fe700 1 --2- 172.21.15.77:0/1315948527 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe3dc0662f0 0x7fe3dc0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:22.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.877+0000 7fe3f37fe700 1 --2- 172.21.15.77:0/1315948527 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe3dc0662f0 0x7fe3dc0687b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc0cf120 tx=0x7fe3e4009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:22.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:22.885+0000 7fe3f97fa700 1 -- 172.21.15.77:0/1315948527 <== mon.2 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe3ec052070 con 0x7fe3fc06afc0 2023-07-24T05:47:23.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.057+0000 7fe4026d8700 1 -- 172.21.15.77:0/1315948527 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe3fc0b6170 con 0x7fe3fc06afc0 2023-07-24T05:47:23.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.057+0000 7fe3f97fa700 1 -- 172.21.15.77:0/1315948527 <== mon.2 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe3ec006da0 con 0x7fe3fc06afc0 2023-07-24T05:47:23.064 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-07-24T05:47:23.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.061+0000 7fe4026d8700 1 -- 172.21.15.77:0/1315948527 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe3dc0662f0 msgr2=0x7fe3dc0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:23.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.061+0000 7fe4026d8700 1 --2- 172.21.15.77:0/1315948527 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe3dc0662f0 0x7fe3dc0687b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc0cf120 tx=0x7fe3e4009240 comp rx=0 tx=0).stop 2023-07-24T05:47:23.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.061+0000 7fe4026d8700 1 -- 172.21.15.77:0/1315948527 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3fc06afc0 msgr2=0x7fe3fc150970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:23.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.061+0000 7fe4026d8700 1 --2- 172.21.15.77:0/1315948527 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3fc06afc0 0x7fe3fc150970 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc0ccf20 tx=0x7fe3ec004770 comp rx=0 tx=0).stop 2023-07-24T05:47:23.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.061+0000 7fe4026d8700 1 -- 172.21.15.77:0/1315948527 shutdown_connections 2023-07-24T05:47:23.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.061+0000 7fe4026d8700 1 --2- 172.21.15.77:0/1315948527 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3fc15db20 0x7fe3fc0ceaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:23.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.061+0000 7fe4026d8700 1 --2- 172.21.15.77:0/1315948527 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3fc0d2df0 0x7fe3fc0ce560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:23.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.061+0000 7fe4026d8700 1 --2- 172.21.15.77:0/1315948527 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe3dc0662f0 0x7fe3dc0687b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:23.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.061+0000 7fe4026d8700 1 --2- 172.21.15.77:0/1315948527 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3fc06afc0 0x7fe3fc150970 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:23.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.061+0000 7fe4026d8700 1 -- 172.21.15.77:0/1315948527 >> 172.21.15.77:0/1315948527 conn(0x7fe3fc09bc20 msgr2=0x7fe3fc0b54a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:23.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.065+0000 7fe4026d8700 1 -- 172.21.15.77:0/1315948527 shutdown_connections 2023-07-24T05:47:23.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.065+0000 7fe4026d8700 1 -- 172.21.15.77:0/1315948527 wait complete. 2023-07-24T05:47:23.090 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-24T05:47:23.271 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.265+0000 7f0d621ef700 1 Processor -- start 2023-07-24T05:47:23.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.265+0000 7f0d621ef700 1 -- start start 2023-07-24T05:47:23.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.269+0000 7f0d621ef700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0d5c15c870 0x7f0d5c0cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:23.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.269+0000 7f0d621ef700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0d5c15cc50 0x7f0d5c0b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:23.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.269+0000 7f0d621ef700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d5c0cf520 con 0x7f0d5c06a520 2023-07-24T05:47:23.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.269+0000 7f0d621ef700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d5c06aaa0 con 0x7f0d5c15c870 2023-07-24T05:47:23.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.269+0000 7f0d621ef700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c06ad80 con 0x7f0d5c15cc50 2023-07-24T05:47:23.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.269+0000 7f0d609ec700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0d5c15cc50 0x7f0d5c0b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:23.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.269+0000 7f0d611ed700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0d5c15c870 0x7f0d5c0cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:23.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.269+0000 7f0d609ec700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0d5c15cc50 0x7f0d5c0b1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.77:35956/0 (socket says 172.21.15.77:35956) 2023-07-24T05:47:23.277 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.269+0000 7f0d609ec700 1 -- 172.21.15.77:0/4014097093 learned_addr learned my addr 172.21.15.77:0/4014097093 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:23.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.273+0000 7f0d609ec700 1 -- 172.21.15.77:0/4014097093 >> v2:172.21.15.103:3300/0 conn(0x7f0d5c15c870 msgr2=0x7f0d5c0cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:23.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.273+0000 7f0d609ec700 1 --2- 172.21.15.77:0/4014097093 >> v2:172.21.15.103:3300/0 conn(0x7f0d5c15c870 0x7f0d5c0cefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:23.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.273+0000 7f0d609ec700 1 -- 172.21.15.77:0/4014097093 >> v1:172.21.15.103:6789/0 conn(0x7f0d5c06a520 legacy=0x7f0d5c0b40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:23.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.273+0000 7f0d609ec700 1 -- 172.21.15.77:0/4014097093 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d5c06b060 con 0x7f0d5c15cc50 2023-07-24T05:47:23.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.273+0000 7f0d611ed700 1 --2- 172.21.15.77:0/4014097093 >> v2:172.21.15.103:3300/0 conn(0x7f0d5c15c870 0x7f0d5c0cefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:47:23.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.273+0000 7f0d53fff700 1 -- 172.21.15.77:0/4014097093 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 859463002 0 0) 0x7f0d5c0cf520 con 0x7f0d5c06a520 2023-07-24T05:47:23.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.273+0000 7f0d609ec700 1 --2- 172.21.15.77:0/4014097093 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0d5c15cc50 0x7f0d5c0b1b20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c009910 tx=0x7f0d4c009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c185102907e5f87 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:23.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.273+0000 7f0d53fff700 1 -- 172.21.15.77:0/4014097093 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c011830 con 0x7f0d5c15cc50 2023-07-24T05:47:23.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.273+0000 7f0d53fff700 1 -- 172.21.15.77:0/4014097093 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4c011990 con 0x7f0d5c15cc50 2023-07-24T05:47:23.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.273+0000 7f0d53fff700 1 -- 172.21.15.77:0/4014097093 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c011d40 con 0x7f0d5c15cc50 2023-07-24T05:47:23.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.273+0000 7f0d621ef700 1 -- 172.21.15.77:0/4014097093 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0d5c15cc50 msgr2=0x7f0d5c0b1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:23.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.273+0000 7f0d621ef700 1 --2- 172.21.15.77:0/4014097093 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0d5c15cc50 0x7f0d5c0b1b20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c009910 tx=0x7f0d4c009c20 comp rx=0 tx=0).stop 2023-07-24T05:47:23.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.273+0000 7f0d621ef700 1 -- 172.21.15.77:0/4014097093 shutdown_connections 2023-07-24T05:47:23.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.273+0000 7f0d621ef700 1 --2- 172.21.15.77:0/4014097093 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0d5c15cc50 0x7f0d5c0b1b20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:23.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.273+0000 7f0d621ef700 1 --2- 172.21.15.77:0/4014097093 >> v2:172.21.15.103:3300/0 conn(0x7f0d5c15c870 0x7f0d5c0cefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:23.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.273+0000 7f0d621ef700 1 -- 172.21.15.77:0/4014097093 >> 172.21.15.77:0/4014097093 conn(0x7f0d5c089f80 msgr2=0x7f0d5c09b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:23.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.273+0000 7f0d621ef700 1 -- 172.21.15.77:0/4014097093 shutdown_connections 2023-07-24T05:47:23.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.273+0000 7f0d621ef700 1 -- 172.21.15.77:0/4014097093 wait complete. 2023-07-24T05:47:23.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.277+0000 7f0d621ef700 1 Processor -- start 2023-07-24T05:47:23.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.277+0000 7f0d621ef700 1 -- start start 2023-07-24T05:47:23.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.281+0000 7f0d621ef700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0d5c06a520 0x7f0d5c0b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:23.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.281+0000 7f0d621ef700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d5c15c870 0x7f0d5c0c9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:23.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.281+0000 7f0d621ef700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d5c15cc50 0x7f0d5c0c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:23.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.281+0000 7f0d621ef700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c0c5af0 con 0x7f0d5c15cc50 2023-07-24T05:47:23.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.281+0000 7f0d621ef700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c0c9c70 con 0x7f0d5c15c870 2023-07-24T05:47:23.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.281+0000 7f0d621ef700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5c0c8f90 con 0x7f0d5c06a520 2023-07-24T05:47:23.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.281+0000 7f0d609ec700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d5c15c870 0x7f0d5c0c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:23.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.281+0000 7f0d611ed700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0d5c06a520 0x7f0d5c0b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:23.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.281+0000 7f0d619ee700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d5c15cc50 0x7f0d5c0c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:23.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.281+0000 7f0d611ed700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0d5c06a520 0x7f0d5c0b40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.77:35972/0 (socket says 172.21.15.77:35972) 2023-07-24T05:47:23.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.281+0000 7f0d609ec700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d5c15c870 0x7f0d5c0c9730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:47894/0 (socket says 172.21.15.77:47894) 2023-07-24T05:47:23.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.281+0000 7f0d611ed700 1 -- 172.21.15.77:0/2697217919 learned_addr learned my addr 172.21.15.77:0/2697217919 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:23.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.281+0000 7f0d611ed700 1 -- 172.21.15.77:0/2697217919 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d5c15c870 msgr2=0x7f0d5c0c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:23.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.281+0000 7f0d611ed700 1 --2- 172.21.15.77:0/2697217919 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d5c15c870 0x7f0d5c0c9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:23.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.281+0000 7f0d611ed700 1 -- 172.21.15.77:0/2697217919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d5c15cc50 msgr2=0x7f0d5c0c8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:23.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.281+0000 7f0d611ed700 1 --2- 172.21.15.77:0/2697217919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d5c15cc50 0x7f0d5c0c8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:23.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.281+0000 7f0d611ed700 1 -- 172.21.15.77:0/2697217919 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d58009450 con 0x7f0d5c06a520 2023-07-24T05:47:23.289 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.281+0000 7f0d619ee700 1 --2- 172.21.15.77:0/2697217919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d5c15cc50 0x7f0d5c0c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:47:23.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.281+0000 7f0d611ed700 1 --2- 172.21.15.77:0/2697217919 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0d5c06a520 0x7f0d5c0b40e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0d5800ebe0 tx=0x7f0d5800eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:23.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.281+0000 7f0d51ffb700 1 -- 172.21.15.77:0/2697217919 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d58005a40 con 0x7f0d5c06a520 2023-07-24T05:47:23.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.281+0000 7f0d51ffb700 1 -- 172.21.15.77:0/2697217919 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d58005ba0 con 0x7f0d5c06a520 2023-07-24T05:47:23.290 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.281+0000 7f0d51ffb700 1 -- 172.21.15.77:0/2697217919 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5800c850 con 0x7f0d5c06a520 2023-07-24T05:47:23.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.285+0000 7f0d621ef700 1 -- 172.21.15.77:0/2697217919 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d4c009570 con 0x7f0d5c06a520 2023-07-24T05:47:23.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.285+0000 7f0d621ef700 1 -- 172.21.15.77:0/2697217919 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d5c0b4a50 con 0x7f0d5c06a520 2023-07-24T05:47:23.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.285+0000 7f0d621ef700 1 -- 172.21.15.77:0/2697217919 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d5c1e7230 con 0x7f0d5c06a520 2023-07-24T05:47:23.293 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.289+0000 7f0d51ffb700 1 -- 172.21.15.77:0/2697217919 <== mon.2 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0d5800c9b0 con 0x7f0d5c06a520 2023-07-24T05:47:23.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.289+0000 7f0d51ffb700 1 --2- 172.21.15.77:0/2697217919 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f0d400662f0 0x7f0d400687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:23.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.289+0000 7f0d51ffb700 1 -- 172.21.15.77:0/2697217919 <== mon.2 v2:172.21.15.103:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0d58084270 con 0x7f0d5c06a520 2023-07-24T05:47:23.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.289+0000 7f0d609ec700 1 --2- 172.21.15.77:0/2697217919 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f0d400662f0 0x7f0d400687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:23.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.289+0000 7f0d609ec700 1 --2- 172.21.15.77:0/2697217919 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f0d400662f0 0x7f0d400687b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c000c00 tx=0x7f0d4c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:23.302 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.297+0000 7f0d51ffb700 1 -- 172.21.15.77:0/2697217919 <== mon.2 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0d580513d0 con 0x7f0d5c06a520 2023-07-24T05:47:23.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.469+0000 7f0d621ef700 1 -- 172.21.15.77:0/2697217919 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0d5c072490 con 0x7f0d5c06a520 2023-07-24T05:47:23.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.473+0000 7f0d51ffb700 1 -- 172.21.15.77:0/2697217919 <== mon.2 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0d580549f0 con 0x7f0d5c06a520 2023-07-24T05:47:23.477 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-07-24T05:47:23.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.473+0000 7f0d621ef700 1 -- 172.21.15.77:0/2697217919 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f0d400662f0 msgr2=0x7f0d400687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:23.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.473+0000 7f0d621ef700 1 --2- 172.21.15.77:0/2697217919 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f0d400662f0 0x7f0d400687b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c000c00 tx=0x7f0d4c008030 comp rx=0 tx=0).stop 2023-07-24T05:47:23.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.473+0000 7f0d621ef700 1 -- 172.21.15.77:0/2697217919 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0d5c06a520 msgr2=0x7f0d5c0b40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:23.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.473+0000 7f0d621ef700 1 --2- 172.21.15.77:0/2697217919 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0d5c06a520 0x7f0d5c0b40e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0d5800ebe0 tx=0x7f0d5800eef0 comp rx=0 tx=0).stop 2023-07-24T05:47:23.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.473+0000 7f0d621ef700 1 -- 172.21.15.77:0/2697217919 shutdown_connections 2023-07-24T05:47:23.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.473+0000 7f0d621ef700 1 --2- 172.21.15.77:0/2697217919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0d5c15cc50 0x7f0d5c0c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:23.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.473+0000 7f0d621ef700 1 --2- 172.21.15.77:0/2697217919 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d5c15c870 0x7f0d5c0c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:23.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.473+0000 7f0d621ef700 1 --2- 172.21.15.77:0/2697217919 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f0d400662f0 0x7f0d400687b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:23.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.473+0000 7f0d621ef700 1 --2- 172.21.15.77:0/2697217919 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0d5c06a520 0x7f0d5c0b40e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:23.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.473+0000 7f0d621ef700 1 -- 172.21.15.77:0/2697217919 >> 172.21.15.77:0/2697217919 conn(0x7f0d5c089f80 msgr2=0x7f0d5c065720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:23.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.473+0000 7f0d621ef700 1 -- 172.21.15.77:0/2697217919 shutdown_connections 2023-07-24T05:47:23.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.473+0000 7f0d621ef700 1 -- 172.21.15.77:0/2697217919 wait complete. 2023-07-24T05:47:23.500 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-24T05:47:23.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.665+0000 7f56fa344700 1 Processor -- start 2023-07-24T05:47:23.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.665+0000 7f56fa344700 1 -- start start 2023-07-24T05:47:23.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.665+0000 7f56fa344700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f56f41600c0 0x7f56f4069b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:23.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.665+0000 7f56fa344700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f56f40cdbd0 0x7f56f4070130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:23.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.669+0000 7f56fa344700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56f406b460 con 0x7f56f406cb30 2023-07-24T05:47:23.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.669+0000 7f56fa344700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56f406ae20 con 0x7f56f41600c0 2023-07-24T05:47:23.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.669+0000 7f56fa344700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56f406a210 con 0x7f56f40cdbd0 2023-07-24T05:47:23.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.669+0000 7f56f3fff700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f56f41600c0 0x7f56f4069b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:23.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.669+0000 7f56f3fff700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f56f41600c0 0x7f56f4069b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41302/0 (socket says 172.21.15.77:41302) 2023-07-24T05:47:23.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.669+0000 7f56f3fff700 1 -- 172.21.15.77:0/1058759608 learned_addr learned my addr 172.21.15.77:0/1058759608 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:23.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.669+0000 7f56f88e1700 1 --2- 172.21.15.77:0/1058759608 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f56f40cdbd0 0x7f56f4070130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:23.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.669+0000 7f56f3fff700 1 -- 172.21.15.77:0/1058759608 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f56f40cdbd0 msgr2=0x7f56f4070130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:23.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.669+0000 7f56f3fff700 1 --2- 172.21.15.77:0/1058759608 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f56f40cdbd0 0x7f56f4070130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:23.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.669+0000 7f56f3fff700 1 -- 172.21.15.77:0/1058759608 >> v1:172.21.15.103:6789/0 conn(0x7f56f406cb30 legacy=0x7f56f40cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:23.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.669+0000 7f56f3fff700 1 -- 172.21.15.77:0/1058759608 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f406a4f0 con 0x7f56f41600c0 2023-07-24T05:47:23.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.669+0000 7f56f3fff700 1 --2- 172.21.15.77:0/1058759608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56f41600c0 0x7f56f4069b10 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f56e4009910 tx=0x7f56e4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0b50615d67418df server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:23.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.669+0000 7f56f37fe700 1 -- 172.21.15.77:0/1058759608 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e4005e50 con 0x7f56f41600c0 2023-07-24T05:47:23.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.669+0000 7f56f37fe700 1 -- 172.21.15.77:0/1058759608 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e4009e60 con 0x7f56f41600c0 2023-07-24T05:47:23.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.669+0000 7f56f37fe700 1 -- 172.21.15.77:0/1058759608 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e400b870 con 0x7f56f41600c0 2023-07-24T05:47:23.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.669+0000 7f56fa344700 1 -- 172.21.15.77:0/1058759608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56f41600c0 msgr2=0x7f56f4069b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:23.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.669+0000 7f56fa344700 1 --2- 172.21.15.77:0/1058759608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56f41600c0 0x7f56f4069b10 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f56e4009910 tx=0x7f56e4009c20 comp rx=0 tx=0).stop 2023-07-24T05:47:23.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.669+0000 7f56fa344700 1 -- 172.21.15.77:0/1058759608 shutdown_connections 2023-07-24T05:47:23.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.669+0000 7f56fa344700 1 --2- 172.21.15.77:0/1058759608 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f56f40cdbd0 0x7f56f4070130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:23.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.669+0000 7f56fa344700 1 --2- 172.21.15.77:0/1058759608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56f41600c0 0x7f56f4069b10 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:23.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.669+0000 7f56fa344700 1 -- 172.21.15.77:0/1058759608 >> 172.21.15.77:0/1058759608 conn(0x7f56f40ce440 msgr2=0x7f56f40ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:23.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.673+0000 7f56fa344700 1 -- 172.21.15.77:0/1058759608 shutdown_connections 2023-07-24T05:47:23.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.673+0000 7f56fa344700 1 -- 172.21.15.77:0/1058759608 wait complete. 2023-07-24T05:47:23.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.673+0000 7f56fa344700 1 Processor -- start 2023-07-24T05:47:23.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.677+0000 7f56fa344700 1 -- start start 2023-07-24T05:47:23.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.677+0000 7f56fa344700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56f406cb30 0x7f56f415a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:23.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.677+0000 7f56fa344700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f56f40cdbd0 0x7f56f40c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:23.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.677+0000 7f56fa344700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56f41600c0 0x7f56f40c1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:23.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.677+0000 7f56fa344700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f40af1a0 con 0x7f56f406cb30 2023-07-24T05:47:23.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.677+0000 7f56fa344700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f40c2e80 con 0x7f56f41600c0 2023-07-24T05:47:23.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.677+0000 7f56fa344700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56f40c28c0 con 0x7f56f40cdbd0 2023-07-24T05:47:23.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.677+0000 7f56f3fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56f406cb30 0x7f56f415a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:23.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.677+0000 7f56f3fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56f406cb30 0x7f56f415a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41318/0 (socket says 172.21.15.77:41318) 2023-07-24T05:47:23.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.677+0000 7f56f3fff700 1 -- 172.21.15.77:0/994523551 learned_addr learned my addr 172.21.15.77:0/994523551 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:23.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.677+0000 7f56f88e1700 1 --2- 172.21.15.77:0/994523551 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56f41600c0 0x7f56f40c1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:23.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.677+0000 7f56ebfff700 1 --2- 172.21.15.77:0/994523551 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f56f40cdbd0 0x7f56f40c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:23.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.677+0000 7f56f3fff700 1 -- 172.21.15.77:0/994523551 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f56f40cdbd0 msgr2=0x7f56f40c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:23.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.677+0000 7f56f3fff700 1 --2- 172.21.15.77:0/994523551 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f56f40cdbd0 0x7f56f40c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:23.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.677+0000 7f56f3fff700 1 -- 172.21.15.77:0/994523551 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56f41600c0 msgr2=0x7f56f40c1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:23.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.677+0000 7f56f3fff700 1 --2- 172.21.15.77:0/994523551 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56f41600c0 0x7f56f40c1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:23.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.677+0000 7f56f3fff700 1 -- 172.21.15.77:0/994523551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e4009520 con 0x7f56f406cb30 2023-07-24T05:47:23.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.677+0000 7f56f88e1700 1 --2- 172.21.15.77:0/994523551 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56f41600c0 0x7f56f40c1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:47:23.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.677+0000 7f56ebfff700 1 --2- 172.21.15.77:0/994523551 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f56f40cdbd0 0x7f56f40c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:47:23.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.677+0000 7f56f3fff700 1 --2- 172.21.15.77:0/994523551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56f406cb30 0x7f56f415a6b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f56e4009c60 tx=0x7f56e4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:23.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.677+0000 7f56f17fa700 1 -- 172.21.15.77:0/994523551 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e400be20 con 0x7f56f406cb30 2023-07-24T05:47:23.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.677+0000 7f56f17fa700 1 -- 172.21.15.77:0/994523551 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e4020070 con 0x7f56f406cb30 2023-07-24T05:47:23.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.677+0000 7f56fa344700 1 -- 172.21.15.77:0/994523551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56f40c2ba0 con 0x7f56f406cb30 2023-07-24T05:47:23.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.681+0000 7f56f17fa700 1 -- 172.21.15.77:0/994523551 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e4006220 con 0x7f56f406cb30 2023-07-24T05:47:23.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.681+0000 7f56fa344700 1 -- 172.21.15.77:0/994523551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56f40c8fb0 con 0x7f56f406cb30 2023-07-24T05:47:23.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.681+0000 7f56fa344700 1 -- 172.21.15.77:0/994523551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56f404df10 con 0x7f56f406cb30 2023-07-24T05:47:23.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.681+0000 7f56f17fa700 1 -- 172.21.15.77:0/994523551 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f56e4022030 con 0x7f56f406cb30 2023-07-24T05:47:23.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.685+0000 7f56f17fa700 1 --2- 172.21.15.77:0/994523551 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f56d40662f0 0x7f56d40687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:23.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.685+0000 7f56f17fa700 1 -- 172.21.15.77:0/994523551 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f56e40856f0 con 0x7f56f406cb30 2023-07-24T05:47:23.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.685+0000 7f56ebfff700 1 --2- 172.21.15.77:0/994523551 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f56d40662f0 0x7f56d40687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:23.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.685+0000 7f56ebfff700 1 --2- 172.21.15.77:0/994523551 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f56d40662f0 0x7f56d40687b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f56f40c84a0 tx=0x7f56dc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:23.694 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.689+0000 7f56f17fa700 1 -- 172.21.15.77:0/994523551 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f56e4052830 con 0x7f56f406cb30 2023-07-24T05:47:23.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.861+0000 7f56fa344700 1 -- 172.21.15.77:0/994523551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f56f40ac3c0 con 0x7f56f406cb30 2023-07-24T05:47:23.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.861+0000 7f56f17fa700 1 -- 172.21.15.77:0/994523551 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f56e4055e50 con 0x7f56f406cb30 2023-07-24T05:47:23.869 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-07-24T05:47:23.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.869+0000 7f56fa344700 1 -- 172.21.15.77:0/994523551 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f56d40662f0 msgr2=0x7f56d40687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:23.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.869+0000 7f56fa344700 1 --2- 172.21.15.77:0/994523551 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f56d40662f0 0x7f56d40687b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f56f40c84a0 tx=0x7f56dc009040 comp rx=0 tx=0).stop 2023-07-24T05:47:23.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.869+0000 7f56fa344700 1 -- 172.21.15.77:0/994523551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56f406cb30 msgr2=0x7f56f415a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:23.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.869+0000 7f56fa344700 1 --2- 172.21.15.77:0/994523551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56f406cb30 0x7f56f415a6b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f56e4009c60 tx=0x7f56e4004770 comp rx=0 tx=0).stop 2023-07-24T05:47:23.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.869+0000 7f56fa344700 1 -- 172.21.15.77:0/994523551 shutdown_connections 2023-07-24T05:47:23.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.869+0000 7f56fa344700 1 --2- 172.21.15.77:0/994523551 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56f41600c0 0x7f56f40c1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:23.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.869+0000 7f56fa344700 1 --2- 172.21.15.77:0/994523551 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f56d40662f0 0x7f56d40687b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:23.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.869+0000 7f56fa344700 1 --2- 172.21.15.77:0/994523551 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f56f40cdbd0 0x7f56f40c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:23.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.869+0000 7f56fa344700 1 --2- 172.21.15.77:0/994523551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f56f406cb30 0x7f56f415a6b0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:23.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.869+0000 7f56fa344700 1 -- 172.21.15.77:0/994523551 >> 172.21.15.77:0/994523551 conn(0x7f56f40ce440 msgr2=0x7f56f406b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:23.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.869+0000 7f56fa344700 1 -- 172.21.15.77:0/994523551 shutdown_connections 2023-07-24T05:47:23.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:23.869+0000 7f56fa344700 1 -- 172.21.15.77:0/994523551 wait complete. 2023-07-24T05:47:23.894 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-24T05:47:24.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.057+0000 7f30d969a700 1 Processor -- start 2023-07-24T05:47:24.064 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.057+0000 7f30d969a700 1 -- start start 2023-07-24T05:47:24.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.061+0000 7f30d969a700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f30d40d2200 0x7f30d40b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:24.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.061+0000 7f30d969a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f30d40b4630 0x7f30d40b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:24.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.061+0000 7f30d969a700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30d40d2640 con 0x7f30d415ca00 2023-07-24T05:47:24.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.061+0000 7f30d969a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30d40b4ac0 con 0x7f30d40b4630 2023-07-24T05:47:24.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.061+0000 7f30d969a700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30d40d0300 con 0x7f30d40d2200 2023-07-24T05:47:24.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.061+0000 7f30d3fff700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f30d415ca00 0x7f30d406d450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.77:43124/0 (socket says 172.21.15.77:43124) 2023-07-24T05:47:24.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.061+0000 7f30d3fff700 1 -- 172.21.15.77:0/1584442053 learned_addr learned my addr 172.21.15.77:0/1584442053 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:24.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.061+0000 7f30d8e99700 1 --2- 172.21.15.77:0/1584442053 >> v2:172.21.15.103:3300/0 conn(0x7f30d40b4630 0x7f30d40b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:24.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.061+0000 7f30d37fe700 1 --2- 172.21.15.77:0/1584442053 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f30d40d2200 0x7f30d40b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:24.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.065+0000 7f30d2ffd700 1 -- 172.21.15.77:0/1584442053 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3976457994 0 0) 0x7f30d40d2640 con 0x7f30d415ca00 2023-07-24T05:47:24.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.065+0000 7f30d2ffd700 1 -- 172.21.15.77:0/1584442053 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30bc0035d0 con 0x7f30d415ca00 2023-07-24T05:47:24.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.065+0000 7f30d8e99700 1 -- 172.21.15.77:0/1584442053 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f30d40d2200 msgr2=0x7f30d40b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:24.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.065+0000 7f30d8e99700 1 --2- 172.21.15.77:0/1584442053 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f30d40d2200 0x7f30d40b40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:24.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.065+0000 7f30d8e99700 1 -- 172.21.15.77:0/1584442053 >> v1:172.21.15.103:6789/0 conn(0x7f30d415ca00 legacy=0x7f30d406d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:24.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.065+0000 7f30d8e99700 1 -- 172.21.15.77:0/1584442053 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d415cde0 con 0x7f30d40b4630 2023-07-24T05:47:24.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.065+0000 7f30d8e99700 1 --2- 172.21.15.77:0/1584442053 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30d40b4630 0x7f30d40b11e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f30cc009d90 tx=0x7f30cc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1679027deb418b20 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:24.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.065+0000 7f30d2ffd700 1 -- 172.21.15.77:0/1584442053 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30cc00e070 con 0x7f30d40b4630 2023-07-24T05:47:24.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.065+0000 7f30d2ffd700 1 -- 172.21.15.77:0/1584442053 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30cc00bb20 con 0x7f30d40b4630 2023-07-24T05:47:24.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.065+0000 7f30d2ffd700 1 -- 172.21.15.77:0/1584442053 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30cc012430 con 0x7f30d40b4630 2023-07-24T05:47:24.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.065+0000 7f30d969a700 1 -- 172.21.15.77:0/1584442053 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30d40b4630 msgr2=0x7f30d40b11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:24.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.065+0000 7f30d969a700 1 --2- 172.21.15.77:0/1584442053 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30d40b4630 0x7f30d40b11e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f30cc009d90 tx=0x7f30cc00b330 comp rx=0 tx=0).stop 2023-07-24T05:47:24.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.065+0000 7f30d969a700 1 -- 172.21.15.77:0/1584442053 shutdown_connections 2023-07-24T05:47:24.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.065+0000 7f30d969a700 1 --2- 172.21.15.77:0/1584442053 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30d40b4630 0x7f30d40b11e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:24.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.065+0000 7f30d969a700 1 --2- 172.21.15.77:0/1584442053 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f30d40d2200 0x7f30d40b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:24.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.065+0000 7f30d969a700 1 -- 172.21.15.77:0/1584442053 >> 172.21.15.77:0/1584442053 conn(0x7f30d40b7610 msgr2=0x7f30d40b7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:24.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.065+0000 7f30d969a700 1 -- 172.21.15.77:0/1584442053 shutdown_connections 2023-07-24T05:47:24.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.065+0000 7f30d969a700 1 -- 172.21.15.77:0/1584442053 wait complete. 2023-07-24T05:47:24.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.069+0000 7f30d969a700 1 Processor -- start 2023-07-24T05:47:24.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.069+0000 7f30d969a700 1 -- start start 2023-07-24T05:47:24.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.069+0000 7f30d969a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30d40b4630 0x7f30d40c8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:24.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.069+0000 7f30d969a700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30d40d2200 0x7f30d40c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:24.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.069+0000 7f30d969a700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f30d415ca00 0x7f30d414dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:24.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.069+0000 7f30d969a700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d4155780 con 0x7f30d40b4630 2023-07-24T05:47:24.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.069+0000 7f30d969a700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d414e180 con 0x7f30d40d2200 2023-07-24T05:47:24.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.069+0000 7f30d969a700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30d40c7270 con 0x7f30d415ca00 2023-07-24T05:47:24.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.069+0000 7f30d3fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30d40b4630 0x7f30d40c8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:24.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.073+0000 7f30d3fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30d40b4630 0x7f30d40c8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41322/0 (socket says 172.21.15.77:41322) 2023-07-24T05:47:24.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.073+0000 7f30d3fff700 1 -- 172.21.15.77:0/1194078650 learned_addr learned my addr 172.21.15.77:0/1194078650 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:24.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.073+0000 7f30d37fe700 1 --2- 172.21.15.77:0/1194078650 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30d40d2200 0x7f30d40c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:24.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.073+0000 7f30d8e99700 1 --2- 172.21.15.77:0/1194078650 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f30d415ca00 0x7f30d414dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:24.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.073+0000 7f30d3fff700 1 -- 172.21.15.77:0/1194078650 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f30d415ca00 msgr2=0x7f30d414dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:24.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.073+0000 7f30d3fff700 1 --2- 172.21.15.77:0/1194078650 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f30d415ca00 0x7f30d414dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:24.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.073+0000 7f30d3fff700 1 -- 172.21.15.77:0/1194078650 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30d40d2200 msgr2=0x7f30d40c6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:24.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.073+0000 7f30d3fff700 1 --2- 172.21.15.77:0/1194078650 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30d40d2200 0x7f30d40c6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:24.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.073+0000 7f30d3fff700 1 -- 172.21.15.77:0/1194078650 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30cc009a70 con 0x7f30d40b4630 2023-07-24T05:47:24.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.073+0000 7f30d8e99700 1 --2- 172.21.15.77:0/1194078650 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f30d415ca00 0x7f30d414dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:24.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.073+0000 7f30d3fff700 1 --2- 172.21.15.77:0/1194078650 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30d40b4630 0x7f30d40c8bb0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f30c400c460 tx=0x7f30c400c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:24.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.073+0000 7f30d0ff9700 1 -- 172.21.15.77:0/1194078650 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c4005de0 con 0x7f30d40b4630 2023-07-24T05:47:24.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.073+0000 7f30d0ff9700 1 -- 172.21.15.77:0/1194078650 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c40070d0 con 0x7f30d40b4630 2023-07-24T05:47:24.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.073+0000 7f30d969a700 1 -- 172.21.15.77:0/1194078650 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30d40c7550 con 0x7f30d40b4630 2023-07-24T05:47:24.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.073+0000 7f30d0ff9700 1 -- 172.21.15.77:0/1194078650 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c4007460 con 0x7f30d40b4630 2023-07-24T05:47:24.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.073+0000 7f30d969a700 1 -- 172.21.15.77:0/1194078650 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30d40c7b10 con 0x7f30d40b4630 2023-07-24T05:47:24.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.073+0000 7f30d969a700 1 -- 172.21.15.77:0/1194078650 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30d4072490 con 0x7f30d40b4630 2023-07-24T05:47:24.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.077+0000 7f30d0ff9700 1 -- 172.21.15.77:0/1194078650 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f30c40075c0 con 0x7f30d40b4630 2023-07-24T05:47:24.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.081+0000 7f30d0ff9700 1 --2- 172.21.15.77:0/1194078650 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f30c00662f0 0x7f30c00687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:24.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.081+0000 7f30d0ff9700 1 -- 172.21.15.77:0/1194078650 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f30c4083550 con 0x7f30d40b4630 2023-07-24T05:47:24.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.081+0000 7f30d37fe700 1 --2- 172.21.15.77:0/1194078650 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f30c00662f0 0x7f30c00687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:24.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.081+0000 7f30d37fe700 1 --2- 172.21.15.77:0/1194078650 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f30c00662f0 0x7f30c00687b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f30d41612b0 tx=0x7f30c8009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:24.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.085+0000 7f30d0ff9700 1 -- 172.21.15.77:0/1194078650 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f30c4050600 con 0x7f30d40b4630 2023-07-24T05:47:24.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.273+0000 7f30d969a700 1 -- 172.21.15.77:0/1194078650 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f30d40d33c0 con 0x7f30d40b4630 2023-07-24T05:47:24.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.273+0000 7f30d0ff9700 1 -- 172.21.15.77:0/1194078650 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f30c4053c20 con 0x7f30d40b4630 2023-07-24T05:47:24.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.277+0000 7f30d969a700 1 -- 172.21.15.77:0/1194078650 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f30c00662f0 msgr2=0x7f30c00687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:24.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.277+0000 7f30d969a700 1 --2- 172.21.15.77:0/1194078650 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f30c00662f0 0x7f30c00687b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f30d41612b0 tx=0x7f30c8009240 comp rx=0 tx=0).stop 2023-07-24T05:47:24.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.277+0000 7f30d969a700 1 -- 172.21.15.77:0/1194078650 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30d40b4630 msgr2=0x7f30d40c8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:24.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.277+0000 7f30d969a700 1 --2- 172.21.15.77:0/1194078650 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30d40b4630 0x7f30d40c8bb0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f30c400c460 tx=0x7f30c400c770 comp rx=0 tx=0).stop 2023-07-24T05:47:24.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.277+0000 7f30d969a700 1 -- 172.21.15.77:0/1194078650 shutdown_connections 2023-07-24T05:47:24.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.277+0000 7f30d969a700 1 --2- 172.21.15.77:0/1194078650 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f30c00662f0 0x7f30c00687b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:24.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.277+0000 7f30d969a700 1 --2- 172.21.15.77:0/1194078650 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f30d415ca00 0x7f30d414dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:24.282 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.277+0000 7f30d969a700 1 --2- 172.21.15.77:0/1194078650 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f30d40d2200 0x7f30d40c6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:24.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.277+0000 7f30d969a700 1 --2- 172.21.15.77:0/1194078650 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30d40b4630 0x7f30d40c8bb0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:24.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.277+0000 7f30d969a700 1 -- 172.21.15.77:0/1194078650 >> 172.21.15.77:0/1194078650 conn(0x7f30d40b7610 msgr2=0x7f30d40d0690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:24.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.277+0000 7f30d969a700 1 -- 172.21.15.77:0/1194078650 shutdown_connections 2023-07-24T05:47:24.283 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.277+0000 7f30d969a700 1 -- 172.21.15.77:0/1194078650 wait complete. 2023-07-24T05:47:24.285 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2023-07-24T05:47:24.305 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-07-24T05:47:24.305 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-24T05:47:24.320 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-24T05:47:24.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.529+0000 7f00c67bf700 1 Processor -- start 2023-07-24T05:47:24.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.529+0000 7f00c67bf700 1 -- start start 2023-07-24T05:47:24.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.533+0000 7f00c67bf700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00c0161030 0x7f00c00c13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:24.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.533+0000 7f00c67bf700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f00c00cac90 0x7f00c00c1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:24.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.533+0000 7f00c67bf700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00c006b810 con 0x7f00c0069ef0 2023-07-24T05:47:24.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.533+0000 7f00c67bf700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00c006ccb0 con 0x7f00c00cac90 2023-07-24T05:47:24.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.533+0000 7f00c67bf700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c00cb230 con 0x7f00c0161030 2023-07-24T05:47:24.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.533+0000 7f00c4d5c700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f00c00cac90 0x7f00c00c1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:24.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.533+0000 7f00b77fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f00c0069ef0 0x7f00c0164b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.77:43128/0 (socket says 172.21.15.77:43128) 2023-07-24T05:47:24.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.533+0000 7f00b77fe700 1 -- 172.21.15.77:0/4034014925 learned_addr learned my addr 172.21.15.77:0/4034014925 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:24.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.533+0000 7f00bffff700 1 --2- 172.21.15.77:0/4034014925 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00c0161030 0x7f00c00c13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:24.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.533+0000 7f00c4d5c700 1 -- 172.21.15.77:0/4034014925 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00c0161030 msgr2=0x7f00c00c13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:24.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.533+0000 7f00c4d5c700 1 --2- 172.21.15.77:0/4034014925 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00c0161030 0x7f00c00c13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:24.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.533+0000 7f00c4d5c700 1 -- 172.21.15.77:0/4034014925 >> v1:172.21.15.103:6789/0 conn(0x7f00c0069ef0 legacy=0x7f00c0164b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:24.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.533+0000 7f00c4d5c700 1 -- 172.21.15.77:0/4034014925 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c00cb510 con 0x7f00c00cac90 2023-07-24T05:47:24.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.533+0000 7f00bf7fe700 1 -- 172.21.15.77:0/4034014925 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3064404994 0 0) 0x7f00c006b810 con 0x7f00c0069ef0 2023-07-24T05:47:24.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.533+0000 7f00c4d5c700 1 --2- 172.21.15.77:0/4034014925 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00c00cac90 0x7f00c00c1920 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f00b8009850 tx=0x7f00b8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=365899a28c3b4b84 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:24.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.533+0000 7f00bf7fe700 1 -- 172.21.15.77:0/4034014925 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b8011830 con 0x7f00c00cac90 2023-07-24T05:47:24.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.533+0000 7f00bf7fe700 1 -- 172.21.15.77:0/4034014925 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b8011990 con 0x7f00c00cac90 2023-07-24T05:47:24.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.533+0000 7f00bf7fe700 1 -- 172.21.15.77:0/4034014925 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b8011d20 con 0x7f00c00cac90 2023-07-24T05:47:24.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.537+0000 7f00c67bf700 1 -- 172.21.15.77:0/4034014925 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00c00cac90 msgr2=0x7f00c00c1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:24.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.537+0000 7f00c67bf700 1 --2- 172.21.15.77:0/4034014925 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00c00cac90 0x7f00c00c1920 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f00b8009850 tx=0x7f00b8009b60 comp rx=0 tx=0).stop 2023-07-24T05:47:24.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.537+0000 7f00c67bf700 1 -- 172.21.15.77:0/4034014925 shutdown_connections 2023-07-24T05:47:24.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.537+0000 7f00c67bf700 1 --2- 172.21.15.77:0/4034014925 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00c00cac90 0x7f00c00c1920 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:24.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.537+0000 7f00c67bf700 1 --2- 172.21.15.77:0/4034014925 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00c0161030 0x7f00c00c13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:24.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.537+0000 7f00c67bf700 1 -- 172.21.15.77:0/4034014925 >> 172.21.15.77:0/4034014925 conn(0x7f00c00ce410 msgr2=0x7f00c00ce7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:24.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.537+0000 7f00c67bf700 1 -- 172.21.15.77:0/4034014925 shutdown_connections 2023-07-24T05:47:24.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.537+0000 7f00c67bf700 1 -- 172.21.15.77:0/4034014925 wait complete. 2023-07-24T05:47:24.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.541+0000 7f00c67bf700 1 Processor -- start 2023-07-24T05:47:24.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.541+0000 7f00c67bf700 1 -- start start 2023-07-24T05:47:24.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.541+0000 7f00c67bf700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00c0069ef0 0x7f00c00c6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:24.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.541+0000 7f00c67bf700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00c00cac90 0x7f00c015f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:24.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.541+0000 7f00c67bf700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00c0161030 0x7f00c01574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:24.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.541+0000 7f00c67bf700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c00c71e0 con 0x7f00c00cac90 2023-07-24T05:47:24.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.541+0000 7f00c67bf700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c00c74c0 con 0x7f00c0069ef0 2023-07-24T05:47:24.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.541+0000 7f00c67bf700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c00c77a0 con 0x7f00c0161030 2023-07-24T05:47:24.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.541+0000 7f00b77fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00c00cac90 0x7f00c015f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:24.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.541+0000 7f00bffff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00c0069ef0 0x7f00c00c6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:24.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.541+0000 7f00b77fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00c00cac90 0x7f00c015f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41332/0 (socket says 172.21.15.77:41332) 2023-07-24T05:47:24.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.541+0000 7f00b77fe700 1 -- 172.21.15.77:0/3752584262 learned_addr learned my addr 172.21.15.77:0/3752584262 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:24.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.541+0000 7f00c4d5c700 1 --2- 172.21.15.77:0/3752584262 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00c0161030 0x7f00c01574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:24.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.545+0000 7f00bffff700 1 -- 172.21.15.77:0/3752584262 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00c0161030 msgr2=0x7f00c01574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:24.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.545+0000 7f00bffff700 1 --2- 172.21.15.77:0/3752584262 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00c0161030 0x7f00c01574a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:24.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.545+0000 7f00bffff700 1 -- 172.21.15.77:0/3752584262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00c00cac90 msgr2=0x7f00c015f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:24.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.545+0000 7f00bffff700 1 --2- 172.21.15.77:0/3752584262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00c00cac90 0x7f00c015f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:24.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.545+0000 7f00bffff700 1 -- 172.21.15.77:0/3752584262 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b80094b0 con 0x7f00c0069ef0 2023-07-24T05:47:24.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.545+0000 7f00b77fe700 1 --2- 172.21.15.77:0/3752584262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00c00cac90 0x7f00c015f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:47:24.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.545+0000 7f00bffff700 1 --2- 172.21.15.77:0/3752584262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00c0069ef0 0x7f00c00c6b60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f00b000d5a0 tx=0x7f00b000d8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:24.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.545+0000 7f00bd7fa700 1 -- 172.21.15.77:0/3752584262 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b0005c50 con 0x7f00c0069ef0 2023-07-24T05:47:24.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.545+0000 7f00bd7fa700 1 -- 172.21.15.77:0/3752584262 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b0005db0 con 0x7f00c0069ef0 2023-07-24T05:47:24.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.545+0000 7f00bd7fa700 1 -- 172.21.15.77:0/3752584262 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b0006290 con 0x7f00c0069ef0 2023-07-24T05:47:24.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.545+0000 7f00c67bf700 1 -- 172.21.15.77:0/3752584262 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00c00c7a80 con 0x7f00c0069ef0 2023-07-24T05:47:24.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.545+0000 7f00c67bf700 1 -- 172.21.15.77:0/3752584262 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00c0158800 con 0x7f00c0069ef0 2023-07-24T05:47:24.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.545+0000 7f00c67bf700 1 -- 172.21.15.77:0/3752584262 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00c00c7fa0 con 0x7f00c0069ef0 2023-07-24T05:47:24.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.549+0000 7f00bd7fa700 1 -- 172.21.15.77:0/3752584262 <== mon.1 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f00b00063f0 con 0x7f00c0069ef0 2023-07-24T05:47:24.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.553+0000 7f00bd7fa700 1 --2- 172.21.15.77:0/3752584262 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f00a0066370 0x7f00a0068830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:24.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.553+0000 7f00bd7fa700 1 -- 172.21.15.77:0/3752584262 <== mon.1 v2:172.21.15.103:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f00b0083cc0 con 0x7f00c0069ef0 2023-07-24T05:47:24.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.553+0000 7f00b77fe700 1 --2- 172.21.15.77:0/3752584262 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f00a0066370 0x7f00a0068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:24.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.553+0000 7f00b77fe700 1 --2- 172.21.15.77:0/3752584262 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f00a0066370 0x7f00a0068830 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f00c015fc30 tx=0x7f00a8007180 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:24.566 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.561+0000 7f00bd7fa700 1 -- 172.21.15.77:0/3752584262 <== mon.1 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f00c00c7fa0 con 0x7f00c0069ef0 2023-07-24T05:47:24.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.733+0000 7f00c67bf700 1 -- 172.21.15.77:0/3752584262 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00c00c7fa0 con 0x7f00c0069ef0 2023-07-24T05:47:24.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.737+0000 7f00bd7fa700 1 -- 172.21.15.77:0/3752584262 <== mon.1 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20204 (secure 0 0 0) 0x7f00c00c7fa0 con 0x7f00c0069ef0 2023-07-24T05:47:24.744 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:47:24.744 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":27,"fsid":"5aed5f7b-fb55-4d95-9c02-c6adbb1677b4","created":"2023-07-24T05:45:39.639731+0000","modified":"2023-07-24T05:46:48.442117+0000","last_up_change":"2023-07-24T05:45:52.319670+0000","last_in_change":"2023-07-24T05:45:43.643277+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-24T05:45:52.610430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-24T05:45:52.773787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-24T05:45:58.121732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-24T05:45:59.368726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-24T05:46:03.032057+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ffa0d496-461a-4053-b764-0627d969521b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6812","nonce":825987196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6817","nonce":825987196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6831","nonce":825987196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6824","nonce":825987196}]},"public_addr":"172.21.15.77:6812/825987196","cluster_addr":"172.21.15.77:6817/825987196","heartbeat_back_addr":"172.21.15.77:6831/825987196","heartbeat_front_addr":"172.21.15.77:6824/825987196","state":["exists","up"]},{"osd":1,"uuid":"9f595e5e-5c43-49bc-8ce4-ee70575c90da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6801","nonce":4133026815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6803","nonce":4133026815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6807","nonce":4133026815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6805","nonce":4133026815}]},"public_addr":"172.21.15.77:6801/4133026815","cluster_addr":"172.21.15.77:6803/4133026815","heartbeat_back_addr":"172.21.15.77:6807/4133026815","heartbeat_front_addr":"172.21.15.77:6805/4133026815","state":["exists","up"]},{"osd":2,"uuid":"2ac177aa-4d7d-4262-bd54-d2b9f29f4c3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6811","nonce":2394142159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6819","nonce":2394142159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6830","nonce":2394142159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6825","nonce":2394142159}]},"public_addr":"172.21.15.77:6811/2394142159","cluster_addr":"172.21.15.77:6819/2394142159","heartbeat_back_addr":"172.21.15.77:6830/2394142159","heartbeat_front_addr":"172.21.15.77:6825/2394142159","state":["exists","up"]},{"osd":3,"uuid":"17d7a251-19e8-484c-8172-a578ab3da153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6813","nonce":1492113982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6818","nonce":1492113982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6829","nonce":1492113982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6823","nonce":1492113982}]},"public_addr":"172.21.15.77:6813/1492113982","cluster_addr":"172.21.15.77:6818/1492113982","heartbeat_back_addr":"172.21.15.77:6829/1492113982","heartbeat_front_addr":"172.21.15.77:6823/1492113982","state":["exists","up"]},{"osd":4,"uuid":"bf63ca05-f06d-4e0f-ac44-2a416c70b919","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6825","nonce":1080481057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6827","nonce":1080481057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6831","nonce":1080481057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6829","nonce":1080481057}]},"public_addr":"172.21.15.103:6825/1080481057","cluster_addr":"172.21.15.103:6827/1080481057","heartbeat_back_addr":"172.21.15.103:6831/1080481057","heartbeat_front_addr":"172.21.15.103:6829/1080481057","state":["exists","up"]},{"osd":5,"uuid":"65a11a35-9e9f-4b3c-9fe3-b658d62b9318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6811","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6813","nonce":2756677504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6818","nonce":2756677504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6823","nonce":2756677504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6821","nonce":2756677504}]},"public_addr":"172.21.15.103:6813/2756677504","cluster_addr":"172.21.15.103:6818/2756677504","heartbeat_back_addr":"172.21.15.103:6823/2756677504","heartbeat_front_addr":"172.21.15.103:6821/2756677504","state":["exists","up"]},{"osd":6,"uuid":"750c1f87-686c-40b4-94a1-1a299dc78f3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6809","nonce":568977764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6812","nonce":568977764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6819","nonce":568977764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6815","nonce":568977764}]},"public_addr":"172.21.15.103:6809/568977764","cluster_addr":"172.21.15.103:6812/568977764","heartbeat_back_addr":"172.21.15.103:6819/568977764","heartbeat_front_addr":"172.21.15.103:6815/568977764","state":["exists","up"]},{"osd":7,"uuid":"d5fe4fb6-2e09-4158-885b-403803c85822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6801","nonce":1074557176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6803","nonce":1074557176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6807","nonce":1074557176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6805","nonce":1074557176}]},"public_addr":"172.21.15.103:6801/1074557176","cluster_addr":"172.21.15.103:6803/1074557176","heartbeat_back_addr":"172.21.15.103:6807/1074557176","heartbeat_front_addr":"172.21.15.103:6805/1074557176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.631032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.154109+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.398587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.679089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.311218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.353726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.314372+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.126212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1d","mappings":[{"from":3,"to":2}]},{"pgid":"4.31","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-24T05:47:24.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.741+0000 7f00c67bf700 1 -- 172.21.15.77:0/3752584262 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f00a0066370 msgr2=0x7f00a0068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:24.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.741+0000 7f00c67bf700 1 --2- 172.21.15.77:0/3752584262 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f00a0066370 0x7f00a0068830 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f00c015fc30 tx=0x7f00a8007180 comp rx=0 tx=0).stop 2023-07-24T05:47:24.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.741+0000 7f00c67bf700 1 -- 172.21.15.77:0/3752584262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00c0069ef0 msgr2=0x7f00c00c6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:24.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.741+0000 7f00c67bf700 1 --2- 172.21.15.77:0/3752584262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00c0069ef0 0x7f00c00c6b60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f00b000d5a0 tx=0x7f00b000d8b0 comp rx=0 tx=0).stop 2023-07-24T05:47:24.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.741+0000 7f00c67bf700 1 -- 172.21.15.77:0/3752584262 shutdown_connections 2023-07-24T05:47:24.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.741+0000 7f00c67bf700 1 --2- 172.21.15.77:0/3752584262 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f00a0066370 0x7f00a0068830 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:24.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.741+0000 7f00c67bf700 1 --2- 172.21.15.77:0/3752584262 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00c0161030 0x7f00c01574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:24.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.741+0000 7f00c67bf700 1 --2- 172.21.15.77:0/3752584262 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00c00cac90 0x7f00c015f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:24.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.741+0000 7f00c67bf700 1 --2- 172.21.15.77:0/3752584262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00c0069ef0 0x7f00c00c6b60 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:24.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.741+0000 7f00c67bf700 1 -- 172.21.15.77:0/3752584262 >> 172.21.15.77:0/3752584262 conn(0x7f00c00ce410 msgr2=0x7f00c006fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:24.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.741+0000 7f00c67bf700 1 -- 172.21.15.77:0/3752584262 shutdown_connections 2023-07-24T05:47:24.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.741+0000 7f00c67bf700 1 -- 172.21.15.77:0/3752584262 wait complete. 2023-07-24T05:47:24.770 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-24T05:45:52.610430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-24T05:45:52.773787+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-24T05:45:58.121732+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-24T05:45:59.368726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-24T05:46:03.032057+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-24T05:47:24.771 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-24T05:47:24.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.937+0000 7f809f5e6700 1 Processor -- start 2023-07-24T05:47:24.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.937+0000 7f809f5e6700 1 -- start start 2023-07-24T05:47:24.944 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:47:24.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.937+0000 7f809f5e6700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f809806b1c0 0x7f80980cd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:24.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.937+0000 7f809f5e6700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8098069d20 con 0x7f8098161140 2023-07-24T05:47:24.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.937+0000 7f809f5e6700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80980cd980 con 0x7f80980c1b20 2023-07-24T05:47:24.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.937+0000 7f809f5e6700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80980cdc60 con 0x7f809806b1c0 2023-07-24T05:47:24.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.941+0000 7f809db83700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f809806b1c0 0x7f80980cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:24.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.941+0000 7f809d382700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f8098161140 0x7f80980c1410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:60280/0 (socket says 172.21.15.77:60280) 2023-07-24T05:47:24.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.941+0000 7f809d382700 1 -- 172.21.15.77:0/1298066282 learned_addr learned my addr 172.21.15.77:0/1298066282 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:24.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.941+0000 7f809db83700 1 -- 172.21.15.77:0/1298066282 >> v1:172.21.15.103:6789/0 conn(0x7f80980c1b20 legacy=0x7f80980ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:24.953 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:47:24.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.941+0000 7f809db83700 1 -- 172.21.15.77:0/1298066282 >> v1:172.21.15.77:6789/0 conn(0x7f8098161140 legacy=0x7f80980c1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:24.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.941+0000 7f809db83700 1 -- 172.21.15.77:0/1298066282 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80980cdf40 con 0x7f809806b1c0 2023-07-24T05:47:24.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.941+0000 7f809db83700 1 --2- 172.21.15.77:0/1298066282 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f809806b1c0 0x7f80980cd300 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8090009d90 tx=0x7f809000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=415ef0d67ab0699 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:24.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.941+0000 7f808ffff700 1 -- 172.21.15.77:0/1298066282 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809000e070 con 0x7f809806b1c0 2023-07-24T05:47:24.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.941+0000 7f808ffff700 1 -- 172.21.15.77:0/1298066282 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809000bbd0 con 0x7f809806b1c0 2023-07-24T05:47:24.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.941+0000 7f808ffff700 1 -- 172.21.15.77:0/1298066282 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8090012430 con 0x7f809806b1c0 2023-07-24T05:47:24.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.941+0000 7f809f5e6700 1 -- 172.21.15.77:0/1298066282 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f809806b1c0 msgr2=0x7f80980cd300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:24.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.941+0000 7f809f5e6700 1 --2- 172.21.15.77:0/1298066282 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f809806b1c0 0x7f80980cd300 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8090009d90 tx=0x7f809000b330 comp rx=0 tx=0).stop 2023-07-24T05:47:24.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.941+0000 7f809f5e6700 1 -- 172.21.15.77:0/1298066282 shutdown_connections 2023-07-24T05:47:24.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.941+0000 7f809f5e6700 1 --2- 172.21.15.77:0/1298066282 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f809806b1c0 0x7f80980cd300 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:24.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.941+0000 7f809f5e6700 1 -- 172.21.15.77:0/1298066282 >> 172.21.15.77:0/1298066282 conn(0x7f80980ce440 msgr2=0x7f80980ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:24.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.945+0000 7f809f5e6700 1 -- 172.21.15.77:0/1298066282 shutdown_connections 2023-07-24T05:47:24.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.945+0000 7f809f5e6700 1 -- 172.21.15.77:0/1298066282 wait complete. 2023-07-24T05:47:24.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.949+0000 7f809f5e6700 1 Processor -- start 2023-07-24T05:47:24.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.949+0000 7f809f5e6700 1 -- start start 2023-07-24T05:47:24.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.949+0000 7f809f5e6700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f809806b1c0 0x7f80981581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:24.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.949+0000 7f809f5e6700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80980c1b20 0x7f80981572a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:24.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.949+0000 7f809f5e6700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8098161140 0x7f8098154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:24.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.949+0000 7f809f5e6700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80981540b0 con 0x7f80980c1b20 2023-07-24T05:47:24.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.949+0000 7f809f5e6700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8098158730 con 0x7f809806b1c0 2023-07-24T05:47:24.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.949+0000 7f809f5e6700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8098153dd0 con 0x7f8098161140 2023-07-24T05:47:24.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.949+0000 7f809cb81700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80980c1b20 0x7f80981572a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:24.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.949+0000 7f809cb81700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80980c1b20 0x7f80981572a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41360/0 (socket says 172.21.15.77:41360) 2023-07-24T05:47:24.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.949+0000 7f809cb81700 1 -- 172.21.15.77:0/1471167257 learned_addr learned my addr 172.21.15.77:0/1471167257 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:24.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.949+0000 7f809d382700 1 --2- 172.21.15.77:0/1471167257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f809806b1c0 0x7f80981581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:24.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.949+0000 7f809db83700 1 --2- 172.21.15.77:0/1471167257 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8098161140 0x7f8098154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:24.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.949+0000 7f809cb81700 1 -- 172.21.15.77:0/1471167257 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8098161140 msgr2=0x7f8098154260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:24.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.949+0000 7f809cb81700 1 --2- 172.21.15.77:0/1471167257 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8098161140 0x7f8098154260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:24.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.949+0000 7f809cb81700 1 -- 172.21.15.77:0/1471167257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f809806b1c0 msgr2=0x7f80981581f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:24.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.949+0000 7f809cb81700 1 --2- 172.21.15.77:0/1471167257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f809806b1c0 0x7f80981581f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:24.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.949+0000 7f809cb81700 1 -- 172.21.15.77:0/1471167257 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8090009a70 con 0x7f80980c1b20 2023-07-24T05:47:24.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.949+0000 7f809cb81700 1 --2- 172.21.15.77:0/1471167257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80980c1b20 0x7f80981572a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f808800c500 tx=0x7f808800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:24.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.953+0000 7f808dffb700 1 -- 172.21.15.77:0/1471167257 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80880052d0 con 0x7f80980c1b20 2023-07-24T05:47:24.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.953+0000 7f808dffb700 1 -- 172.21.15.77:0/1471167257 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8088005430 con 0x7f80980c1b20 2023-07-24T05:47:24.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.953+0000 7f809f5e6700 1 -- 172.21.15.77:0/1471167257 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80981567c0 con 0x7f80980c1b20 2023-07-24T05:47:24.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.953+0000 7f808dffb700 1 -- 172.21.15.77:0/1471167257 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80880055a0 con 0x7f80980c1b20 2023-07-24T05:47:24.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.953+0000 7f809f5e6700 1 -- 172.21.15.77:0/1471167257 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8098156d80 con 0x7f80980c1b20 2023-07-24T05:47:24.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.953+0000 7f809f5e6700 1 -- 172.21.15.77:0/1471167257 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8098156620 con 0x7f80980c1b20 2023-07-24T05:47:24.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.953+0000 7f808dffb700 1 -- 172.21.15.77:0/1471167257 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f80880038e0 con 0x7f80980c1b20 2023-07-24T05:47:24.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.957+0000 7f808dffb700 1 --2- 172.21.15.77:0/1471167257 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f807c0662f0 0x7f807c0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:24.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.957+0000 7f808dffb700 1 -- 172.21.15.77:0/1471167257 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8088083480 con 0x7f80980c1b20 2023-07-24T05:47:24.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.957+0000 7f809d382700 1 --2- 172.21.15.77:0/1471167257 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f807c0662f0 0x7f807c0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:24.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.957+0000 7f809d382700 1 --2- 172.21.15.77:0/1471167257 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f807c0662f0 0x7f807c0687b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8094005930 tx=0x7f8094007ec0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:24.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:24.961+0000 7f808dffb700 1 -- 172.21.15.77:0/1471167257 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8098156620 con 0x7f80980c1b20 2023-07-24T05:47:25.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.137+0000 7f809f5e6700 1 -- 172.21.15.77:0/1471167257 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8098156620 con 0x7f80980c1b20 2023-07-24T05:47:25.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.137+0000 7f808dffb700 1 -- 172.21.15.77:0/1471167257 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8098156620 con 0x7f80980c1b20 2023-07-24T05:47:25.145 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-07-24T05:47:25.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.141+0000 7f809f5e6700 1 -- 172.21.15.77:0/1471167257 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f807c0662f0 msgr2=0x7f807c0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:25.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.141+0000 7f809f5e6700 1 --2- 172.21.15.77:0/1471167257 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f807c0662f0 0x7f807c0687b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8094005930 tx=0x7f8094007ec0 comp rx=0 tx=0).stop 2023-07-24T05:47:25.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.141+0000 7f809f5e6700 1 -- 172.21.15.77:0/1471167257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80980c1b20 msgr2=0x7f80981572a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:25.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.141+0000 7f809f5e6700 1 --2- 172.21.15.77:0/1471167257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80980c1b20 0x7f80981572a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f808800c500 tx=0x7f808800c810 comp rx=0 tx=0).stop 2023-07-24T05:47:25.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.141+0000 7f809f5e6700 1 -- 172.21.15.77:0/1471167257 shutdown_connections 2023-07-24T05:47:25.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.141+0000 7f809f5e6700 1 --2- 172.21.15.77:0/1471167257 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f807c0662f0 0x7f807c0687b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:25.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.141+0000 7f809f5e6700 1 --2- 172.21.15.77:0/1471167257 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8098161140 0x7f8098154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:25.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.141+0000 7f809f5e6700 1 --2- 172.21.15.77:0/1471167257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f80980c1b20 0x7f80981572a0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:25.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.141+0000 7f809f5e6700 1 --2- 172.21.15.77:0/1471167257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f809806b1c0 0x7f80981581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:25.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.141+0000 7f809f5e6700 1 -- 172.21.15.77:0/1471167257 >> 172.21.15.77:0/1471167257 conn(0x7f80980ce440 msgr2=0x7f80980cae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:25.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.141+0000 7f809f5e6700 1 -- 172.21.15.77:0/1471167257 shutdown_connections 2023-07-24T05:47:25.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.141+0000 7f809f5e6700 1 -- 172.21.15.77:0/1471167257 wait complete. 2023-07-24T05:47:25.167 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-24T05:47:25.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.329+0000 7f7939ec4700 1 Processor -- start 2023-07-24T05:47:25.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.333+0000 7f7939ec4700 1 -- start start 2023-07-24T05:47:25.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.333+0000 7f7939ec4700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f79341611b0 0x7f79340ac380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:25.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.333+0000 7f7939ec4700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f793406d350 0x7f79340ab150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:25.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.333+0000 7f7939ec4700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79341616d0 con 0x7f79340c1230 2023-07-24T05:47:25.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.333+0000 7f7939ec4700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79340b1d10 con 0x7f79341611b0 2023-07-24T05:47:25.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.333+0000 7f7939ec4700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79341619b0 con 0x7f793406d350 2023-07-24T05:47:25.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.333+0000 7f7938ec2700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f79340c1230 0x7f79340c1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:60292/0 (socket says 172.21.15.77:60292) 2023-07-24T05:47:25.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.337+0000 7f7938ec2700 1 -- 172.21.15.77:0/1146247779 learned_addr learned my addr 172.21.15.77:0/1146247779 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:25.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.337+0000 7f792bfff700 1 --2- 172.21.15.77:0/1146247779 >> v2:172.21.15.103:3300/0 conn(0x7f79341611b0 0x7f79340ac380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:25.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.337+0000 7f79396c3700 1 --2- 172.21.15.77:0/1146247779 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f793406d350 0x7f79340ab150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:25.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.337+0000 7f792bfff700 1 -- 172.21.15.77:0/1146247779 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f793406d350 msgr2=0x7f79340ab150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:25.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.337+0000 7f792bfff700 1 --2- 172.21.15.77:0/1146247779 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f793406d350 0x7f79340ab150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:25.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.337+0000 7f792b7fe700 1 -- 172.21.15.77:0/1146247779 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3322127481 0 0) 0x7f79341616d0 con 0x7f79340c1230 2023-07-24T05:47:25.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.337+0000 7f792bfff700 1 -- 172.21.15.77:0/1146247779 >> v1:172.21.15.77:6789/0 conn(0x7f79340c1230 legacy=0x7f79340c1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:25.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.337+0000 7f792bfff700 1 -- 172.21.15.77:0/1146247779 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7934161c90 con 0x7f79341611b0 2023-07-24T05:47:25.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.337+0000 7f792bfff700 1 --2- 172.21.15.77:0/1146247779 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79341611b0 0x7f79340ac380 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7924009850 tx=0x7f7924009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66195ea47ec53a06 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:25.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.337+0000 7f792b7fe700 1 -- 172.21.15.77:0/1146247779 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7924011830 con 0x7f79341611b0 2023-07-24T05:47:25.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.337+0000 7f792b7fe700 1 -- 172.21.15.77:0/1146247779 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7924011990 con 0x7f79341611b0 2023-07-24T05:47:25.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.337+0000 7f792b7fe700 1 -- 172.21.15.77:0/1146247779 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7924011d40 con 0x7f79341611b0 2023-07-24T05:47:25.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.337+0000 7f7939ec4700 1 -- 172.21.15.77:0/1146247779 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79341611b0 msgr2=0x7f79340ac380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:25.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.337+0000 7f7939ec4700 1 --2- 172.21.15.77:0/1146247779 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79341611b0 0x7f79340ac380 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7924009850 tx=0x7f7924009b60 comp rx=0 tx=0).stop 2023-07-24T05:47:25.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.337+0000 7f7939ec4700 1 -- 172.21.15.77:0/1146247779 shutdown_connections 2023-07-24T05:47:25.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.337+0000 7f7939ec4700 1 --2- 172.21.15.77:0/1146247779 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f793406d350 0x7f79340ab150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:25.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.337+0000 7f7939ec4700 1 --2- 172.21.15.77:0/1146247779 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f79341611b0 0x7f79340ac380 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:25.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.337+0000 7f7939ec4700 1 -- 172.21.15.77:0/1146247779 >> 172.21.15.77:0/1146247779 conn(0x7f79340ce260 msgr2=0x7f79340ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:25.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.341+0000 7f7939ec4700 1 -- 172.21.15.77:0/1146247779 shutdown_connections 2023-07-24T05:47:25.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.341+0000 7f7939ec4700 1 -- 172.21.15.77:0/1146247779 wait complete. 2023-07-24T05:47:25.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.341+0000 7f7939ec4700 1 Processor -- start 2023-07-24T05:47:25.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.341+0000 7f7939ec4700 1 -- start start 2023-07-24T05:47:25.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.341+0000 7f7939ec4700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f793406d350 0x7f79340c1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:25.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.341+0000 7f7939ec4700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79340c1230 0x7f79341f6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:25.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.341+0000 7f7939ec4700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f79341611b0 0x7f79341f72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:25.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.341+0000 7f7939ec4700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79341f6740 con 0x7f79340c1230 2023-07-24T05:47:25.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.341+0000 7f7939ec4700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79340c6370 con 0x7f793406d350 2023-07-24T05:47:25.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.341+0000 7f7939ec4700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79341f77f0 con 0x7f79341611b0 2023-07-24T05:47:25.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.341+0000 7f792bfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79340c1230 0x7f79341f6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:25.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.345+0000 7f792bfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79340c1230 0x7f79341f6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41372/0 (socket says 172.21.15.77:41372) 2023-07-24T05:47:25.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.345+0000 7f792bfff700 1 -- 172.21.15.77:0/3459662570 learned_addr learned my addr 172.21.15.77:0/3459662570 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:25.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.345+0000 7f7938ec2700 1 --2- 172.21.15.77:0/3459662570 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f793406d350 0x7f79340c1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:25.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.345+0000 7f79396c3700 1 --2- 172.21.15.77:0/3459662570 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f79341611b0 0x7f79341f72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:25.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.345+0000 7f792bfff700 1 -- 172.21.15.77:0/3459662570 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f79341611b0 msgr2=0x7f79341f72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:25.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.345+0000 7f792bfff700 1 --2- 172.21.15.77:0/3459662570 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f79341611b0 0x7f79341f72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:25.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.345+0000 7f792bfff700 1 -- 172.21.15.77:0/3459662570 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f793406d350 msgr2=0x7f79340c1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:25.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.345+0000 7f792bfff700 1 --2- 172.21.15.77:0/3459662570 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f793406d350 0x7f79340c1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:25.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.345+0000 7f792bfff700 1 -- 172.21.15.77:0/3459662570 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79240094b0 con 0x7f79340c1230 2023-07-24T05:47:25.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.345+0000 7f7938ec2700 1 --2- 172.21.15.77:0/3459662570 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f793406d350 0x7f79340c1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:25.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.345+0000 7f792bfff700 1 --2- 172.21.15.77:0/3459662570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79340c1230 0x7f79341f6200 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f79240090b0 tx=0x7f7924004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:25.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.345+0000 7f79297fa700 1 -- 172.21.15.77:0/3459662570 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7924019ab0 con 0x7f79340c1230 2023-07-24T05:47:25.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.345+0000 7f79297fa700 1 -- 172.21.15.77:0/3459662570 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f792401e070 con 0x7f79340c1230 2023-07-24T05:47:25.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.345+0000 7f79297fa700 1 -- 172.21.15.77:0/3459662570 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7924019e50 con 0x7f79340c1230 2023-07-24T05:47:25.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.345+0000 7f7939ec4700 1 -- 172.21.15.77:0/3459662570 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79340c6a50 con 0x7f79340c1230 2023-07-24T05:47:25.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.345+0000 7f7939ec4700 1 -- 172.21.15.77:0/3459662570 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79340c5ad0 con 0x7f79340c1230 2023-07-24T05:47:25.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.345+0000 7f7939ec4700 1 -- 172.21.15.77:0/3459662570 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f793406bae0 con 0x7f79340c1230 2023-07-24T05:47:25.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.349+0000 7f79297fa700 1 -- 172.21.15.77:0/3459662570 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f792401a420 con 0x7f79340c1230 2023-07-24T05:47:25.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.349+0000 7f79297fa700 1 --2- 172.21.15.77:0/3459662570 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f79200662f0 0x7f79200687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:25.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.349+0000 7f79297fa700 1 -- 172.21.15.77:0/3459662570 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7924085180 con 0x7f79340c1230 2023-07-24T05:47:25.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.349+0000 7f7938ec2700 1 --2- 172.21.15.77:0/3459662570 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f79200662f0 0x7f79200687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:25.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.349+0000 7f7938ec2700 1 --2- 172.21.15.77:0/3459662570 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f79200662f0 0x7f79200687b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7930000f60 tx=0x7f7930007cc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:25.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.357+0000 7f79297fa700 1 -- 172.21.15.77:0/3459662570 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7924052240 con 0x7f79340c1230 2023-07-24T05:47:25.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.525+0000 7f7939ec4700 1 -- 172.21.15.77:0/3459662570 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7934072490 con 0x7f79340c1230 2023-07-24T05:47:25.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.525+0000 7f79297fa700 1 -- 172.21.15.77:0/3459662570 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7924055860 con 0x7f79340c1230 2023-07-24T05:47:25.532 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 8 2023-07-24T05:47:25.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.529+0000 7f7939ec4700 1 -- 172.21.15.77:0/3459662570 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f79200662f0 msgr2=0x7f79200687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:25.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.529+0000 7f7939ec4700 1 --2- 172.21.15.77:0/3459662570 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f79200662f0 0x7f79200687b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7930000f60 tx=0x7f7930007cc0 comp rx=0 tx=0).stop 2023-07-24T05:47:25.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.529+0000 7f7939ec4700 1 -- 172.21.15.77:0/3459662570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79340c1230 msgr2=0x7f79341f6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:25.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.529+0000 7f7939ec4700 1 --2- 172.21.15.77:0/3459662570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79340c1230 0x7f79341f6200 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f79240090b0 tx=0x7f7924004770 comp rx=0 tx=0).stop 2023-07-24T05:47:25.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.529+0000 7f7939ec4700 1 -- 172.21.15.77:0/3459662570 shutdown_connections 2023-07-24T05:47:25.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.529+0000 7f7939ec4700 1 --2- 172.21.15.77:0/3459662570 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f79200662f0 0x7f79200687b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:25.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.529+0000 7f7939ec4700 1 --2- 172.21.15.77:0/3459662570 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f79341611b0 0x7f79341f72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:25.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.529+0000 7f7939ec4700 1 --2- 172.21.15.77:0/3459662570 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f79340c1230 0x7f79341f6200 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:25.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.529+0000 7f7939ec4700 1 --2- 172.21.15.77:0/3459662570 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f793406d350 0x7f79340c1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:25.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.529+0000 7f7939ec4700 1 -- 172.21.15.77:0/3459662570 >> 172.21.15.77:0/3459662570 conn(0x7f79340ce260 msgr2=0x7f79340ccad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:25.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.529+0000 7f7939ec4700 1 -- 172.21.15.77:0/3459662570 shutdown_connections 2023-07-24T05:47:25.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.533+0000 7f7939ec4700 1 -- 172.21.15.77:0/3459662570 wait complete. 2023-07-24T05:47:25.558 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-24T05:47:25.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.733+0000 7fd7e6051700 1 Processor -- start 2023-07-24T05:47:25.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.733+0000 7fd7e6051700 1 -- start start 2023-07-24T05:47:25.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.737+0000 7fd7e6051700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd7e006afc0 0x7fd7e00b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:25.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.737+0000 7fd7e6051700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd7e00d2fc0 0x7fd7e00d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:25.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.737+0000 7fd7e6051700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e0160fa0 con 0x7fd7e015db20 2023-07-24T05:47:25.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.737+0000 7fd7e6051700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7e00d0360 con 0x7fd7e00d2fc0 2023-07-24T05:47:25.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.737+0000 7fd7e6051700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e00b20b0 con 0x7fd7e006afc0 2023-07-24T05:47:25.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.737+0000 7fd7dffff700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd7e00d2fc0 0x7fd7e00d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:25.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.737+0000 7fd7dffff700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fd7e00d2fc0 0x7fd7e00d1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41384/0 (socket says 172.21.15.77:41384) 2023-07-24T05:47:25.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.737+0000 7fd7dffff700 1 -- 172.21.15.77:0/3664938712 learned_addr learned my addr 172.21.15.77:0/3664938712 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:25.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.737+0000 7fd7df7fe700 1 --2- 172.21.15.77:0/3664938712 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd7e006afc0 0x7fd7e00b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:25.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.737+0000 7fd7dffff700 1 -- 172.21.15.77:0/3664938712 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd7e006afc0 msgr2=0x7fd7e00b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:25.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.737+0000 7fd7dffff700 1 --2- 172.21.15.77:0/3664938712 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd7e006afc0 0x7fd7e00b1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:25.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.737+0000 7fd7dffff700 1 -- 172.21.15.77:0/3664938712 >> v1:172.21.15.103:6789/0 conn(0x7fd7e015db20 legacy=0x7fd7e00d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:25.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.737+0000 7fd7dffff700 1 -- 172.21.15.77:0/3664938712 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e0160670 con 0x7fd7e00d2fc0 2023-07-24T05:47:25.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.737+0000 7fd7df7fe700 1 --2- 172.21.15.77:0/3664938712 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd7e006afc0 0x7fd7e00b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:25.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.737+0000 7fd7dffff700 1 --2- 172.21.15.77:0/3664938712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7e00d2fc0 0x7fd7e00d1520 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8009e50 tx=0x7fd7d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6074b7839bf3f1 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:25.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.737+0000 7fd7de7fc700 1 -- 172.21.15.77:0/3664938712 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d800e070 con 0x7fd7e00d2fc0 2023-07-24T05:47:25.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.737+0000 7fd7de7fc700 1 -- 172.21.15.77:0/3664938712 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d800b9c0 con 0x7fd7e00d2fc0 2023-07-24T05:47:25.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.737+0000 7fd7de7fc700 1 -- 172.21.15.77:0/3664938712 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d800bd70 con 0x7fd7e00d2fc0 2023-07-24T05:47:25.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.741+0000 7fd7e6051700 1 -- 172.21.15.77:0/3664938712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7e00d2fc0 msgr2=0x7fd7e00d1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:25.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.741+0000 7fd7e6051700 1 --2- 172.21.15.77:0/3664938712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7e00d2fc0 0x7fd7e00d1520 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8009e50 tx=0x7fd7d800b330 comp rx=0 tx=0).stop 2023-07-24T05:47:25.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.741+0000 7fd7e6051700 1 -- 172.21.15.77:0/3664938712 shutdown_connections 2023-07-24T05:47:25.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.741+0000 7fd7e6051700 1 --2- 172.21.15.77:0/3664938712 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7e00d2fc0 0x7fd7e00d1520 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:25.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.741+0000 7fd7e6051700 1 --2- 172.21.15.77:0/3664938712 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd7e006afc0 0x7fd7e00b1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:25.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.741+0000 7fd7e6051700 1 -- 172.21.15.77:0/3664938712 >> 172.21.15.77:0/3664938712 conn(0x7fd7e009bc20 msgr2=0x7fd7e00b7920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:25.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.741+0000 7fd7e6051700 1 -- 172.21.15.77:0/3664938712 shutdown_connections 2023-07-24T05:47:25.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.741+0000 7fd7e6051700 1 -- 172.21.15.77:0/3664938712 wait complete. 2023-07-24T05:47:25.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.741+0000 7fd7e6051700 1 Processor -- start 2023-07-24T05:47:25.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.741+0000 7fd7e6051700 1 -- start start 2023-07-24T05:47:25.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.745+0000 7fd7e6051700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7e006afc0 0x7fd7e01562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:25.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.745+0000 7fd7e6051700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd7e00d2fc0 0x7fd7e01e78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:25.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.745+0000 7fd7e6051700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7e015db20 0x7fd7e00b0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:25.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.745+0000 7fd7e6051700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e01e8170 con 0x7fd7e006afc0 2023-07-24T05:47:25.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.745+0000 7fd7e6051700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e00b2440 con 0x7fd7e015db20 2023-07-24T05:47:25.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.745+0000 7fd7e6051700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e00b2720 con 0x7fd7e00d2fc0 2023-07-24T05:47:25.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.745+0000 7fd7df7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7e006afc0 0x7fd7e01562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:25.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.745+0000 7fd7df7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7e006afc0 0x7fd7e01562d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41398/0 (socket says 172.21.15.77:41398) 2023-07-24T05:47:25.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.745+0000 7fd7df7fe700 1 -- 172.21.15.77:0/2464845268 learned_addr learned my addr 172.21.15.77:0/2464845268 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:25.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.745+0000 7fd7deffd700 1 --2- 172.21.15.77:0/2464845268 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd7e00d2fc0 0x7fd7e01e78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:25.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.745+0000 7fd7dffff700 1 --2- 172.21.15.77:0/2464845268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7e015db20 0x7fd7e00b0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:25.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.745+0000 7fd7df7fe700 1 -- 172.21.15.77:0/2464845268 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd7e00d2fc0 msgr2=0x7fd7e01e78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:25.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.745+0000 7fd7df7fe700 1 --2- 172.21.15.77:0/2464845268 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd7e00d2fc0 0x7fd7e01e78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:25.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.745+0000 7fd7df7fe700 1 -- 172.21.15.77:0/2464845268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7e015db20 msgr2=0x7fd7e00b0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:25.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.745+0000 7fd7df7fe700 1 --2- 172.21.15.77:0/2464845268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7e015db20 0x7fd7e00b0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:25.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.745+0000 7fd7df7fe700 1 -- 172.21.15.77:0/2464845268 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d8009b30 con 0x7fd7e006afc0 2023-07-24T05:47:25.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.745+0000 7fd7df7fe700 1 --2- 172.21.15.77:0/2464845268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7e006afc0 0x7fd7e01562d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd7d000e760 tx=0x7fd7d000ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:25.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.745+0000 7fd7c7fff700 1 -- 172.21.15.77:0/2464845268 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d000c070 con 0x7fd7e006afc0 2023-07-24T05:47:25.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.745+0000 7fd7c7fff700 1 -- 172.21.15.77:0/2464845268 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d0004250 con 0x7fd7e006afc0 2023-07-24T05:47:25.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.745+0000 7fd7e6051700 1 -- 172.21.15.77:0/2464845268 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7e00b2a00 con 0x7fd7e006afc0 2023-07-24T05:47:25.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.745+0000 7fd7c7fff700 1 -- 172.21.15.77:0/2464845268 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d00036c0 con 0x7fd7e006afc0 2023-07-24T05:47:25.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.745+0000 7fd7e6051700 1 -- 172.21.15.77:0/2464845268 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e01e7df0 con 0x7fd7e006afc0 2023-07-24T05:47:25.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.749+0000 7fd7e6051700 1 -- 172.21.15.77:0/2464845268 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7e004df10 con 0x7fd7e006afc0 2023-07-24T05:47:25.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.749+0000 7fd7c7fff700 1 -- 172.21.15.77:0/2464845268 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd7d0003820 con 0x7fd7e006afc0 2023-07-24T05:47:25.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.749+0000 7fd7c7fff700 1 --2- 172.21.15.77:0/2464845268 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd7cc0662f0 0x7fd7cc0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:25.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.749+0000 7fd7c7fff700 1 -- 172.21.15.77:0/2464845268 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd7d0083cb0 con 0x7fd7e006afc0 2023-07-24T05:47:25.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.749+0000 7fd7deffd700 1 --2- 172.21.15.77:0/2464845268 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd7cc0662f0 0x7fd7cc0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:25.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.753+0000 7fd7deffd700 1 --2- 172.21.15.77:0/2464845268 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd7cc0662f0 0x7fd7cc0687b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd7e00b5180 tx=0x7fd7d4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:25.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.757+0000 7fd7c7fff700 1 -- 172.21.15.77:0/2464845268 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd7d0050e10 con 0x7fd7e006afc0 2023-07-24T05:47:25.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.929+0000 7fd7e6051700 1 -- 172.21.15.77:0/2464845268 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd7e006c280 con 0x7fd7e006afc0 2023-07-24T05:47:25.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.929+0000 7fd7c7fff700 1 -- 172.21.15.77:0/2464845268 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd7d0083020 con 0x7fd7e006afc0 2023-07-24T05:47:25.934 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-07-24T05:47:25.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.929+0000 7fd7e6051700 1 -- 172.21.15.77:0/2464845268 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd7cc0662f0 msgr2=0x7fd7cc0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:25.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.929+0000 7fd7e6051700 1 --2- 172.21.15.77:0/2464845268 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd7cc0662f0 0x7fd7cc0687b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd7e00b5180 tx=0x7fd7d4009040 comp rx=0 tx=0).stop 2023-07-24T05:47:25.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.929+0000 7fd7e6051700 1 -- 172.21.15.77:0/2464845268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7e006afc0 msgr2=0x7fd7e01562d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:25.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.929+0000 7fd7e6051700 1 --2- 172.21.15.77:0/2464845268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7e006afc0 0x7fd7e01562d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd7d000e760 tx=0x7fd7d000ea70 comp rx=0 tx=0).stop 2023-07-24T05:47:25.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.929+0000 7fd7e6051700 1 -- 172.21.15.77:0/2464845268 shutdown_connections 2023-07-24T05:47:25.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.929+0000 7fd7e6051700 1 --2- 172.21.15.77:0/2464845268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7e015db20 0x7fd7e00b0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:25.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.929+0000 7fd7e6051700 1 --2- 172.21.15.77:0/2464845268 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd7cc0662f0 0x7fd7cc0687b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:25.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.929+0000 7fd7e6051700 1 --2- 172.21.15.77:0/2464845268 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd7e00d2fc0 0x7fd7e01e78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:25.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.929+0000 7fd7e6051700 1 --2- 172.21.15.77:0/2464845268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd7e006afc0 0x7fd7e01562d0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:25.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.929+0000 7fd7e6051700 1 -- 172.21.15.77:0/2464845268 >> 172.21.15.77:0/2464845268 conn(0x7fd7e009bc20 msgr2=0x7fd7e00af5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:25.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.929+0000 7fd7e6051700 1 -- 172.21.15.77:0/2464845268 shutdown_connections 2023-07-24T05:47:25.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:25.929+0000 7fd7e6051700 1 -- 172.21.15.77:0/2464845268 wait complete. 2023-07-24T05:47:25.955 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-24T05:47:26.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.129+0000 7f36f8c2c700 1 Processor -- start 2023-07-24T05:47:26.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.129+0000 7f36f8c2c700 1 -- start start 2023-07-24T05:47:26.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.133+0000 7f36f8c2c700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f36f406afc0 0x7f36f40b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:26.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.133+0000 7f36f8c2c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f36f415db20 0x7f36f40d28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:26.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.133+0000 7f36f8c2c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36f4160fa0 con 0x7f36f40d2df0 2023-07-24T05:47:26.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.133+0000 7f36f8c2c700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36f40d3260 con 0x7f36f406afc0 2023-07-24T05:47:26.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.133+0000 7f36f8c2c700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36f40d0360 con 0x7f36f415db20 2023-07-24T05:47:26.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.133+0000 7f36f259c700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f36f406afc0 0x7f36f40b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:26.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.133+0000 7f36f259c700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f36f406afc0 0x7f36f40b1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41402/0 (socket says 172.21.15.77:41402) 2023-07-24T05:47:26.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.133+0000 7f36f259c700 1 -- 172.21.15.77:0/3253863327 learned_addr learned my addr 172.21.15.77:0/3253863327 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:26.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.133+0000 7f36f1d9b700 1 --2- 172.21.15.77:0/3253863327 >> v2:172.21.15.103:3300/0 conn(0x7f36f415db20 0x7f36f40d28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:26.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.133+0000 7f36f259c700 1 -- 172.21.15.77:0/3253863327 >> v2:172.21.15.103:3300/0 conn(0x7f36f415db20 msgr2=0x7f36f40d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:26.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.133+0000 7f36f259c700 1 --2- 172.21.15.77:0/3253863327 >> v2:172.21.15.103:3300/0 conn(0x7f36f415db20 0x7f36f40d28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:26.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.133+0000 7f36f259c700 1 -- 172.21.15.77:0/3253863327 >> v1:172.21.15.103:6789/0 conn(0x7f36f40d2df0 legacy=0x7f36f40d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:26.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.133+0000 7f36f259c700 1 -- 172.21.15.77:0/3253863327 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f40b20b0 con 0x7f36f406afc0 2023-07-24T05:47:26.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.133+0000 7f36f259c700 1 --2- 172.21.15.77:0/3253863327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36f406afc0 0x7f36f40b1a20 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f36f406dc10 tx=0x7f36e4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=491a9e4740b1671b server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:26.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.133+0000 7f36f159a700 1 -- 172.21.15.77:0/3253863327 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e4011830 con 0x7f36f406afc0 2023-07-24T05:47:26.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.133+0000 7f36f159a700 1 -- 172.21.15.77:0/3253863327 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e4011990 con 0x7f36f406afc0 2023-07-24T05:47:26.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.133+0000 7f36f159a700 1 -- 172.21.15.77:0/3253863327 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e4011d40 con 0x7f36f406afc0 2023-07-24T05:47:26.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.133+0000 7f36f8c2c700 1 -- 172.21.15.77:0/3253863327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36f406afc0 msgr2=0x7f36f40b1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:26.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.133+0000 7f36f8c2c700 1 --2- 172.21.15.77:0/3253863327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36f406afc0 0x7f36f40b1a20 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f36f406dc10 tx=0x7f36e4009c20 comp rx=0 tx=0).stop 2023-07-24T05:47:26.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.137+0000 7f36f8c2c700 1 -- 172.21.15.77:0/3253863327 shutdown_connections 2023-07-24T05:47:26.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.137+0000 7f36f8c2c700 1 --2- 172.21.15.77:0/3253863327 >> v2:172.21.15.103:3300/0 conn(0x7f36f415db20 0x7f36f40d28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:26.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.137+0000 7f36f8c2c700 1 --2- 172.21.15.77:0/3253863327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36f406afc0 0x7f36f40b1a20 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:26.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.137+0000 7f36f8c2c700 1 -- 172.21.15.77:0/3253863327 >> 172.21.15.77:0/3253863327 conn(0x7f36f409bc20 msgr2=0x7f36f40b7920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:26.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.137+0000 7f36f8c2c700 1 -- 172.21.15.77:0/3253863327 shutdown_connections 2023-07-24T05:47:26.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.137+0000 7f36f8c2c700 1 -- 172.21.15.77:0/3253863327 wait complete. 2023-07-24T05:47:26.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.137+0000 7f36f8c2c700 1 Processor -- start 2023-07-24T05:47:26.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.137+0000 7f36f8c2c700 1 -- start start 2023-07-24T05:47:26.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.141+0000 7f36f8c2c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f36f406afc0 0x7f36f40b2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:26.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.141+0000 7f36f8c2c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36f40d2df0 0x7f36f40b4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:26.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.141+0000 7f36f8c2c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36f415db20 0x7f36f4156db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:26.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.141+0000 7f36f8c2c700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f40b5250 con 0x7f36f40d2df0 2023-07-24T05:47:26.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.141+0000 7f36f8c2c700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f40c7040 con 0x7f36f415db20 2023-07-24T05:47:26.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.141+0000 7f36f8c2c700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f40b33e0 con 0x7f36f406afc0 2023-07-24T05:47:26.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.141+0000 7f36f1d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36f40d2df0 0x7f36f40b4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:26.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.141+0000 7f36f1d9b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36f40d2df0 0x7f36f40b4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41404/0 (socket says 172.21.15.77:41404) 2023-07-24T05:47:26.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.141+0000 7f36f1d9b700 1 -- 172.21.15.77:0/2239408469 learned_addr learned my addr 172.21.15.77:0/2239408469 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:26.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.141+0000 7f36f259c700 1 --2- 172.21.15.77:0/2239408469 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f36f406afc0 0x7f36f40b2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:26.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.141+0000 7f36f2d9d700 1 --2- 172.21.15.77:0/2239408469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36f415db20 0x7f36f4156db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:26.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.141+0000 7f36f1d9b700 1 -- 172.21.15.77:0/2239408469 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f36f406afc0 msgr2=0x7f36f40b2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:26.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.141+0000 7f36f1d9b700 1 --2- 172.21.15.77:0/2239408469 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f36f406afc0 0x7f36f40b2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:26.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.141+0000 7f36f1d9b700 1 -- 172.21.15.77:0/2239408469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36f415db20 msgr2=0x7f36f4156db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:26.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.141+0000 7f36f1d9b700 1 --2- 172.21.15.77:0/2239408469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36f415db20 0x7f36f4156db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:26.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.141+0000 7f36f1d9b700 1 -- 172.21.15.77:0/2239408469 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e4009570 con 0x7f36f40d2df0 2023-07-24T05:47:26.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.141+0000 7f36f2d9d700 1 --2- 172.21.15.77:0/2239408469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36f415db20 0x7f36f4156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:26.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.141+0000 7f36f1d9b700 1 --2- 172.21.15.77:0/2239408469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36f40d2df0 0x7f36f40b4d10 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f36e800e870 tx=0x7f36e800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:26.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.141+0000 7f36e2ffd700 1 -- 172.21.15.77:0/2239408469 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e80095c0 con 0x7f36f40d2df0 2023-07-24T05:47:26.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.141+0000 7f36e2ffd700 1 -- 172.21.15.77:0/2239408469 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e8013680 con 0x7f36f40d2df0 2023-07-24T05:47:26.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.141+0000 7f36e2ffd700 1 -- 172.21.15.77:0/2239408469 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e8013a10 con 0x7f36f40d2df0 2023-07-24T05:47:26.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.141+0000 7f36f8c2c700 1 -- 172.21.15.77:0/2239408469 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36f40b36c0 con 0x7f36f40d2df0 2023-07-24T05:47:26.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.141+0000 7f36f8c2c700 1 -- 172.21.15.77:0/2239408469 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f40b3c80 con 0x7f36f40d2df0 2023-07-24T05:47:26.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.145+0000 7f36f8c2c700 1 -- 172.21.15.77:0/2239408469 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36f404df10 con 0x7f36f40d2df0 2023-07-24T05:47:26.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.145+0000 7f36e2ffd700 1 -- 172.21.15.77:0/2239408469 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f36e8013b70 con 0x7f36f40d2df0 2023-07-24T05:47:26.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.145+0000 7f36e2ffd700 1 --2- 172.21.15.77:0/2239408469 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f36d4066320 0x7f36d40687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:26.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.145+0000 7f36e2ffd700 1 -- 172.21.15.77:0/2239408469 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f36e80840c0 con 0x7f36f40d2df0 2023-07-24T05:47:26.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.149+0000 7f36f259c700 1 --2- 172.21.15.77:0/2239408469 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f36d4066320 0x7f36d40687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:26.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.149+0000 7f36f259c700 1 --2- 172.21.15.77:0/2239408469 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f36d4066320 0x7f36d40687e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f36e4009c60 tx=0x7f36e4008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:26.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.153+0000 7f36e2ffd700 1 -- 172.21.15.77:0/2239408469 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f36e80510f0 con 0x7f36f40d2df0 2023-07-24T05:47:26.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.325+0000 7f36f8c2c700 1 -- 172.21.15.77:0/2239408469 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f36f40b01e0 con 0x7f36f40d2df0 2023-07-24T05:47:26.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.325+0000 7f36e2ffd700 1 -- 172.21.15.77:0/2239408469 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f36e8054710 con 0x7f36f40d2df0 2023-07-24T05:47:26.331 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-07-24T05:47:26.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.329+0000 7f36f8c2c700 1 -- 172.21.15.77:0/2239408469 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f36d4066320 msgr2=0x7f36d40687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:26.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.329+0000 7f36f8c2c700 1 --2- 172.21.15.77:0/2239408469 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f36d4066320 0x7f36d40687e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f36e4009c60 tx=0x7f36e4008030 comp rx=0 tx=0).stop 2023-07-24T05:47:26.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.329+0000 7f36f8c2c700 1 -- 172.21.15.77:0/2239408469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36f40d2df0 msgr2=0x7f36f40b4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:26.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.329+0000 7f36f8c2c700 1 --2- 172.21.15.77:0/2239408469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36f40d2df0 0x7f36f40b4d10 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f36e800e870 tx=0x7f36e800eb80 comp rx=0 tx=0).stop 2023-07-24T05:47:26.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.329+0000 7f36f8c2c700 1 -- 172.21.15.77:0/2239408469 shutdown_connections 2023-07-24T05:47:26.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.329+0000 7f36f8c2c700 1 --2- 172.21.15.77:0/2239408469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f36f415db20 0x7f36f4156db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:26.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.329+0000 7f36f8c2c700 1 --2- 172.21.15.77:0/2239408469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f36f40d2df0 0x7f36f40b4d10 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:26.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.329+0000 7f36f8c2c700 1 --2- 172.21.15.77:0/2239408469 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f36d4066320 0x7f36d40687e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:26.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.329+0000 7f36f8c2c700 1 --2- 172.21.15.77:0/2239408469 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f36f406afc0 0x7f36f40b2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:26.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.329+0000 7f36f8c2c700 1 -- 172.21.15.77:0/2239408469 >> 172.21.15.77:0/2239408469 conn(0x7f36f409bc20 msgr2=0x7f36f4069b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:26.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.329+0000 7f36f8c2c700 1 -- 172.21.15.77:0/2239408469 shutdown_connections 2023-07-24T05:47:26.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.329+0000 7f36f8c2c700 1 -- 172.21.15.77:0/2239408469 wait complete. 2023-07-24T05:47:26.358 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-24T05:47:26.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.525+0000 7ffa72627700 1 Processor -- start 2023-07-24T05:47:26.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.525+0000 7ffa72627700 1 -- start start 2023-07-24T05:47:26.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.529+0000 7ffa72627700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ffa6c15c870 0x7ffa6c0cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:26.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.529+0000 7ffa72627700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ffa6c0b2230 0x7ffa6c0cd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:26.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.529+0000 7ffa72627700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa6c0cf520 con 0x7ffa6c15cc50 2023-07-24T05:47:26.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.529+0000 7ffa72627700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa6c06aaa0 con 0x7ffa6c0b2230 2023-07-24T05:47:26.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.529+0000 7ffa72627700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c06ad80 con 0x7ffa6c15c870 2023-07-24T05:47:26.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.529+0000 7ffa71625700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ffa6c15c870 0x7ffa6c0cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:26.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.529+0000 7ffa71e26700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ffa6c0b2230 0x7ffa6c0cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:26.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.529+0000 7ffa71625700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ffa6c15c870 0x7ffa6c0cefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.77:36092/0 (socket says 172.21.15.77:36092) 2023-07-24T05:47:26.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.529+0000 7ffa71e26700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ffa6c0b2230 0x7ffa6c0cd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41412/0 (socket says 172.21.15.77:41412) 2023-07-24T05:47:26.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.529+0000 7ffa71625700 1 -- 172.21.15.77:0/1485234809 learned_addr learned my addr 172.21.15.77:0/1485234809 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:26.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.529+0000 7ffa70e24700 1 --1- 172.21.15.77:0/1485234809 >> v1:172.21.15.103:6789/0 conn(0x7ffa6c15cc50 0x7ffa6c0b1b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.77:43164/0 (socket says 172.21.15.77:43164) 2023-07-24T05:47:26.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.529+0000 7ffa71e26700 1 -- 172.21.15.77:0/1485234809 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ffa6c15c870 msgr2=0x7ffa6c0cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:26.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.529+0000 7ffa71e26700 1 --2- 172.21.15.77:0/1485234809 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ffa6c15c870 0x7ffa6c0cefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:26.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.529+0000 7ffa71e26700 1 -- 172.21.15.77:0/1485234809 >> v1:172.21.15.103:6789/0 conn(0x7ffa6c15cc50 legacy=0x7ffa6c0b1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:26.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.529+0000 7ffa71e26700 1 -- 172.21.15.77:0/1485234809 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa6c06b060 con 0x7ffa6c0b2230 2023-07-24T05:47:26.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.529+0000 7ffa71e26700 1 --2- 172.21.15.77:0/1485234809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa6c0b2230 0x7ffa6c0cd090 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ffa64009d90 tx=0x7ffa6400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db3f397cbab50684 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:26.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.529+0000 7ffa63fff700 1 -- 172.21.15.77:0/1485234809 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6400e070 con 0x7ffa6c0b2230 2023-07-24T05:47:26.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.529+0000 7ffa63fff700 1 -- 172.21.15.77:0/1485234809 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6400bb20 con 0x7ffa6c0b2230 2023-07-24T05:47:26.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.529+0000 7ffa63fff700 1 -- 172.21.15.77:0/1485234809 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa64012430 con 0x7ffa6c0b2230 2023-07-24T05:47:26.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.533+0000 7ffa72627700 1 -- 172.21.15.77:0/1485234809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa6c0b2230 msgr2=0x7ffa6c0cd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:26.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.533+0000 7ffa72627700 1 --2- 172.21.15.77:0/1485234809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa6c0b2230 0x7ffa6c0cd090 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ffa64009d90 tx=0x7ffa6400b330 comp rx=0 tx=0).stop 2023-07-24T05:47:26.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.533+0000 7ffa72627700 1 -- 172.21.15.77:0/1485234809 shutdown_connections 2023-07-24T05:47:26.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.533+0000 7ffa72627700 1 --2- 172.21.15.77:0/1485234809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa6c0b2230 0x7ffa6c0cd090 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:26.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.533+0000 7ffa72627700 1 --2- 172.21.15.77:0/1485234809 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ffa6c15c870 0x7ffa6c0cefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:26.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.533+0000 7ffa72627700 1 -- 172.21.15.77:0/1485234809 >> 172.21.15.77:0/1485234809 conn(0x7ffa6c089f80 msgr2=0x7ffa6c09b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:26.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.533+0000 7ffa72627700 1 -- 172.21.15.77:0/1485234809 shutdown_connections 2023-07-24T05:47:26.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.533+0000 7ffa72627700 1 -- 172.21.15.77:0/1485234809 wait complete. 2023-07-24T05:47:26.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.533+0000 7ffa72627700 1 Processor -- start 2023-07-24T05:47:26.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.537+0000 7ffa72627700 1 -- start start 2023-07-24T05:47:26.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.537+0000 7ffa72627700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ffa6c0b2230 0x7ffa6c0ca780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:26.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.537+0000 7ffa72627700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa6c15c870 0x7ffa6c0d0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:26.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.537+0000 7ffa72627700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa6c15cc50 0x7ffa6c0d0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:26.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.537+0000 7ffa72627700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c0cbd70 con 0x7ffa6c15cc50 2023-07-24T05:47:26.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.537+0000 7ffa72627700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c0cb0f0 con 0x7ffa6c15c870 2023-07-24T05:47:26.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.537+0000 7ffa72627700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6c0cb3d0 con 0x7ffa6c0b2230 2023-07-24T05:47:26.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.537+0000 7ffa71e26700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa6c15cc50 0x7ffa6c0d0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:26.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.537+0000 7ffa71e26700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa6c15cc50 0x7ffa6c0d0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41416/0 (socket says 172.21.15.77:41416) 2023-07-24T05:47:26.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.537+0000 7ffa71e26700 1 -- 172.21.15.77:0/215792860 learned_addr learned my addr 172.21.15.77:0/215792860 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:26.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.537+0000 7ffa71625700 1 --2- 172.21.15.77:0/215792860 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ffa6c0b2230 0x7ffa6c0ca780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:26.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.537+0000 7ffa70e24700 1 --2- 172.21.15.77:0/215792860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa6c15c870 0x7ffa6c0d0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:26.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.537+0000 7ffa71e26700 1 -- 172.21.15.77:0/215792860 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ffa6c0b2230 msgr2=0x7ffa6c0ca780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:26.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.537+0000 7ffa71e26700 1 --2- 172.21.15.77:0/215792860 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ffa6c0b2230 0x7ffa6c0ca780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:26.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.537+0000 7ffa71e26700 1 -- 172.21.15.77:0/215792860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa6c15c870 msgr2=0x7ffa6c0d0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:26.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.537+0000 7ffa71e26700 1 --2- 172.21.15.77:0/215792860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa6c15c870 0x7ffa6c0d0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:26.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.537+0000 7ffa71e26700 1 -- 172.21.15.77:0/215792860 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa64009a70 con 0x7ffa6c15cc50 2023-07-24T05:47:26.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.537+0000 7ffa71e26700 1 --2- 172.21.15.77:0/215792860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa6c15cc50 0x7ffa6c0d0750 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ffa64014040 tx=0x7ffa64004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:26.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.537+0000 7ffa61ffb700 1 -- 172.21.15.77:0/215792860 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa64012430 con 0x7ffa6c15cc50 2023-07-24T05:47:26.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.537+0000 7ffa61ffb700 1 -- 172.21.15.77:0/215792860 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa64020070 con 0x7ffa6c15cc50 2023-07-24T05:47:26.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.537+0000 7ffa72627700 1 -- 172.21.15.77:0/215792860 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa6c0cb6b0 con 0x7ffa6c15cc50 2023-07-24T05:47:26.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.537+0000 7ffa61ffb700 1 -- 172.21.15.77:0/215792860 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa64004280 con 0x7ffa6c15cc50 2023-07-24T05:47:26.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.537+0000 7ffa72627700 1 -- 172.21.15.77:0/215792860 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa6c0cacc0 con 0x7ffa6c15cc50 2023-07-24T05:47:26.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.541+0000 7ffa72627700 1 -- 172.21.15.77:0/215792860 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa6c0cbeb0 con 0x7ffa6c15cc50 2023-07-24T05:47:26.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.541+0000 7ffa61ffb700 1 -- 172.21.15.77:0/215792860 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffa640043e0 con 0x7ffa6c15cc50 2023-07-24T05:47:26.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.541+0000 7ffa61ffb700 1 --2- 172.21.15.77:0/215792860 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ffa500662f0 0x7ffa500687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:26.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.541+0000 7ffa61ffb700 1 -- 172.21.15.77:0/215792860 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ffa64022070 con 0x7ffa6c15cc50 2023-07-24T05:47:26.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.545+0000 7ffa71625700 1 --2- 172.21.15.77:0/215792860 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ffa500662f0 0x7ffa500687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:26.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.545+0000 7ffa71625700 1 --2- 172.21.15.77:0/215792860 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ffa500662f0 0x7ffa500687b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ffa68009b80 tx=0x7ffa68008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:26.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.549+0000 7ffa61ffb700 1 -- 172.21.15.77:0/215792860 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffa6c0cbeb0 con 0x7ffa6c15cc50 2023-07-24T05:47:26.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.721+0000 7ffa72627700 1 -- 172.21.15.77:0/215792860 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ffa6c0cbeb0 con 0x7ffa6c15cc50 2023-07-24T05:47:26.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.721+0000 7ffa61ffb700 1 -- 172.21.15.77:0/215792860 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7ffa6c0cbeb0 con 0x7ffa6c15cc50 2023-07-24T05:47:26.728 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-07-24T05:47:26.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.725+0000 7ffa72627700 1 -- 172.21.15.77:0/215792860 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ffa500662f0 msgr2=0x7ffa500687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:26.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.725+0000 7ffa72627700 1 --2- 172.21.15.77:0/215792860 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ffa500662f0 0x7ffa500687b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ffa68009b80 tx=0x7ffa68008040 comp rx=0 tx=0).stop 2023-07-24T05:47:26.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.725+0000 7ffa72627700 1 -- 172.21.15.77:0/215792860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa6c15cc50 msgr2=0x7ffa6c0d0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:26.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.725+0000 7ffa72627700 1 --2- 172.21.15.77:0/215792860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa6c15cc50 0x7ffa6c0d0750 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ffa64014040 tx=0x7ffa64004af0 comp rx=0 tx=0).stop 2023-07-24T05:47:26.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.725+0000 7ffa72627700 1 -- 172.21.15.77:0/215792860 shutdown_connections 2023-07-24T05:47:26.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.725+0000 7ffa72627700 1 --2- 172.21.15.77:0/215792860 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa6c15cc50 0x7ffa6c0d0750 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:26.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.725+0000 7ffa72627700 1 --2- 172.21.15.77:0/215792860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa6c15c870 0x7ffa6c0d0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:26.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.725+0000 7ffa72627700 1 --2- 172.21.15.77:0/215792860 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ffa500662f0 0x7ffa500687b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:26.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.725+0000 7ffa72627700 1 --2- 172.21.15.77:0/215792860 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ffa6c0b2230 0x7ffa6c0ca780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:26.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.725+0000 7ffa72627700 1 -- 172.21.15.77:0/215792860 >> 172.21.15.77:0/215792860 conn(0x7ffa6c089f80 msgr2=0x7ffa6c06bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:26.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.725+0000 7ffa72627700 1 -- 172.21.15.77:0/215792860 shutdown_connections 2023-07-24T05:47:26.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.725+0000 7ffa72627700 1 -- 172.21.15.77:0/215792860 wait complete. 2023-07-24T05:47:26.752 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-24T05:47:26.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.925+0000 7f385b59e700 1 Processor -- start 2023-07-24T05:47:26.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.925+0000 7f385b59e700 1 -- start start 2023-07-24T05:47:26.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.925+0000 7f385b59e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f385c0b17a0 0x7f385c16be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:26.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.925+0000 7f385b59e700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f385c0af170 con 0x7f385c160d20 2023-07-24T05:47:26.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.925+0000 7f385b59e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f385c0ae5f0 con 0x7f385c161100 2023-07-24T05:47:26.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.925+0000 7f385b59e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f385c0ae8d0 con 0x7f385c0b17a0 2023-07-24T05:47:26.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.929+0000 7f385a59c700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f385c160d20 0x7f385c0adba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:60304/0 (socket says 172.21.15.77:60304) 2023-07-24T05:47:26.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.929+0000 7f385a59c700 1 -- 172.21.15.77:0/2258432870 learned_addr learned my addr 172.21.15.77:0/2258432870 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:26.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.929+0000 7f385ad9d700 1 --2- 172.21.15.77:0/2258432870 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f385c0b17a0 0x7f385c16be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:26.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.929+0000 7f3859d9b700 1 -- 172.21.15.77:0/2258432870 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3158846612 0 0) 0x7f385c0af170 con 0x7f385c160d20 2023-07-24T05:47:26.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.929+0000 7f3859d9b700 1 -- 172.21.15.77:0/2258432870 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38480035d0 con 0x7f385c160d20 2023-07-24T05:47:26.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.929+0000 7f385ad9d700 1 -- 172.21.15.77:0/2258432870 >> v1:172.21.15.103:6789/0 conn(0x7f385c161100 legacy=0x7f385c0b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:26.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.929+0000 7f3859d9b700 1 -- 172.21.15.77:0/2258432870 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3602182607 0 0) 0x7f385c0ae5f0 con 0x7f385c161100 2023-07-24T05:47:26.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.929+0000 7f385ad9d700 1 -- 172.21.15.77:0/2258432870 >> v1:172.21.15.77:6789/0 conn(0x7f385c160d20 legacy=0x7f385c0adba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:26.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.929+0000 7f385ad9d700 1 -- 172.21.15.77:0/2258432870 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f385c0aebb0 con 0x7f385c0b17a0 2023-07-24T05:47:26.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.929+0000 7f385ad9d700 1 --2- 172.21.15.77:0/2258432870 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f385c0b17a0 0x7f385c16be60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3854009880 tx=0x7f3854009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f1e80905a9ce5e8 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:26.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.929+0000 7f3859d9b700 1 -- 172.21.15.77:0/2258432870 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3854011830 con 0x7f385c0b17a0 2023-07-24T05:47:26.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.929+0000 7f3859d9b700 1 -- 172.21.15.77:0/2258432870 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3854011990 con 0x7f385c0b17a0 2023-07-24T05:47:26.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.929+0000 7f3859d9b700 1 -- 172.21.15.77:0/2258432870 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3854011d20 con 0x7f385c0b17a0 2023-07-24T05:47:26.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.929+0000 7f385b59e700 1 -- 172.21.15.77:0/2258432870 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f385c0b17a0 msgr2=0x7f385c16be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:26.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.929+0000 7f385b59e700 1 --2- 172.21.15.77:0/2258432870 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f385c0b17a0 0x7f385c16be60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3854009880 tx=0x7f3854009b90 comp rx=0 tx=0).stop 2023-07-24T05:47:26.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.929+0000 7f385b59e700 1 -- 172.21.15.77:0/2258432870 shutdown_connections 2023-07-24T05:47:26.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.929+0000 7f385b59e700 1 --2- 172.21.15.77:0/2258432870 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f385c0b17a0 0x7f385c16be60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:26.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.929+0000 7f385b59e700 1 -- 172.21.15.77:0/2258432870 >> 172.21.15.77:0/2258432870 conn(0x7f385c0cacc0 msgr2=0x7f385c0cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:26.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.929+0000 7f385b59e700 1 -- 172.21.15.77:0/2258432870 shutdown_connections 2023-07-24T05:47:26.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.929+0000 7f385b59e700 1 -- 172.21.15.77:0/2258432870 wait complete. 2023-07-24T05:47:26.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.933+0000 7f385b59e700 1 Processor -- start 2023-07-24T05:47:26.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.933+0000 7f385b59e700 1 -- start start 2023-07-24T05:47:26.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.933+0000 7f385b59e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f385c0b17a0 0x7f385c163510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:26.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.933+0000 7f385b59e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f385c160d20 0x7f385c161f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:26.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.933+0000 7f385b59e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f385c161100 0x7f385c15ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:26.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.933+0000 7f385b59e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385c162490 con 0x7f385c161100 2023-07-24T05:47:26.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.933+0000 7f385b59e700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385c1626a0 con 0x7f385c0b17a0 2023-07-24T05:47:26.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.933+0000 7f385b59e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f385c162980 con 0x7f385c160d20 2023-07-24T05:47:26.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.933+0000 7f385ad9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f385c161100 0x7f385c15ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:26.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.933+0000 7f385ad9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f385c161100 0x7f385c15ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41418/0 (socket says 172.21.15.77:41418) 2023-07-24T05:47:26.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.933+0000 7f385ad9d700 1 -- 172.21.15.77:0/1843768598 learned_addr learned my addr 172.21.15.77:0/1843768598 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:26.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.937+0000 7f3851d9b700 1 --2- 172.21.15.77:0/1843768598 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f385c160d20 0x7f385c161f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:26.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.937+0000 7f385a59c700 1 --2- 172.21.15.77:0/1843768598 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f385c0b17a0 0x7f385c163510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:26.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.937+0000 7f385ad9d700 1 -- 172.21.15.77:0/1843768598 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f385c160d20 msgr2=0x7f385c161f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:26.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.937+0000 7f385ad9d700 1 --2- 172.21.15.77:0/1843768598 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f385c160d20 0x7f385c161f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:26.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.937+0000 7f385ad9d700 1 -- 172.21.15.77:0/1843768598 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f385c0b17a0 msgr2=0x7f385c163510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:26.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.937+0000 7f385ad9d700 1 --2- 172.21.15.77:0/1843768598 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f385c0b17a0 0x7f385c163510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:26.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.937+0000 7f385ad9d700 1 -- 172.21.15.77:0/1843768598 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38540094b0 con 0x7f385c161100 2023-07-24T05:47:26.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.937+0000 7f385a59c700 1 --2- 172.21.15.77:0/1843768598 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f385c0b17a0 0x7f385c163510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:47:26.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.937+0000 7f385ad9d700 1 --2- 172.21.15.77:0/1843768598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f385c161100 0x7f385c15ea40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f38540090b0 tx=0x7f3854004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:26.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.937+0000 7f38537fe700 1 -- 172.21.15.77:0/1843768598 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3854019950 con 0x7f385c161100 2023-07-24T05:47:26.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.937+0000 7f38537fe700 1 -- 172.21.15.77:0/1843768598 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385401e070 con 0x7f385c161100 2023-07-24T05:47:26.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.937+0000 7f38537fe700 1 -- 172.21.15.77:0/1843768598 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3854019cd0 con 0x7f385c161100 2023-07-24T05:47:26.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.937+0000 7f385b59e700 1 -- 172.21.15.77:0/1843768598 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f385c162c60 con 0x7f385c161100 2023-07-24T05:47:26.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.937+0000 7f385b59e700 1 -- 172.21.15.77:0/1843768598 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f385c15ef80 con 0x7f385c161100 2023-07-24T05:47:26.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.937+0000 7f385b59e700 1 -- 172.21.15.77:0/1843768598 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f385c072490 con 0x7f385c161100 2023-07-24T05:47:26.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.941+0000 7f38537fe700 1 -- 172.21.15.77:0/1843768598 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f385402d450 con 0x7f385c161100 2023-07-24T05:47:26.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.941+0000 7f38537fe700 1 --2- 172.21.15.77:0/1843768598 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f383c0662f0 0x7f383c0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:26.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.941+0000 7f38537fe700 1 -- 172.21.15.77:0/1843768598 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3854084fe0 con 0x7f385c161100 2023-07-24T05:47:26.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.941+0000 7f385a59c700 1 --2- 172.21.15.77:0/1843768598 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f383c0662f0 0x7f383c0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:26.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.941+0000 7f385a59c700 1 --2- 172.21.15.77:0/1843768598 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f383c0662f0 0x7f383c0687b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f384c005930 tx=0x7f384c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:26.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:26.945+0000 7f38537fe700 1 -- 172.21.15.77:0/1843768598 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3854052160 con 0x7f385c161100 2023-07-24T05:47:27.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.141+0000 7f385b59e700 1 -- 172.21.15.77:0/1843768598 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f385c06acd0 con 0x7f385c161100 2023-07-24T05:47:27.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.141+0000 7f38537fe700 1 -- 172.21.15.77:0/1843768598 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3854020070 con 0x7f385c161100 2023-07-24T05:47:27.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.145+0000 7f385b59e700 1 -- 172.21.15.77:0/1843768598 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f383c0662f0 msgr2=0x7f383c0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:27.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.145+0000 7f385b59e700 1 --2- 172.21.15.77:0/1843768598 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f383c0662f0 0x7f383c0687b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f384c005930 tx=0x7f384c009040 comp rx=0 tx=0).stop 2023-07-24T05:47:27.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.145+0000 7f385b59e700 1 -- 172.21.15.77:0/1843768598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f385c161100 msgr2=0x7f385c15ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:27.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.145+0000 7f385b59e700 1 --2- 172.21.15.77:0/1843768598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f385c161100 0x7f385c15ea40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f38540090b0 tx=0x7f3854004770 comp rx=0 tx=0).stop 2023-07-24T05:47:27.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.145+0000 7f385b59e700 1 -- 172.21.15.77:0/1843768598 shutdown_connections 2023-07-24T05:47:27.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.145+0000 7f385b59e700 1 --2- 172.21.15.77:0/1843768598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f385c161100 0x7f385c15ea40 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:27.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.145+0000 7f385b59e700 1 --2- 172.21.15.77:0/1843768598 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f383c0662f0 0x7f383c0687b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:27.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.145+0000 7f385b59e700 1 --2- 172.21.15.77:0/1843768598 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f385c160d20 0x7f385c161f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:27.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.145+0000 7f385b59e700 1 --2- 172.21.15.77:0/1843768598 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f385c0b17a0 0x7f385c163510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:27.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.145+0000 7f385b59e700 1 -- 172.21.15.77:0/1843768598 >> 172.21.15.77:0/1843768598 conn(0x7f385c0cacc0 msgr2=0x7f385c06bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:27.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.145+0000 7f385b59e700 1 -- 172.21.15.77:0/1843768598 shutdown_connections 2023-07-24T05:47:27.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.145+0000 7f385b59e700 1 -- 172.21.15.77:0/1843768598 wait complete. 2023-07-24T05:47:27.154 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2023-07-24T05:47:27.173 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi077.front.sepia.ceph.com... 2023-07-24T05:47:27.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:47:27.173 DEBUG:teuthology.orchestra.run.smithi077:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-07-24T05:47:27.203 INFO:teuthology.orchestra.run:waiting for 300 2023-07-24T05:47:27.203 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi077.front.sepia.ceph.com 2023-07-24T05:47:27.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:47:27.204 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-07-24T05:47:27.263 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2023-07-24T05:47:27.264 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-24T05:47:27.280 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2023-07-24T05:47:27.281 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-24T05:47:27.340 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-24T05:47:27.518 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.513+0000 7f69fa269700 1 Processor -- start 2023-07-24T05:47:27.519 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.513+0000 7f69fa269700 1 -- start start 2023-07-24T05:47:27.520 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.513+0000 7f69fa269700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f69f40ca890 0x7f69f40cbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:27.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.513+0000 7f69fa269700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f69f40cde50 0x7f69f406cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:27.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.513+0000 7f69fa269700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69f406a5c0 con 0x7f69f40cc520 2023-07-24T05:47:27.521 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.517+0000 7f69fa269700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69f40cac70 con 0x7f69f40ca890 2023-07-24T05:47:27.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.517+0000 7f69fa269700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f406a8a0 con 0x7f69f40cde50 2023-07-24T05:47:27.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.517+0000 7f69f8806700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f69f40cc520 0x7f69f406b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:60310/0 (socket says 172.21.15.77:60310) 2023-07-24T05:47:27.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.517+0000 7f69f8806700 1 -- 172.21.15.77:0/1697816370 learned_addr learned my addr 172.21.15.77:0/1697816370 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:27.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.517+0000 7f69f37fe700 1 --2- 172.21.15.77:0/1697816370 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f69f40cde50 0x7f69f406cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:27.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.517+0000 7f69f3fff700 1 --2- 172.21.15.77:0/1697816370 >> v2:172.21.15.103:3300/0 conn(0x7f69f40ca890 0x7f69f40cbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:27.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.517+0000 7f69f2ffd700 1 -- 172.21.15.77:0/1697816370 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 699618335 0 0) 0x7f69f406a5c0 con 0x7f69f40cc520 2023-07-24T05:47:27.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.517+0000 7f69f2ffd700 1 -- 172.21.15.77:0/1697816370 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69dc0035d0 con 0x7f69f40cc520 2023-07-24T05:47:27.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.517+0000 7f69f3fff700 1 -- 172.21.15.77:0/1697816370 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f69f40cde50 msgr2=0x7f69f406cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:27.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.517+0000 7f69f3fff700 1 --2- 172.21.15.77:0/1697816370 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f69f40cde50 0x7f69f406cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:27.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.517+0000 7f69f3fff700 1 -- 172.21.15.77:0/1697816370 >> v1:172.21.15.77:6789/0 conn(0x7f69f40cc520 legacy=0x7f69f406b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:27.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.517+0000 7f69f3fff700 1 -- 172.21.15.77:0/1697816370 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f406ab80 con 0x7f69f40ca890 2023-07-24T05:47:27.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.517+0000 7f69f3fff700 1 --2- 172.21.15.77:0/1697816370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69f40ca890 0x7f69f40cbfe0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f69e4009840 tx=0x7f69e4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2da9a5a9030b8e7 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:27.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.517+0000 7f69f2ffd700 1 -- 172.21.15.77:0/1697816370 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e4005e50 con 0x7f69f40ca890 2023-07-24T05:47:27.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.517+0000 7f69f2ffd700 1 -- 172.21.15.77:0/1697816370 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e4006030 con 0x7f69f40ca890 2023-07-24T05:47:27.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.517+0000 7f69f2ffd700 1 -- 172.21.15.77:0/1697816370 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e40063c0 con 0x7f69f40ca890 2023-07-24T05:47:27.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.521+0000 7f69fa269700 1 -- 172.21.15.77:0/1697816370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69f40ca890 msgr2=0x7f69f40cbfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:27.525 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.521+0000 7f69fa269700 1 --2- 172.21.15.77:0/1697816370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69f40ca890 0x7f69f40cbfe0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f69e4009840 tx=0x7f69e4009b50 comp rx=0 tx=0).stop 2023-07-24T05:47:27.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.521+0000 7f69fa269700 1 -- 172.21.15.77:0/1697816370 shutdown_connections 2023-07-24T05:47:27.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.521+0000 7f69fa269700 1 --2- 172.21.15.77:0/1697816370 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f69f40cde50 0x7f69f406cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:27.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.521+0000 7f69fa269700 1 --2- 172.21.15.77:0/1697816370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69f40ca890 0x7f69f40cbfe0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:27.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.521+0000 7f69fa269700 1 -- 172.21.15.77:0/1697816370 >> 172.21.15.77:0/1697816370 conn(0x7f69f40ce410 msgr2=0x7f69f40ce7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:27.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.521+0000 7f69fa269700 1 -- 172.21.15.77:0/1697816370 shutdown_connections 2023-07-24T05:47:27.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.521+0000 7f69fa269700 1 -- 172.21.15.77:0/1697816370 wait complete. 2023-07-24T05:47:27.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.521+0000 7f69fa269700 1 Processor -- start 2023-07-24T05:47:27.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.521+0000 7f69fa269700 1 -- start start 2023-07-24T05:47:27.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.521+0000 7f69fa269700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69f40ca890 0x7f69f40c2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:27.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.521+0000 7f69fa269700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f69f40cc520 0x7f69f40c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:27.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.521+0000 7f69fa269700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69f40cde50 0x7f69f40c00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:27.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.521+0000 7f69fa269700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f40aece0 con 0x7f69f40cde50 2023-07-24T05:47:27.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.521+0000 7f69fa269700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f4096970 con 0x7f69f40ca890 2023-07-24T05:47:27.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.521+0000 7f69fa269700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f40c5230 con 0x7f69f40cc520 2023-07-24T05:47:27.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.521+0000 7f69f8806700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69f40cde50 0x7f69f40c00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:27.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.525+0000 7f69f8806700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69f40cde50 0x7f69f40c00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41424/0 (socket says 172.21.15.77:41424) 2023-07-24T05:47:27.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.525+0000 7f69f8806700 1 -- 172.21.15.77:0/1558640472 learned_addr learned my addr 172.21.15.77:0/1558640472 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:27.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.525+0000 7f69f37fe700 1 --2- 172.21.15.77:0/1558640472 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f69f40cc520 0x7f69f40c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:27.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.525+0000 7f69f3fff700 1 --2- 172.21.15.77:0/1558640472 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69f40ca890 0x7f69f40c2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:27.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.525+0000 7f69f8806700 1 -- 172.21.15.77:0/1558640472 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f69f40cc520 msgr2=0x7f69f40c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:27.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.525+0000 7f69f8806700 1 --2- 172.21.15.77:0/1558640472 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f69f40cc520 0x7f69f40c4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:27.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.525+0000 7f69f8806700 1 -- 172.21.15.77:0/1558640472 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69f40ca890 msgr2=0x7f69f40c2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:27.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.525+0000 7f69f8806700 1 --2- 172.21.15.77:0/1558640472 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69f40ca890 0x7f69f40c2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:27.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.525+0000 7f69f8806700 1 -- 172.21.15.77:0/1558640472 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e4009450 con 0x7f69f40cde50 2023-07-24T05:47:27.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.525+0000 7f69f8806700 1 --2- 172.21.15.77:0/1558640472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69f40cde50 0x7f69f40c00c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f69ec00cae0 tx=0x7f69ec00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:27.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.525+0000 7f69f0ff9700 1 -- 172.21.15.77:0/1558640472 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ec007480 con 0x7f69f40cde50 2023-07-24T05:47:27.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.525+0000 7f69f0ff9700 1 -- 172.21.15.77:0/1558640472 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69ec0075e0 con 0x7f69f40cde50 2023-07-24T05:47:27.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.525+0000 7f69fa269700 1 -- 172.21.15.77:0/1558640472 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69f40ae720 con 0x7f69f40cde50 2023-07-24T05:47:27.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.525+0000 7f69f0ff9700 1 -- 172.21.15.77:0/1558640472 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ec007990 con 0x7f69f40cde50 2023-07-24T05:47:27.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.525+0000 7f69fa269700 1 -- 172.21.15.77:0/1558640472 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69f4096600 con 0x7f69f40cde50 2023-07-24T05:47:27.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.525+0000 7f69fa269700 1 -- 172.21.15.77:0/1558640472 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69f4096460 con 0x7f69f40cde50 2023-07-24T05:47:27.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.529+0000 7f69f0ff9700 1 -- 172.21.15.77:0/1558640472 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f69ec01b3b0 con 0x7f69f40cde50 2023-07-24T05:47:27.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.529+0000 7f69f0ff9700 1 --2- 172.21.15.77:0/1558640472 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f69e00662f0 0x7f69e00687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:27.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.529+0000 7f69f0ff9700 1 -- 172.21.15.77:0/1558640472 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f69ec083980 con 0x7f69f40cde50 2023-07-24T05:47:27.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.529+0000 7f69f3fff700 1 --2- 172.21.15.77:0/1558640472 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f69e00662f0 0x7f69e00687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:27.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.533+0000 7f69f3fff700 1 --2- 172.21.15.77:0/1558640472 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f69e00662f0 0x7f69e00687b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f69e4009b90 tx=0x7f69e4008070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:27.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.537+0000 7f69f0ff9700 1 -- 172.21.15.77:0/1558640472 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f69f4096460 con 0x7f69f40cde50 2023-07-24T05:47:27.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.713+0000 7f69fa269700 1 -- 172.21.15.77:0/1558640472 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f69f4096460 con 0x7f69f40cde50 2023-07-24T05:47:27.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.713+0000 7f69f0ff9700 1 -- 172.21.15.77:0/1558640472 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20204 (secure 0 0 0) 0x7f69f4096460 con 0x7f69f40cde50 2023-07-24T05:47:27.721 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:47:27.721 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":27,"fsid":"5aed5f7b-fb55-4d95-9c02-c6adbb1677b4","created":"2023-07-24T05:45:39.639731+0000","modified":"2023-07-24T05:46:48.442117+0000","last_up_change":"2023-07-24T05:45:52.319670+0000","last_in_change":"2023-07-24T05:45:43.643277+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-24T05:45:52.610430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-24T05:45:52.773787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-24T05:45:58.121732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-24T05:45:59.368726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-24T05:46:03.032057+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ffa0d496-461a-4053-b764-0627d969521b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6812","nonce":825987196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6817","nonce":825987196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6831","nonce":825987196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6824","nonce":825987196}]},"public_addr":"172.21.15.77:6812/825987196","cluster_addr":"172.21.15.77:6817/825987196","heartbeat_back_addr":"172.21.15.77:6831/825987196","heartbeat_front_addr":"172.21.15.77:6824/825987196","state":["exists","up"]},{"osd":1,"uuid":"9f595e5e-5c43-49bc-8ce4-ee70575c90da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6801","nonce":4133026815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6803","nonce":4133026815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6807","nonce":4133026815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6805","nonce":4133026815}]},"public_addr":"172.21.15.77:6801/4133026815","cluster_addr":"172.21.15.77:6803/4133026815","heartbeat_back_addr":"172.21.15.77:6807/4133026815","heartbeat_front_addr":"172.21.15.77:6805/4133026815","state":["exists","up"]},{"osd":2,"uuid":"2ac177aa-4d7d-4262-bd54-d2b9f29f4c3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6811","nonce":2394142159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6819","nonce":2394142159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6830","nonce":2394142159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6825","nonce":2394142159}]},"public_addr":"172.21.15.77:6811/2394142159","cluster_addr":"172.21.15.77:6819/2394142159","heartbeat_back_addr":"172.21.15.77:6830/2394142159","heartbeat_front_addr":"172.21.15.77:6825/2394142159","state":["exists","up"]},{"osd":3,"uuid":"17d7a251-19e8-484c-8172-a578ab3da153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6813","nonce":1492113982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6818","nonce":1492113982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6829","nonce":1492113982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6823","nonce":1492113982}]},"public_addr":"172.21.15.77:6813/1492113982","cluster_addr":"172.21.15.77:6818/1492113982","heartbeat_back_addr":"172.21.15.77:6829/1492113982","heartbeat_front_addr":"172.21.15.77:6823/1492113982","state":["exists","up"]},{"osd":4,"uuid":"bf63ca05-f06d-4e0f-ac44-2a416c70b919","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6825","nonce":1080481057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6827","nonce":1080481057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6831","nonce":1080481057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6829","nonce":1080481057}]},"public_addr":"172.21.15.103:6825/1080481057","cluster_addr":"172.21.15.103:6827/1080481057","heartbeat_back_addr":"172.21.15.103:6831/1080481057","heartbeat_front_addr":"172.21.15.103:6829/1080481057","state":["exists","up"]},{"osd":5,"uuid":"65a11a35-9e9f-4b3c-9fe3-b658d62b9318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6811","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6813","nonce":2756677504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6818","nonce":2756677504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6823","nonce":2756677504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6821","nonce":2756677504}]},"public_addr":"172.21.15.103:6813/2756677504","cluster_addr":"172.21.15.103:6818/2756677504","heartbeat_back_addr":"172.21.15.103:6823/2756677504","heartbeat_front_addr":"172.21.15.103:6821/2756677504","state":["exists","up"]},{"osd":6,"uuid":"750c1f87-686c-40b4-94a1-1a299dc78f3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6809","nonce":568977764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6812","nonce":568977764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6819","nonce":568977764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6815","nonce":568977764}]},"public_addr":"172.21.15.103:6809/568977764","cluster_addr":"172.21.15.103:6812/568977764","heartbeat_back_addr":"172.21.15.103:6819/568977764","heartbeat_front_addr":"172.21.15.103:6815/568977764","state":["exists","up"]},{"osd":7,"uuid":"d5fe4fb6-2e09-4158-885b-403803c85822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6801","nonce":1074557176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6803","nonce":1074557176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6807","nonce":1074557176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6805","nonce":1074557176}]},"public_addr":"172.21.15.103:6801/1074557176","cluster_addr":"172.21.15.103:6803/1074557176","heartbeat_back_addr":"172.21.15.103:6807/1074557176","heartbeat_front_addr":"172.21.15.103:6805/1074557176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.631032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.154109+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.398587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.679089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.311218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.353726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.314372+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.126212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1d","mappings":[{"from":3,"to":2}]},{"pgid":"4.31","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-24T05:47:27.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.717+0000 7f69fa269700 1 -- 172.21.15.77:0/1558640472 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f69e00662f0 msgr2=0x7f69e00687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:27.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.717+0000 7f69fa269700 1 --2- 172.21.15.77:0/1558640472 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f69e00662f0 0x7f69e00687b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f69e4009b90 tx=0x7f69e4008070 comp rx=0 tx=0).stop 2023-07-24T05:47:27.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.721+0000 7f69fa269700 1 -- 172.21.15.77:0/1558640472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69f40cde50 msgr2=0x7f69f40c00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:27.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.721+0000 7f69fa269700 1 --2- 172.21.15.77:0/1558640472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69f40cde50 0x7f69f40c00c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f69ec00cae0 tx=0x7f69ec00cb10 comp rx=0 tx=0).stop 2023-07-24T05:47:27.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.721+0000 7f69fa269700 1 -- 172.21.15.77:0/1558640472 shutdown_connections 2023-07-24T05:47:27.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.721+0000 7f69fa269700 1 --2- 172.21.15.77:0/1558640472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f69f40cde50 0x7f69f40c00c0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:27.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.721+0000 7f69fa269700 1 --2- 172.21.15.77:0/1558640472 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f69e00662f0 0x7f69e00687b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:27.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.721+0000 7f69fa269700 1 --2- 172.21.15.77:0/1558640472 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f69f40cc520 0x7f69f40c4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:27.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.721+0000 7f69fa269700 1 --2- 172.21.15.77:0/1558640472 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69f40ca890 0x7f69f40c2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:27.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.721+0000 7f69fa269700 1 -- 172.21.15.77:0/1558640472 >> 172.21.15.77:0/1558640472 conn(0x7f69f40ce410 msgr2=0x7f69f406c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:27.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.721+0000 7f69fa269700 1 -- 172.21.15.77:0/1558640472 shutdown_connections 2023-07-24T05:47:27.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.721+0000 7f69fa269700 1 -- 172.21.15.77:0/1558640472 wait complete. 2023-07-24T05:47:27.747 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-24T05:45:52.610430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-24T05:45:52.773787+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-24T05:45:58.121732+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-24T05:45:59.368726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-24T05:46:03.032057+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-24T05:47:27.748 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-24T05:47:27.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.925+0000 7f21ad253700 1 Processor -- start 2023-07-24T05:47:27.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.925+0000 7f21ad253700 1 -- start start 2023-07-24T05:47:27.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.929+0000 7f21ad253700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f21a815c870 0x7f21a80cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:27.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.929+0000 7f21ad253700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f21a815cc50 0x7f21a80b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:27.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.929+0000 7f21ad253700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21a80cf520 con 0x7f21a806a520 2023-07-24T05:47:27.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.929+0000 7f21ad253700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21a806aaa0 con 0x7f21a815cc50 2023-07-24T05:47:27.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.929+0000 7f21ad253700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21a806ad80 con 0x7f21a815c870 2023-07-24T05:47:27.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.929+0000 7f219ffff700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f21a815cc50 0x7f21a80b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:27.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.929+0000 7f21aca52700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f21a806a520 0x7f21a80b40e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:60324/0 (socket says 172.21.15.77:60324) 2023-07-24T05:47:27.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.929+0000 7f21aca52700 1 -- 172.21.15.77:0/540495191 learned_addr learned my addr 172.21.15.77:0/540495191 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:27.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.929+0000 7f21a7fff700 1 --2- 172.21.15.77:0/540495191 >> v2:172.21.15.103:3300/0 conn(0x7f21a815c870 0x7f21a80cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:27.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.929+0000 7f219ffff700 1 -- 172.21.15.77:0/540495191 >> v2:172.21.15.103:3300/0 conn(0x7f21a815c870 msgr2=0x7f21a80cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:27.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.929+0000 7f219ffff700 1 --2- 172.21.15.77:0/540495191 >> v2:172.21.15.103:3300/0 conn(0x7f21a815c870 0x7f21a80cefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:27.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.929+0000 7f219ffff700 1 -- 172.21.15.77:0/540495191 >> v1:172.21.15.77:6789/0 conn(0x7f21a806a520 legacy=0x7f21a80b40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:27.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.929+0000 7f219ffff700 1 -- 172.21.15.77:0/540495191 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a806b060 con 0x7f21a815cc50 2023-07-24T05:47:27.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.929+0000 7f21a77fe700 1 -- 172.21.15.77:0/540495191 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1252944395 0 0) 0x7f21a80cf520 con 0x7f21a806a520 2023-07-24T05:47:27.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.929+0000 7f219ffff700 1 --2- 172.21.15.77:0/540495191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21a815cc50 0x7f21a80b1b20 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f21a80b7e30 tx=0x7f2190009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb4729ec0d09b61a server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:27.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.929+0000 7f21a77fe700 1 -- 172.21.15.77:0/540495191 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2190011830 con 0x7f21a815cc50 2023-07-24T05:47:27.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.929+0000 7f21a77fe700 1 -- 172.21.15.77:0/540495191 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2190011990 con 0x7f21a815cc50 2023-07-24T05:47:27.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.929+0000 7f21a77fe700 1 -- 172.21.15.77:0/540495191 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2190011d40 con 0x7f21a815cc50 2023-07-24T05:47:27.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.933+0000 7f21ad253700 1 -- 172.21.15.77:0/540495191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21a815cc50 msgr2=0x7f21a80b1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:27.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.933+0000 7f21ad253700 1 --2- 172.21.15.77:0/540495191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21a815cc50 0x7f21a80b1b20 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f21a80b7e30 tx=0x7f2190009b30 comp rx=0 tx=0).stop 2023-07-24T05:47:27.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.933+0000 7f21ad253700 1 -- 172.21.15.77:0/540495191 shutdown_connections 2023-07-24T05:47:27.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.933+0000 7f21ad253700 1 --2- 172.21.15.77:0/540495191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21a815cc50 0x7f21a80b1b20 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:27.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.933+0000 7f21ad253700 1 --2- 172.21.15.77:0/540495191 >> v2:172.21.15.103:3300/0 conn(0x7f21a815c870 0x7f21a80cefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:27.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.933+0000 7f21ad253700 1 -- 172.21.15.77:0/540495191 >> 172.21.15.77:0/540495191 conn(0x7f21a8089f80 msgr2=0x7f21a809b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:27.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.933+0000 7f21ad253700 1 -- 172.21.15.77:0/540495191 shutdown_connections 2023-07-24T05:47:27.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.933+0000 7f21ad253700 1 -- 172.21.15.77:0/540495191 wait complete. 2023-07-24T05:47:27.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.933+0000 7f21ad253700 1 Processor -- start 2023-07-24T05:47:27.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.933+0000 7f21ad253700 1 -- start start 2023-07-24T05:47:27.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.937+0000 7f21ad253700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21a806a520 0x7f21a80b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:27.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.937+0000 7f21ad253700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21a815c870 0x7f21a80d0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:27.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.937+0000 7f21ad253700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21a815cc50 0x7f21a80d2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:27.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.937+0000 7f21ad253700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a80d0970 con 0x7f21a806a520 2023-07-24T05:47:27.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.937+0000 7f21ad253700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a80d25c0 con 0x7f21a815cc50 2023-07-24T05:47:27.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.937+0000 7f21ad253700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a80d2860 con 0x7f21a815c870 2023-07-24T05:47:27.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.937+0000 7f21a7fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21a806a520 0x7f21a80b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:27.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.937+0000 7f21a7fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21a806a520 0x7f21a80b1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41448/0 (socket says 172.21.15.77:41448) 2023-07-24T05:47:27.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.937+0000 7f21a7fff700 1 -- 172.21.15.77:0/396888699 learned_addr learned my addr 172.21.15.77:0/396888699 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:27.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.937+0000 7f219ffff700 1 --2- 172.21.15.77:0/396888699 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21a815c870 0x7f21a80d0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:27.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.937+0000 7f21aca52700 1 --2- 172.21.15.77:0/396888699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21a815cc50 0x7f21a80d2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:27.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.937+0000 7f21a7fff700 1 -- 172.21.15.77:0/396888699 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21a815c870 msgr2=0x7f21a80d0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:27.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.937+0000 7f21a7fff700 1 --2- 172.21.15.77:0/396888699 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21a815c870 0x7f21a80d0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:27.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.937+0000 7f21a7fff700 1 -- 172.21.15.77:0/396888699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21a815cc50 msgr2=0x7f21a80d2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:27.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.937+0000 7f21a7fff700 1 --2- 172.21.15.77:0/396888699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21a815cc50 0x7f21a80d2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:27.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.937+0000 7f21a7fff700 1 -- 172.21.15.77:0/396888699 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21900094b0 con 0x7f21a806a520 2023-07-24T05:47:27.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.937+0000 7f21aca52700 1 --2- 172.21.15.77:0/396888699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21a815cc50 0x7f21a80d2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:27.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.937+0000 7f21a7fff700 1 --2- 172.21.15.77:0/396888699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21a806a520 0x7f21a80b1ca0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f219800d800 tx=0x7f219800db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:27.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.937+0000 7f21a57fa700 1 -- 172.21.15.77:0/396888699 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2198017070 con 0x7f21a806a520 2023-07-24T05:47:27.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.937+0000 7f21a57fa700 1 -- 172.21.15.77:0/396888699 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2198005a40 con 0x7f21a806a520 2023-07-24T05:47:27.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.937+0000 7f21ad253700 1 -- 172.21.15.77:0/396888699 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21a80d02b0 con 0x7f21a806a520 2023-07-24T05:47:27.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.937+0000 7f21a57fa700 1 -- 172.21.15.77:0/396888699 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2198005bf0 con 0x7f21a806a520 2023-07-24T05:47:27.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.937+0000 7f21ad253700 1 -- 172.21.15.77:0/396888699 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21a80d2b40 con 0x7f21a806a520 2023-07-24T05:47:27.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.941+0000 7f21ad253700 1 -- 172.21.15.77:0/396888699 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21a80c6000 con 0x7f21a806a520 2023-07-24T05:47:27.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.941+0000 7f21a57fa700 1 -- 172.21.15.77:0/396888699 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2198005d50 con 0x7f21a806a520 2023-07-24T05:47:27.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.941+0000 7f21a57fa700 1 --2- 172.21.15.77:0/396888699 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f21880662f0 0x7f21880687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:27.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.941+0000 7f21a57fa700 1 -- 172.21.15.77:0/396888699 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2198083b20 con 0x7f21a806a520 2023-07-24T05:47:27.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.945+0000 7f219ffff700 1 --2- 172.21.15.77:0/396888699 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f21880662f0 0x7f21880687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:27.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.945+0000 7f219ffff700 1 --2- 172.21.15.77:0/396888699 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f21880662f0 0x7f21880687b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2190009b70 tx=0x7f2190008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:27.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:27.949+0000 7f21a57fa700 1 -- 172.21.15.77:0/396888699 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f21980546f0 con 0x7f21a806a520 2023-07-24T05:47:28.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.121+0000 7f21ad253700 1 -- 172.21.15.77:0/396888699 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f21a8072490 con 0x7f21a806a520 2023-07-24T05:47:28.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.121+0000 7f21a57fa700 1 -- 172.21.15.77:0/396888699 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2198054280 con 0x7f21a806a520 2023-07-24T05:47:28.128 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-07-24T05:47:28.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.125+0000 7f21ad253700 1 -- 172.21.15.77:0/396888699 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f21880662f0 msgr2=0x7f21880687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:28.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.125+0000 7f21ad253700 1 --2- 172.21.15.77:0/396888699 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f21880662f0 0x7f21880687b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2190009b70 tx=0x7f2190008030 comp rx=0 tx=0).stop 2023-07-24T05:47:28.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.125+0000 7f21ad253700 1 -- 172.21.15.77:0/396888699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21a806a520 msgr2=0x7f21a80b1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:28.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.125+0000 7f21ad253700 1 --2- 172.21.15.77:0/396888699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21a806a520 0x7f21a80b1ca0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f219800d800 tx=0x7f219800db10 comp rx=0 tx=0).stop 2023-07-24T05:47:28.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.129+0000 7f21ad253700 1 -- 172.21.15.77:0/396888699 shutdown_connections 2023-07-24T05:47:28.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.129+0000 7f21ad253700 1 --2- 172.21.15.77:0/396888699 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21a815cc50 0x7f21a80d2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:28.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.129+0000 7f21ad253700 1 --2- 172.21.15.77:0/396888699 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f21880662f0 0x7f21880687b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:28.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.129+0000 7f21ad253700 1 --2- 172.21.15.77:0/396888699 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f21a815c870 0x7f21a80d0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:28.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.129+0000 7f21ad253700 1 --2- 172.21.15.77:0/396888699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21a806a520 0x7f21a80b1ca0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:28.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.129+0000 7f21ad253700 1 -- 172.21.15.77:0/396888699 >> 172.21.15.77:0/396888699 conn(0x7f21a8089f80 msgr2=0x7f21a80b5190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:28.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.129+0000 7f21ad253700 1 -- 172.21.15.77:0/396888699 shutdown_connections 2023-07-24T05:47:28.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.129+0000 7f21ad253700 1 -- 172.21.15.77:0/396888699 wait complete. 2023-07-24T05:47:28.154 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-24T05:47:28.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.321+0000 7f70f3fff700 1 Processor -- start 2023-07-24T05:47:28.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.321+0000 7f70f3fff700 1 -- start start 2023-07-24T05:47:28.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.321+0000 7f70f3fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f70f415c870 0x7f70f40cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:28.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.325+0000 7f70f3fff700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70f40cf520 con 0x7f70f40b2230 2023-07-24T05:47:28.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.325+0000 7f70f3fff700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70f406aaa0 con 0x7f70f415cc50 2023-07-24T05:47:28.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.325+0000 7f70f3fff700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70f406ad80 con 0x7f70f415c870 2023-07-24T05:47:28.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.325+0000 7f70f37fe700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f70f40b2230 0x7f70f40cd090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:60338/0 (socket says 172.21.15.77:60338) 2023-07-24T05:47:28.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.325+0000 7f70f37fe700 1 -- 172.21.15.77:0/977914021 learned_addr learned my addr 172.21.15.77:0/977914021 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:28.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.325+0000 7f70f2ffd700 1 --2- 172.21.15.77:0/977914021 >> v2:172.21.15.103:3300/0 conn(0x7f70f415c870 0x7f70f40cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:28.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.325+0000 7f70f27fc700 1 -- 172.21.15.77:0/977914021 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 765264101 0 0) 0x7f70f40cf520 con 0x7f70f40b2230 2023-07-24T05:47:28.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.325+0000 7f70f27fc700 1 -- 172.21.15.77:0/977914021 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70e00035d0 con 0x7f70f40b2230 2023-07-24T05:47:28.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.325+0000 7f70f2ffd700 1 -- 172.21.15.77:0/977914021 >> v1:172.21.15.103:6789/0 conn(0x7f70f415cc50 legacy=0x7f70f40b1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:28.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.325+0000 7f70f27fc700 1 -- 172.21.15.77:0/977914021 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 684335449 0 0) 0x7f70f406aaa0 con 0x7f70f415cc50 2023-07-24T05:47:28.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.325+0000 7f70f2ffd700 1 -- 172.21.15.77:0/977914021 >> v1:172.21.15.77:6789/0 conn(0x7f70f40b2230 legacy=0x7f70f40cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:28.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.325+0000 7f70f2ffd700 1 -- 172.21.15.77:0/977914021 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f406b060 con 0x7f70f415c870 2023-07-24T05:47:28.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.325+0000 7f70f2ffd700 1 --2- 172.21.15.77:0/977914021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70f415c870 0x7f70f40cefe0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f70e4009840 tx=0x7f70e4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fcecf74c5f2a22a server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:28.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.325+0000 7f70f27fc700 1 -- 172.21.15.77:0/977914021 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e4005e50 con 0x7f70f415c870 2023-07-24T05:47:28.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.325+0000 7f70f27fc700 1 -- 172.21.15.77:0/977914021 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e4006030 con 0x7f70f415c870 2023-07-24T05:47:28.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.325+0000 7f70f27fc700 1 -- 172.21.15.77:0/977914021 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e40063c0 con 0x7f70f415c870 2023-07-24T05:47:28.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.325+0000 7f70f3fff700 1 -- 172.21.15.77:0/977914021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70f415c870 msgr2=0x7f70f40cefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:28.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.325+0000 7f70f3fff700 1 --2- 172.21.15.77:0/977914021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70f415c870 0x7f70f40cefe0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f70e4009840 tx=0x7f70e4009b50 comp rx=0 tx=0).stop 2023-07-24T05:47:28.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.325+0000 7f70f3fff700 1 -- 172.21.15.77:0/977914021 shutdown_connections 2023-07-24T05:47:28.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.325+0000 7f70f3fff700 1 --2- 172.21.15.77:0/977914021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70f415c870 0x7f70f40cefe0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:28.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.329+0000 7f70f3fff700 1 -- 172.21.15.77:0/977914021 >> 172.21.15.77:0/977914021 conn(0x7f70f4089f80 msgr2=0x7f70f409b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:28.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.329+0000 7f70f3fff700 1 -- 172.21.15.77:0/977914021 shutdown_connections 2023-07-24T05:47:28.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.329+0000 7f70f3fff700 1 -- 172.21.15.77:0/977914021 wait complete. 2023-07-24T05:47:28.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.329+0000 7f70f3fff700 1 Processor -- start 2023-07-24T05:47:28.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.329+0000 7f70f3fff700 1 -- start start 2023-07-24T05:47:28.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.333+0000 7f70f3fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70f40b2230 0x7f70f4150c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:28.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.333+0000 7f70f3fff700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f70f415c870 0x7f70f4152de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:28.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.333+0000 7f70f3fff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70f415cc50 0x7f70f40b1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:28.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.333+0000 7f70f3fff700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f41527a0 con 0x7f70f40b2230 2023-07-24T05:47:28.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.333+0000 7f70f3fff700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70f4151700 con 0x7f70f415cc50 2023-07-24T05:47:28.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.333+0000 7f70f3fff700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70f41519e0 con 0x7f70f415c870 2023-07-24T05:47:28.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.333+0000 7f70f2ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70f40b2230 0x7f70f4150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:28.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.333+0000 7f70f2ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70f40b2230 0x7f70f4150c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41462/0 (socket says 172.21.15.77:41462) 2023-07-24T05:47:28.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.333+0000 7f70f2ffd700 1 -- 172.21.15.77:0/3495047329 learned_addr learned my addr 172.21.15.77:0/3495047329 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:28.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.333+0000 7f70ebfff700 1 --2- 172.21.15.77:0/3495047329 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f70f415c870 0x7f70f4152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:28.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.333+0000 7f70f37fe700 1 --2- 172.21.15.77:0/3495047329 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70f415cc50 0x7f70f40b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:28.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.333+0000 7f70f2ffd700 1 -- 172.21.15.77:0/3495047329 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f70f415c870 msgr2=0x7f70f4152de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:28.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.333+0000 7f70f2ffd700 1 --2- 172.21.15.77:0/3495047329 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f70f415c870 0x7f70f4152de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:28.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.333+0000 7f70f2ffd700 1 -- 172.21.15.77:0/3495047329 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70f415cc50 msgr2=0x7f70f40b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:28.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.333+0000 7f70f2ffd700 1 --2- 172.21.15.77:0/3495047329 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70f415cc50 0x7f70f40b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:28.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.333+0000 7f70f2ffd700 1 -- 172.21.15.77:0/3495047329 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e4009450 con 0x7f70f40b2230 2023-07-24T05:47:28.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.333+0000 7f70f37fe700 1 --2- 172.21.15.77:0/3495047329 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70f415cc50 0x7f70f40b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:28.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.333+0000 7f70f2ffd700 1 --2- 172.21.15.77:0/3495047329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70f40b2230 0x7f70f4150c70 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f70e4013040 tx=0x7f70e4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:28.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.333+0000 7f70eb7fe700 1 -- 172.21.15.77:0/3495047329 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e4006990 con 0x7f70f40b2230 2023-07-24T05:47:28.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.333+0000 7f70eb7fe700 1 -- 172.21.15.77:0/3495047329 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e4020070 con 0x7f70f40b2230 2023-07-24T05:47:28.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.333+0000 7f70f3fff700 1 -- 172.21.15.77:0/3495047329 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70f4151cc0 con 0x7f70f40b2230 2023-07-24T05:47:28.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.333+0000 7f70eb7fe700 1 -- 172.21.15.77:0/3495047329 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e4025670 con 0x7f70f40b2230 2023-07-24T05:47:28.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.333+0000 7f70f3fff700 1 -- 172.21.15.77:0/3495047329 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70f4152280 con 0x7f70f40b2230 2023-07-24T05:47:28.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.337+0000 7f70f3fff700 1 -- 172.21.15.77:0/3495047329 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70f4072490 con 0x7f70f40b2230 2023-07-24T05:47:28.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.337+0000 7f70eb7fe700 1 -- 172.21.15.77:0/3495047329 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f70e4022030 con 0x7f70f40b2230 2023-07-24T05:47:28.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.337+0000 7f70eb7fe700 1 --2- 172.21.15.77:0/3495047329 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f70d40662f0 0x7f70d40687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:28.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.341+0000 7f70eb7fe700 1 -- 172.21.15.77:0/3495047329 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f70e40855e0 con 0x7f70f40b2230 2023-07-24T05:47:28.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.341+0000 7f70ebfff700 1 --2- 172.21.15.77:0/3495047329 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f70d40662f0 0x7f70d40687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:28.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.341+0000 7f70ebfff700 1 --2- 172.21.15.77:0/3495047329 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f70d40662f0 0x7f70d40687b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f70f41e7080 tx=0x7f70dc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:28.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.345+0000 7f70eb7fe700 1 -- 172.21.15.77:0/3495047329 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f70e40528e0 con 0x7f70f40b2230 2023-07-24T05:47:28.522 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.517+0000 7f70f3fff700 1 -- 172.21.15.77:0/3495047329 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f70f415b650 con 0x7f70f40b2230 2023-07-24T05:47:28.523 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.517+0000 7f70eb7fe700 1 -- 172.21.15.77:0/3495047329 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f70e4055f00 con 0x7f70f40b2230 2023-07-24T05:47:28.524 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 8 2023-07-24T05:47:28.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.521+0000 7f70f3fff700 1 -- 172.21.15.77:0/3495047329 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f70d40662f0 msgr2=0x7f70d40687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:28.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.521+0000 7f70f3fff700 1 --2- 172.21.15.77:0/3495047329 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f70d40662f0 0x7f70d40687b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f70f41e7080 tx=0x7f70dc009040 comp rx=0 tx=0).stop 2023-07-24T05:47:28.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.521+0000 7f70f3fff700 1 -- 172.21.15.77:0/3495047329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70f40b2230 msgr2=0x7f70f4150c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:28.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.521+0000 7f70f3fff700 1 --2- 172.21.15.77:0/3495047329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70f40b2230 0x7f70f4150c70 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f70e4013040 tx=0x7f70e4004770 comp rx=0 tx=0).stop 2023-07-24T05:47:28.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.521+0000 7f70f3fff700 1 -- 172.21.15.77:0/3495047329 shutdown_connections 2023-07-24T05:47:28.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.521+0000 7f70f3fff700 1 --2- 172.21.15.77:0/3495047329 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70f415cc50 0x7f70f40b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:28.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.521+0000 7f70f3fff700 1 --2- 172.21.15.77:0/3495047329 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f70d40662f0 0x7f70d40687b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:28.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.521+0000 7f70f3fff700 1 --2- 172.21.15.77:0/3495047329 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f70f415c870 0x7f70f4152de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:28.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.521+0000 7f70f3fff700 1 --2- 172.21.15.77:0/3495047329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f70f40b2230 0x7f70f4150c70 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:28.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.521+0000 7f70f3fff700 1 -- 172.21.15.77:0/3495047329 >> 172.21.15.77:0/3495047329 conn(0x7f70f4089f80 msgr2=0x7f70f4069b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:28.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.521+0000 7f70f3fff700 1 -- 172.21.15.77:0/3495047329 shutdown_connections 2023-07-24T05:47:28.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.521+0000 7f70f3fff700 1 -- 172.21.15.77:0/3495047329 wait complete. 2023-07-24T05:47:28.546 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-24T05:47:28.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.721+0000 7f0339937700 1 Processor -- start 2023-07-24T05:47:28.728 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.721+0000 7f0339937700 1 -- start start 2023-07-24T05:47:28.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.725+0000 7f0339937700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f033415cc50 0x7f03340b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:28.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.725+0000 7f0339937700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f033406a520 0x7f03340b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:28.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.725+0000 7f0339937700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f033406aaa0 con 0x7f033415c870 2023-07-24T05:47:28.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.725+0000 7f0339937700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f033406ad80 con 0x7f033406a520 2023-07-24T05:47:28.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.725+0000 7f0339937700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f033406b060 con 0x7f033415cc50 2023-07-24T05:47:28.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.725+0000 7f0338935700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f033415c870 0x7f03340cefe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:60352/0 (socket says 172.21.15.77:60352) 2023-07-24T05:47:28.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.725+0000 7f0338935700 1 -- 172.21.15.77:0/3770296690 learned_addr learned my addr 172.21.15.77:0/3770296690 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:28.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.725+0000 7f0339136700 1 --2- 172.21.15.77:0/3770296690 >> v2:172.21.15.77:3300/0 conn(0x7f033406a520 0x7f03340b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:28.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.725+0000 7f0333fff700 1 --2- 172.21.15.77:0/3770296690 >> v2:172.21.15.103:3300/0 conn(0x7f033415cc50 0x7f03340b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:28.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.725+0000 7f0339136700 1 -- 172.21.15.77:0/3770296690 >> v2:172.21.15.103:3300/0 conn(0x7f033415cc50 msgr2=0x7f03340b1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:28.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.725+0000 7f03337fe700 1 -- 172.21.15.77:0/3770296690 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4122874563 0 0) 0x7f033406aaa0 con 0x7f033415c870 2023-07-24T05:47:28.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.729+0000 7f0339136700 1 --2- 172.21.15.77:0/3770296690 >> v2:172.21.15.103:3300/0 conn(0x7f033415cc50 0x7f03340b1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:28.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.729+0000 7f0339136700 1 -- 172.21.15.77:0/3770296690 >> v1:172.21.15.77:6789/0 conn(0x7f033415c870 legacy=0x7f03340cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:28.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.729+0000 7f0339136700 1 -- 172.21.15.77:0/3770296690 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f033406b340 con 0x7f033406a520 2023-07-24T05:47:28.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.729+0000 7f0339136700 1 --2- 172.21.15.77:0/3770296690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f033406a520 0x7f03340b2060 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f03340670d0 tx=0x7f032c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcaa7afac638cc45 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:28.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.729+0000 7f03337fe700 1 -- 172.21.15.77:0/3770296690 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032c00e070 con 0x7f033406a520 2023-07-24T05:47:28.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.729+0000 7f03337fe700 1 -- 172.21.15.77:0/3770296690 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032c00bb20 con 0x7f033406a520 2023-07-24T05:47:28.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.729+0000 7f03337fe700 1 -- 172.21.15.77:0/3770296690 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032c012430 con 0x7f033406a520 2023-07-24T05:47:28.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.729+0000 7f0339937700 1 -- 172.21.15.77:0/3770296690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f033406a520 msgr2=0x7f03340b2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:28.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.729+0000 7f0339937700 1 --2- 172.21.15.77:0/3770296690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f033406a520 0x7f03340b2060 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f03340670d0 tx=0x7f032c00b330 comp rx=0 tx=0).stop 2023-07-24T05:47:28.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.729+0000 7f0339937700 1 -- 172.21.15.77:0/3770296690 shutdown_connections 2023-07-24T05:47:28.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.729+0000 7f0339937700 1 --2- 172.21.15.77:0/3770296690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f033406a520 0x7f03340b2060 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:28.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.729+0000 7f0339937700 1 --2- 172.21.15.77:0/3770296690 >> v2:172.21.15.103:3300/0 conn(0x7f033415cc50 0x7f03340b1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:28.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.729+0000 7f0339937700 1 -- 172.21.15.77:0/3770296690 >> 172.21.15.77:0/3770296690 conn(0x7f0334089f80 msgr2=0x7f033409b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:28.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.729+0000 7f0339937700 1 -- 172.21.15.77:0/3770296690 shutdown_connections 2023-07-24T05:47:28.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.729+0000 7f0339937700 1 -- 172.21.15.77:0/3770296690 wait complete. 2023-07-24T05:47:28.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.733+0000 7f0339937700 1 Processor -- start 2023-07-24T05:47:28.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.733+0000 7f0339937700 1 -- start start 2023-07-24T05:47:28.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.733+0000 7f0339937700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f033406a520 0x7f033406d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:28.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.733+0000 7f0339937700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f033415c870 0x7f0334154060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:28.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.733+0000 7f0339937700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f033415cc50 0x7f03340c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:28.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.733+0000 7f0339937700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03340cc110 con 0x7f033415c870 2023-07-24T05:47:28.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.733+0000 7f0339937700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03340cb500 con 0x7f033406a520 2023-07-24T05:47:28.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.733+0000 7f0339937700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03340cb7e0 con 0x7f033415cc50 2023-07-24T05:47:28.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.733+0000 7f0333fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f033415c870 0x7f0334154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:28.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.733+0000 7f0333fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f033415c870 0x7f0334154060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41484/0 (socket says 172.21.15.77:41484) 2023-07-24T05:47:28.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.733+0000 7f0333fff700 1 -- 172.21.15.77:0/276235452 learned_addr learned my addr 172.21.15.77:0/276235452 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:28.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.733+0000 7f0338935700 1 --2- 172.21.15.77:0/276235452 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f033406a520 0x7f033406d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:28.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.733+0000 7f0339136700 1 --2- 172.21.15.77:0/276235452 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f033415cc50 0x7f03340c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:28.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.733+0000 7f0333fff700 1 -- 172.21.15.77:0/276235452 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f033415cc50 msgr2=0x7f03340c7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:28.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.733+0000 7f0333fff700 1 --2- 172.21.15.77:0/276235452 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f033415cc50 0x7f03340c7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:28.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.733+0000 7f0333fff700 1 -- 172.21.15.77:0/276235452 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f033406a520 msgr2=0x7f033406d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:28.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.733+0000 7f0333fff700 1 --2- 172.21.15.77:0/276235452 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f033406a520 0x7f033406d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:28.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.733+0000 7f0333fff700 1 -- 172.21.15.77:0/276235452 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f032c009a70 con 0x7f033415c870 2023-07-24T05:47:28.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.737+0000 7f0333fff700 1 --2- 172.21.15.77:0/276235452 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f033415c870 0x7f0334154060 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f032000e840 tx=0x7f032000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:28.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.737+0000 7f03317fa700 1 -- 172.21.15.77:0/276235452 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03200095a0 con 0x7f033415c870 2023-07-24T05:47:28.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.737+0000 7f03317fa700 1 -- 172.21.15.77:0/276235452 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0320013680 con 0x7f033415c870 2023-07-24T05:47:28.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.737+0000 7f0339937700 1 -- 172.21.15.77:0/276235452 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03340cbac0 con 0x7f033415c870 2023-07-24T05:47:28.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.737+0000 7f03317fa700 1 -- 172.21.15.77:0/276235452 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03200139f0 con 0x7f033415c870 2023-07-24T05:47:28.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.737+0000 7f0339937700 1 -- 172.21.15.77:0/276235452 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03340cb140 con 0x7f033415c870 2023-07-24T05:47:28.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.737+0000 7f0339937700 1 -- 172.21.15.77:0/276235452 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03340d0910 con 0x7f033415c870 2023-07-24T05:47:28.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.737+0000 7f03317fa700 1 -- 172.21.15.77:0/276235452 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0320013b50 con 0x7f033415c870 2023-07-24T05:47:28.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.741+0000 7f03317fa700 1 --2- 172.21.15.77:0/276235452 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f03180662f0 0x7f03180687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:28.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.741+0000 7f03317fa700 1 -- 172.21.15.77:0/276235452 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0320083f80 con 0x7f033415c870 2023-07-24T05:47:28.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.741+0000 7f0338935700 1 --2- 172.21.15.77:0/276235452 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f03180662f0 0x7f03180687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:28.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.741+0000 7f0338935700 1 --2- 172.21.15.77:0/276235452 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f03180662f0 0x7f03180687b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f03280010e0 tx=0x7f0328009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:28.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.745+0000 7f03317fa700 1 -- 172.21.15.77:0/276235452 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0320054a40 con 0x7f033415c870 2023-07-24T05:47:28.924 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.917+0000 7f0339937700 1 -- 172.21.15.77:0/276235452 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0334072490 con 0x7f033415c870 2023-07-24T05:47:28.925 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.917+0000 7f03317fa700 1 -- 172.21.15.77:0/276235452 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f03200545d0 con 0x7f033415c870 2023-07-24T05:47:28.925 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-07-24T05:47:28.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.921+0000 7f0339937700 1 -- 172.21.15.77:0/276235452 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f03180662f0 msgr2=0x7f03180687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:28.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.921+0000 7f0339937700 1 --2- 172.21.15.77:0/276235452 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f03180662f0 0x7f03180687b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f03280010e0 tx=0x7f0328009040 comp rx=0 tx=0).stop 2023-07-24T05:47:28.927 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.921+0000 7f0339937700 1 -- 172.21.15.77:0/276235452 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f033415c870 msgr2=0x7f0334154060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:28.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.921+0000 7f0339937700 1 --2- 172.21.15.77:0/276235452 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f033415c870 0x7f0334154060 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f032000e840 tx=0x7f032000eb50 comp rx=0 tx=0).stop 2023-07-24T05:47:28.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.921+0000 7f0339937700 1 -- 172.21.15.77:0/276235452 shutdown_connections 2023-07-24T05:47:28.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.921+0000 7f0339937700 1 --2- 172.21.15.77:0/276235452 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f03180662f0 0x7f03180687b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:28.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.921+0000 7f0339937700 1 --2- 172.21.15.77:0/276235452 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f033415cc50 0x7f03340c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:28.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.921+0000 7f0339937700 1 --2- 172.21.15.77:0/276235452 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f033415c870 0x7f0334154060 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:28.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.921+0000 7f0339937700 1 --2- 172.21.15.77:0/276235452 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f033406a520 0x7f033406d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:28.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.921+0000 7f0339937700 1 -- 172.21.15.77:0/276235452 >> 172.21.15.77:0/276235452 conn(0x7f0334089f80 msgr2=0x7f0334154cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:28.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.921+0000 7f0339937700 1 -- 172.21.15.77:0/276235452 shutdown_connections 2023-07-24T05:47:28.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:28.921+0000 7f0339937700 1 -- 172.21.15.77:0/276235452 wait complete. 2023-07-24T05:47:28.951 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-24T05:47:29.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.117+0000 7f5e83fff700 1 Processor -- start 2023-07-24T05:47:29.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.117+0000 7f5e83fff700 1 -- start start 2023-07-24T05:47:29.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.121+0000 7f5e83fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5e84159840 0x7f5e8406bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:29.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.121+0000 7f5e83fff700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5e840ced80 0x7f5e84070360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:29.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.121+0000 7f5e83fff700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e8406c1d0 con 0x7f5e840ca2d0 2023-07-24T05:47:29.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.121+0000 7f5e83fff700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e8406daa0 con 0x7f5e840ced80 2023-07-24T05:47:29.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.121+0000 7f5e83fff700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e840cf210 con 0x7f5e84159840 2023-07-24T05:47:29.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.121+0000 7f5e837fe700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5e840ced80 0x7f5e84070360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:29.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.121+0000 7f5e827fc700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f5e840ca2d0 0x7f5e8406fc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:60360/0 (socket says 172.21.15.77:60360) 2023-07-24T05:47:29.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.121+0000 7f5e837fe700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5e840ced80 0x7f5e84070360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41488/0 (socket says 172.21.15.77:41488) 2023-07-24T05:47:29.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.121+0000 7f5e827fc700 1 -- 172.21.15.77:0/183252626 learned_addr learned my addr 172.21.15.77:0/183252626 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:29.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.121+0000 7f5e82ffd700 1 --2- 172.21.15.77:0/183252626 >> v2:172.21.15.103:3300/0 conn(0x7f5e84159840 0x7f5e8406bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:29.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.121+0000 7f5e837fe700 1 -- 172.21.15.77:0/183252626 >> v2:172.21.15.103:3300/0 conn(0x7f5e84159840 msgr2=0x7f5e8406bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:29.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.121+0000 7f5e837fe700 1 --2- 172.21.15.77:0/183252626 >> v2:172.21.15.103:3300/0 conn(0x7f5e84159840 0x7f5e8406bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:29.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.121+0000 7f5e837fe700 1 -- 172.21.15.77:0/183252626 >> v1:172.21.15.77:6789/0 conn(0x7f5e840ca2d0 legacy=0x7f5e8406fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:29.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.121+0000 7f5e837fe700 1 -- 172.21.15.77:0/183252626 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e840ca730 con 0x7f5e840ced80 2023-07-24T05:47:29.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.121+0000 7f5e81ffb700 1 -- 172.21.15.77:0/183252626 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2346805476 0 0) 0x7f5e8406c1d0 con 0x7f5e840ca2d0 2023-07-24T05:47:29.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.125+0000 7f5e837fe700 1 --2- 172.21.15.77:0/183252626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e840ced80 0x7f5e84070360 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f5e84078d20 tx=0x7f5e7c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7352c480b0b641c server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:29.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.125+0000 7f5e81ffb700 1 -- 172.21.15.77:0/183252626 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c00bce0 con 0x7f5e840ced80 2023-07-24T05:47:29.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.125+0000 7f5e81ffb700 1 -- 172.21.15.77:0/183252626 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7c00be40 con 0x7f5e840ced80 2023-07-24T05:47:29.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.125+0000 7f5e81ffb700 1 -- 172.21.15.77:0/183252626 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c0116a0 con 0x7f5e840ced80 2023-07-24T05:47:29.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.125+0000 7f5e83fff700 1 -- 172.21.15.77:0/183252626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e840ced80 msgr2=0x7f5e84070360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:29.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.125+0000 7f5e83fff700 1 --2- 172.21.15.77:0/183252626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e840ced80 0x7f5e84070360 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f5e84078d20 tx=0x7f5e7c00b330 comp rx=0 tx=0).stop 2023-07-24T05:47:29.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.125+0000 7f5e83fff700 1 -- 172.21.15.77:0/183252626 shutdown_connections 2023-07-24T05:47:29.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.125+0000 7f5e83fff700 1 --2- 172.21.15.77:0/183252626 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e840ced80 0x7f5e84070360 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:29.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.125+0000 7f5e83fff700 1 --2- 172.21.15.77:0/183252626 >> v2:172.21.15.103:3300/0 conn(0x7f5e84159840 0x7f5e8406bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:29.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.125+0000 7f5e83fff700 1 -- 172.21.15.77:0/183252626 >> 172.21.15.77:0/183252626 conn(0x7f5e840ce260 msgr2=0x7f5e840ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:29.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.125+0000 7f5e83fff700 1 -- 172.21.15.77:0/183252626 shutdown_connections 2023-07-24T05:47:29.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.125+0000 7f5e83fff700 1 -- 172.21.15.77:0/183252626 wait complete. 2023-07-24T05:47:29.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.129+0000 7f5e83fff700 1 Processor -- start 2023-07-24T05:47:29.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.129+0000 7f5e83fff700 1 -- start start 2023-07-24T05:47:29.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.129+0000 7f5e83fff700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5e840ca2d0 0x7f5e840c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:29.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.129+0000 7f5e83fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e840ced80 0x7f5e84099fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:29.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.129+0000 7f5e83fff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e84159840 0x7f5e8409a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:29.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.129+0000 7f5e83fff700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e840c81f0 con 0x7f5e840ced80 2023-07-24T05:47:29.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.129+0000 7f5e83fff700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e840c5330 con 0x7f5e84159840 2023-07-24T05:47:29.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.129+0000 7f5e83fff700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8409aa50 con 0x7f5e840ca2d0 2023-07-24T05:47:29.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.129+0000 7f5e827fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e840ced80 0x7f5e84099fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:29.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.129+0000 7f5e827fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e840ced80 0x7f5e84099fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41490/0 (socket says 172.21.15.77:41490) 2023-07-24T05:47:29.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.129+0000 7f5e827fc700 1 -- 172.21.15.77:0/4248117780 learned_addr learned my addr 172.21.15.77:0/4248117780 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:29.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.129+0000 7f5e837fe700 1 --2- 172.21.15.77:0/4248117780 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e84159840 0x7f5e8409a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:29.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.129+0000 7f5e82ffd700 1 --2- 172.21.15.77:0/4248117780 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5e840ca2d0 0x7f5e840c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:29.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.129+0000 7f5e827fc700 1 -- 172.21.15.77:0/4248117780 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5e840ca2d0 msgr2=0x7f5e840c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:29.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.129+0000 7f5e827fc700 1 --2- 172.21.15.77:0/4248117780 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5e840ca2d0 0x7f5e840c7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:29.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.129+0000 7f5e827fc700 1 -- 172.21.15.77:0/4248117780 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e84159840 msgr2=0x7f5e8409a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:29.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.129+0000 7f5e827fc700 1 --2- 172.21.15.77:0/4248117780 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e84159840 0x7f5e8409a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:29.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.129+0000 7f5e827fc700 1 -- 172.21.15.77:0/4248117780 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e7c009a70 con 0x7f5e840ced80 2023-07-24T05:47:29.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.133+0000 7f5e827fc700 1 --2- 172.21.15.77:0/4248117780 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e840ced80 0x7f5e84099fd0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f5e7800c4e0 tx=0x7f5e7800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:29.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.133+0000 7f5e6bfff700 1 -- 172.21.15.77:0/4248117780 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e78004ca0 con 0x7f5e840ced80 2023-07-24T05:47:29.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.133+0000 7f5e6bfff700 1 -- 172.21.15.77:0/4248117780 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e78004e20 con 0x7f5e840ced80 2023-07-24T05:47:29.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.133+0000 7f5e83fff700 1 -- 172.21.15.77:0/4248117780 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e840c5580 con 0x7f5e840ced80 2023-07-24T05:47:29.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.133+0000 7f5e6bfff700 1 -- 172.21.15.77:0/4248117780 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e78007310 con 0x7f5e840ced80 2023-07-24T05:47:29.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.133+0000 7f5e83fff700 1 -- 172.21.15.77:0/4248117780 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e840c5b40 con 0x7f5e840ced80 2023-07-24T05:47:29.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.133+0000 7f5e83fff700 1 -- 172.21.15.77:0/4248117780 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e84072490 con 0x7f5e840ced80 2023-07-24T05:47:29.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.137+0000 7f5e6bfff700 1 -- 172.21.15.77:0/4248117780 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5e78007470 con 0x7f5e840ced80 2023-07-24T05:47:29.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.137+0000 7f5e6bfff700 1 --2- 172.21.15.77:0/4248117780 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f5e70066340 0x7f5e70068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:29.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.137+0000 7f5e6bfff700 1 -- 172.21.15.77:0/4248117780 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5e78083a90 con 0x7f5e840ced80 2023-07-24T05:47:29.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.137+0000 7f5e82ffd700 1 --2- 172.21.15.77:0/4248117780 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f5e70066340 0x7f5e70068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:29.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.137+0000 7f5e82ffd700 1 --2- 172.21.15.77:0/4248117780 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f5e70066340 0x7f5e70068800 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5e74009bf0 tx=0x7f5e74009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:29.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.145+0000 7f5e6bfff700 1 -- 172.21.15.77:0/4248117780 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5e78050d50 con 0x7f5e840ced80 2023-07-24T05:47:29.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.313+0000 7f5e83fff700 1 -- 172.21.15.77:0/4248117780 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5e840ce890 con 0x7f5e840ced80 2023-07-24T05:47:29.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.313+0000 7f5e6bfff700 1 -- 172.21.15.77:0/4248117780 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5e78007720 con 0x7f5e840ced80 2023-07-24T05:47:29.321 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-07-24T05:47:29.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.317+0000 7f5e83fff700 1 -- 172.21.15.77:0/4248117780 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f5e70066340 msgr2=0x7f5e70068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:29.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.317+0000 7f5e83fff700 1 --2- 172.21.15.77:0/4248117780 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f5e70066340 0x7f5e70068800 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5e74009bf0 tx=0x7f5e74009240 comp rx=0 tx=0).stop 2023-07-24T05:47:29.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.317+0000 7f5e83fff700 1 -- 172.21.15.77:0/4248117780 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e840ced80 msgr2=0x7f5e84099fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:29.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.317+0000 7f5e83fff700 1 --2- 172.21.15.77:0/4248117780 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e840ced80 0x7f5e84099fd0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f5e7800c4e0 tx=0x7f5e7800c7f0 comp rx=0 tx=0).stop 2023-07-24T05:47:29.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.317+0000 7f5e83fff700 1 -- 172.21.15.77:0/4248117780 shutdown_connections 2023-07-24T05:47:29.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.317+0000 7f5e83fff700 1 --2- 172.21.15.77:0/4248117780 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e84159840 0x7f5e8409a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:29.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.317+0000 7f5e83fff700 1 --2- 172.21.15.77:0/4248117780 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5e840ced80 0x7f5e84099fd0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:29.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.317+0000 7f5e83fff700 1 --2- 172.21.15.77:0/4248117780 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f5e70066340 0x7f5e70068800 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:29.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.317+0000 7f5e83fff700 1 --2- 172.21.15.77:0/4248117780 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5e840ca2d0 0x7f5e840c7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:29.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.317+0000 7f5e83fff700 1 -- 172.21.15.77:0/4248117780 >> 172.21.15.77:0/4248117780 conn(0x7f5e840ce260 msgr2=0x7f5e84071370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:29.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.317+0000 7f5e83fff700 1 -- 172.21.15.77:0/4248117780 shutdown_connections 2023-07-24T05:47:29.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.317+0000 7f5e83fff700 1 -- 172.21.15.77:0/4248117780 wait complete. 2023-07-24T05:47:29.344 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-24T05:47:29.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.517+0000 7f7755977700 1 Processor -- start 2023-07-24T05:47:29.524 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.517+0000 7f7755977700 1 -- start start 2023-07-24T05:47:29.526 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.521+0000 7f7755977700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f775015c870 0x7f77500cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:29.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.521+0000 7f7755977700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f775015cc50 0x7f77500b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:29.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.521+0000 7f7755977700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77500cf520 con 0x7f775006a520 2023-07-24T05:47:29.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.521+0000 7f7755977700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f775006aaa0 con 0x7f775015c870 2023-07-24T05:47:29.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.521+0000 7f7755977700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f775006ad80 con 0x7f775015cc50 2023-07-24T05:47:29.527 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.521+0000 7f7754975700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f775015c870 0x7f77500cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:29.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.521+0000 7f774ffff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f775015cc50 0x7f77500b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:29.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.521+0000 7f7754975700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f775015c870 0x7f77500cefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41492/0 (socket says 172.21.15.77:41492) 2023-07-24T05:47:29.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.521+0000 7f7754975700 1 -- 172.21.15.77:0/3003633297 learned_addr learned my addr 172.21.15.77:0/3003633297 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:29.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.521+0000 7f774ffff700 1 -- 172.21.15.77:0/3003633297 >> v2:172.21.15.77:3300/0 conn(0x7f775015c870 msgr2=0x7f77500cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:29.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.521+0000 7f774ffff700 1 --2- 172.21.15.77:0/3003633297 >> v2:172.21.15.77:3300/0 conn(0x7f775015c870 0x7f77500cefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:29.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.521+0000 7f774ffff700 1 -- 172.21.15.77:0/3003633297 >> v1:172.21.15.103:6789/0 conn(0x7f775006a520 legacy=0x7f77500b40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:29.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.521+0000 7f774ffff700 1 -- 172.21.15.77:0/3003633297 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f775006b060 con 0x7f775015cc50 2023-07-24T05:47:29.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.521+0000 7f7754975700 1 --2- 172.21.15.77:0/3003633297 >> v2:172.21.15.77:3300/0 conn(0x7f775015c870 0x7f77500cefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:47:29.529 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.525+0000 7f774ffff700 1 --2- 172.21.15.77:0/3003633297 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f775015cc50 0x7f77500b1b20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f77500670d0 tx=0x7f7744009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96f5d927f132a3f4 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:29.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.525+0000 7f774f7fe700 1 -- 172.21.15.77:0/3003633297 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7744011830 con 0x7f775015cc50 2023-07-24T05:47:29.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.525+0000 7f774f7fe700 1 -- 172.21.15.77:0/3003633297 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7744011990 con 0x7f775015cc50 2023-07-24T05:47:29.530 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.525+0000 7f774f7fe700 1 -- 172.21.15.77:0/3003633297 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7744011d20 con 0x7f775015cc50 2023-07-24T05:47:29.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.525+0000 7f7755977700 1 -- 172.21.15.77:0/3003633297 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f775015cc50 msgr2=0x7f77500b1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:29.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.525+0000 7f7755977700 1 --2- 172.21.15.77:0/3003633297 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f775015cc50 0x7f77500b1b20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f77500670d0 tx=0x7f7744009b30 comp rx=0 tx=0).stop 2023-07-24T05:47:29.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.525+0000 7f7755977700 1 -- 172.21.15.77:0/3003633297 shutdown_connections 2023-07-24T05:47:29.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.525+0000 7f7755977700 1 --2- 172.21.15.77:0/3003633297 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f775015cc50 0x7f77500b1b20 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:29.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.525+0000 7f7755977700 1 --2- 172.21.15.77:0/3003633297 >> v2:172.21.15.77:3300/0 conn(0x7f775015c870 0x7f77500cefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:29.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.525+0000 7f7755977700 1 -- 172.21.15.77:0/3003633297 >> 172.21.15.77:0/3003633297 conn(0x7f7750089f80 msgr2=0x7f775009b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:29.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.525+0000 7f7755977700 1 -- 172.21.15.77:0/3003633297 shutdown_connections 2023-07-24T05:47:29.532 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.525+0000 7f7755977700 1 -- 172.21.15.77:0/3003633297 wait complete. 2023-07-24T05:47:29.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.529+0000 7f7755977700 1 Processor -- start 2023-07-24T05:47:29.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.529+0000 7f7755977700 1 -- start start 2023-07-24T05:47:29.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.529+0000 7f7755977700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f775006a520 0x7f7750159a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:29.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.529+0000 7f7755977700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f775015c870 0x7f775006bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:29.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.529+0000 7f7755977700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f775015cc50 0x7f775006c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:29.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.529+0000 7f7755977700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77500c81a0 con 0x7f775006a520 2023-07-24T05:47:29.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.529+0000 7f7755977700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77500c8440 con 0x7f775015c870 2023-07-24T05:47:29.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.529+0000 7f7755977700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77500c8720 con 0x7f775015cc50 2023-07-24T05:47:29.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.529+0000 7f7754975700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f775006a520 0x7f7750159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:29.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.529+0000 7f7754975700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f775006a520 0x7f7750159a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41494/0 (socket says 172.21.15.77:41494) 2023-07-24T05:47:29.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.529+0000 7f7754975700 1 -- 172.21.15.77:0/242652000 learned_addr learned my addr 172.21.15.77:0/242652000 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:29.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.529+0000 7f774ffff700 1 --2- 172.21.15.77:0/242652000 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f775015c870 0x7f775006bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:29.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.529+0000 7f7755176700 1 --2- 172.21.15.77:0/242652000 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f775015cc50 0x7f775006c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:29.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.529+0000 7f7754975700 1 -- 172.21.15.77:0/242652000 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f775015cc50 msgr2=0x7f775006c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:29.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.529+0000 7f7754975700 1 --2- 172.21.15.77:0/242652000 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f775015cc50 0x7f775006c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:29.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.529+0000 7f7754975700 1 -- 172.21.15.77:0/242652000 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f775015c870 msgr2=0x7f775006bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:29.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.529+0000 7f7754975700 1 --2- 172.21.15.77:0/242652000 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f775015c870 0x7f775006bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:29.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.529+0000 7f7754975700 1 -- 172.21.15.77:0/242652000 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7740009520 con 0x7f775006a520 2023-07-24T05:47:29.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.533+0000 7f7754975700 1 --2- 172.21.15.77:0/242652000 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f775006a520 0x7f7750159a40 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f774000e9d0 tx=0x7f774000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:29.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.533+0000 7f774d7fa700 1 -- 172.21.15.77:0/242652000 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7740005a40 con 0x7f775006a520 2023-07-24T05:47:29.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.533+0000 7f774d7fa700 1 -- 172.21.15.77:0/242652000 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7740005ba0 con 0x7f775006a520 2023-07-24T05:47:29.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.533+0000 7f774d7fa700 1 -- 172.21.15.77:0/242652000 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774000c850 con 0x7f775006a520 2023-07-24T05:47:29.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.533+0000 7f7755977700 1 -- 172.21.15.77:0/242652000 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77440094b0 con 0x7f775006a520 2023-07-24T05:47:29.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.533+0000 7f7755977700 1 -- 172.21.15.77:0/242652000 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77500c8ce0 con 0x7f775006a520 2023-07-24T05:47:29.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.533+0000 7f7755977700 1 -- 172.21.15.77:0/242652000 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77500c8e70 con 0x7f775006a520 2023-07-24T05:47:29.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.533+0000 7f774d7fa700 1 -- 172.21.15.77:0/242652000 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f774000c9b0 con 0x7f775006a520 2023-07-24T05:47:29.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.537+0000 7f774d7fa700 1 --2- 172.21.15.77:0/242652000 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f773c0662f0 0x7f773c0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:29.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.537+0000 7f774d7fa700 1 -- 172.21.15.77:0/242652000 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7740083fd0 con 0x7f775006a520 2023-07-24T05:47:29.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.537+0000 7f774ffff700 1 --2- 172.21.15.77:0/242652000 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f773c0662f0 0x7f773c0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:29.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.541+0000 7f774ffff700 1 --2- 172.21.15.77:0/242652000 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f773c0662f0 0x7f773c0687b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7744000c00 tx=0x7f7744008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:29.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.545+0000 7f774d7fa700 1 -- 172.21.15.77:0/242652000 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7740051080 con 0x7f775006a520 2023-07-24T05:47:29.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.717+0000 7f7755977700 1 -- 172.21.15.77:0/242652000 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f7750072490 con 0x7f775006a520 2023-07-24T05:47:29.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.717+0000 7f774d7fa700 1 -- 172.21.15.77:0/242652000 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f77400546a0 con 0x7f775006a520 2023-07-24T05:47:29.722 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-07-24T05:47:29.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.717+0000 7f7755977700 1 -- 172.21.15.77:0/242652000 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f773c0662f0 msgr2=0x7f773c0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:29.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.717+0000 7f7755977700 1 --2- 172.21.15.77:0/242652000 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f773c0662f0 0x7f773c0687b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7744000c00 tx=0x7f7744008030 comp rx=0 tx=0).stop 2023-07-24T05:47:29.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.717+0000 7f7755977700 1 -- 172.21.15.77:0/242652000 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f775006a520 msgr2=0x7f7750159a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:29.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.717+0000 7f7755977700 1 --2- 172.21.15.77:0/242652000 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f775006a520 0x7f7750159a40 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f774000e9d0 tx=0x7f774000ece0 comp rx=0 tx=0).stop 2023-07-24T05:47:29.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.721+0000 7f7755977700 1 -- 172.21.15.77:0/242652000 shutdown_connections 2023-07-24T05:47:29.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.721+0000 7f7755977700 1 --2- 172.21.15.77:0/242652000 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f773c0662f0 0x7f773c0687b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:29.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.721+0000 7f7755977700 1 --2- 172.21.15.77:0/242652000 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f775015cc50 0x7f775006c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:29.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.721+0000 7f7755977700 1 --2- 172.21.15.77:0/242652000 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f775015c870 0x7f775006bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:29.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.721+0000 7f7755977700 1 --2- 172.21.15.77:0/242652000 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f775006a520 0x7f7750159a40 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:29.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.721+0000 7f7755977700 1 -- 172.21.15.77:0/242652000 >> 172.21.15.77:0/242652000 conn(0x7f7750089f80 msgr2=0x7f775009b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:29.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.721+0000 7f7755977700 1 -- 172.21.15.77:0/242652000 shutdown_connections 2023-07-24T05:47:29.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.721+0000 7f7755977700 1 -- 172.21.15.77:0/242652000 wait complete. 2023-07-24T05:47:29.746 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-24T05:47:29.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.909+0000 7f6c1cbca700 1 Processor -- start 2023-07-24T05:47:29.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.913+0000 7f6c1cbca700 1 -- start start 2023-07-24T05:47:29.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.913+0000 7f6c1cbca700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6c18160d20 0x7f6c180adba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:29.919 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.913+0000 7f6c1cbca700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c180af170 con 0x7f6c180b17a0 2023-07-24T05:47:29.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.913+0000 7f6c1cbca700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c180ae5f0 con 0x7f6c180ae0e0 2023-07-24T05:47:29.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.913+0000 7f6c1cbca700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c180ae8d0 con 0x7f6c18160d20 2023-07-24T05:47:29.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.913+0000 7f6c177fe700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6c18160d20 0x7f6c180adba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:29.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.913+0000 7f6c177fe700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6c18160d20 0x7f6c180adba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41498/0 (socket says 172.21.15.77:41498) 2023-07-24T05:47:29.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.913+0000 7f6c177fe700 1 -- 172.21.15.77:0/192739799 learned_addr learned my addr 172.21.15.77:0/192739799 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:29.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.913+0000 7f6c177fe700 1 -- 172.21.15.77:0/192739799 >> v1:172.21.15.103:6789/0 conn(0x7f6c180ae0e0 legacy=0x7f6c180b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:29.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.913+0000 7f6c177fe700 1 -- 172.21.15.77:0/192739799 >> v1:172.21.15.77:6789/0 conn(0x7f6c180b17a0 legacy=0x7f6c180af700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:29.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.913+0000 7f6c177fe700 1 -- 172.21.15.77:0/192739799 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c180aebb0 con 0x7f6c18160d20 2023-07-24T05:47:29.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.913+0000 7f6c177fe700 1 --2- 172.21.15.77:0/192739799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c18160d20 0x7f6c180adba0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f6c08009910 tx=0x7f6c08009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2b183911da6931c server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:29.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.917+0000 7f6c16ffd700 1 -- 172.21.15.77:0/192739799 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c08004230 con 0x7f6c18160d20 2023-07-24T05:47:29.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.917+0000 7f6c16ffd700 1 -- 172.21.15.77:0/192739799 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c08004390 con 0x7f6c18160d20 2023-07-24T05:47:29.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.917+0000 7f6c16ffd700 1 -- 172.21.15.77:0/192739799 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c08009e60 con 0x7f6c18160d20 2023-07-24T05:47:29.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.917+0000 7f6c1cbca700 1 -- 172.21.15.77:0/192739799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c18160d20 msgr2=0x7f6c180adba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:29.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.917+0000 7f6c1cbca700 1 --2- 172.21.15.77:0/192739799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c18160d20 0x7f6c180adba0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f6c08009910 tx=0x7f6c08009c20 comp rx=0 tx=0).stop 2023-07-24T05:47:29.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.917+0000 7f6c1cbca700 1 -- 172.21.15.77:0/192739799 shutdown_connections 2023-07-24T05:47:29.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.917+0000 7f6c1cbca700 1 --2- 172.21.15.77:0/192739799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c18160d20 0x7f6c180adba0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:29.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.917+0000 7f6c1cbca700 1 -- 172.21.15.77:0/192739799 >> 172.21.15.77:0/192739799 conn(0x7f6c180cacc0 msgr2=0x7f6c180cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:29.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.917+0000 7f6c1cbca700 1 -- 172.21.15.77:0/192739799 shutdown_connections 2023-07-24T05:47:29.923 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.917+0000 7f6c1cbca700 1 -- 172.21.15.77:0/192739799 wait complete. 2023-07-24T05:47:29.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.921+0000 7f6c1cbca700 1 Processor -- start 2023-07-24T05:47:29.926 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.921+0000 7f6c1cbca700 1 -- start start 2023-07-24T05:47:29.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.921+0000 7f6c1cbca700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c180ae0e0 0x7f6c1815f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:29.928 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.921+0000 7f6c1cbca700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6c180b17a0 0x7f6c180c3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:29.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.921+0000 7f6c1cbca700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c18160d20 0x7f6c18161100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:29.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.921+0000 7f6c1cbca700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1815fc50 con 0x7f6c18160d20 2023-07-24T05:47:29.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.921+0000 7f6c1cbca700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c180c2b70 con 0x7f6c180ae0e0 2023-07-24T05:47:29.929 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.921+0000 7f6c1cbca700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c18163fa0 con 0x7f6c180b17a0 2023-07-24T05:47:29.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.925+0000 7f6c17fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c18160d20 0x7f6c18161100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:29.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.925+0000 7f6c17fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c18160d20 0x7f6c18161100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41500/0 (socket says 172.21.15.77:41500) 2023-07-24T05:47:29.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.925+0000 7f6c17fff700 1 -- 172.21.15.77:0/788443742 learned_addr learned my addr 172.21.15.77:0/788443742 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:29.930 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.925+0000 7f6c177fe700 1 --2- 172.21.15.77:0/788443742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c180ae0e0 0x7f6c1815f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:29.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.925+0000 7f6c0effd700 1 --2- 172.21.15.77:0/788443742 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6c180b17a0 0x7f6c180c3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:29.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.925+0000 7f6c17fff700 1 -- 172.21.15.77:0/788443742 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6c180b17a0 msgr2=0x7f6c180c3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:29.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.925+0000 7f6c17fff700 1 --2- 172.21.15.77:0/788443742 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6c180b17a0 0x7f6c180c3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:29.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.925+0000 7f6c17fff700 1 -- 172.21.15.77:0/788443742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c180ae0e0 msgr2=0x7f6c1815f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:29.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.925+0000 7f6c17fff700 1 --2- 172.21.15.77:0/788443742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c180ae0e0 0x7f6c1815f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:29.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.925+0000 7f6c17fff700 1 -- 172.21.15.77:0/788443742 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c08009570 con 0x7f6c18160d20 2023-07-24T05:47:29.931 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.925+0000 7f6c17fff700 1 --2- 172.21.15.77:0/788443742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c18160d20 0x7f6c18161100 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6c1000cc50 tx=0x7f6c1000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:29.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.925+0000 7f6c14ff9700 1 -- 172.21.15.77:0/788443742 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c10003c20 con 0x7f6c18160d20 2023-07-24T05:47:29.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.925+0000 7f6c14ff9700 1 -- 172.21.15.77:0/788443742 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c10003d80 con 0x7f6c18160d20 2023-07-24T05:47:29.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.925+0000 7f6c1cbca700 1 -- 172.21.15.77:0/788443742 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c18164280 con 0x7f6c18160d20 2023-07-24T05:47:29.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.925+0000 7f6c14ff9700 1 -- 172.21.15.77:0/788443742 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1000aab0 con 0x7f6c18160d20 2023-07-24T05:47:29.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.925+0000 7f6c1cbca700 1 -- 172.21.15.77:0/788443742 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c180c30f0 con 0x7f6c18160d20 2023-07-24T05:47:29.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.925+0000 7f6c1cbca700 1 -- 172.21.15.77:0/788443742 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c18163d70 con 0x7f6c18160d20 2023-07-24T05:47:29.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.929+0000 7f6c14ff9700 1 -- 172.21.15.77:0/788443742 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6c1000ac10 con 0x7f6c18160d20 2023-07-24T05:47:29.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.929+0000 7f6c14ff9700 1 --2- 172.21.15.77:0/788443742 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6bfc0662f0 0x7f6bfc0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:29.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.929+0000 7f6c14ff9700 1 -- 172.21.15.77:0/788443742 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6c10084090 con 0x7f6c18160d20 2023-07-24T05:47:29.935 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.929+0000 7f6c177fe700 1 --2- 172.21.15.77:0/788443742 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6bfc0662f0 0x7f6bfc0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:29.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.929+0000 7f6c177fe700 1 --2- 172.21.15.77:0/788443742 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6bfc0662f0 0x7f6bfc0687b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6c08009910 tx=0x7f6c08008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:29.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:29.937+0000 7f6c14ff9700 1 -- 172.21.15.77:0/788443742 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6c10051170 con 0x7f6c18160d20 2023-07-24T05:47:30.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.125+0000 7f6c1cbca700 1 -- 172.21.15.77:0/788443742 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6c180c32e0 con 0x7f6c18160d20 2023-07-24T05:47:30.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.125+0000 7f6c14ff9700 1 -- 172.21.15.77:0/788443742 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6c10054790 con 0x7f6c18160d20 2023-07-24T05:47:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.129+0000 7f6c1cbca700 1 -- 172.21.15.77:0/788443742 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6bfc0662f0 msgr2=0x7f6bfc0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.129+0000 7f6c1cbca700 1 --2- 172.21.15.77:0/788443742 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6bfc0662f0 0x7f6bfc0687b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6c08009910 tx=0x7f6c08008030 comp rx=0 tx=0).stop 2023-07-24T05:47:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.129+0000 7f6c1cbca700 1 -- 172.21.15.77:0/788443742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c18160d20 msgr2=0x7f6c18161100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.129+0000 7f6c1cbca700 1 --2- 172.21.15.77:0/788443742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c18160d20 0x7f6c18161100 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6c1000cc50 tx=0x7f6c1000cf60 comp rx=0 tx=0).stop 2023-07-24T05:47:30.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.129+0000 7f6c1cbca700 1 -- 172.21.15.77:0/788443742 shutdown_connections 2023-07-24T05:47:30.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.129+0000 7f6c1cbca700 1 --2- 172.21.15.77:0/788443742 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6c18160d20 0x7f6c18161100 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:30.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.129+0000 7f6c1cbca700 1 --2- 172.21.15.77:0/788443742 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6bfc0662f0 0x7f6bfc0687b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:30.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.129+0000 7f6c1cbca700 1 --2- 172.21.15.77:0/788443742 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6c180b17a0 0x7f6c180c3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:30.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.129+0000 7f6c1cbca700 1 --2- 172.21.15.77:0/788443742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c180ae0e0 0x7f6c1815f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:30.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.129+0000 7f6c1cbca700 1 -- 172.21.15.77:0/788443742 >> 172.21.15.77:0/788443742 conn(0x7f6c180cacc0 msgr2=0x7f6c18069fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:30.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.129+0000 7f6c1cbca700 1 -- 172.21.15.77:0/788443742 shutdown_connections 2023-07-24T05:47:30.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.129+0000 7f6c1cbca700 1 -- 172.21.15.77:0/788443742 wait complete. 2023-07-24T05:47:30.138 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2023-07-24T05:47:30.157 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2023-07-24T05:47:30.157 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-24T05:47:30.174 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-24T05:47:30.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.341+0000 7fd143b7c700 1 Processor -- start 2023-07-24T05:47:30.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.345+0000 7fd143b7c700 1 -- start start 2023-07-24T05:47:30.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.345+0000 7fd143b7c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fd13c160350 0x7fd13c0ad870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:30.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.345+0000 7fd143b7c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd13c06d400 0x7fd13c0c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:30.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.345+0000 7fd143b7c700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd13c0cb870 con 0x7fd13c0ad320 2023-07-24T05:47:30.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.345+0000 7fd143b7c700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd13c0ccc20 con 0x7fd13c160350 2023-07-24T05:47:30.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.345+0000 7fd143b7c700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd13c0cac60 con 0x7fd13c06d400 2023-07-24T05:47:30.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.345+0000 7fd141117700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fd13c0ad320 0x7fd13c06ccf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:60384/0 (socket says 172.21.15.77:60384) 2023-07-24T05:47:30.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.345+0000 7fd141117700 1 -- 172.21.15.77:0/950849009 learned_addr learned my addr 172.21.15.77:0/950849009 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:30.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.345+0000 7fd141918700 1 --2- 172.21.15.77:0/950849009 >> v2:172.21.15.103:3300/0 conn(0x7fd13c160350 0x7fd13c0ad870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:30.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.345+0000 7fd142119700 1 --2- 172.21.15.77:0/950849009 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd13c06d400 0x7fd13c0c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:30.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.345+0000 7fd140916700 1 -- 172.21.15.77:0/950849009 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2684120794 0 0) 0x7fd13c0cb870 con 0x7fd13c0ad320 2023-07-24T05:47:30.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.345+0000 7fd140916700 1 -- 172.21.15.77:0/950849009 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1280035d0 con 0x7fd13c0ad320 2023-07-24T05:47:30.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.349+0000 7fd142119700 1 -- 172.21.15.77:0/950849009 >> v2:172.21.15.103:3300/0 conn(0x7fd13c160350 msgr2=0x7fd13c0ad870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:30.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.349+0000 7fd142119700 1 --2- 172.21.15.77:0/950849009 >> v2:172.21.15.103:3300/0 conn(0x7fd13c160350 0x7fd13c0ad870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:30.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.349+0000 7fd142119700 1 -- 172.21.15.77:0/950849009 >> v1:172.21.15.77:6789/0 conn(0x7fd13c0ad320 legacy=0x7fd13c06ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:30.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.349+0000 7fd142119700 1 -- 172.21.15.77:0/950849009 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd13c0caf40 con 0x7fd13c06d400 2023-07-24T05:47:30.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.349+0000 7fd142119700 1 --2- 172.21.15.77:0/950849009 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd13c06d400 0x7fd13c0c8a60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd134009850 tx=0x7fd134009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a865cf24c690d96 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:30.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.349+0000 7fd140916700 1 -- 172.21.15.77:0/950849009 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd134011830 con 0x7fd13c06d400 2023-07-24T05:47:30.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.349+0000 7fd140916700 1 -- 172.21.15.77:0/950849009 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd134011990 con 0x7fd13c06d400 2023-07-24T05:47:30.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.349+0000 7fd140916700 1 -- 172.21.15.77:0/950849009 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd134011d40 con 0x7fd13c06d400 2023-07-24T05:47:30.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.349+0000 7fd143b7c700 1 -- 172.21.15.77:0/950849009 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd13c06d400 msgr2=0x7fd13c0c8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:30.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.349+0000 7fd143b7c700 1 --2- 172.21.15.77:0/950849009 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd13c06d400 0x7fd13c0c8a60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd134009850 tx=0x7fd134009b60 comp rx=0 tx=0).stop 2023-07-24T05:47:30.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.349+0000 7fd143b7c700 1 -- 172.21.15.77:0/950849009 shutdown_connections 2023-07-24T05:47:30.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.349+0000 7fd143b7c700 1 --2- 172.21.15.77:0/950849009 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd13c06d400 0x7fd13c0c8a60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:30.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.349+0000 7fd143b7c700 1 --2- 172.21.15.77:0/950849009 >> v2:172.21.15.103:3300/0 conn(0x7fd13c160350 0x7fd13c0ad870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:30.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.349+0000 7fd143b7c700 1 -- 172.21.15.77:0/950849009 >> 172.21.15.77:0/950849009 conn(0x7fd13c0ce410 msgr2=0x7fd13c0ce7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:30.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.349+0000 7fd143b7c700 1 -- 172.21.15.77:0/950849009 shutdown_connections 2023-07-24T05:47:30.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.349+0000 7fd143b7c700 1 -- 172.21.15.77:0/950849009 wait complete. 2023-07-24T05:47:30.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.353+0000 7fd143b7c700 1 Processor -- start 2023-07-24T05:47:30.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.353+0000 7fd143b7c700 1 -- start start 2023-07-24T05:47:30.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.353+0000 7fd143b7c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd13c06d400 0x7fd13c153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:30.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.353+0000 7fd143b7c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd13c0ad320 0x7fd13c0ac0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:30.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.353+0000 7fd143b7c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd13c160350 0x7fd13c0ac630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:30.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.353+0000 7fd143b7c700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13c15c580 con 0x7fd13c0ad320 2023-07-24T05:47:30.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.353+0000 7fd143b7c700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13c153a50 con 0x7fd13c06d400 2023-07-24T05:47:30.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.353+0000 7fd143b7c700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd13c15c2a0 con 0x7fd13c160350 2023-07-24T05:47:30.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.353+0000 7fd141117700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd13c0ad320 0x7fd13c0ac0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:30.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.353+0000 7fd141117700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd13c0ad320 0x7fd13c0ac0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41514/0 (socket says 172.21.15.77:41514) 2023-07-24T05:47:30.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.353+0000 7fd141117700 1 -- 172.21.15.77:0/203472904 learned_addr learned my addr 172.21.15.77:0/203472904 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:30.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.353+0000 7fd141918700 1 --2- 172.21.15.77:0/203472904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd13c06d400 0x7fd13c153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:30.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.353+0000 7fd142119700 1 --2- 172.21.15.77:0/203472904 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd13c160350 0x7fd13c0ac630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:30.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.353+0000 7fd141117700 1 -- 172.21.15.77:0/203472904 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd13c160350 msgr2=0x7fd13c0ac630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:30.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.353+0000 7fd141117700 1 --2- 172.21.15.77:0/203472904 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd13c160350 0x7fd13c0ac630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:30.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.353+0000 7fd141117700 1 -- 172.21.15.77:0/203472904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd13c06d400 msgr2=0x7fd13c153510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:30.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.353+0000 7fd141117700 1 --2- 172.21.15.77:0/203472904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd13c06d400 0x7fd13c153510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:30.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.353+0000 7fd141117700 1 -- 172.21.15.77:0/203472904 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1340094b0 con 0x7fd13c0ad320 2023-07-24T05:47:30.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.357+0000 7fd141117700 1 --2- 172.21.15.77:0/203472904 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd13c0ad320 0x7fd13c0ac0f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd12c00c4d0 tx=0x7fd12c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:30.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.357+0000 7fd1327fc700 1 -- 172.21.15.77:0/203472904 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c005d90 con 0x7fd13c0ad320 2023-07-24T05:47:30.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.357+0000 7fd1327fc700 1 -- 172.21.15.77:0/203472904 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12c0070d0 con 0x7fd13c0ad320 2023-07-24T05:47:30.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.357+0000 7fd143b7c700 1 -- 172.21.15.77:0/203472904 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd13c0adfe0 con 0x7fd13c0ad320 2023-07-24T05:47:30.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.357+0000 7fd1327fc700 1 -- 172.21.15.77:0/203472904 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c007480 con 0x7fd13c0ad320 2023-07-24T05:47:30.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.357+0000 7fd143b7c700 1 -- 172.21.15.77:0/203472904 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd13c0ae5a0 con 0x7fd13c0ad320 2023-07-24T05:47:30.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.357+0000 7fd143b7c700 1 -- 172.21.15.77:0/203472904 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd13c0ade40 con 0x7fd13c0ad320 2023-07-24T05:47:30.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.357+0000 7fd1327fc700 1 -- 172.21.15.77:0/203472904 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd12c0075e0 con 0x7fd13c0ad320 2023-07-24T05:47:30.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.361+0000 7fd1327fc700 1 --2- 172.21.15.77:0/203472904 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd1200662f0 0x7fd1200687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:30.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.361+0000 7fd1327fc700 1 -- 172.21.15.77:0/203472904 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd12c0834c0 con 0x7fd13c0ad320 2023-07-24T05:47:30.366 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.361+0000 7fd141918700 1 --2- 172.21.15.77:0/203472904 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd1200662f0 0x7fd1200687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:30.367 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.361+0000 7fd141918700 1 --2- 172.21.15.77:0/203472904 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd1200662f0 0x7fd1200687b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd138009fd0 tx=0x7fd13800b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:30.371 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.365+0000 7fd1327fc700 1 -- 172.21.15.77:0/203472904 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd13c0ade40 con 0x7fd13c0ad320 2023-07-24T05:47:30.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.537+0000 7fd143b7c700 1 -- 172.21.15.77:0/203472904 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd13c0ade40 con 0x7fd13c0ad320 2023-07-24T05:47:30.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.537+0000 7fd1327fc700 1 -- 172.21.15.77:0/203472904 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20204 (secure 0 0 0) 0x7fd13c0ade40 con 0x7fd13c0ad320 2023-07-24T05:47:30.544 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:47:30.544 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":27,"fsid":"5aed5f7b-fb55-4d95-9c02-c6adbb1677b4","created":"2023-07-24T05:45:39.639731+0000","modified":"2023-07-24T05:46:48.442117+0000","last_up_change":"2023-07-24T05:45:52.319670+0000","last_in_change":"2023-07-24T05:45:43.643277+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-24T05:45:52.610430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-24T05:45:52.773787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-24T05:45:58.121732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-24T05:45:59.368726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-24T05:46:03.032057+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ffa0d496-461a-4053-b764-0627d969521b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6812","nonce":825987196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6817","nonce":825987196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6831","nonce":825987196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6824","nonce":825987196}]},"public_addr":"172.21.15.77:6812/825987196","cluster_addr":"172.21.15.77:6817/825987196","heartbeat_back_addr":"172.21.15.77:6831/825987196","heartbeat_front_addr":"172.21.15.77:6824/825987196","state":["exists","up"]},{"osd":1,"uuid":"9f595e5e-5c43-49bc-8ce4-ee70575c90da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6801","nonce":4133026815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6803","nonce":4133026815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6807","nonce":4133026815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6805","nonce":4133026815}]},"public_addr":"172.21.15.77:6801/4133026815","cluster_addr":"172.21.15.77:6803/4133026815","heartbeat_back_addr":"172.21.15.77:6807/4133026815","heartbeat_front_addr":"172.21.15.77:6805/4133026815","state":["exists","up"]},{"osd":2,"uuid":"2ac177aa-4d7d-4262-bd54-d2b9f29f4c3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6811","nonce":2394142159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6819","nonce":2394142159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6830","nonce":2394142159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6825","nonce":2394142159}]},"public_addr":"172.21.15.77:6811/2394142159","cluster_addr":"172.21.15.77:6819/2394142159","heartbeat_back_addr":"172.21.15.77:6830/2394142159","heartbeat_front_addr":"172.21.15.77:6825/2394142159","state":["exists","up"]},{"osd":3,"uuid":"17d7a251-19e8-484c-8172-a578ab3da153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6813","nonce":1492113982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6818","nonce":1492113982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6829","nonce":1492113982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6823","nonce":1492113982}]},"public_addr":"172.21.15.77:6813/1492113982","cluster_addr":"172.21.15.77:6818/1492113982","heartbeat_back_addr":"172.21.15.77:6829/1492113982","heartbeat_front_addr":"172.21.15.77:6823/1492113982","state":["exists","up"]},{"osd":4,"uuid":"bf63ca05-f06d-4e0f-ac44-2a416c70b919","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6825","nonce":1080481057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6827","nonce":1080481057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6831","nonce":1080481057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6829","nonce":1080481057}]},"public_addr":"172.21.15.103:6825/1080481057","cluster_addr":"172.21.15.103:6827/1080481057","heartbeat_back_addr":"172.21.15.103:6831/1080481057","heartbeat_front_addr":"172.21.15.103:6829/1080481057","state":["exists","up"]},{"osd":5,"uuid":"65a11a35-9e9f-4b3c-9fe3-b658d62b9318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6811","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6813","nonce":2756677504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6818","nonce":2756677504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6823","nonce":2756677504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6821","nonce":2756677504}]},"public_addr":"172.21.15.103:6813/2756677504","cluster_addr":"172.21.15.103:6818/2756677504","heartbeat_back_addr":"172.21.15.103:6823/2756677504","heartbeat_front_addr":"172.21.15.103:6821/2756677504","state":["exists","up"]},{"osd":6,"uuid":"750c1f87-686c-40b4-94a1-1a299dc78f3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6809","nonce":568977764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6812","nonce":568977764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6819","nonce":568977764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6815","nonce":568977764}]},"public_addr":"172.21.15.103:6809/568977764","cluster_addr":"172.21.15.103:6812/568977764","heartbeat_back_addr":"172.21.15.103:6819/568977764","heartbeat_front_addr":"172.21.15.103:6815/568977764","state":["exists","up"]},{"osd":7,"uuid":"d5fe4fb6-2e09-4158-885b-403803c85822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6801","nonce":1074557176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6803","nonce":1074557176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6807","nonce":1074557176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6805","nonce":1074557176}]},"public_addr":"172.21.15.103:6801/1074557176","cluster_addr":"172.21.15.103:6803/1074557176","heartbeat_back_addr":"172.21.15.103:6807/1074557176","heartbeat_front_addr":"172.21.15.103:6805/1074557176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.631032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.154109+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.398587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.679089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.311218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.353726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.314372+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.126212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1d","mappings":[{"from":3,"to":2}]},{"pgid":"4.31","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-24T05:47:30.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.541+0000 7fd143b7c700 1 -- 172.21.15.77:0/203472904 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd1200662f0 msgr2=0x7fd1200687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:30.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.541+0000 7fd143b7c700 1 --2- 172.21.15.77:0/203472904 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd1200662f0 0x7fd1200687b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd138009fd0 tx=0x7fd13800b040 comp rx=0 tx=0).stop 2023-07-24T05:47:30.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.541+0000 7fd143b7c700 1 -- 172.21.15.77:0/203472904 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd13c0ad320 msgr2=0x7fd13c0ac0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:30.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.541+0000 7fd143b7c700 1 --2- 172.21.15.77:0/203472904 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd13c0ad320 0x7fd13c0ac0f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd12c00c4d0 tx=0x7fd12c00c7e0 comp rx=0 tx=0).stop 2023-07-24T05:47:30.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.541+0000 7fd143b7c700 1 -- 172.21.15.77:0/203472904 shutdown_connections 2023-07-24T05:47:30.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.541+0000 7fd143b7c700 1 --2- 172.21.15.77:0/203472904 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fd1200662f0 0x7fd1200687b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:30.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.541+0000 7fd143b7c700 1 --2- 172.21.15.77:0/203472904 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fd13c160350 0x7fd13c0ac630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:30.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.541+0000 7fd143b7c700 1 --2- 172.21.15.77:0/203472904 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd13c0ad320 0x7fd13c0ac0f0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:30.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.541+0000 7fd143b7c700 1 --2- 172.21.15.77:0/203472904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd13c06d400 0x7fd13c153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:30.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.541+0000 7fd143b7c700 1 -- 172.21.15.77:0/203472904 >> 172.21.15.77:0/203472904 conn(0x7fd13c0ce410 msgr2=0x7fd13c155350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:30.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.541+0000 7fd143b7c700 1 -- 172.21.15.77:0/203472904 shutdown_connections 2023-07-24T05:47:30.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.541+0000 7fd143b7c700 1 -- 172.21.15.77:0/203472904 wait complete. 2023-07-24T05:47:30.570 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-24T05:45:52.610430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-24T05:45:52.773787+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-24T05:45:58.121732+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-24T05:45:59.368726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-24T05:46:03.032057+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-24T05:47:30.571 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-24T05:47:30.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.741+0000 7f741b58b700 1 Processor -- start 2023-07-24T05:47:30.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.741+0000 7f741b58b700 1 -- start start 2023-07-24T05:47:30.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.745+0000 7f741b58b700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f741415c870 0x7f74140cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:30.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.745+0000 7f741b58b700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f74140b2230 0x7f74140cd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:30.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.745+0000 7f741b58b700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74140cf520 con 0x7f741415cc50 2023-07-24T05:47:30.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.745+0000 7f741b58b700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f741406aaa0 con 0x7f741415c870 2023-07-24T05:47:30.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.745+0000 7f741b58b700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f741406ad80 con 0x7f74140b2230 2023-07-24T05:47:30.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.745+0000 7f741a589700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f741415c870 0x7f74140cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:30.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.745+0000 7f741a589700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f741415c870 0x7f74140cefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41520/0 (socket says 172.21.15.77:41520) 2023-07-24T05:47:30.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.745+0000 7f741a589700 1 -- 172.21.15.77:0/2304261390 learned_addr learned my addr 172.21.15.77:0/2304261390 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:30.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.745+0000 7f741ad8a700 1 --2- 172.21.15.77:0/2304261390 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f74140b2230 0x7f74140cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:30.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.745+0000 7f741a589700 1 -- 172.21.15.77:0/2304261390 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f74140b2230 msgr2=0x7f74140cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:30.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.745+0000 7f741a589700 1 --2- 172.21.15.77:0/2304261390 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f74140b2230 0x7f74140cd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:30.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.745+0000 7f7419587700 1 -- 172.21.15.77:0/2304261390 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 704484999 0 0) 0x7f74140cf520 con 0x7f741415cc50 2023-07-24T05:47:30.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.745+0000 7f741a589700 1 -- 172.21.15.77:0/2304261390 >> v1:172.21.15.77:6789/0 conn(0x7f741415cc50 legacy=0x7f74140b1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:30.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.745+0000 7f741a589700 1 -- 172.21.15.77:0/2304261390 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f741406b060 con 0x7f741415c870 2023-07-24T05:47:30.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.745+0000 7f741a589700 1 --2- 172.21.15.77:0/2304261390 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f741415c870 0x7f74140cefe0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7410009910 tx=0x7f7410009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d187d05310f7b1 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:30.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.745+0000 7f7419587700 1 -- 172.21.15.77:0/2304261390 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7410005e50 con 0x7f741415c870 2023-07-24T05:47:30.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.749+0000 7f7419587700 1 -- 172.21.15.77:0/2304261390 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7410009e60 con 0x7f741415c870 2023-07-24T05:47:30.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.749+0000 7f7419587700 1 -- 172.21.15.77:0/2304261390 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741000b870 con 0x7f741415c870 2023-07-24T05:47:30.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.749+0000 7f741b58b700 1 -- 172.21.15.77:0/2304261390 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f741415c870 msgr2=0x7f74140cefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:30.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.749+0000 7f741b58b700 1 --2- 172.21.15.77:0/2304261390 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f741415c870 0x7f74140cefe0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7410009910 tx=0x7f7410009c20 comp rx=0 tx=0).stop 2023-07-24T05:47:30.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.749+0000 7f741b58b700 1 -- 172.21.15.77:0/2304261390 shutdown_connections 2023-07-24T05:47:30.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.749+0000 7f741b58b700 1 --2- 172.21.15.77:0/2304261390 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f74140b2230 0x7f74140cd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:30.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.749+0000 7f741b58b700 1 --2- 172.21.15.77:0/2304261390 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f741415c870 0x7f74140cefe0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:30.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.749+0000 7f741b58b700 1 -- 172.21.15.77:0/2304261390 >> 172.21.15.77:0/2304261390 conn(0x7f7414089f80 msgr2=0x7f741409b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:30.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.749+0000 7f741b58b700 1 -- 172.21.15.77:0/2304261390 shutdown_connections 2023-07-24T05:47:30.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.749+0000 7f741b58b700 1 -- 172.21.15.77:0/2304261390 wait complete. 2023-07-24T05:47:30.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.753+0000 7f741b58b700 1 Processor -- start 2023-07-24T05:47:30.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.753+0000 7f741b58b700 1 -- start start 2023-07-24T05:47:30.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.753+0000 7f741b58b700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74140b2230 0x7f7414150ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:30.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.753+0000 7f741b58b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f741415c870 0x7f7414151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:30.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.753+0000 7f741b58b700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f741415cc50 0x7f74140cde40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:30.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.753+0000 7f741b58b700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7414159930 con 0x7f741415c870 2023-07-24T05:47:30.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.753+0000 7f741b58b700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7414151220 con 0x7f74140b2230 2023-07-24T05:47:30.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.753+0000 7f741b58b700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7414158cb0 con 0x7f741415cc50 2023-07-24T05:47:30.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.753+0000 7f7419d88700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f741415c870 0x7f7414151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:30.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.753+0000 7f7419d88700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f741415c870 0x7f7414151ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41532/0 (socket says 172.21.15.77:41532) 2023-07-24T05:47:30.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.753+0000 7f7419d88700 1 -- 172.21.15.77:0/1308407009 learned_addr learned my addr 172.21.15.77:0/1308407009 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:30.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.753+0000 7f741a589700 1 --2- 172.21.15.77:0/1308407009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74140b2230 0x7f7414150ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:30.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.753+0000 7f741ad8a700 1 --2- 172.21.15.77:0/1308407009 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f741415cc50 0x7f74140cde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:30.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.753+0000 7f7419d88700 1 -- 172.21.15.77:0/1308407009 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f741415cc50 msgr2=0x7f74140cde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:30.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.753+0000 7f7419d88700 1 --2- 172.21.15.77:0/1308407009 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f741415cc50 0x7f74140cde40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:30.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.753+0000 7f7419d88700 1 -- 172.21.15.77:0/1308407009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74140b2230 msgr2=0x7f7414150ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:30.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.753+0000 7f7419d88700 1 --2- 172.21.15.77:0/1308407009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74140b2230 0x7f7414150ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:30.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.753+0000 7f7419d88700 1 -- 172.21.15.77:0/1308407009 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7410009520 con 0x7f741415c870 2023-07-24T05:47:30.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.757+0000 7f7419d88700 1 --2- 172.21.15.77:0/1308407009 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f741415c870 0x7f7414151ef0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f740400c520 tx=0x7f740400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:30.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.757+0000 7f740affd700 1 -- 172.21.15.77:0/1308407009 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74040054e0 con 0x7f741415c870 2023-07-24T05:47:30.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.757+0000 7f740affd700 1 -- 172.21.15.77:0/1308407009 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74040036a0 con 0x7f741415c870 2023-07-24T05:47:30.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.757+0000 7f741b58b700 1 -- 172.21.15.77:0/1308407009 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7414158f90 con 0x7f741415c870 2023-07-24T05:47:30.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.757+0000 7f740affd700 1 -- 172.21.15.77:0/1308407009 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7404003a50 con 0x7f741415c870 2023-07-24T05:47:30.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.757+0000 7f741b58b700 1 -- 172.21.15.77:0/1308407009 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7414159550 con 0x7f741415c870 2023-07-24T05:47:30.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.757+0000 7f741b58b700 1 -- 172.21.15.77:0/1308407009 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7414072490 con 0x7f741415c870 2023-07-24T05:47:30.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.761+0000 7f740affd700 1 -- 172.21.15.77:0/1308407009 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7404003bb0 con 0x7f741415c870 2023-07-24T05:47:30.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.761+0000 7f740affd700 1 --2- 172.21.15.77:0/1308407009 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f73f80662f0 0x7f73f80687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:30.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.761+0000 7f740affd700 1 -- 172.21.15.77:0/1308407009 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7404083700 con 0x7f741415c870 2023-07-24T05:47:30.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.761+0000 7f741a589700 1 --2- 172.21.15.77:0/1308407009 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f73f80662f0 0x7f73f80687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:30.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.765+0000 7f741a589700 1 --2- 172.21.15.77:0/1308407009 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f73f80662f0 0x7f73f80687b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7410009c60 tx=0x7f7410008070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:30.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.769+0000 7f740affd700 1 -- 172.21.15.77:0/1308407009 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7404050720 con 0x7f741415c870 2023-07-24T05:47:30.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.937+0000 7f741b58b700 1 -- 172.21.15.77:0/1308407009 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f741415b780 con 0x7f741415c870 2023-07-24T05:47:30.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.937+0000 7f740affd700 1 -- 172.21.15.77:0/1308407009 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f74040170a0 con 0x7f741415c870 2023-07-24T05:47:30.945 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-07-24T05:47:30.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.945+0000 7f741b58b700 1 -- 172.21.15.77:0/1308407009 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f73f80662f0 msgr2=0x7f73f80687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:30.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.945+0000 7f741b58b700 1 --2- 172.21.15.77:0/1308407009 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f73f80662f0 0x7f73f80687b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7410009c60 tx=0x7f7410008070 comp rx=0 tx=0).stop 2023-07-24T05:47:30.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.945+0000 7f741b58b700 1 -- 172.21.15.77:0/1308407009 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f741415c870 msgr2=0x7f7414151ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:30.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.945+0000 7f741b58b700 1 --2- 172.21.15.77:0/1308407009 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f741415c870 0x7f7414151ef0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f740400c520 tx=0x7f740400c8e0 comp rx=0 tx=0).stop 2023-07-24T05:47:30.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.945+0000 7f741b58b700 1 -- 172.21.15.77:0/1308407009 shutdown_connections 2023-07-24T05:47:30.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.945+0000 7f741b58b700 1 --2- 172.21.15.77:0/1308407009 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f73f80662f0 0x7f73f80687b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:30.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.945+0000 7f741b58b700 1 --2- 172.21.15.77:0/1308407009 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f741415cc50 0x7f74140cde40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:30.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.945+0000 7f741b58b700 1 --2- 172.21.15.77:0/1308407009 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f741415c870 0x7f7414151ef0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:30.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.945+0000 7f741b58b700 1 --2- 172.21.15.77:0/1308407009 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74140b2230 0x7f7414150ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:30.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.945+0000 7f741b58b700 1 -- 172.21.15.77:0/1308407009 >> 172.21.15.77:0/1308407009 conn(0x7f7414089f80 msgr2=0x7f741406bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:30.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.945+0000 7f741b58b700 1 -- 172.21.15.77:0/1308407009 shutdown_connections 2023-07-24T05:47:30.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:30.945+0000 7f741b58b700 1 -- 172.21.15.77:0/1308407009 wait complete. 2023-07-24T05:47:30.970 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-24T05:47:31.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.137+0000 7ffb31dbc700 1 Processor -- start 2023-07-24T05:47:31.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.137+0000 7ffb31dbc700 1 -- start start 2023-07-24T05:47:31.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.137+0000 7ffb31dbc700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ffb2c0aaf50 0x7ffb2c0abb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:31.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.137+0000 7ffb31dbc700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ffb2c06a520 0x7ffb2c0ab330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:31.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.137+0000 7ffb31dbc700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb2c06cf70 con 0x7ffb2c06d400 2023-07-24T05:47:31.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.137+0000 7ffb31dbc700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb2c0ac400 con 0x7ffb2c06a520 2023-07-24T05:47:31.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.137+0000 7ffb31dbc700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c0ab870 con 0x7ffb2c0aaf50 2023-07-24T05:47:31.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.141+0000 7ffb2bfff700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ffb2c06a520 0x7ffb2c0ab330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:31.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.141+0000 7ffb2bfff700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ffb2c06a520 0x7ffb2c0ab330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41534/0 (socket says 172.21.15.77:41534) 2023-07-24T05:47:31.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.141+0000 7ffb2bfff700 1 -- 172.21.15.77:0/335065990 learned_addr learned my addr 172.21.15.77:0/335065990 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:31.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.141+0000 7ffb315bb700 1 --1- 172.21.15.77:0/335065990 >> v1:172.21.15.77:6789/0 conn(0x7ffb2c06d400 0x7ffb2c0b10b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:60408/0 (socket says 172.21.15.77:60408) 2023-07-24T05:47:31.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.141+0000 7ffb30dba700 1 --2- 172.21.15.77:0/335065990 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ffb2c0aaf50 0x7ffb2c0abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:31.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.141+0000 7ffb2bfff700 1 -- 172.21.15.77:0/335065990 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ffb2c0aaf50 msgr2=0x7ffb2c0abb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:31.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.141+0000 7ffb2bfff700 1 --2- 172.21.15.77:0/335065990 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ffb2c0aaf50 0x7ffb2c0abb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:31.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.141+0000 7ffb2bfff700 1 -- 172.21.15.77:0/335065990 >> v1:172.21.15.77:6789/0 conn(0x7ffb2c06d400 legacy=0x7ffb2c0b10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:31.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.141+0000 7ffb2bfff700 1 -- 172.21.15.77:0/335065990 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb2c06ac90 con 0x7ffb2c06a520 2023-07-24T05:47:31.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.141+0000 7ffb2b7fe700 1 -- 172.21.15.77:0/335065990 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1143348142 0 0) 0x7ffb2c06cf70 con 0x7ffb2c06d400 2023-07-24T05:47:31.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.141+0000 7ffb2bfff700 1 --2- 172.21.15.77:0/335065990 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb2c06a520 0x7ffb2c0ab330 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c009910 tx=0x7ffb1c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=356d5241e2b2472e server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:31.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.141+0000 7ffb2b7fe700 1 -- 172.21.15.77:0/335065990 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c011830 con 0x7ffb2c06a520 2023-07-24T05:47:31.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.141+0000 7ffb2b7fe700 1 -- 172.21.15.77:0/335065990 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb1c011990 con 0x7ffb2c06a520 2023-07-24T05:47:31.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.141+0000 7ffb2b7fe700 1 -- 172.21.15.77:0/335065990 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c011d40 con 0x7ffb2c06a520 2023-07-24T05:47:31.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.141+0000 7ffb31dbc700 1 -- 172.21.15.77:0/335065990 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb2c06a520 msgr2=0x7ffb2c0ab330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:31.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.141+0000 7ffb31dbc700 1 --2- 172.21.15.77:0/335065990 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb2c06a520 0x7ffb2c0ab330 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c009910 tx=0x7ffb1c009c20 comp rx=0 tx=0).stop 2023-07-24T05:47:31.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.141+0000 7ffb31dbc700 1 -- 172.21.15.77:0/335065990 shutdown_connections 2023-07-24T05:47:31.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.141+0000 7ffb31dbc700 1 --2- 172.21.15.77:0/335065990 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb2c06a520 0x7ffb2c0ab330 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:31.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.141+0000 7ffb31dbc700 1 --2- 172.21.15.77:0/335065990 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ffb2c0aaf50 0x7ffb2c0abb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:31.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.141+0000 7ffb31dbc700 1 -- 172.21.15.77:0/335065990 >> 172.21.15.77:0/335065990 conn(0x7ffb2c0ce260 msgr2=0x7ffb2c0ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:31.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.141+0000 7ffb31dbc700 1 -- 172.21.15.77:0/335065990 shutdown_connections 2023-07-24T05:47:31.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.141+0000 7ffb31dbc700 1 -- 172.21.15.77:0/335065990 wait complete. 2023-07-24T05:47:31.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.145+0000 7ffb31dbc700 1 Processor -- start 2023-07-24T05:47:31.151 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.145+0000 7ffb31dbc700 1 -- start start 2023-07-24T05:47:31.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.145+0000 7ffb31dbc700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb2c06a520 0x7ffb2c14f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:31.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.145+0000 7ffb31dbc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb2c06d400 0x7ffb2c0c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:31.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.145+0000 7ffb31dbc700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ffb2c0aaf50 0x7ffb2c0c8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:31.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.145+0000 7ffb31dbc700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c150a30 con 0x7ffb2c06d400 2023-07-24T05:47:31.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.145+0000 7ffb31dbc700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c150160 con 0x7ffb2c06a520 2023-07-24T05:47:31.153 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.145+0000 7ffb31dbc700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2c14fe70 con 0x7ffb2c0aaf50 2023-07-24T05:47:31.154 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.149+0000 7ffb2bfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb2c06d400 0x7ffb2c0c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:31.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.149+0000 7ffb2bfff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb2c06d400 0x7ffb2c0c7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41542/0 (socket says 172.21.15.77:41542) 2023-07-24T05:47:31.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.149+0000 7ffb2bfff700 1 -- 172.21.15.77:0/1759513117 learned_addr learned my addr 172.21.15.77:0/1759513117 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:31.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.149+0000 7ffb315bb700 1 --2- 172.21.15.77:0/1759513117 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ffb2c0aaf50 0x7ffb2c0c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:31.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.149+0000 7ffb30dba700 1 --2- 172.21.15.77:0/1759513117 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb2c06a520 0x7ffb2c14f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:31.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.149+0000 7ffb2bfff700 1 -- 172.21.15.77:0/1759513117 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ffb2c0aaf50 msgr2=0x7ffb2c0c8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:31.155 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.149+0000 7ffb2bfff700 1 --2- 172.21.15.77:0/1759513117 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ffb2c0aaf50 0x7ffb2c0c8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:31.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.149+0000 7ffb2bfff700 1 -- 172.21.15.77:0/1759513117 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb2c06a520 msgr2=0x7ffb2c14f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:31.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.149+0000 7ffb2bfff700 1 --2- 172.21.15.77:0/1759513117 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb2c06a520 0x7ffb2c14f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:31.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.149+0000 7ffb2bfff700 1 -- 172.21.15.77:0/1759513117 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb1c009570 con 0x7ffb2c06d400 2023-07-24T05:47:31.156 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.149+0000 7ffb2bfff700 1 --2- 172.21.15.77:0/1759513117 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb2c06d400 0x7ffb2c0c7b40 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c0b0e50 tx=0x7ffb1c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:31.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.149+0000 7ffb297fa700 1 -- 172.21.15.77:0/1759513117 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c01a900 con 0x7ffb2c06d400 2023-07-24T05:47:31.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.149+0000 7ffb297fa700 1 -- 172.21.15.77:0/1759513117 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb1c01f070 con 0x7ffb2c06d400 2023-07-24T05:47:31.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.149+0000 7ffb31dbc700 1 -- 172.21.15.77:0/1759513117 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb2c0c3940 con 0x7ffb2c06d400 2023-07-24T05:47:31.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.149+0000 7ffb297fa700 1 -- 172.21.15.77:0/1759513117 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c01ace0 con 0x7ffb2c06d400 2023-07-24T05:47:31.157 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.149+0000 7ffb31dbc700 1 -- 172.21.15.77:0/1759513117 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb2c150650 con 0x7ffb2c06d400 2023-07-24T05:47:31.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.153+0000 7ffb31dbc700 1 -- 172.21.15.77:0/1759513117 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb2c0ac760 con 0x7ffb2c06d400 2023-07-24T05:47:31.158 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.153+0000 7ffb297fa700 1 -- 172.21.15.77:0/1759513117 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffb1c01b430 con 0x7ffb2c06d400 2023-07-24T05:47:31.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.153+0000 7ffb297fa700 1 --2- 172.21.15.77:0/1759513117 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ffb180662f0 0x7ffb180687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:31.160 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.153+0000 7ffb297fa700 1 -- 172.21.15.77:0/1759513117 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ffb1c021070 con 0x7ffb2c06d400 2023-07-24T05:47:31.161 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.153+0000 7ffb30dba700 1 --2- 172.21.15.77:0/1759513117 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ffb180662f0 0x7ffb180687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:31.162 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.157+0000 7ffb30dba700 1 --2- 172.21.15.77:0/1759513117 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ffb180662f0 0x7ffb180687b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c1f5d40 tx=0x7ffb20009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:31.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.161+0000 7ffb297fa700 1 -- 172.21.15.77:0/1759513117 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffb1c052a70 con 0x7ffb2c06d400 2023-07-24T05:47:31.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.329+0000 7ffb31dbc700 1 -- 172.21.15.77:0/1759513117 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ffb2c072490 con 0x7ffb2c06d400 2023-07-24T05:47:31.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.329+0000 7ffb297fa700 1 -- 172.21.15.77:0/1759513117 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7ffb1c056090 con 0x7ffb2c06d400 2023-07-24T05:47:31.335 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 8 2023-07-24T05:47:31.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.333+0000 7ffb31dbc700 1 -- 172.21.15.77:0/1759513117 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ffb180662f0 msgr2=0x7ffb180687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:31.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.333+0000 7ffb31dbc700 1 --2- 172.21.15.77:0/1759513117 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ffb180662f0 0x7ffb180687b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c1f5d40 tx=0x7ffb20009240 comp rx=0 tx=0).stop 2023-07-24T05:47:31.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.333+0000 7ffb31dbc700 1 -- 172.21.15.77:0/1759513117 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb2c06d400 msgr2=0x7ffb2c0c7b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:31.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.333+0000 7ffb31dbc700 1 --2- 172.21.15.77:0/1759513117 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb2c06d400 0x7ffb2c0c7b40 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c0b0e50 tx=0x7ffb1c004770 comp rx=0 tx=0).stop 2023-07-24T05:47:31.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.333+0000 7ffb31dbc700 1 -- 172.21.15.77:0/1759513117 shutdown_connections 2023-07-24T05:47:31.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.333+0000 7ffb31dbc700 1 --2- 172.21.15.77:0/1759513117 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ffb180662f0 0x7ffb180687b0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:31.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.333+0000 7ffb31dbc700 1 --2- 172.21.15.77:0/1759513117 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ffb2c0aaf50 0x7ffb2c0c8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:31.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.333+0000 7ffb31dbc700 1 --2- 172.21.15.77:0/1759513117 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb2c06d400 0x7ffb2c0c7b40 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:31.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.333+0000 7ffb31dbc700 1 --2- 172.21.15.77:0/1759513117 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb2c06a520 0x7ffb2c14f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:31.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.333+0000 7ffb31dbc700 1 -- 172.21.15.77:0/1759513117 >> 172.21.15.77:0/1759513117 conn(0x7ffb2c0ce260 msgr2=0x7ffb2c071bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:31.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.333+0000 7ffb31dbc700 1 -- 172.21.15.77:0/1759513117 shutdown_connections 2023-07-24T05:47:31.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.333+0000 7ffb31dbc700 1 -- 172.21.15.77:0/1759513117 wait complete. 2023-07-24T05:47:31.362 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-24T05:47:31.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.537+0000 7fad1cb9e700 1 Processor -- start 2023-07-24T05:47:31.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.537+0000 7fad1cb9e700 1 -- start start 2023-07-24T05:47:31.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.537+0000 7fad1cb9e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fad1815c870 0x7fad180cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:31.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.541+0000 7fad1cb9e700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fad1815cc50 0x7fad180b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:31.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.541+0000 7fad1cb9e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad180cf520 con 0x7fad1806a520 2023-07-24T05:47:31.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.541+0000 7fad1cb9e700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad1806aaa0 con 0x7fad1815cc50 2023-07-24T05:47:31.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.541+0000 7fad1cb9e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad1806ad80 con 0x7fad1815c870 2023-07-24T05:47:31.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.541+0000 7fad16ffd700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fad1815cc50 0x7fad180b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:31.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.541+0000 7fad16ffd700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fad1815cc50 0x7fad180b1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41556/0 (socket says 172.21.15.77:41556) 2023-07-24T05:47:31.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.541+0000 7fad16ffd700 1 -- 172.21.15.77:0/3367725436 learned_addr learned my addr 172.21.15.77:0/3367725436 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:31.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.541+0000 7fad177fe700 1 --2- 172.21.15.77:0/3367725436 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fad1815c870 0x7fad180cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:31.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.541+0000 7fad16ffd700 1 -- 172.21.15.77:0/3367725436 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fad1815c870 msgr2=0x7fad180cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:31.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.541+0000 7fad16ffd700 1 --2- 172.21.15.77:0/3367725436 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fad1815c870 0x7fad180cefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:31.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.541+0000 7fad16ffd700 1 -- 172.21.15.77:0/3367725436 >> v1:172.21.15.103:6789/0 conn(0x7fad1806a520 legacy=0x7fad180b40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:31.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.541+0000 7fad16ffd700 1 -- 172.21.15.77:0/3367725436 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad1806b060 con 0x7fad1815cc50 2023-07-24T05:47:31.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.541+0000 7fad16ffd700 1 --2- 172.21.15.77:0/3367725436 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad1815cc50 0x7fad180b1b20 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fad0c009910 tx=0x7fad0c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1464715d4b3e374 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:31.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.541+0000 7fad167fc700 1 -- 172.21.15.77:0/3367725436 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c011830 con 0x7fad1815cc50 2023-07-24T05:47:31.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.541+0000 7fad167fc700 1 -- 172.21.15.77:0/3367725436 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0c011990 con 0x7fad1815cc50 2023-07-24T05:47:31.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.541+0000 7fad167fc700 1 -- 172.21.15.77:0/3367725436 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c011d40 con 0x7fad1815cc50 2023-07-24T05:47:31.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.541+0000 7fad1cb9e700 1 -- 172.21.15.77:0/3367725436 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad1815cc50 msgr2=0x7fad180b1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:31.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.541+0000 7fad1cb9e700 1 --2- 172.21.15.77:0/3367725436 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad1815cc50 0x7fad180b1b20 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fad0c009910 tx=0x7fad0c009c20 comp rx=0 tx=0).stop 2023-07-24T05:47:31.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.541+0000 7fad1cb9e700 1 -- 172.21.15.77:0/3367725436 shutdown_connections 2023-07-24T05:47:31.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.541+0000 7fad1cb9e700 1 --2- 172.21.15.77:0/3367725436 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad1815cc50 0x7fad180b1b20 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:31.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.541+0000 7fad1cb9e700 1 --2- 172.21.15.77:0/3367725436 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fad1815c870 0x7fad180cefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:31.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.541+0000 7fad1cb9e700 1 -- 172.21.15.77:0/3367725436 >> 172.21.15.77:0/3367725436 conn(0x7fad18089f80 msgr2=0x7fad1809b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:31.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.541+0000 7fad1cb9e700 1 -- 172.21.15.77:0/3367725436 shutdown_connections 2023-07-24T05:47:31.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.541+0000 7fad1cb9e700 1 -- 172.21.15.77:0/3367725436 wait complete. 2023-07-24T05:47:31.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.545+0000 7fad1cb9e700 1 Processor -- start 2023-07-24T05:47:31.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.545+0000 7fad1cb9e700 1 -- start start 2023-07-24T05:47:31.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.549+0000 7fad1cb9e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad1806a520 0x7fad181521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:31.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.549+0000 7fad1cb9e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad1815c870 0x7fad180cba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:31.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.549+0000 7fad1cb9e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fad1815cc50 0x7fad180cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:31.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.549+0000 7fad1cb9e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad18152710 con 0x7fad1806a520 2023-07-24T05:47:31.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.549+0000 7fad1cb9e700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad180d0e90 con 0x7fad1815c870 2023-07-24T05:47:31.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.549+0000 7fad1cb9e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad180ca640 con 0x7fad1815cc50 2023-07-24T05:47:31.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.549+0000 7fad177fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad1806a520 0x7fad181521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:31.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.549+0000 7fad177fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad1806a520 0x7fad181521d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41572/0 (socket says 172.21.15.77:41572) 2023-07-24T05:47:31.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.549+0000 7fad177fe700 1 -- 172.21.15.77:0/3435022126 learned_addr learned my addr 172.21.15.77:0/3435022126 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:31.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.549+0000 7fad17fff700 1 --2- 172.21.15.77:0/3435022126 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fad1815cc50 0x7fad180cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:31.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.549+0000 7fad16ffd700 1 --2- 172.21.15.77:0/3435022126 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad1815c870 0x7fad180cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:31.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.549+0000 7fad177fe700 1 -- 172.21.15.77:0/3435022126 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fad1815cc50 msgr2=0x7fad180cbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:31.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.549+0000 7fad177fe700 1 --2- 172.21.15.77:0/3435022126 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fad1815cc50 0x7fad180cbfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:31.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.549+0000 7fad177fe700 1 -- 172.21.15.77:0/3435022126 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad1815c870 msgr2=0x7fad180cba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:31.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.549+0000 7fad177fe700 1 --2- 172.21.15.77:0/3435022126 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad1815c870 0x7fad180cba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:31.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.549+0000 7fad177fe700 1 -- 172.21.15.77:0/3435022126 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad0c009570 con 0x7fad1806a520 2023-07-24T05:47:31.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.549+0000 7fad177fe700 1 --2- 172.21.15.77:0/3435022126 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad1806a520 0x7fad181521d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fad0800e9b0 tx=0x7fad0800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:31.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.549+0000 7facfffff700 1 -- 172.21.15.77:0/3435022126 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad08009710 con 0x7fad1806a520 2023-07-24T05:47:31.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.549+0000 7facfffff700 1 -- 172.21.15.77:0/3435022126 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0800ee50 con 0x7fad1806a520 2023-07-24T05:47:31.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.549+0000 7fad1cb9e700 1 -- 172.21.15.77:0/3435022126 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad180ca920 con 0x7fad1806a520 2023-07-24T05:47:31.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.549+0000 7facfffff700 1 -- 172.21.15.77:0/3435022126 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0800ca50 con 0x7fad1806a520 2023-07-24T05:47:31.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.549+0000 7fad1cb9e700 1 -- 172.21.15.77:0/3435022126 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad180caee0 con 0x7fad1806a520 2023-07-24T05:47:31.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.553+0000 7fad1cb9e700 1 -- 172.21.15.77:0/3435022126 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad180d1000 con 0x7fad1806a520 2023-07-24T05:47:31.560 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.553+0000 7facfffff700 1 -- 172.21.15.77:0/3435022126 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fad0800cbb0 con 0x7fad1806a520 2023-07-24T05:47:31.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.557+0000 7facfffff700 1 --2- 172.21.15.77:0/3435022126 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fad040662f0 0x7fad040687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:31.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.557+0000 7facfffff700 1 -- 172.21.15.77:0/3435022126 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fad08084340 con 0x7fad1806a520 2023-07-24T05:47:31.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.557+0000 7fad16ffd700 1 --2- 172.21.15.77:0/3435022126 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fad040662f0 0x7fad040687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:31.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.557+0000 7fad16ffd700 1 --2- 172.21.15.77:0/3435022126 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fad040662f0 0x7fad040687b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fad0c000c00 tx=0x7fad0c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:31.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.561+0000 7facfffff700 1 -- 172.21.15.77:0/3435022126 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fad180d1000 con 0x7fad1806a520 2023-07-24T05:47:31.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.733+0000 7fad1cb9e700 1 -- 172.21.15.77:0/3435022126 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fad180d1000 con 0x7fad1806a520 2023-07-24T05:47:31.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.737+0000 7facfffff700 1 -- 172.21.15.77:0/3435022126 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fad180d1000 con 0x7fad1806a520 2023-07-24T05:47:31.742 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-07-24T05:47:31.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.737+0000 7fad1cb9e700 1 -- 172.21.15.77:0/3435022126 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fad040662f0 msgr2=0x7fad040687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:31.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.737+0000 7fad1cb9e700 1 --2- 172.21.15.77:0/3435022126 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fad040662f0 0x7fad040687b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fad0c000c00 tx=0x7fad0c008030 comp rx=0 tx=0).stop 2023-07-24T05:47:31.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.737+0000 7fad1cb9e700 1 -- 172.21.15.77:0/3435022126 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad1806a520 msgr2=0x7fad181521d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:31.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.737+0000 7fad1cb9e700 1 --2- 172.21.15.77:0/3435022126 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad1806a520 0x7fad181521d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fad0800e9b0 tx=0x7fad0800ecc0 comp rx=0 tx=0).stop 2023-07-24T05:47:31.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.737+0000 7fad1cb9e700 1 -- 172.21.15.77:0/3435022126 shutdown_connections 2023-07-24T05:47:31.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.737+0000 7fad1cb9e700 1 --2- 172.21.15.77:0/3435022126 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fad040662f0 0x7fad040687b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:31.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.737+0000 7fad1cb9e700 1 --2- 172.21.15.77:0/3435022126 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fad1815cc50 0x7fad180cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:31.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.737+0000 7fad1cb9e700 1 --2- 172.21.15.77:0/3435022126 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad1815c870 0x7fad180cba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:31.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.737+0000 7fad1cb9e700 1 --2- 172.21.15.77:0/3435022126 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad1806a520 0x7fad181521d0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:31.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.737+0000 7fad1cb9e700 1 -- 172.21.15.77:0/3435022126 >> 172.21.15.77:0/3435022126 conn(0x7fad18089f80 msgr2=0x7fad1806bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:31.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.737+0000 7fad1cb9e700 1 -- 172.21.15.77:0/3435022126 shutdown_connections 2023-07-24T05:47:31.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.737+0000 7fad1cb9e700 1 -- 172.21.15.77:0/3435022126 wait complete. 2023-07-24T05:47:31.769 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-24T05:47:31.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.941+0000 7f2077a87700 1 Processor -- start 2023-07-24T05:47:31.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.941+0000 7f2077a87700 1 -- start start 2023-07-24T05:47:31.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.945+0000 7f2077a87700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2070161140 0x7f20700c1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:31.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.945+0000 7f2077a87700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f20700c1950 0x7f20700ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:31.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.945+0000 7f2077a87700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f20700cd130 0x7f20700cae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:31.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.945+0000 7f2077a87700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20700c1db0 con 0x7f20700c1950 2023-07-24T05:47:31.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.945+0000 7f2077a87700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2070069d20 con 0x7f20700cd130 2023-07-24T05:47:31.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.945+0000 7f2077a87700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20700cd980 con 0x7f2070161140 2023-07-24T05:47:31.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.945+0000 7f2075022700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f20700c1950 0x7f20700ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:31.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.945+0000 7f2075022700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f20700c1950 0x7f20700ccbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41574/0 (socket says 172.21.15.77:41574) 2023-07-24T05:47:31.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.945+0000 7f2075022700 1 -- 172.21.15.77:0/3371364807 learned_addr learned my addr 172.21.15.77:0/3371364807 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:31.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.945+0000 7f2075823700 1 --2- 172.21.15.77:0/3371364807 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2070161140 0x7f20700c1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:31.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.945+0000 7f2076024700 1 --2- 172.21.15.77:0/3371364807 >> v2:172.21.15.103:3300/0 conn(0x7f20700cd130 0x7f20700cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:31.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.945+0000 7f2075022700 1 -- 172.21.15.77:0/3371364807 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2070161140 msgr2=0x7f20700c1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:31.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.945+0000 7f2075022700 1 --2- 172.21.15.77:0/3371364807 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2070161140 0x7f20700c1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:31.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.945+0000 7f2075022700 1 -- 172.21.15.77:0/3371364807 >> v2:172.21.15.103:3300/0 conn(0x7f20700cd130 msgr2=0x7f20700cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:31.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.945+0000 7f2075022700 1 --2- 172.21.15.77:0/3371364807 >> v2:172.21.15.103:3300/0 conn(0x7f20700cd130 0x7f20700cae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:31.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.945+0000 7f2075022700 1 -- 172.21.15.77:0/3371364807 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20700cdc60 con 0x7f20700c1950 2023-07-24T05:47:31.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.945+0000 7f2075022700 1 --2- 172.21.15.77:0/3371364807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20700c1950 0x7f20700ccbf0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f20700b8b80 tx=0x7f2060009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fd0f2d41ea95137 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:31.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.945+0000 7f2074821700 1 -- 172.21.15.77:0/3371364807 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206000b8a0 con 0x7f20700c1950 2023-07-24T05:47:31.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.945+0000 7f2074821700 1 -- 172.21.15.77:0/3371364807 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f206000ba00 con 0x7f20700c1950 2023-07-24T05:47:31.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.945+0000 7f2074821700 1 -- 172.21.15.77:0/3371364807 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f206000bd90 con 0x7f20700c1950 2023-07-24T05:47:31.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.949+0000 7f2077a87700 1 -- 172.21.15.77:0/3371364807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20700c1950 msgr2=0x7f20700ccbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:31.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.949+0000 7f2077a87700 1 --2- 172.21.15.77:0/3371364807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20700c1950 0x7f20700ccbf0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f20700b8b80 tx=0x7f2060009bf0 comp rx=0 tx=0).stop 2023-07-24T05:47:31.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.949+0000 7f2077a87700 1 -- 172.21.15.77:0/3371364807 shutdown_connections 2023-07-24T05:47:31.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.949+0000 7f2077a87700 1 --2- 172.21.15.77:0/3371364807 >> v2:172.21.15.103:3300/0 conn(0x7f20700cd130 0x7f20700cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:31.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.949+0000 7f2077a87700 1 --2- 172.21.15.77:0/3371364807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20700c1950 0x7f20700ccbf0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:31.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.949+0000 7f2077a87700 1 --2- 172.21.15.77:0/3371364807 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2070161140 0x7f20700c1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:31.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.949+0000 7f2077a87700 1 -- 172.21.15.77:0/3371364807 >> 172.21.15.77:0/3371364807 conn(0x7f20700ce440 msgr2=0x7f20700ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:31.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.949+0000 7f2077a87700 1 -- 172.21.15.77:0/3371364807 shutdown_connections 2023-07-24T05:47:31.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.949+0000 7f2077a87700 1 -- 172.21.15.77:0/3371364807 wait complete. 2023-07-24T05:47:31.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.949+0000 7f2077a87700 1 Processor -- start 2023-07-24T05:47:31.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.953+0000 7f2077a87700 1 -- start start 2023-07-24T05:47:31.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.953+0000 7f2077a87700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20700c1950 0x7f207015d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:31.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.953+0000 7f2077a87700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20700cd130 0x7f20700ad060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:31.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.953+0000 7f2077a87700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2070161140 0x7f20700ad5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:31.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.953+0000 7f2077a87700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20700c4cf0 con 0x7f20700cd130 2023-07-24T05:47:31.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.953+0000 7f2077a87700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20700c4170 con 0x7f20700c1950 2023-07-24T05:47:31.959 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.953+0000 7f2077a87700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20700c4450 con 0x7f2070161140 2023-07-24T05:47:31.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.953+0000 7f2075022700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20700cd130 0x7f20700ad060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:31.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.953+0000 7f2075022700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20700cd130 0x7f20700ad060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41586/0 (socket says 172.21.15.77:41586) 2023-07-24T05:47:31.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.953+0000 7f2075022700 1 -- 172.21.15.77:0/349969282 learned_addr learned my addr 172.21.15.77:0/349969282 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:31.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.953+0000 7f2075823700 1 --2- 172.21.15.77:0/349969282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20700c1950 0x7f207015d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:31.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.953+0000 7f2076024700 1 --2- 172.21.15.77:0/349969282 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2070161140 0x7f20700ad5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:31.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.953+0000 7f2075022700 1 -- 172.21.15.77:0/349969282 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2070161140 msgr2=0x7f20700ad5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:31.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.953+0000 7f2075022700 1 --2- 172.21.15.77:0/349969282 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2070161140 0x7f20700ad5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:31.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.953+0000 7f2075022700 1 -- 172.21.15.77:0/349969282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20700c1950 msgr2=0x7f207015d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:31.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.953+0000 7f2075022700 1 --2- 172.21.15.77:0/349969282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20700c1950 0x7f207015d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:31.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.953+0000 7f2075022700 1 -- 172.21.15.77:0/349969282 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2060009570 con 0x7f20700cd130 2023-07-24T05:47:31.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.953+0000 7f2075823700 1 --2- 172.21.15.77:0/349969282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20700c1950 0x7f207015d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:31.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.953+0000 7f2075022700 1 --2- 172.21.15.77:0/349969282 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20700cd130 0x7f20700ad060 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f20700cbfc0 tx=0x7f2060004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:31.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.953+0000 7f20667fc700 1 -- 172.21.15.77:0/349969282 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20600036c0 con 0x7f20700cd130 2023-07-24T05:47:31.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.953+0000 7f20667fc700 1 -- 172.21.15.77:0/349969282 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f206001f070 con 0x7f20700cd130 2023-07-24T05:47:31.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.953+0000 7f2077a87700 1 -- 172.21.15.77:0/349969282 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20700c4730 con 0x7f20700cd130 2023-07-24T05:47:31.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.953+0000 7f20667fc700 1 -- 172.21.15.77:0/349969282 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2060003a80 con 0x7f20700cd130 2023-07-24T05:47:31.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.953+0000 7f2077a87700 1 -- 172.21.15.77:0/349969282 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f207015d920 con 0x7f20700cd130 2023-07-24T05:47:31.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.957+0000 7f2077a87700 1 -- 172.21.15.77:0/349969282 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20700ade30 con 0x7f20700cd130 2023-07-24T05:47:31.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.957+0000 7f20667fc700 1 -- 172.21.15.77:0/349969282 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2060021030 con 0x7f20700cd130 2023-07-24T05:47:31.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.961+0000 7f20667fc700 1 --2- 172.21.15.77:0/349969282 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f20540662f0 0x7f20540687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:31.965 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.961+0000 7f20667fc700 1 -- 172.21.15.77:0/349969282 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f20600856d0 con 0x7f20700cd130 2023-07-24T05:47:31.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.961+0000 7f2075823700 1 --2- 172.21.15.77:0/349969282 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f20540662f0 0x7f20540687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:31.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.961+0000 7f2075823700 1 --2- 172.21.15.77:0/349969282 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f20540662f0 0x7f20540687b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f206c006fd0 tx=0x7f206c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:31.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:31.965+0000 7f20667fc700 1 -- 172.21.15.77:0/349969282 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f20700ade30 con 0x7f20700cd130 2023-07-24T05:47:32.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.137+0000 7f2077a87700 1 -- 172.21.15.77:0/349969282 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f20700ade30 con 0x7f20700cd130 2023-07-24T05:47:32.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.137+0000 7f20667fc700 1 -- 172.21.15.77:0/349969282 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f20700ade30 con 0x7f20700cd130 2023-07-24T05:47:32.144 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-07-24T05:47:32.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.141+0000 7f2077a87700 1 -- 172.21.15.77:0/349969282 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f20540662f0 msgr2=0x7f20540687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:32.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.141+0000 7f2077a87700 1 --2- 172.21.15.77:0/349969282 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f20540662f0 0x7f20540687b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f206c006fd0 tx=0x7f206c008040 comp rx=0 tx=0).stop 2023-07-24T05:47:32.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.141+0000 7f2077a87700 1 -- 172.21.15.77:0/349969282 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20700cd130 msgr2=0x7f20700ad060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:32.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.141+0000 7f2077a87700 1 --2- 172.21.15.77:0/349969282 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20700cd130 0x7f20700ad060 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f20700cbfc0 tx=0x7f2060004770 comp rx=0 tx=0).stop 2023-07-24T05:47:32.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.141+0000 7f2077a87700 1 -- 172.21.15.77:0/349969282 shutdown_connections 2023-07-24T05:47:32.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.141+0000 7f2077a87700 1 --2- 172.21.15.77:0/349969282 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f20540662f0 0x7f20540687b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:32.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.141+0000 7f2077a87700 1 --2- 172.21.15.77:0/349969282 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2070161140 0x7f20700ad5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:32.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.141+0000 7f2077a87700 1 --2- 172.21.15.77:0/349969282 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f20700cd130 0x7f20700ad060 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:32.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.141+0000 7f2077a87700 1 --2- 172.21.15.77:0/349969282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20700c1950 0x7f207015d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:32.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.141+0000 7f2077a87700 1 -- 172.21.15.77:0/349969282 >> 172.21.15.77:0/349969282 conn(0x7f20700ce440 msgr2=0x7f2070070f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:32.149 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.141+0000 7f2077a87700 1 -- 172.21.15.77:0/349969282 shutdown_connections 2023-07-24T05:47:32.150 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.141+0000 7f2077a87700 1 -- 172.21.15.77:0/349969282 wait complete. 2023-07-24T05:47:32.169 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-24T05:47:32.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.341+0000 7fa8712b8700 1 Processor -- start 2023-07-24T05:47:32.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.341+0000 7fa8712b8700 1 -- start start 2023-07-24T05:47:32.349 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.345+0000 7fa8712b8700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa86c15c870 0x7fa86c0cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:32.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.345+0000 7fa8712b8700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa86c15cc50 0x7fa86c0b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:32.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.345+0000 7fa8712b8700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa86c0cf520 con 0x7fa86c06a520 2023-07-24T05:47:32.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.345+0000 7fa8712b8700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa86c06aaa0 con 0x7fa86c15cc50 2023-07-24T05:47:32.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.345+0000 7fa8712b8700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa86c06ad80 con 0x7fa86c15c870 2023-07-24T05:47:32.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.345+0000 7fa86b7fe700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa86c15cc50 0x7fa86c0b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:32.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.345+0000 7fa86bfff700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa86c15c870 0x7fa86c0cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:32.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.345+0000 7fa86b7fe700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fa86c15cc50 0x7fa86c0b1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41594/0 (socket says 172.21.15.77:41594) 2023-07-24T05:47:32.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.345+0000 7fa86b7fe700 1 -- 172.21.15.77:0/4220482135 learned_addr learned my addr 172.21.15.77:0/4220482135 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:32.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.345+0000 7fa86b7fe700 1 -- 172.21.15.77:0/4220482135 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa86c15c870 msgr2=0x7fa86c0cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:32.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.345+0000 7fa86b7fe700 1 --2- 172.21.15.77:0/4220482135 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa86c15c870 0x7fa86c0cefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:32.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.345+0000 7fa86b7fe700 1 -- 172.21.15.77:0/4220482135 >> v1:172.21.15.103:6789/0 conn(0x7fa86c06a520 legacy=0x7fa86c0b40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:32.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.345+0000 7fa86b7fe700 1 -- 172.21.15.77:0/4220482135 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa86c06b060 con 0x7fa86c15cc50 2023-07-24T05:47:32.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.345+0000 7fa86affd700 1 -- 172.21.15.77:0/4220482135 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1032297650 0 0) 0x7fa86c0cf520 con 0x7fa86c06a520 2023-07-24T05:47:32.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.345+0000 7fa86b7fe700 1 --2- 172.21.15.77:0/4220482135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa86c15cc50 0x7fa86c0b1b20 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa860009910 tx=0x7fa860009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31071b984f2db92c server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:32.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.345+0000 7fa86affd700 1 -- 172.21.15.77:0/4220482135 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa860011830 con 0x7fa86c15cc50 2023-07-24T05:47:32.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.345+0000 7fa86affd700 1 -- 172.21.15.77:0/4220482135 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa860011990 con 0x7fa86c15cc50 2023-07-24T05:47:32.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.345+0000 7fa86affd700 1 -- 172.21.15.77:0/4220482135 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa860011d40 con 0x7fa86c15cc50 2023-07-24T05:47:32.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.349+0000 7fa8712b8700 1 -- 172.21.15.77:0/4220482135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa86c15cc50 msgr2=0x7fa86c0b1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:32.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.349+0000 7fa8712b8700 1 --2- 172.21.15.77:0/4220482135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa86c15cc50 0x7fa86c0b1b20 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa860009910 tx=0x7fa860009c20 comp rx=0 tx=0).stop 2023-07-24T05:47:32.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.349+0000 7fa8712b8700 1 -- 172.21.15.77:0/4220482135 shutdown_connections 2023-07-24T05:47:32.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.349+0000 7fa8712b8700 1 --2- 172.21.15.77:0/4220482135 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa86c15cc50 0x7fa86c0b1b20 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:32.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.349+0000 7fa8712b8700 1 --2- 172.21.15.77:0/4220482135 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa86c15c870 0x7fa86c0cefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:32.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.349+0000 7fa8712b8700 1 -- 172.21.15.77:0/4220482135 >> 172.21.15.77:0/4220482135 conn(0x7fa86c089f80 msgr2=0x7fa86c09b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:32.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.349+0000 7fa8712b8700 1 -- 172.21.15.77:0/4220482135 shutdown_connections 2023-07-24T05:47:32.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.349+0000 7fa8712b8700 1 -- 172.21.15.77:0/4220482135 wait complete. 2023-07-24T05:47:32.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.349+0000 7fa8712b8700 1 Processor -- start 2023-07-24T05:47:32.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.349+0000 7fa8712b8700 1 -- start start 2023-07-24T05:47:32.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.353+0000 7fa8712b8700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa86c06a520 0x7fa86c0c9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:32.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.353+0000 7fa8712b8700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa86c15c870 0x7fa86c1e6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:32.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.353+0000 7fa8712b8700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa86c15cc50 0x7fa86c153a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:32.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.353+0000 7fa8712b8700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa86c0ca540 con 0x7fa86c15c870 2023-07-24T05:47:32.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.353+0000 7fa8712b8700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa86c0c9f80 con 0x7fa86c15cc50 2023-07-24T05:47:32.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.353+0000 7fa8712b8700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa86c0ca260 con 0x7fa86c06a520 2023-07-24T05:47:32.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.353+0000 7fa86b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa86c15c870 0x7fa86c1e6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:32.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.353+0000 7fa86b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa86c15c870 0x7fa86c1e6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41596/0 (socket says 172.21.15.77:41596) 2023-07-24T05:47:32.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.353+0000 7fa86b7fe700 1 -- 172.21.15.77:0/789829150 learned_addr learned my addr 172.21.15.77:0/789829150 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:32.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.353+0000 7fa86bfff700 1 --2- 172.21.15.77:0/789829150 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa86c06a520 0x7fa86c0c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:32.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.353+0000 7fa870ab7700 1 --2- 172.21.15.77:0/789829150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa86c15cc50 0x7fa86c153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:32.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.353+0000 7fa86b7fe700 1 -- 172.21.15.77:0/789829150 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa86c06a520 msgr2=0x7fa86c0c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:32.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.353+0000 7fa86b7fe700 1 --2- 172.21.15.77:0/789829150 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa86c06a520 0x7fa86c0c9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:32.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.353+0000 7fa86b7fe700 1 -- 172.21.15.77:0/789829150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa86c15cc50 msgr2=0x7fa86c153a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:32.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.353+0000 7fa86b7fe700 1 --2- 172.21.15.77:0/789829150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa86c15cc50 0x7fa86c153a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:32.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.353+0000 7fa86b7fe700 1 -- 172.21.15.77:0/789829150 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa860009570 con 0x7fa86c15c870 2023-07-24T05:47:32.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.353+0000 7fa870ab7700 1 --2- 172.21.15.77:0/789829150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa86c15cc50 0x7fa86c153a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:32.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.353+0000 7fa86b7fe700 1 --2- 172.21.15.77:0/789829150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa86c15c870 0x7fa86c1e6610 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa86c0b5250 tx=0x7fa860004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:32.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.353+0000 7fa868ff9700 1 -- 172.21.15.77:0/789829150 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa860004480 con 0x7fa86c15c870 2023-07-24T05:47:32.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.353+0000 7fa868ff9700 1 -- 172.21.15.77:0/789829150 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86001f070 con 0x7fa86c15c870 2023-07-24T05:47:32.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.353+0000 7fa868ff9700 1 -- 172.21.15.77:0/789829150 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa860003900 con 0x7fa86c15c870 2023-07-24T05:47:32.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.353+0000 7fa8712b8700 1 -- 172.21.15.77:0/789829150 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa86c153280 con 0x7fa86c15c870 2023-07-24T05:47:32.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.353+0000 7fa8712b8700 1 -- 172.21.15.77:0/789829150 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa86c0c9c70 con 0x7fa86c15c870 2023-07-24T05:47:32.361 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.357+0000 7fa8712b8700 1 -- 172.21.15.77:0/789829150 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa86c1530e0 con 0x7fa86c15c870 2023-07-24T05:47:32.362 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.357+0000 7fa868ff9700 1 -- 172.21.15.77:0/789829150 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa860021030 con 0x7fa86c15c870 2023-07-24T05:47:32.363 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.357+0000 7fa868ff9700 1 --2- 172.21.15.77:0/789829150 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa8580662f0 0x7fa8580687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:32.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.357+0000 7fa868ff9700 1 -- 172.21.15.77:0/789829150 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa8600854f0 con 0x7fa86c15c870 2023-07-24T05:47:32.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.357+0000 7fa86bfff700 1 --2- 172.21.15.77:0/789829150 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa8580662f0 0x7fa8580687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:32.365 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.361+0000 7fa86bfff700 1 --2- 172.21.15.77:0/789829150 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa8580662f0 0x7fa8580687b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa85c009b70 tx=0x7fa85c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:32.369 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.365+0000 7fa868ff9700 1 -- 172.21.15.77:0/789829150 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa86c1530e0 con 0x7fa86c15c870 2023-07-24T05:47:32.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.533+0000 7fa8712b8700 1 -- 172.21.15.77:0/789829150 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa86c1537a0 con 0x7fa86c15c870 2023-07-24T05:47:32.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.533+0000 7fa868ff9700 1 -- 172.21.15.77:0/789829150 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa86c1537a0 con 0x7fa86c15c870 2023-07-24T05:47:32.541 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-07-24T05:47:32.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.537+0000 7fa8712b8700 1 -- 172.21.15.77:0/789829150 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa8580662f0 msgr2=0x7fa8580687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:32.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.537+0000 7fa8712b8700 1 --2- 172.21.15.77:0/789829150 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa8580662f0 0x7fa8580687b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa85c009b70 tx=0x7fa85c008040 comp rx=0 tx=0).stop 2023-07-24T05:47:32.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.537+0000 7fa8712b8700 1 -- 172.21.15.77:0/789829150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa86c15c870 msgr2=0x7fa86c1e6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:32.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.537+0000 7fa8712b8700 1 --2- 172.21.15.77:0/789829150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa86c15c870 0x7fa86c1e6610 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa86c0b5250 tx=0x7fa860004770 comp rx=0 tx=0).stop 2023-07-24T05:47:32.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.537+0000 7fa8712b8700 1 -- 172.21.15.77:0/789829150 shutdown_connections 2023-07-24T05:47:32.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.537+0000 7fa8712b8700 1 --2- 172.21.15.77:0/789829150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa86c15cc50 0x7fa86c153a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:32.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.537+0000 7fa8712b8700 1 --2- 172.21.15.77:0/789829150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa86c15c870 0x7fa86c1e6610 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:32.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.537+0000 7fa8712b8700 1 --2- 172.21.15.77:0/789829150 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa8580662f0 0x7fa8580687b0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:32.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.537+0000 7fa8712b8700 1 --2- 172.21.15.77:0/789829150 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa86c06a520 0x7fa86c0c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:32.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.537+0000 7fa8712b8700 1 -- 172.21.15.77:0/789829150 >> 172.21.15.77:0/789829150 conn(0x7fa86c089f80 msgr2=0x7fa86c0b54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:32.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.537+0000 7fa8712b8700 1 -- 172.21.15.77:0/789829150 shutdown_connections 2023-07-24T05:47:32.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.537+0000 7fa8712b8700 1 -- 172.21.15.77:0/789829150 wait complete. 2023-07-24T05:47:32.564 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-24T05:47:32.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.729+0000 7f4952af2700 1 Processor -- start 2023-07-24T05:47:32.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.729+0000 7f4952af2700 1 -- start start 2023-07-24T05:47:32.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.733+0000 7f4952af2700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f494c0d2200 0x7f494c0b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:32.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.733+0000 7f4952af2700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f494c0b4630 0x7f494c0b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:32.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.733+0000 7f4952af2700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f494c0d0300 con 0x7f494c15ca00 2023-07-24T05:47:32.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.733+0000 7f4952af2700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f494c0d2670 con 0x7f494c0d2200 2023-07-24T05:47:32.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.733+0000 7f4952af2700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f494c0b4ac0 con 0x7f494c0b4630 2023-07-24T05:47:32.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.733+0000 7f49512ef700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f494c0d2200 0x7f494c0b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:32.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.733+0000 7f49512ef700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f494c0d2200 0x7f494c0b40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41606/0 (socket says 172.21.15.77:41606) 2023-07-24T05:47:32.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.733+0000 7f49512ef700 1 -- 172.21.15.77:0/1462284460 learned_addr learned my addr 172.21.15.77:0/1462284460 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:32.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.733+0000 7f49522f1700 1 --2- 172.21.15.77:0/1462284460 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f494c0b4630 0x7f494c0b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:32.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.733+0000 7f49512ef700 1 -- 172.21.15.77:0/1462284460 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f494c0b4630 msgr2=0x7f494c0b11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:32.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.733+0000 7f49512ef700 1 --2- 172.21.15.77:0/1462284460 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f494c0b4630 0x7f494c0b11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:32.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.733+0000 7f49512ef700 1 -- 172.21.15.77:0/1462284460 >> v1:172.21.15.103:6789/0 conn(0x7f494c15ca00 legacy=0x7f494c06d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:32.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.733+0000 7f49512ef700 1 -- 172.21.15.77:0/1462284460 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f494c15cde0 con 0x7f494c0d2200 2023-07-24T05:47:32.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.733+0000 7f49512ef700 1 --2- 172.21.15.77:0/1462284460 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f494c0d2200 0x7f494c0b40f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f493c009910 tx=0x7f493c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c764c9003619989 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:32.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.733+0000 7f4950aee700 1 -- 172.21.15.77:0/1462284460 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493c00ba60 con 0x7f494c0d2200 2023-07-24T05:47:32.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.733+0000 7f4950aee700 1 -- 172.21.15.77:0/1462284460 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493c00bbc0 con 0x7f494c0d2200 2023-07-24T05:47:32.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.733+0000 7f4950aee700 1 -- 172.21.15.77:0/1462284460 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493c009e60 con 0x7f494c0d2200 2023-07-24T05:47:32.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.737+0000 7f4952af2700 1 -- 172.21.15.77:0/1462284460 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f494c0d2200 msgr2=0x7f494c0b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:32.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.737+0000 7f4952af2700 1 --2- 172.21.15.77:0/1462284460 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f494c0d2200 0x7f494c0b40f0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f493c009910 tx=0x7f493c009c20 comp rx=0 tx=0).stop 2023-07-24T05:47:32.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.737+0000 7f4952af2700 1 -- 172.21.15.77:0/1462284460 shutdown_connections 2023-07-24T05:47:32.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.737+0000 7f4952af2700 1 --2- 172.21.15.77:0/1462284460 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f494c0b4630 0x7f494c0b11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:32.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.737+0000 7f4952af2700 1 --2- 172.21.15.77:0/1462284460 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f494c0d2200 0x7f494c0b40f0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:32.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.737+0000 7f4952af2700 1 -- 172.21.15.77:0/1462284460 >> 172.21.15.77:0/1462284460 conn(0x7f494c0b7610 msgr2=0x7f494c0b7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:32.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.737+0000 7f4952af2700 1 -- 172.21.15.77:0/1462284460 shutdown_connections 2023-07-24T05:47:32.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.737+0000 7f4952af2700 1 -- 172.21.15.77:0/1462284460 wait complete. 2023-07-24T05:47:32.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.741+0000 7f4952af2700 1 Processor -- start 2023-07-24T05:47:32.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.741+0000 7f4952af2700 1 -- start start 2023-07-24T05:47:32.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.741+0000 7f4952af2700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f494c0b4630 0x7f494c157180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:32.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.741+0000 7f4952af2700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f494c0d2200 0x7f494c09c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:32.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.741+0000 7f4952af2700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f494c15ca00 0x7f494c15f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:32.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.741+0000 7f4952af2700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c0c7130 con 0x7f494c0d2200 2023-07-24T05:47:32.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.741+0000 7f4952af2700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c09efb0 con 0x7f494c15ca00 2023-07-24T05:47:32.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.741+0000 7f4952af2700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f494c0c65b0 con 0x7f494c0b4630 2023-07-24T05:47:32.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.741+0000 7f49512ef700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f494c0d2200 0x7f494c09c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:32.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.741+0000 7f49512ef700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f494c0d2200 0x7f494c09c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41622/0 (socket says 172.21.15.77:41622) 2023-07-24T05:47:32.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.741+0000 7f49512ef700 1 -- 172.21.15.77:0/2635889367 learned_addr learned my addr 172.21.15.77:0/2635889367 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:32.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.741+0000 7f4951af0700 1 --2- 172.21.15.77:0/2635889367 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f494c0b4630 0x7f494c157180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:32.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.745+0000 7f49522f1700 1 --2- 172.21.15.77:0/2635889367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f494c15ca00 0x7f494c15f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:32.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.745+0000 7f49512ef700 1 -- 172.21.15.77:0/2635889367 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f494c0b4630 msgr2=0x7f494c157180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:32.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.745+0000 7f49512ef700 1 --2- 172.21.15.77:0/2635889367 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f494c0b4630 0x7f494c157180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:32.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.745+0000 7f49512ef700 1 -- 172.21.15.77:0/2635889367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f494c15ca00 msgr2=0x7f494c15f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:32.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.745+0000 7f49512ef700 1 --2- 172.21.15.77:0/2635889367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f494c15ca00 0x7f494c15f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:32.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.745+0000 7f49512ef700 1 -- 172.21.15.77:0/2635889367 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f493c009570 con 0x7f494c0d2200 2023-07-24T05:47:32.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.745+0000 7f49512ef700 1 --2- 172.21.15.77:0/2635889367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f494c0d2200 0x7f494c09c500 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f494c08c900 tx=0x7f493c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:32.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.745+0000 7f49427fc700 1 -- 172.21.15.77:0/2635889367 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493c004510 con 0x7f494c0d2200 2023-07-24T05:47:32.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.745+0000 7f4952af2700 1 -- 172.21.15.77:0/2635889367 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f494c0c6890 con 0x7f494c0d2200 2023-07-24T05:47:32.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.745+0000 7f49427fc700 1 -- 172.21.15.77:0/2635889367 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493c01f070 con 0x7f494c0d2200 2023-07-24T05:47:32.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.745+0000 7f49427fc700 1 -- 172.21.15.77:0/2635889367 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493c003900 con 0x7f494c0d2200 2023-07-24T05:47:32.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.745+0000 7f4952af2700 1 -- 172.21.15.77:0/2635889367 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f494c0c6e50 con 0x7f494c0d2200 2023-07-24T05:47:32.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.745+0000 7f4952af2700 1 -- 172.21.15.77:0/2635889367 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f494c09f1b0 con 0x7f494c0d2200 2023-07-24T05:47:32.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.749+0000 7f49427fc700 1 -- 172.21.15.77:0/2635889367 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f493c003a60 con 0x7f494c0d2200 2023-07-24T05:47:32.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.749+0000 7f49427fc700 1 --2- 172.21.15.77:0/2635889367 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f49300662f0 0x7f49300687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:32.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.749+0000 7f49427fc700 1 -- 172.21.15.77:0/2635889367 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f493c021070 con 0x7f494c0d2200 2023-07-24T05:47:32.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.749+0000 7f4951af0700 1 --2- 172.21.15.77:0/2635889367 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f49300662f0 0x7f49300687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:32.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.749+0000 7f4951af0700 1 --2- 172.21.15.77:0/2635889367 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f49300662f0 0x7f49300687b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4948000fb0 tx=0x7f4948009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:32.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.753+0000 7f49427fc700 1 -- 172.21.15.77:0/2635889367 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f494c09f1b0 con 0x7f494c0d2200 2023-07-24T05:47:32.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.937+0000 7f4952af2700 1 -- 172.21.15.77:0/2635889367 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f494c09f170 con 0x7f494c0d2200 2023-07-24T05:47:32.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.937+0000 7f49427fc700 1 -- 172.21.15.77:0/2635889367 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f493c0528f0 con 0x7f494c0d2200 2023-07-24T05:47:32.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.945+0000 7f4952af2700 1 -- 172.21.15.77:0/2635889367 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f49300662f0 msgr2=0x7f49300687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:32.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.945+0000 7f4952af2700 1 --2- 172.21.15.77:0/2635889367 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f49300662f0 0x7f49300687b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4948000fb0 tx=0x7f4948009040 comp rx=0 tx=0).stop 2023-07-24T05:47:32.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.945+0000 7f4952af2700 1 -- 172.21.15.77:0/2635889367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f494c0d2200 msgr2=0x7f494c09c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:32.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.945+0000 7f4952af2700 1 --2- 172.21.15.77:0/2635889367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f494c0d2200 0x7f494c09c500 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f494c08c900 tx=0x7f493c004770 comp rx=0 tx=0).stop 2023-07-24T05:47:32.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.945+0000 7f4952af2700 1 -- 172.21.15.77:0/2635889367 shutdown_connections 2023-07-24T05:47:32.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.945+0000 7f4952af2700 1 --2- 172.21.15.77:0/2635889367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f494c15ca00 0x7f494c15f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:32.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.945+0000 7f4952af2700 1 --2- 172.21.15.77:0/2635889367 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f494c0d2200 0x7f494c09c500 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:32.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.945+0000 7f4952af2700 1 --2- 172.21.15.77:0/2635889367 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f49300662f0 0x7f49300687b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:32.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.945+0000 7f4952af2700 1 --2- 172.21.15.77:0/2635889367 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f494c0b4630 0x7f494c157180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:32.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.945+0000 7f4952af2700 1 -- 172.21.15.77:0/2635889367 >> 172.21.15.77:0/2635889367 conn(0x7f494c0b7610 msgr2=0x7f494c0d0790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:32.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.945+0000 7f4952af2700 1 -- 172.21.15.77:0/2635889367 shutdown_connections 2023-07-24T05:47:32.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:32.945+0000 7f4952af2700 1 -- 172.21.15.77:0/2635889367 wait complete. 2023-07-24T05:47:32.951 INFO:teuthology.orchestra.run.smithi077.stderr:listed 0 entries 2023-07-24T05:47:32.970 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2023-07-24T05:47:32.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:47:32.970 DEBUG:teuthology.orchestra.run.smithi103:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-07-24T05:47:33.006 INFO:teuthology.orchestra.run:waiting for 300 2023-07-24T05:47:33.007 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi103.front.sepia.ceph.com 2023-07-24T05:47:33.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:47:33.008 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-07-24T05:47:33.068 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-24T05:47:33.068 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-24T05:47:33.245 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.241+0000 7f6d8f061700 1 Processor -- start 2023-07-24T05:47:33.246 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.241+0000 7f6d8f061700 1 -- start start 2023-07-24T05:47:33.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.241+0000 7f6d8f061700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6d880d2200 0x7f6d880b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:33.247 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.241+0000 7f6d8f061700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6d880b4630 0x7f6d880b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:33.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.241+0000 7f6d8f061700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d880b4a80 con 0x7f6d8815ca00 2023-07-24T05:47:33.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.241+0000 7f6d8f061700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d880d2670 con 0x7f6d880d2200 2023-07-24T05:47:33.248 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.241+0000 7f6d8f061700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d880d0300 con 0x7f6d880b4630 2023-07-24T05:47:33.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.241+0000 7f6d8d85e700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6d880d2200 0x7f6d880b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:33.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.241+0000 7f6d8d85e700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6d880d2200 0x7f6d880b40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46638/0 (socket says 172.21.15.77:46638) 2023-07-24T05:47:33.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.241+0000 7f6d8d85e700 1 -- 172.21.15.77:0/139177713 learned_addr learned my addr 172.21.15.77:0/139177713 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:33.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.241+0000 7f6d8e860700 1 --2- 172.21.15.77:0/139177713 >> v2:172.21.15.103:3300/0 conn(0x7f6d880b4630 0x7f6d880b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:33.249 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.241+0000 7f6d8d85e700 1 -- 172.21.15.77:0/139177713 >> v2:172.21.15.103:3300/0 conn(0x7f6d880b4630 msgr2=0x7f6d880b11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:33.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.241+0000 7f6d8d85e700 1 --2- 172.21.15.77:0/139177713 >> v2:172.21.15.103:3300/0 conn(0x7f6d880b4630 0x7f6d880b11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:33.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.241+0000 7f6d8d85e700 1 -- 172.21.15.77:0/139177713 >> v1:172.21.15.103:6789/0 conn(0x7f6d8815ca00 legacy=0x7f6d8806d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:33.250 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.241+0000 7f6d8d85e700 1 -- 172.21.15.77:0/139177713 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8815cde0 con 0x7f6d880d2200 2023-07-24T05:47:33.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.245+0000 7f6d8d85e700 1 --2- 172.21.15.77:0/139177713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d880d2200 0x7f6d880b40f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f6d8808c020 tx=0x7f6d78009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f5257b830b22d35 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:33.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.245+0000 7f6d8d05d700 1 -- 172.21.15.77:0/139177713 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d78011830 con 0x7f6d880d2200 2023-07-24T05:47:33.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.245+0000 7f6d8d05d700 1 -- 172.21.15.77:0/139177713 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d78011990 con 0x7f6d880d2200 2023-07-24T05:47:33.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.245+0000 7f6d8d05d700 1 -- 172.21.15.77:0/139177713 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d78011d20 con 0x7f6d880d2200 2023-07-24T05:47:33.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.245+0000 7f6d8f061700 1 -- 172.21.15.77:0/139177713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d880d2200 msgr2=0x7f6d880b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:33.251 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.245+0000 7f6d8f061700 1 --2- 172.21.15.77:0/139177713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d880d2200 0x7f6d880b40f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f6d8808c020 tx=0x7f6d78009bf0 comp rx=0 tx=0).stop 2023-07-24T05:47:33.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.245+0000 7f6d8f061700 1 -- 172.21.15.77:0/139177713 shutdown_connections 2023-07-24T05:47:33.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.245+0000 7f6d8f061700 1 --2- 172.21.15.77:0/139177713 >> v2:172.21.15.103:3300/0 conn(0x7f6d880b4630 0x7f6d880b11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:33.252 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.245+0000 7f6d8f061700 1 --2- 172.21.15.77:0/139177713 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d880d2200 0x7f6d880b40f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:33.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.245+0000 7f6d8f061700 1 -- 172.21.15.77:0/139177713 >> 172.21.15.77:0/139177713 conn(0x7f6d880b7610 msgr2=0x7f6d880b7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:33.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.245+0000 7f6d8f061700 1 -- 172.21.15.77:0/139177713 shutdown_connections 2023-07-24T05:47:33.253 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.245+0000 7f6d8f061700 1 -- 172.21.15.77:0/139177713 wait complete. 2023-07-24T05:47:33.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.249+0000 7f6d8f061700 1 Processor -- start 2023-07-24T05:47:33.254 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.249+0000 7f6d8f061700 1 -- start start 2023-07-24T05:47:33.255 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.249+0000 7f6d8f061700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d880b4630 0x7f6d8814d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:33.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.249+0000 7f6d8f061700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d880d2200 0x7f6d8815e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:33.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.249+0000 7f6d8f061700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6d8815ca00 0x7f6d8815e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:33.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.249+0000 7f6d8f061700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d880c6200 con 0x7f6d880d2200 2023-07-24T05:47:33.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.249+0000 7f6d8f061700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d880c7260 con 0x7f6d880b4630 2023-07-24T05:47:33.256 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.249+0000 7f6d8f061700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d880c64a0 con 0x7f6d8815ca00 2023-07-24T05:47:33.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.249+0000 7f6d8d85e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d880d2200 0x7f6d8815e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:33.257 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.249+0000 7f6d8d85e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d880d2200 0x7f6d8815e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46650/0 (socket says 172.21.15.77:46650) 2023-07-24T05:47:33.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.249+0000 7f6d8d85e700 1 -- 172.21.15.77:0/3733141909 learned_addr learned my addr 172.21.15.77:0/3733141909 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:33.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.249+0000 7f6d8e05f700 1 --2- 172.21.15.77:0/3733141909 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d880b4630 0x7f6d8814d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:33.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.249+0000 7f6d8e860700 1 --2- 172.21.15.77:0/3733141909 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6d8815ca00 0x7f6d8815e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:33.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.253+0000 7f6d8d85e700 1 -- 172.21.15.77:0/3733141909 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6d8815ca00 msgr2=0x7f6d8815e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:33.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.253+0000 7f6d8d85e700 1 --2- 172.21.15.77:0/3733141909 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6d8815ca00 0x7f6d8815e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:33.258 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.253+0000 7f6d8d85e700 1 -- 172.21.15.77:0/3733141909 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d880b4630 msgr2=0x7f6d8814d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:33.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.253+0000 7f6d8d85e700 1 --2- 172.21.15.77:0/3733141909 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d880b4630 0x7f6d8814d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:33.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.253+0000 7f6d8d85e700 1 -- 172.21.15.77:0/3733141909 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d78009570 con 0x7f6d880d2200 2023-07-24T05:47:33.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.253+0000 7f6d8d85e700 1 --2- 172.21.15.77:0/3733141909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d880d2200 0x7f6d8815e1e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f6d8808c900 tx=0x7f6d78004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:33.259 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.253+0000 7f6d7effd700 1 -- 172.21.15.77:0/3733141909 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d78004450 con 0x7f6d880d2200 2023-07-24T05:47:33.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.253+0000 7f6d8f061700 1 -- 172.21.15.77:0/3733141909 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d880c6780 con 0x7f6d880d2200 2023-07-24T05:47:33.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.253+0000 7f6d7effd700 1 -- 172.21.15.77:0/3733141909 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d7801f070 con 0x7f6d880d2200 2023-07-24T05:47:33.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.253+0000 7f6d7effd700 1 -- 172.21.15.77:0/3733141909 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d78003900 con 0x7f6d880d2200 2023-07-24T05:47:33.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.253+0000 7f6d8f061700 1 -- 172.21.15.77:0/3733141909 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d880c6d40 con 0x7f6d880d2200 2023-07-24T05:47:33.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.253+0000 7f6d8f061700 1 -- 172.21.15.77:0/3733141909 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d88072490 con 0x7f6d880d2200 2023-07-24T05:47:33.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.257+0000 7f6d7effd700 1 -- 172.21.15.77:0/3733141909 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6d78003a60 con 0x7f6d880d2200 2023-07-24T05:47:33.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.257+0000 7f6d7effd700 1 --2- 172.21.15.77:0/3733141909 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6d6c0662f0 0x7f6d6c0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:33.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.257+0000 7f6d7effd700 1 -- 172.21.15.77:0/3733141909 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6d78021070 con 0x7f6d880d2200 2023-07-24T05:47:33.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.257+0000 7f6d8e05f700 1 --2- 172.21.15.77:0/3733141909 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6d6c0662f0 0x7f6d6c0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:33.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.257+0000 7f6d8e05f700 1 --2- 172.21.15.77:0/3733141909 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6d6c0662f0 0x7f6d6c0687b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6d8815b830 tx=0x7f6d84009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:33.269 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.265+0000 7f6d7effd700 1 -- 172.21.15.77:0/3733141909 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6d780525a0 con 0x7f6d880d2200 2023-07-24T05:47:33.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.473+0000 7f6d8f061700 1 -- 172.21.15.77:0/3733141909 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6d880d33c0 con 0x7f6d880d2200 2023-07-24T05:47:33.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.473+0000 7f6d7effd700 1 -- 172.21.15.77:0/3733141909 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f6d780045d0 con 0x7f6d880d2200 2023-07-24T05:47:33.479 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:47:33.479 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/4201639271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4201639271},{"type":"v1","addr":"172.21.15.77:6834","nonce":4201639271}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/993116623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":993116623},{"type":"v1","addr":"172.21.15.103:6835","nonce":993116623}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/1196529067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":1196529067},{"type":"v1","addr":"172.21.15.103:6837","nonce":1196529067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-24T05:46:00.395327+0000","modified":"2023-07-24T05:46:27.438873+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6835/2428690206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2428690206},{"type":"v1","addr":"172.21.15.77:6835","nonce":2428690206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-24T05:47:33.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.477+0000 7f6d8f061700 1 -- 172.21.15.77:0/3733141909 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6d6c0662f0 msgr2=0x7f6d6c0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:33.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.477+0000 7f6d8f061700 1 --2- 172.21.15.77:0/3733141909 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6d6c0662f0 0x7f6d6c0687b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6d8815b830 tx=0x7f6d84009040 comp rx=0 tx=0).stop 2023-07-24T05:47:33.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.477+0000 7f6d8f061700 1 -- 172.21.15.77:0/3733141909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d880d2200 msgr2=0x7f6d8815e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:33.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.477+0000 7f6d8f061700 1 --2- 172.21.15.77:0/3733141909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d880d2200 0x7f6d8815e1e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f6d8808c900 tx=0x7f6d78004770 comp rx=0 tx=0).stop 2023-07-24T05:47:33.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.477+0000 7f6d8f061700 1 -- 172.21.15.77:0/3733141909 shutdown_connections 2023-07-24T05:47:33.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.477+0000 7f6d8f061700 1 --2- 172.21.15.77:0/3733141909 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6d6c0662f0 0x7f6d6c0687b0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:33.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.477+0000 7f6d8f061700 1 --2- 172.21.15.77:0/3733141909 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6d8815ca00 0x7f6d8815e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:33.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.477+0000 7f6d8f061700 1 --2- 172.21.15.77:0/3733141909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6d880d2200 0x7f6d8815e1e0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:33.483 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.477+0000 7f6d8f061700 1 --2- 172.21.15.77:0/3733141909 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d880b4630 0x7f6d8814d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:33.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.477+0000 7f6d8f061700 1 -- 172.21.15.77:0/3733141909 >> 172.21.15.77:0/3733141909 conn(0x7f6d880b7610 msgr2=0x7f6d880cf5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:33.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.477+0000 7f6d8f061700 1 -- 172.21.15.77:0/3733141909 shutdown_connections 2023-07-24T05:47:33.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.477+0000 7f6d8f061700 1 -- 172.21.15.77:0/3733141909 wait complete. 2023-07-24T05:47:33.484 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 9 2023-07-24T05:47:33.502 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-24T05:47:33.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.673+0000 7f99d0f2b700 1 Processor -- start 2023-07-24T05:47:33.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.673+0000 7f99d0f2b700 1 -- start start 2023-07-24T05:47:33.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.673+0000 7f99d0f2b700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f99cc0b17a0 0x7f99cc16be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:33.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.673+0000 7f99d0f2b700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99cc0af170 con 0x7f99cc160d20 2023-07-24T05:47:33.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.673+0000 7f99d0f2b700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99cc0ae5f0 con 0x7f99cc161100 2023-07-24T05:47:33.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.673+0000 7f99d0f2b700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc0ae8d0 con 0x7f99cc0b17a0 2023-07-24T05:47:33.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.673+0000 7f99cb7fe700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f99cc160d20 0x7f99cc0adba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:56496/0 (socket says 172.21.15.77:56496) 2023-07-24T05:47:33.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.673+0000 7f99cb7fe700 1 -- 172.21.15.77:0/2408023711 learned_addr learned my addr 172.21.15.77:0/2408023711 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:33.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.673+0000 7f99cbfff700 1 --2- 172.21.15.77:0/2408023711 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f99cc0b17a0 0x7f99cc16be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:33.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.677+0000 7f99ca7fc700 1 -- 172.21.15.77:0/2408023711 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1421967062 0 0) 0x7f99cc0af170 con 0x7f99cc160d20 2023-07-24T05:47:33.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.677+0000 7f99cbfff700 1 -- 172.21.15.77:0/2408023711 >> v1:172.21.15.103:6789/0 conn(0x7f99cc161100 legacy=0x7f99cc0b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:33.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.677+0000 7f99cbfff700 1 -- 172.21.15.77:0/2408023711 >> v1:172.21.15.77:6789/0 conn(0x7f99cc160d20 legacy=0x7f99cc0adba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:33.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.677+0000 7f99cbfff700 1 -- 172.21.15.77:0/2408023711 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99cc0aebb0 con 0x7f99cc0b17a0 2023-07-24T05:47:33.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.677+0000 7f99cbfff700 1 --2- 172.21.15.77:0/2408023711 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f99cc0b17a0 0x7f99cc16be60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f99c4009dc0 tx=0x7f99c400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=385811efdaa3bc78 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:33.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.677+0000 7f99ca7fc700 1 -- 172.21.15.77:0/2408023711 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c400e070 con 0x7f99cc0b17a0 2023-07-24T05:47:33.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.677+0000 7f99ca7fc700 1 -- 172.21.15.77:0/2408023711 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c400bbd0 con 0x7f99cc0b17a0 2023-07-24T05:47:33.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.677+0000 7f99ca7fc700 1 -- 172.21.15.77:0/2408023711 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c4012430 con 0x7f99cc0b17a0 2023-07-24T05:47:33.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.677+0000 7f99d0f2b700 1 -- 172.21.15.77:0/2408023711 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f99cc0b17a0 msgr2=0x7f99cc16be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:33.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.677+0000 7f99d0f2b700 1 --2- 172.21.15.77:0/2408023711 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f99cc0b17a0 0x7f99cc16be60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f99c4009dc0 tx=0x7f99c400b330 comp rx=0 tx=0).stop 2023-07-24T05:47:33.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.677+0000 7f99d0f2b700 1 -- 172.21.15.77:0/2408023711 shutdown_connections 2023-07-24T05:47:33.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.677+0000 7f99d0f2b700 1 --2- 172.21.15.77:0/2408023711 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f99cc0b17a0 0x7f99cc16be60 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:33.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.677+0000 7f99d0f2b700 1 -- 172.21.15.77:0/2408023711 >> 172.21.15.77:0/2408023711 conn(0x7f99cc0cacc0 msgr2=0x7f99cc0cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:33.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.677+0000 7f99d0f2b700 1 -- 172.21.15.77:0/2408023711 shutdown_connections 2023-07-24T05:47:33.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.677+0000 7f99d0f2b700 1 -- 172.21.15.77:0/2408023711 wait complete. 2023-07-24T05:47:33.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.681+0000 7f99d0f2b700 1 Processor -- start 2023-07-24T05:47:33.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.681+0000 7f99d0f2b700 1 -- start start 2023-07-24T05:47:33.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.681+0000 7f99d0f2b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99cc0b17a0 0x7f99cc0cc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:33.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.681+0000 7f99d0f2b700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99cc160d20 0x7f99cc15cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:33.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.681+0000 7f99d0f2b700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f99cc161100 0x7f99cc15d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:33.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.681+0000 7f99d0f2b700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc157a30 con 0x7f99cc0b17a0 2023-07-24T05:47:33.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.681+0000 7f99d0f2b700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc0c3180 con 0x7f99cc160d20 2023-07-24T05:47:33.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.681+0000 7f99d0f2b700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99cc0c2570 con 0x7f99cc161100 2023-07-24T05:47:33.689 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.681+0000 7f99cb7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99cc0b17a0 0x7f99cc0cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:33.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.681+0000 7f99cb7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99cc0b17a0 0x7f99cc0cc240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46660/0 (socket says 172.21.15.77:46660) 2023-07-24T05:47:33.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.681+0000 7f99cb7fe700 1 -- 172.21.15.77:0/3584912022 learned_addr learned my addr 172.21.15.77:0/3584912022 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:33.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.681+0000 7f99caffd700 1 --2- 172.21.15.77:0/3584912022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99cc160d20 0x7f99cc15cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:33.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.681+0000 7f99cbfff700 1 --2- 172.21.15.77:0/3584912022 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f99cc161100 0x7f99cc15d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:33.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.681+0000 7f99cb7fe700 1 -- 172.21.15.77:0/3584912022 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f99cc161100 msgr2=0x7f99cc15d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:33.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.681+0000 7f99cb7fe700 1 --2- 172.21.15.77:0/3584912022 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f99cc161100 0x7f99cc15d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:33.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.681+0000 7f99cb7fe700 1 -- 172.21.15.77:0/3584912022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99cc160d20 msgr2=0x7f99cc15cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:33.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.681+0000 7f99cb7fe700 1 --2- 172.21.15.77:0/3584912022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99cc160d20 0x7f99cc15cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:33.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.681+0000 7f99cb7fe700 1 -- 172.21.15.77:0/3584912022 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c4009a70 con 0x7f99cc0b17a0 2023-07-24T05:47:33.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.685+0000 7f99cb7fe700 1 --2- 172.21.15.77:0/3584912022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99cc0b17a0 0x7f99cc0cc240 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f99bc00c550 tx=0x7f99bc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:33.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.685+0000 7f99b3fff700 1 -- 172.21.15.77:0/3584912022 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc004ca0 con 0x7f99cc0b17a0 2023-07-24T05:47:33.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.685+0000 7f99b3fff700 1 -- 172.21.15.77:0/3584912022 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99bc004e00 con 0x7f99cc0b17a0 2023-07-24T05:47:33.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.685+0000 7f99d0f2b700 1 -- 172.21.15.77:0/3584912022 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99cc0c2850 con 0x7f99cc0b17a0 2023-07-24T05:47:33.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.685+0000 7f99b3fff700 1 -- 172.21.15.77:0/3584912022 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc007310 con 0x7f99cc0b17a0 2023-07-24T05:47:33.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.685+0000 7f99d0f2b700 1 -- 172.21.15.77:0/3584912022 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99cc0c2e10 con 0x7f99cc0b17a0 2023-07-24T05:47:33.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.685+0000 7f99d0f2b700 1 -- 172.21.15.77:0/3584912022 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99cc072490 con 0x7f99cc0b17a0 2023-07-24T05:47:33.693 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.689+0000 7f99b3fff700 1 -- 172.21.15.77:0/3584912022 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f99bc007470 con 0x7f99cc0b17a0 2023-07-24T05:47:33.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.689+0000 7f99b3fff700 1 --2- 172.21.15.77:0/3584912022 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f99b80662f0 0x7f99b80687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:33.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.689+0000 7f99b3fff700 1 -- 172.21.15.77:0/3584912022 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f99bc083ca0 con 0x7f99cc0b17a0 2023-07-24T05:47:33.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.689+0000 7f99caffd700 1 --2- 172.21.15.77:0/3584912022 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f99b80662f0 0x7f99b80687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:33.697 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.693+0000 7f99caffd700 1 --2- 172.21.15.77:0/3584912022 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f99b80662f0 0x7f99b80687b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f99cc09c190 tx=0x7f99c0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:33.701 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.697+0000 7f99b3fff700 1 -- 172.21.15.77:0/3584912022 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f99bc050d50 con 0x7f99cc0b17a0 2023-07-24T05:47:33.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.865+0000 7f99d0f2b700 1 -- 172.21.15.77:0/3584912022 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99cc0aee60 con 0x7f99cc0b17a0 2023-07-24T05:47:33.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.869+0000 7f99b3fff700 1 -- 172.21.15.77:0/3584912022 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20204 (secure 0 0 0) 0x7f99bc007720 con 0x7f99cc0b17a0 2023-07-24T05:47:33.875 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:47:33.876 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":27,"fsid":"5aed5f7b-fb55-4d95-9c02-c6adbb1677b4","created":"2023-07-24T05:45:39.639731+0000","modified":"2023-07-24T05:46:48.442117+0000","last_up_change":"2023-07-24T05:45:52.319670+0000","last_in_change":"2023-07-24T05:45:43.643277+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-24T05:45:52.610430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-24T05:45:52.773787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-24T05:45:58.121732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-24T05:45:59.368726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-24T05:46:03.032057+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ffa0d496-461a-4053-b764-0627d969521b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6812","nonce":825987196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6817","nonce":825987196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6831","nonce":825987196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6824","nonce":825987196}]},"public_addr":"172.21.15.77:6812/825987196","cluster_addr":"172.21.15.77:6817/825987196","heartbeat_back_addr":"172.21.15.77:6831/825987196","heartbeat_front_addr":"172.21.15.77:6824/825987196","state":["exists","up"]},{"osd":1,"uuid":"9f595e5e-5c43-49bc-8ce4-ee70575c90da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6801","nonce":4133026815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6803","nonce":4133026815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6807","nonce":4133026815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6805","nonce":4133026815}]},"public_addr":"172.21.15.77:6801/4133026815","cluster_addr":"172.21.15.77:6803/4133026815","heartbeat_back_addr":"172.21.15.77:6807/4133026815","heartbeat_front_addr":"172.21.15.77:6805/4133026815","state":["exists","up"]},{"osd":2,"uuid":"2ac177aa-4d7d-4262-bd54-d2b9f29f4c3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6811","nonce":2394142159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6819","nonce":2394142159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6830","nonce":2394142159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6825","nonce":2394142159}]},"public_addr":"172.21.15.77:6811/2394142159","cluster_addr":"172.21.15.77:6819/2394142159","heartbeat_back_addr":"172.21.15.77:6830/2394142159","heartbeat_front_addr":"172.21.15.77:6825/2394142159","state":["exists","up"]},{"osd":3,"uuid":"17d7a251-19e8-484c-8172-a578ab3da153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6813","nonce":1492113982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6818","nonce":1492113982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6829","nonce":1492113982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6823","nonce":1492113982}]},"public_addr":"172.21.15.77:6813/1492113982","cluster_addr":"172.21.15.77:6818/1492113982","heartbeat_back_addr":"172.21.15.77:6829/1492113982","heartbeat_front_addr":"172.21.15.77:6823/1492113982","state":["exists","up"]},{"osd":4,"uuid":"bf63ca05-f06d-4e0f-ac44-2a416c70b919","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6825","nonce":1080481057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6827","nonce":1080481057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6831","nonce":1080481057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6829","nonce":1080481057}]},"public_addr":"172.21.15.103:6825/1080481057","cluster_addr":"172.21.15.103:6827/1080481057","heartbeat_back_addr":"172.21.15.103:6831/1080481057","heartbeat_front_addr":"172.21.15.103:6829/1080481057","state":["exists","up"]},{"osd":5,"uuid":"65a11a35-9e9f-4b3c-9fe3-b658d62b9318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6811","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6813","nonce":2756677504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6818","nonce":2756677504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6823","nonce":2756677504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6821","nonce":2756677504}]},"public_addr":"172.21.15.103:6813/2756677504","cluster_addr":"172.21.15.103:6818/2756677504","heartbeat_back_addr":"172.21.15.103:6823/2756677504","heartbeat_front_addr":"172.21.15.103:6821/2756677504","state":["exists","up"]},{"osd":6,"uuid":"750c1f87-686c-40b4-94a1-1a299dc78f3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6809","nonce":568977764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6812","nonce":568977764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6819","nonce":568977764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6815","nonce":568977764}]},"public_addr":"172.21.15.103:6809/568977764","cluster_addr":"172.21.15.103:6812/568977764","heartbeat_back_addr":"172.21.15.103:6819/568977764","heartbeat_front_addr":"172.21.15.103:6815/568977764","state":["exists","up"]},{"osd":7,"uuid":"d5fe4fb6-2e09-4158-885b-403803c85822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6801","nonce":1074557176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6803","nonce":1074557176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6807","nonce":1074557176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6805","nonce":1074557176}]},"public_addr":"172.21.15.103:6801/1074557176","cluster_addr":"172.21.15.103:6803/1074557176","heartbeat_back_addr":"172.21.15.103:6807/1074557176","heartbeat_front_addr":"172.21.15.103:6805/1074557176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.631032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.154109+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.398587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.679089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.311218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.353726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.314372+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.126212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1d","mappings":[{"from":3,"to":2}]},{"pgid":"4.31","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-24T05:47:33.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.873+0000 7f99d0f2b700 1 -- 172.21.15.77:0/3584912022 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f99b80662f0 msgr2=0x7f99b80687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:33.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.873+0000 7f99d0f2b700 1 --2- 172.21.15.77:0/3584912022 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f99b80662f0 0x7f99b80687b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f99cc09c190 tx=0x7f99c0009040 comp rx=0 tx=0).stop 2023-07-24T05:47:33.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.873+0000 7f99d0f2b700 1 -- 172.21.15.77:0/3584912022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99cc0b17a0 msgr2=0x7f99cc0cc240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:33.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.873+0000 7f99d0f2b700 1 --2- 172.21.15.77:0/3584912022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99cc0b17a0 0x7f99cc0cc240 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f99bc00c550 tx=0x7f99bc00c860 comp rx=0 tx=0).stop 2023-07-24T05:47:33.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.873+0000 7f99d0f2b700 1 -- 172.21.15.77:0/3584912022 shutdown_connections 2023-07-24T05:47:33.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.873+0000 7f99d0f2b700 1 --2- 172.21.15.77:0/3584912022 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f99b80662f0 0x7f99b80687b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:33.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.873+0000 7f99d0f2b700 1 --2- 172.21.15.77:0/3584912022 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f99cc161100 0x7f99cc15d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:33.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.873+0000 7f99d0f2b700 1 --2- 172.21.15.77:0/3584912022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99cc160d20 0x7f99cc15cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:33.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.873+0000 7f99d0f2b700 1 --2- 172.21.15.77:0/3584912022 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99cc0b17a0 0x7f99cc0cc240 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:33.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.873+0000 7f99d0f2b700 1 -- 172.21.15.77:0/3584912022 >> 172.21.15.77:0/3584912022 conn(0x7f99cc0cacc0 msgr2=0x7f99cc06c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:33.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.873+0000 7f99d0f2b700 1 -- 172.21.15.77:0/3584912022 shutdown_connections 2023-07-24T05:47:33.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:33.873+0000 7f99d0f2b700 1 -- 172.21.15.77:0/3584912022 wait complete. 2023-07-24T05:47:33.901 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-24T05:45:52.610430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-24T05:45:52.773787+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-24T05:45:58.121732+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-24T05:45:59.368726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-07-24T05:46:03.032057+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-07-24T05:47:33.902 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-24T05:47:34.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.065+0000 7f8a81586700 1 Processor -- start 2023-07-24T05:47:34.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.065+0000 7f8a81586700 1 -- start start 2023-07-24T05:47:34.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.069+0000 7f8a81586700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8a7c06afc0 0x7f8a7c0b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:34.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.069+0000 7f8a81586700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8a7c0d2fc0 0x7f8a7c0d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:34.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.069+0000 7f8a81586700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a7c160fa0 con 0x7f8a7c15db20 2023-07-24T05:47:34.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.069+0000 7f8a81586700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a7c0d0360 con 0x7f8a7c06afc0 2023-07-24T05:47:34.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.069+0000 7f8a81586700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a7c0b20b0 con 0x7f8a7c0d2fc0 2023-07-24T05:47:34.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.069+0000 7f8a7affd700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8a7c06afc0 0x7f8a7c0b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:34.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.069+0000 7f8a7a7fc700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f8a7c15db20 0x7f8a7c0d28b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.77:36960/0 (socket says 172.21.15.77:36960) 2023-07-24T05:47:34.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.069+0000 7f8a7affd700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8a7c06afc0 0x7f8a7c0b1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46664/0 (socket says 172.21.15.77:46664) 2023-07-24T05:47:34.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.069+0000 7f8a7a7fc700 1 -- 172.21.15.77:0/1034149310 learned_addr learned my addr 172.21.15.77:0/1034149310 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:34.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.069+0000 7f8a7b7fe700 1 --2- 172.21.15.77:0/1034149310 >> v2:172.21.15.103:3300/0 conn(0x7f8a7c0d2fc0 0x7f8a7c0d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:34.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.069+0000 7f8a7affd700 1 -- 172.21.15.77:0/1034149310 >> v2:172.21.15.103:3300/0 conn(0x7f8a7c0d2fc0 msgr2=0x7f8a7c0d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:34.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.069+0000 7f8a7affd700 1 --2- 172.21.15.77:0/1034149310 >> v2:172.21.15.103:3300/0 conn(0x7f8a7c0d2fc0 0x7f8a7c0d1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:34.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.069+0000 7f8a7affd700 1 -- 172.21.15.77:0/1034149310 >> v1:172.21.15.103:6789/0 conn(0x7f8a7c15db20 legacy=0x7f8a7c0d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:34.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.069+0000 7f8a7affd700 1 -- 172.21.15.77:0/1034149310 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a7c160670 con 0x7f8a7c06afc0 2023-07-24T05:47:34.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.069+0000 7f8a7affd700 1 --2- 172.21.15.77:0/1034149310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a7c06afc0 0x7f8a7c0b1a20 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c08bb80 tx=0x7f8a6c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bfcad4a23b8fe76 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:34.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.069+0000 7f8a79ffb700 1 -- 172.21.15.77:0/1034149310 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c011830 con 0x7f8a7c06afc0 2023-07-24T05:47:34.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.069+0000 7f8a79ffb700 1 -- 172.21.15.77:0/1034149310 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a6c011990 con 0x7f8a7c06afc0 2023-07-24T05:47:34.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.069+0000 7f8a79ffb700 1 -- 172.21.15.77:0/1034149310 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c011d20 con 0x7f8a7c06afc0 2023-07-24T05:47:34.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.069+0000 7f8a81586700 1 -- 172.21.15.77:0/1034149310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a7c06afc0 msgr2=0x7f8a7c0b1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:34.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.069+0000 7f8a81586700 1 --2- 172.21.15.77:0/1034149310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a7c06afc0 0x7f8a7c0b1a20 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c08bb80 tx=0x7f8a6c009b30 comp rx=0 tx=0).stop 2023-07-24T05:47:34.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.073+0000 7f8a81586700 1 -- 172.21.15.77:0/1034149310 shutdown_connections 2023-07-24T05:47:34.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.073+0000 7f8a81586700 1 --2- 172.21.15.77:0/1034149310 >> v2:172.21.15.103:3300/0 conn(0x7f8a7c0d2fc0 0x7f8a7c0d1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:34.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.073+0000 7f8a81586700 1 --2- 172.21.15.77:0/1034149310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a7c06afc0 0x7f8a7c0b1a20 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:34.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.073+0000 7f8a81586700 1 -- 172.21.15.77:0/1034149310 >> 172.21.15.77:0/1034149310 conn(0x7f8a7c09bc20 msgr2=0x7f8a7c0b7920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:34.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.073+0000 7f8a81586700 1 -- 172.21.15.77:0/1034149310 shutdown_connections 2023-07-24T05:47:34.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.073+0000 7f8a81586700 1 -- 172.21.15.77:0/1034149310 wait complete. 2023-07-24T05:47:34.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.073+0000 7f8a81586700 1 Processor -- start 2023-07-24T05:47:34.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.073+0000 7f8a81586700 1 -- start start 2023-07-24T05:47:34.080 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.073+0000 7f8a81586700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a7c06afc0 0x7f8a7c156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:34.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.073+0000 7f8a81586700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a7c0d2fc0 0x7f8a7c0b47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:34.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.073+0000 7f8a81586700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8a7c15db20 0x7f8a7c0b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:34.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.073+0000 7f8a81586700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7c0ca8e0 con 0x7f8a7c06afc0 2023-07-24T05:47:34.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.073+0000 7f8a81586700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7c157460 con 0x7f8a7c0d2fc0 2023-07-24T05:47:34.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.073+0000 7f8a81586700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7c0c9a10 con 0x7f8a7c15db20 2023-07-24T05:47:34.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.073+0000 7f8a7affd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a7c06afc0 0x7f8a7c156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:34.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.073+0000 7f8a7affd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a7c06afc0 0x7f8a7c156f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46672/0 (socket says 172.21.15.77:46672) 2023-07-24T05:47:34.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.073+0000 7f8a7affd700 1 -- 172.21.15.77:0/2199598948 learned_addr learned my addr 172.21.15.77:0/2199598948 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:34.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.077+0000 7f8a7a7fc700 1 --2- 172.21.15.77:0/2199598948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a7c0d2fc0 0x7f8a7c0b47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:34.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.077+0000 7f8a7b7fe700 1 --2- 172.21.15.77:0/2199598948 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8a7c15db20 0x7f8a7c0b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:34.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.077+0000 7f8a7affd700 1 -- 172.21.15.77:0/2199598948 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8a7c15db20 msgr2=0x7f8a7c0b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:34.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.077+0000 7f8a7affd700 1 --2- 172.21.15.77:0/2199598948 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8a7c15db20 0x7f8a7c0b4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:34.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.077+0000 7f8a7affd700 1 -- 172.21.15.77:0/2199598948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a7c0d2fc0 msgr2=0x7f8a7c0b47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:34.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.077+0000 7f8a7affd700 1 --2- 172.21.15.77:0/2199598948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a7c0d2fc0 0x7f8a7c0b47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:34.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.077+0000 7f8a7affd700 1 -- 172.21.15.77:0/2199598948 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a6c0094b0 con 0x7f8a7c06afc0 2023-07-24T05:47:34.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.077+0000 7f8a7a7fc700 1 --2- 172.21.15.77:0/2199598948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a7c0d2fc0 0x7f8a7c0b47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:47:34.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.077+0000 7f8a7b7fe700 1 --2- 172.21.15.77:0/2199598948 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8a7c15db20 0x7f8a7c0b4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:47:34.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.077+0000 7f8a7affd700 1 --2- 172.21.15.77:0/2199598948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a7c06afc0 0x7f8a7c156f20 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c009b70 tx=0x7f8a6c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:34.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.077+0000 7f8a637fe700 1 -- 172.21.15.77:0/2199598948 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c004530 con 0x7f8a7c06afc0 2023-07-24T05:47:34.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.077+0000 7f8a637fe700 1 -- 172.21.15.77:0/2199598948 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a6c01f070 con 0x7f8a7c06afc0 2023-07-24T05:47:34.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.077+0000 7f8a81586700 1 -- 172.21.15.77:0/2199598948 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a7c0c9c60 con 0x7f8a7c06afc0 2023-07-24T05:47:34.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.077+0000 7f8a637fe700 1 -- 172.21.15.77:0/2199598948 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c0038e0 con 0x7f8a7c06afc0 2023-07-24T05:47:34.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.077+0000 7f8a81586700 1 -- 172.21.15.77:0/2199598948 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a7c0ca220 con 0x7f8a7c06afc0 2023-07-24T05:47:34.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.077+0000 7f8a81586700 1 -- 172.21.15.77:0/2199598948 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a7c0b22f0 con 0x7f8a7c06afc0 2023-07-24T05:47:34.085 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.081+0000 7f8a637fe700 1 -- 172.21.15.77:0/2199598948 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8a6c021030 con 0x7f8a7c06afc0 2023-07-24T05:47:34.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.081+0000 7f8a637fe700 1 --2- 172.21.15.77:0/2199598948 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f8a680662f0 0x7f8a680687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:34.086 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.081+0000 7f8a637fe700 1 -- 172.21.15.77:0/2199598948 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8a6c085430 con 0x7f8a7c06afc0 2023-07-24T05:47:34.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.081+0000 7f8a7a7fc700 1 --2- 172.21.15.77:0/2199598948 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f8a680662f0 0x7f8a680687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:34.088 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.081+0000 7f8a7a7fc700 1 --2- 172.21.15.77:0/2199598948 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f8a680662f0 0x7f8a680687b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c0ce4b0 tx=0x7f8a70009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:34.091 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.085+0000 7f8a637fe700 1 -- 172.21.15.77:0/2199598948 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8a6c052570 con 0x7f8a7c06afc0 2023-07-24T05:47:34.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.253+0000 7f8a81586700 1 -- 172.21.15.77:0/2199598948 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8a7c04df10 con 0x7f8a7c06afc0 2023-07-24T05:47:34.260 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.253+0000 7f8a637fe700 1 -- 172.21.15.77:0/2199598948 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8a6c055b90 con 0x7f8a7c06afc0 2023-07-24T05:47:34.261 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-07-24T05:47:34.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.257+0000 7f8a81586700 1 -- 172.21.15.77:0/2199598948 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f8a680662f0 msgr2=0x7f8a680687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:34.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.257+0000 7f8a81586700 1 --2- 172.21.15.77:0/2199598948 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f8a680662f0 0x7f8a680687b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c0ce4b0 tx=0x7f8a70009040 comp rx=0 tx=0).stop 2023-07-24T05:47:34.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.257+0000 7f8a81586700 1 -- 172.21.15.77:0/2199598948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a7c06afc0 msgr2=0x7f8a7c156f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:34.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.257+0000 7f8a81586700 1 --2- 172.21.15.77:0/2199598948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a7c06afc0 0x7f8a7c156f20 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c009b70 tx=0x7f8a6c004770 comp rx=0 tx=0).stop 2023-07-24T05:47:34.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.257+0000 7f8a81586700 1 -- 172.21.15.77:0/2199598948 shutdown_connections 2023-07-24T05:47:34.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.257+0000 7f8a81586700 1 --2- 172.21.15.77:0/2199598948 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f8a680662f0 0x7f8a680687b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:34.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.257+0000 7f8a81586700 1 --2- 172.21.15.77:0/2199598948 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8a7c15db20 0x7f8a7c0b4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:34.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.257+0000 7f8a81586700 1 --2- 172.21.15.77:0/2199598948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a7c0d2fc0 0x7f8a7c0b47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:34.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.257+0000 7f8a81586700 1 --2- 172.21.15.77:0/2199598948 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8a7c06afc0 0x7f8a7c156f20 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:34.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.257+0000 7f8a81586700 1 -- 172.21.15.77:0/2199598948 >> 172.21.15.77:0/2199598948 conn(0x7f8a7c09bc20 msgr2=0x7f8a7c15d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:34.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.257+0000 7f8a81586700 1 -- 172.21.15.77:0/2199598948 shutdown_connections 2023-07-24T05:47:34.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.257+0000 7f8a81586700 1 -- 172.21.15.77:0/2199598948 wait complete. 2023-07-24T05:47:34.287 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-24T05:47:34.461 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.457+0000 7f3105970700 1 Processor -- start 2023-07-24T05:47:34.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.457+0000 7f3105970700 1 -- start start 2023-07-24T05:47:34.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.457+0000 7f3105970700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f31000b1b40 0x7f31000d0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:34.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.457+0000 7f3105970700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f31000c5980 0x7f31000b7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:34.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.461+0000 7f3105970700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f310006d470 con 0x7f31000d25a0 2023-07-24T05:47:34.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.461+0000 7f3105970700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31000b7ba0 con 0x7f31000b1b40 2023-07-24T05:47:34.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.461+0000 7f3105970700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31000b1f20 con 0x7f31000c5980 2023-07-24T05:47:34.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.461+0000 7f310516f700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f31000d25a0 0x7f31000cf220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.77:36966/0 (socket says 172.21.15.77:36966) 2023-07-24T05:47:34.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.461+0000 7f310516f700 1 -- 172.21.15.77:0/1139062402 learned_addr learned my addr 172.21.15.77:0/1139062402 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:34.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.461+0000 7f30fffff700 1 --2- 172.21.15.77:0/1139062402 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f31000c5980 0x7f31000b7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:34.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.461+0000 7f310496e700 1 --2- 172.21.15.77:0/1139062402 >> v2:172.21.15.103:3300/0 conn(0x7f31000b1b40 0x7f31000d0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:34.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.461+0000 7f30ff7fe700 1 -- 172.21.15.77:0/1139062402 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2169848515 0 0) 0x7f310006d470 con 0x7f31000d25a0 2023-07-24T05:47:34.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.461+0000 7f30ff7fe700 1 -- 172.21.15.77:0/1139062402 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30f00035d0 con 0x7f31000d25a0 2023-07-24T05:47:34.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.461+0000 7f30fffff700 1 -- 172.21.15.77:0/1139062402 >> v2:172.21.15.103:3300/0 conn(0x7f31000b1b40 msgr2=0x7f31000d0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:34.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.461+0000 7f30fffff700 1 --2- 172.21.15.77:0/1139062402 >> v2:172.21.15.103:3300/0 conn(0x7f31000b1b40 0x7f31000d0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:34.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.461+0000 7f30fffff700 1 -- 172.21.15.77:0/1139062402 >> v1:172.21.15.103:6789/0 conn(0x7f31000d25a0 legacy=0x7f31000cf220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:34.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.461+0000 7f30fffff700 1 -- 172.21.15.77:0/1139062402 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31000b7f30 con 0x7f31000c5980 2023-07-24T05:47:34.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.461+0000 7f30fffff700 1 --2- 172.21.15.77:0/1139062402 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f31000c5980 0x7f31000b7660 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f30ec009850 tx=0x7f30ec009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc97455a6c3b30f server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:34.468 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.461+0000 7f30ff7fe700 1 -- 172.21.15.77:0/1139062402 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ec011830 con 0x7f31000c5980 2023-07-24T05:47:34.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.461+0000 7f30ff7fe700 1 -- 172.21.15.77:0/1139062402 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30ec011990 con 0x7f31000c5980 2023-07-24T05:47:34.469 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.461+0000 7f30ff7fe700 1 -- 172.21.15.77:0/1139062402 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ec011d40 con 0x7f31000c5980 2023-07-24T05:47:34.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.461+0000 7f3105970700 1 -- 172.21.15.77:0/1139062402 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f31000c5980 msgr2=0x7f31000b7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:34.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.461+0000 7f3105970700 1 --2- 172.21.15.77:0/1139062402 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f31000c5980 0x7f31000b7660 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f30ec009850 tx=0x7f30ec009b60 comp rx=0 tx=0).stop 2023-07-24T05:47:34.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.461+0000 7f3105970700 1 -- 172.21.15.77:0/1139062402 shutdown_connections 2023-07-24T05:47:34.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.461+0000 7f3105970700 1 --2- 172.21.15.77:0/1139062402 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f31000c5980 0x7f31000b7660 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:34.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.461+0000 7f3105970700 1 --2- 172.21.15.77:0/1139062402 >> v2:172.21.15.103:3300/0 conn(0x7f31000b1b40 0x7f31000d0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:34.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.461+0000 7f3105970700 1 -- 172.21.15.77:0/1139062402 >> 172.21.15.77:0/1139062402 conn(0x7f31000b5610 msgr2=0x7f31000b5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:34.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.461+0000 7f3105970700 1 -- 172.21.15.77:0/1139062402 shutdown_connections 2023-07-24T05:47:34.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.465+0000 7f3105970700 1 -- 172.21.15.77:0/1139062402 wait complete. 2023-07-24T05:47:34.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.465+0000 7f3105970700 1 Processor -- start 2023-07-24T05:47:34.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.465+0000 7f3105970700 1 -- start start 2023-07-24T05:47:34.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.465+0000 7f3105970700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31000b1b40 0x7f310014f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:34.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.465+0000 7f3105970700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31000c5980 0x7f310014fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:34.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.465+0000 7f3105970700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f31000d25a0 0x7f31000b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:34.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.465+0000 7f3105970700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31000cb7e0 con 0x7f31000c5980 2023-07-24T05:47:34.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.465+0000 7f3105970700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31000cac60 con 0x7f31000b1b40 2023-07-24T05:47:34.473 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.465+0000 7f3105970700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31000caf40 con 0x7f31000d25a0 2023-07-24T05:47:34.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.465+0000 7f30fffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31000c5980 0x7f310014fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:34.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.465+0000 7f30fffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31000c5980 0x7f310014fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46674/0 (socket says 172.21.15.77:46674) 2023-07-24T05:47:34.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.465+0000 7f30fffff700 1 -- 172.21.15.77:0/2092124120 learned_addr learned my addr 172.21.15.77:0/2092124120 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:34.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.469+0000 7f310496e700 1 --2- 172.21.15.77:0/2092124120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31000b1b40 0x7f310014f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:34.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.469+0000 7f310516f700 1 --2- 172.21.15.77:0/2092124120 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f31000d25a0 0x7f31000b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:34.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.469+0000 7f30fffff700 1 -- 172.21.15.77:0/2092124120 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f31000d25a0 msgr2=0x7f31000b0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:34.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.469+0000 7f30fffff700 1 --2- 172.21.15.77:0/2092124120 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f31000d25a0 0x7f31000b0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:34.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.469+0000 7f30fffff700 1 -- 172.21.15.77:0/2092124120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31000b1b40 msgr2=0x7f310014f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:34.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.469+0000 7f30fffff700 1 --2- 172.21.15.77:0/2092124120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31000b1b40 0x7f310014f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:34.475 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.469+0000 7f30fffff700 1 -- 172.21.15.77:0/2092124120 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30ec0094b0 con 0x7f31000c5980 2023-07-24T05:47:34.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.469+0000 7f30fffff700 1 --2- 172.21.15.77:0/2092124120 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31000c5980 0x7f310014fa90 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f30ec0090b0 tx=0x7f30ec004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:34.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.469+0000 7f30fd7fa700 1 -- 172.21.15.77:0/2092124120 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ec004380 con 0x7f31000c5980 2023-07-24T05:47:34.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.469+0000 7f30fd7fa700 1 -- 172.21.15.77:0/2092124120 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30ec01f070 con 0x7f31000c5980 2023-07-24T05:47:34.476 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.469+0000 7f3105970700 1 -- 172.21.15.77:0/2092124120 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31000cb220 con 0x7f31000c5980 2023-07-24T05:47:34.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.469+0000 7f30fd7fa700 1 -- 172.21.15.77:0/2092124120 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ec0036c0 con 0x7f31000c5980 2023-07-24T05:47:34.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.469+0000 7f3105970700 1 -- 172.21.15.77:0/2092124120 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3100150300 con 0x7f31000c5980 2023-07-24T05:47:34.477 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.473+0000 7f3105970700 1 -- 172.21.15.77:0/2092124120 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3100072490 con 0x7f31000c5980 2023-07-24T05:47:34.478 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.473+0000 7f30fd7fa700 1 -- 172.21.15.77:0/2092124120 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f30ec021030 con 0x7f31000c5980 2023-07-24T05:47:34.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.473+0000 7f30fd7fa700 1 --2- 172.21.15.77:0/2092124120 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f30e40662f0 0x7f30e40687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:34.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.473+0000 7f30fd7fa700 1 -- 172.21.15.77:0/2092124120 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f30ec0852a0 con 0x7f31000c5980 2023-07-24T05:47:34.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.473+0000 7f310496e700 1 --2- 172.21.15.77:0/2092124120 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f30e40662f0 0x7f30e40687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:34.481 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.477+0000 7f310496e700 1 --2- 172.21.15.77:0/2092124120 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f30e40662f0 0x7f30e40687b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f30f4009b50 tx=0x7f30f4009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:34.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.481+0000 7f30fd7fa700 1 -- 172.21.15.77:0/2092124120 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f30ec052520 con 0x7f31000c5980 2023-07-24T05:47:34.659 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.653+0000 7f3105970700 1 -- 172.21.15.77:0/2092124120 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f31000d1010 con 0x7f31000c5980 2023-07-24T05:47:34.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.653+0000 7f30fd7fa700 1 -- 172.21.15.77:0/2092124120 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f30ec006ce0 con 0x7f31000c5980 2023-07-24T05:47:34.660 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 8 2023-07-24T05:47:34.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.657+0000 7f3105970700 1 -- 172.21.15.77:0/2092124120 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f30e40662f0 msgr2=0x7f30e40687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:34.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.657+0000 7f3105970700 1 --2- 172.21.15.77:0/2092124120 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f30e40662f0 0x7f30e40687b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f30f4009b50 tx=0x7f30f4009240 comp rx=0 tx=0).stop 2023-07-24T05:47:34.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.657+0000 7f3105970700 1 -- 172.21.15.77:0/2092124120 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31000c5980 msgr2=0x7f310014fa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:34.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.657+0000 7f3105970700 1 --2- 172.21.15.77:0/2092124120 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31000c5980 0x7f310014fa90 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f30ec0090b0 tx=0x7f30ec004770 comp rx=0 tx=0).stop 2023-07-24T05:47:34.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.657+0000 7f3105970700 1 -- 172.21.15.77:0/2092124120 shutdown_connections 2023-07-24T05:47:34.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.657+0000 7f3105970700 1 --2- 172.21.15.77:0/2092124120 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f30e40662f0 0x7f30e40687b0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:34.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.657+0000 7f3105970700 1 --2- 172.21.15.77:0/2092124120 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f31000d25a0 0x7f31000b0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:34.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.657+0000 7f3105970700 1 --2- 172.21.15.77:0/2092124120 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f31000c5980 0x7f310014fa90 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:34.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.657+0000 7f3105970700 1 --2- 172.21.15.77:0/2092124120 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31000b1b40 0x7f310014f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:34.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.657+0000 7f3105970700 1 -- 172.21.15.77:0/2092124120 >> 172.21.15.77:0/2092124120 conn(0x7f31000b5610 msgr2=0x7f3100069b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:34.664 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.657+0000 7f3105970700 1 -- 172.21.15.77:0/2092124120 shutdown_connections 2023-07-24T05:47:34.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.657+0000 7f3105970700 1 -- 172.21.15.77:0/2092124120 wait complete. 2023-07-24T05:47:34.687 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-24T05:47:34.863 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.857+0000 7f105da03700 1 Processor -- start 2023-07-24T05:47:34.864 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.857+0000 7f105da03700 1 -- start start 2023-07-24T05:47:34.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.861+0000 7f105da03700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1058069b10 0x7f105806c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:34.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.861+0000 7f105da03700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f105806a0f0 con 0x7f105806c930 2023-07-24T05:47:34.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.861+0000 7f105da03700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f105806a3d0 con 0x7f105815a750 2023-07-24T05:47:34.868 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.861+0000 7f105da03700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f105806cda0 con 0x7f1058069b10 2023-07-24T05:47:34.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.861+0000 7f1057fff700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1058069b10 0x7f105806c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:34.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.861+0000 7f105d202700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f105806c930 0x7f10580c9f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:56504/0 (socket says 172.21.15.77:56504) 2023-07-24T05:47:34.869 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.861+0000 7f105d202700 1 -- 172.21.15.77:0/1533952132 learned_addr learned my addr 172.21.15.77:0/1533952132 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:34.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.865+0000 7f1057fff700 1 -- 172.21.15.77:0/1533952132 >> v1:172.21.15.103:6789/0 conn(0x7f105815a750 legacy=0x7f1058070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:34.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.865+0000 7f1057fff700 1 -- 172.21.15.77:0/1533952132 >> v1:172.21.15.77:6789/0 conn(0x7f105806c930 legacy=0x7f10580c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:34.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.865+0000 7f1057fff700 1 -- 172.21.15.77:0/1533952132 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10580c9760 con 0x7f1058069b10 2023-07-24T05:47:34.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.865+0000 7f10577fe700 1 -- 172.21.15.77:0/1533952132 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3321578905 0 0) 0x7f105806a0f0 con 0x7f105806c930 2023-07-24T05:47:34.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.865+0000 7f1057fff700 1 --2- 172.21.15.77:0/1533952132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1058069b10 0x7f105806c3f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1044009850 tx=0x7f1044009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b0d7f3d1a045237 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:34.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.865+0000 7f10577fe700 1 -- 172.21.15.77:0/1533952132 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1044011830 con 0x7f1058069b10 2023-07-24T05:47:34.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.865+0000 7f10577fe700 1 -- 172.21.15.77:0/1533952132 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1044011990 con 0x7f1058069b10 2023-07-24T05:47:34.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.865+0000 7f10577fe700 1 -- 172.21.15.77:0/1533952132 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1044011d20 con 0x7f1058069b10 2023-07-24T05:47:34.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.865+0000 7f105da03700 1 -- 172.21.15.77:0/1533952132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1058069b10 msgr2=0x7f105806c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:34.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.865+0000 7f105da03700 1 --2- 172.21.15.77:0/1533952132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1058069b10 0x7f105806c3f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1044009850 tx=0x7f1044009b60 comp rx=0 tx=0).stop 2023-07-24T05:47:34.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.865+0000 7f105da03700 1 -- 172.21.15.77:0/1533952132 shutdown_connections 2023-07-24T05:47:34.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.865+0000 7f105da03700 1 --2- 172.21.15.77:0/1533952132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1058069b10 0x7f105806c3f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:34.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.865+0000 7f105da03700 1 -- 172.21.15.77:0/1533952132 >> 172.21.15.77:0/1533952132 conn(0x7f10580ceb90 msgr2=0x7f10580cefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:34.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.865+0000 7f105da03700 1 -- 172.21.15.77:0/1533952132 shutdown_connections 2023-07-24T05:47:34.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.865+0000 7f105da03700 1 -- 172.21.15.77:0/1533952132 wait complete. 2023-07-24T05:47:34.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.869+0000 7f105da03700 1 Processor -- start 2023-07-24T05:47:34.873 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.869+0000 7f105da03700 1 -- start start 2023-07-24T05:47:34.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.869+0000 7f105da03700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1058069b10 0x7f105815bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:34.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.869+0000 7f105da03700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f105806c930 0x7f1058156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:34.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.869+0000 7f105da03700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f105815a750 0x7f1058143590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:34.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.869+0000 7f105da03700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1058156f60 con 0x7f105815a750 2023-07-24T05:47:34.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.869+0000 7f105da03700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105815b8c0 con 0x7f1058069b10 2023-07-24T05:47:34.875 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.869+0000 7f105da03700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f105815acb0 con 0x7f105806c930 2023-07-24T05:47:34.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.869+0000 7f105d202700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f105815a750 0x7f1058143590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:34.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.869+0000 7f105d202700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f105815a750 0x7f1058143590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46690/0 (socket says 172.21.15.77:46690) 2023-07-24T05:47:34.876 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.869+0000 7f105d202700 1 -- 172.21.15.77:0/3924972030 learned_addr learned my addr 172.21.15.77:0/3924972030 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:34.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.869+0000 7f1057fff700 1 --2- 172.21.15.77:0/3924972030 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f105806c930 0x7f1058156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:34.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.869+0000 7f105ca01700 1 --2- 172.21.15.77:0/3924972030 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1058069b10 0x7f105815bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:34.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.869+0000 7f105d202700 1 -- 172.21.15.77:0/3924972030 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f105806c930 msgr2=0x7f1058156a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:34.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.869+0000 7f105d202700 1 --2- 172.21.15.77:0/3924972030 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f105806c930 0x7f1058156a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:34.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.869+0000 7f105d202700 1 -- 172.21.15.77:0/3924972030 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1058069b10 msgr2=0x7f105815bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:34.877 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.869+0000 7f105d202700 1 --2- 172.21.15.77:0/3924972030 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1058069b10 0x7f105815bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:34.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.869+0000 7f105d202700 1 -- 172.21.15.77:0/3924972030 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10440094b0 con 0x7f105815a750 2023-07-24T05:47:34.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.869+0000 7f1057fff700 1 --2- 172.21.15.77:0/3924972030 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f105806c930 0x7f1058156a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:34.878 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.869+0000 7f105d202700 1 --2- 172.21.15.77:0/3924972030 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f105815a750 0x7f1058143590 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1050002230 tx=0x7f105000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:34.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.869+0000 7f10557fa700 1 -- 172.21.15.77:0/3924972030 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105000ab70 con 0x7f105815a750 2023-07-24T05:47:34.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.869+0000 7f10557fa700 1 -- 172.21.15.77:0/3924972030 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105000acf0 con 0x7f105815a750 2023-07-24T05:47:34.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.873+0000 7f10557fa700 1 -- 172.21.15.77:0/3924972030 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1050007310 con 0x7f105815a750 2023-07-24T05:47:34.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.873+0000 7f105da03700 1 -- 172.21.15.77:0/3924972030 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f105815af90 con 0x7f105815a750 2023-07-24T05:47:34.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.873+0000 7f105da03700 1 -- 172.21.15.77:0/3924972030 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f105815b550 con 0x7f105815a750 2023-07-24T05:47:34.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.873+0000 7f105da03700 1 -- 172.21.15.77:0/3924972030 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1058072490 con 0x7f105815a750 2023-07-24T05:47:34.880 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.873+0000 7f10557fa700 1 -- 172.21.15.77:0/3924972030 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1050007470 con 0x7f105815a750 2023-07-24T05:47:34.881 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.877+0000 7f10557fa700 1 --2- 172.21.15.77:0/3924972030 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f103c066320 0x7f103c0687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:34.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.877+0000 7f10557fa700 1 -- 172.21.15.77:0/3924972030 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1050083ab0 con 0x7f105815a750 2023-07-24T05:47:34.882 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.877+0000 7f105ca01700 1 --2- 172.21.15.77:0/3924972030 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f103c066320 0x7f103c0687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:34.883 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.877+0000 7f105ca01700 1 --2- 172.21.15.77:0/3924972030 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f103c066320 0x7f103c0687e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f104c000f60 tx=0x7f104c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:34.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:34.881+0000 7f10557fa700 1 -- 172.21.15.77:0/3924972030 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1050050bf0 con 0x7f105815a750 2023-07-24T05:47:35.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.053+0000 7f105da03700 1 -- 172.21.15.77:0/3924972030 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1058157b00 con 0x7f105815a750 2023-07-24T05:47:35.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.053+0000 7f10557fa700 1 -- 172.21.15.77:0/3924972030 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f105000ae60 con 0x7f105815a750 2023-07-24T05:47:35.059 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-07-24T05:47:35.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.053+0000 7f105da03700 1 -- 172.21.15.77:0/3924972030 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f103c066320 msgr2=0x7f103c0687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:35.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.053+0000 7f105da03700 1 --2- 172.21.15.77:0/3924972030 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f103c066320 0x7f103c0687e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f104c000f60 tx=0x7f104c009040 comp rx=0 tx=0).stop 2023-07-24T05:47:35.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.057+0000 7f105da03700 1 -- 172.21.15.77:0/3924972030 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f105815a750 msgr2=0x7f1058143590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:35.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.057+0000 7f105da03700 1 --2- 172.21.15.77:0/3924972030 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f105815a750 0x7f1058143590 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1050002230 tx=0x7f105000cf50 comp rx=0 tx=0).stop 2023-07-24T05:47:35.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.057+0000 7f105da03700 1 -- 172.21.15.77:0/3924972030 shutdown_connections 2023-07-24T05:47:35.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.057+0000 7f105da03700 1 --2- 172.21.15.77:0/3924972030 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f105815a750 0x7f1058143590 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:35.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.057+0000 7f105da03700 1 --2- 172.21.15.77:0/3924972030 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f103c066320 0x7f103c0687e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:35.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.057+0000 7f105da03700 1 --2- 172.21.15.77:0/3924972030 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f105806c930 0x7f1058156a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:35.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.057+0000 7f105da03700 1 --2- 172.21.15.77:0/3924972030 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1058069b10 0x7f105815bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:35.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.057+0000 7f105da03700 1 -- 172.21.15.77:0/3924972030 >> 172.21.15.77:0/3924972030 conn(0x7f10580ceb90 msgr2=0x7f10580b33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:35.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.057+0000 7f105da03700 1 -- 172.21.15.77:0/3924972030 shutdown_connections 2023-07-24T05:47:35.063 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.057+0000 7f105da03700 1 -- 172.21.15.77:0/3924972030 wait complete. 2023-07-24T05:47:35.082 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-24T05:47:35.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.257+0000 7f489c94c700 1 Processor -- start 2023-07-24T05:47:35.261 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.257+0000 7f489c94c700 1 -- start start 2023-07-24T05:47:35.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.257+0000 7f489c94c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f489815a950 0x7f48980b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:35.262 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.257+0000 7f489c94c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f48980c4e70 0x7f4898069b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:35.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.257+0000 7f489c94c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f489806b000 con 0x7f489806a050 2023-07-24T05:47:35.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.257+0000 7f489c94c700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48980b1ac0 con 0x7f489815a950 2023-07-24T05:47:35.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.257+0000 7f489c94c700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f489806a7c0 con 0x7f48980c4e70 2023-07-24T05:47:35.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.257+0000 7f488effd700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f48980c4e70 0x7f4898069b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:35.263 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.257+0000 7f48977fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f489815a950 0x7f48980b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:35.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.257+0000 7f488effd700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f48980c4e70 0x7f4898069b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.77:48580/0 (socket says 172.21.15.77:48580) 2023-07-24T05:47:35.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.257+0000 7f488effd700 1 -- 172.21.15.77:0/1041235087 learned_addr learned my addr 172.21.15.77:0/1041235087 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:35.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.257+0000 7f4897fff700 1 --1- 172.21.15.77:0/1041235087 >> v1:172.21.15.103:6789/0 conn(0x7f489806a050 0x7f48980aaf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.77:36986/0 (socket says 172.21.15.77:36986) 2023-07-24T05:47:35.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.257+0000 7f488effd700 1 -- 172.21.15.77:0/1041235087 >> v2:172.21.15.103:3300/0 conn(0x7f489815a950 msgr2=0x7f48980b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:35.264 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.257+0000 7f488effd700 1 --2- 172.21.15.77:0/1041235087 >> v2:172.21.15.103:3300/0 conn(0x7f489815a950 0x7f48980b1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:35.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.257+0000 7f488effd700 1 -- 172.21.15.77:0/1041235087 >> v1:172.21.15.103:6789/0 conn(0x7f489806a050 legacy=0x7f48980aaf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:35.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.257+0000 7f488effd700 1 -- 172.21.15.77:0/1041235087 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f489806aaa0 con 0x7f48980c4e70 2023-07-24T05:47:35.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.257+0000 7f488effd700 1 --2- 172.21.15.77:0/1041235087 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f48980c4e70 0x7f4898069b10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4880009910 tx=0x7f4880009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7263feb63c40c1d6 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:35.265 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.261+0000 7f4896ffd700 1 -- 172.21.15.77:0/1041235087 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4880011830 con 0x7f48980c4e70 2023-07-24T05:47:35.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.261+0000 7f4896ffd700 1 -- 172.21.15.77:0/1041235087 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4880011990 con 0x7f48980c4e70 2023-07-24T05:47:35.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.261+0000 7f4896ffd700 1 -- 172.21.15.77:0/1041235087 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4880011d40 con 0x7f48980c4e70 2023-07-24T05:47:35.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.261+0000 7f489c94c700 1 -- 172.21.15.77:0/1041235087 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f48980c4e70 msgr2=0x7f4898069b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:35.266 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.261+0000 7f489c94c700 1 --2- 172.21.15.77:0/1041235087 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f48980c4e70 0x7f4898069b10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4880009910 tx=0x7f4880009c20 comp rx=0 tx=0).stop 2023-07-24T05:47:35.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.261+0000 7f489c94c700 1 -- 172.21.15.77:0/1041235087 shutdown_connections 2023-07-24T05:47:35.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.261+0000 7f489c94c700 1 --2- 172.21.15.77:0/1041235087 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f48980c4e70 0x7f4898069b10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:35.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.261+0000 7f489c94c700 1 --2- 172.21.15.77:0/1041235087 >> v2:172.21.15.103:3300/0 conn(0x7f489815a950 0x7f48980b1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:35.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.261+0000 7f489c94c700 1 -- 172.21.15.77:0/1041235087 >> 172.21.15.77:0/1041235087 conn(0x7f48980ce260 msgr2=0x7f48980ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:35.267 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.261+0000 7f489c94c700 1 -- 172.21.15.77:0/1041235087 shutdown_connections 2023-07-24T05:47:35.268 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.261+0000 7f489c94c700 1 -- 172.21.15.77:0/1041235087 wait complete. 2023-07-24T05:47:35.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.265+0000 7f489c94c700 1 Processor -- start 2023-07-24T05:47:35.270 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.265+0000 7f489c94c700 1 -- start start 2023-07-24T05:47:35.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.265+0000 7f489c94c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f489806a050 0x7f4898151c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:35.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.265+0000 7f489c94c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48980c4e70 0x7f4898156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:35.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.265+0000 7f489c94c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f489815a950 0x7f4898157220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:35.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.265+0000 7f489c94c700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48980c2b50 con 0x7f48980c4e70 2023-07-24T05:47:35.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.265+0000 7f489c94c700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48980c2e30 con 0x7f489815a950 2023-07-24T05:47:35.272 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.265+0000 7f489c94c700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48980c3110 con 0x7f489806a050 2023-07-24T05:47:35.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.265+0000 7f488effd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48980c4e70 0x7f4898156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:35.273 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.265+0000 7f488effd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48980c4e70 0x7f4898156ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46694/0 (socket says 172.21.15.77:46694) 2023-07-24T05:47:35.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.265+0000 7f488effd700 1 -- 172.21.15.77:0/3420856746 learned_addr learned my addr 172.21.15.77:0/3420856746 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:35.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.265+0000 7f48977fe700 1 --2- 172.21.15.77:0/3420856746 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f489806a050 0x7f4898151c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:35.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.265+0000 7f4897fff700 1 --2- 172.21.15.77:0/3420856746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f489815a950 0x7f4898157220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:35.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.269+0000 7f488effd700 1 -- 172.21.15.77:0/3420856746 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f489806a050 msgr2=0x7f4898151c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:35.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.269+0000 7f488effd700 1 --2- 172.21.15.77:0/3420856746 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f489806a050 0x7f4898151c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:35.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.269+0000 7f488effd700 1 -- 172.21.15.77:0/3420856746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f489815a950 msgr2=0x7f4898157220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:35.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.269+0000 7f488effd700 1 --2- 172.21.15.77:0/3420856746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f489815a950 0x7f4898157220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:35.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.269+0000 7f488effd700 1 -- 172.21.15.77:0/3420856746 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4880009570 con 0x7f48980c4e70 2023-07-24T05:47:35.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.269+0000 7f488effd700 1 --2- 172.21.15.77:0/3420856746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48980c4e70 0x7f4898156ce0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f48980b1c00 tx=0x7f4880004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:35.275 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.269+0000 7f4894ff9700 1 -- 172.21.15.77:0/3420856746 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4880004510 con 0x7f48980c4e70 2023-07-24T05:47:35.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.269+0000 7f4894ff9700 1 -- 172.21.15.77:0/3420856746 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f488001e070 con 0x7f48980c4e70 2023-07-24T05:47:35.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.269+0000 7f489c94c700 1 -- 172.21.15.77:0/3420856746 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48980c33f0 con 0x7f48980c4e70 2023-07-24T05:47:35.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.269+0000 7f4894ff9700 1 -- 172.21.15.77:0/3420856746 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4880003900 con 0x7f48980c4e70 2023-07-24T05:47:35.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.269+0000 7f489c94c700 1 -- 172.21.15.77:0/3420856746 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48981521a0 con 0x7f48980c4e70 2023-07-24T05:47:35.276 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.269+0000 7f489c94c700 1 -- 172.21.15.77:0/3420856746 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f489809c100 con 0x7f48980c4e70 2023-07-24T05:47:35.278 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.273+0000 7f4894ff9700 1 -- 172.21.15.77:0/3420856746 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4880003a60 con 0x7f48980c4e70 2023-07-24T05:47:35.279 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.273+0000 7f4894ff9700 1 --2- 172.21.15.77:0/3420856746 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f48780662f0 0x7f48780687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:35.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.273+0000 7f4894ff9700 1 -- 172.21.15.77:0/3420856746 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4880084c50 con 0x7f48980c4e70 2023-07-24T05:47:35.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.273+0000 7f48977fe700 1 --2- 172.21.15.77:0/3420856746 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f48780662f0 0x7f48780687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:35.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.277+0000 7f48977fe700 1 --2- 172.21.15.77:0/3420856746 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f48780662f0 0x7f48780687b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4888009b50 tx=0x7f4888009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:35.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.281+0000 7f4894ff9700 1 -- 172.21.15.77:0/3420856746 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4880051d90 con 0x7f48980c4e70 2023-07-24T05:47:35.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.457+0000 7f489c94c700 1 -- 172.21.15.77:0/3420856746 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f489806bd40 con 0x7f48980c4e70 2023-07-24T05:47:35.462 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.457+0000 7f4894ff9700 1 -- 172.21.15.77:0/3420856746 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f48800200a0 con 0x7f48980c4e70 2023-07-24T05:47:35.463 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2023-07-24T05:47:35.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.457+0000 7f489c94c700 1 -- 172.21.15.77:0/3420856746 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f48780662f0 msgr2=0x7f48780687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:35.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.457+0000 7f489c94c700 1 --2- 172.21.15.77:0/3420856746 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f48780662f0 0x7f48780687b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4888009b50 tx=0x7f4888009240 comp rx=0 tx=0).stop 2023-07-24T05:47:35.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.457+0000 7f489c94c700 1 -- 172.21.15.77:0/3420856746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48980c4e70 msgr2=0x7f4898156ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:35.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.457+0000 7f489c94c700 1 --2- 172.21.15.77:0/3420856746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48980c4e70 0x7f4898156ce0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f48980b1c00 tx=0x7f4880004770 comp rx=0 tx=0).stop 2023-07-24T05:47:35.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.461+0000 7f489c94c700 1 -- 172.21.15.77:0/3420856746 shutdown_connections 2023-07-24T05:47:35.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.461+0000 7f489c94c700 1 --2- 172.21.15.77:0/3420856746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f489815a950 0x7f4898157220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:35.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.461+0000 7f489c94c700 1 --2- 172.21.15.77:0/3420856746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48980c4e70 0x7f4898156ce0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:35.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.461+0000 7f489c94c700 1 --2- 172.21.15.77:0/3420856746 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f48780662f0 0x7f48780687b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:35.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.461+0000 7f489c94c700 1 --2- 172.21.15.77:0/3420856746 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f489806a050 0x7f4898151c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:35.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.461+0000 7f489c94c700 1 -- 172.21.15.77:0/3420856746 >> 172.21.15.77:0/3420856746 conn(0x7f48980ce260 msgr2=0x7f48980cbdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:35.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.461+0000 7f489c94c700 1 -- 172.21.15.77:0/3420856746 shutdown_connections 2023-07-24T05:47:35.467 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.461+0000 7f489c94c700 1 -- 172.21.15.77:0/3420856746 wait complete. 2023-07-24T05:47:35.488 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-07-24T05:47:35.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.661+0000 7f6a32970700 1 Processor -- start 2023-07-24T05:47:35.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.661+0000 7f6a32970700 1 -- start start 2023-07-24T05:47:35.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.661+0000 7f6a32970700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f6a2c15cc50 0x7f6a2c0b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:35.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.661+0000 7f6a32970700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f6a2c06a520 0x7f6a2c0b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:35.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.661+0000 7f6a32970700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a2c06aaa0 con 0x7f6a2c15c870 2023-07-24T05:47:35.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.661+0000 7f6a32970700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a2c06ad80 con 0x7f6a2c06a520 2023-07-24T05:47:35.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.661+0000 7f6a32970700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a2c06b060 con 0x7f6a2c15cc50 2023-07-24T05:47:35.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.661+0000 7f6a3196e700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f6a2c15c870 0x7f6a2c0cefe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:56516/0 (socket says 172.21.15.77:56516) 2023-07-24T05:47:35.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.661+0000 7f6a3196e700 1 -- 172.21.15.77:0/3200769128 learned_addr learned my addr 172.21.15.77:0/3200769128 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:35.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.661+0000 7f6a3216f700 1 --2- 172.21.15.77:0/3200769128 >> v2:172.21.15.77:3300/0 conn(0x7f6a2c06a520 0x7f6a2c0b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:35.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.665+0000 7f6a3216f700 1 -- 172.21.15.77:0/3200769128 >> v2:172.21.15.103:3300/0 conn(0x7f6a2c15cc50 msgr2=0x7f6a2c0b1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:35.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.665+0000 7f6a3116d700 1 --2- 172.21.15.77:0/3200769128 >> v2:172.21.15.103:3300/0 conn(0x7f6a2c15cc50 0x7f6a2c0b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:35.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.665+0000 7f6a3096c700 1 -- 172.21.15.77:0/3200769128 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3914924491 0 0) 0x7f6a2c06aaa0 con 0x7f6a2c15c870 2023-07-24T05:47:35.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.665+0000 7f6a3216f700 1 --2- 172.21.15.77:0/3200769128 >> v2:172.21.15.103:3300/0 conn(0x7f6a2c15cc50 0x7f6a2c0b1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:35.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.665+0000 7f6a3216f700 1 -- 172.21.15.77:0/3200769128 >> v1:172.21.15.77:6789/0 conn(0x7f6a2c15c870 legacy=0x7f6a2c0cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:35.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.665+0000 7f6a3216f700 1 -- 172.21.15.77:0/3200769128 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2c06b340 con 0x7f6a2c06a520 2023-07-24T05:47:35.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.665+0000 7f6a3116d700 1 --2- 172.21.15.77:0/3200769128 >> v2:172.21.15.103:3300/0 conn(0x7f6a2c15cc50 0x7f6a2c0b1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:47:35.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.665+0000 7f6a3216f700 1 --2- 172.21.15.77:0/3200769128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a2c06a520 0x7f6a2c0b2060 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c0670d0 tx=0x7f6a2400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1fbedaddd75820e server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:35.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.665+0000 7f6a3096c700 1 -- 172.21.15.77:0/3200769128 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2400e070 con 0x7f6a2c06a520 2023-07-24T05:47:35.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.665+0000 7f6a3096c700 1 -- 172.21.15.77:0/3200769128 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2400bbd0 con 0x7f6a2c06a520 2023-07-24T05:47:35.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.665+0000 7f6a3096c700 1 -- 172.21.15.77:0/3200769128 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a24012430 con 0x7f6a2c06a520 2023-07-24T05:47:35.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.665+0000 7f6a32970700 1 -- 172.21.15.77:0/3200769128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a2c06a520 msgr2=0x7f6a2c0b2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:35.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.665+0000 7f6a32970700 1 --2- 172.21.15.77:0/3200769128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a2c06a520 0x7f6a2c0b2060 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c0670d0 tx=0x7f6a2400b330 comp rx=0 tx=0).stop 2023-07-24T05:47:35.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.665+0000 7f6a32970700 1 -- 172.21.15.77:0/3200769128 shutdown_connections 2023-07-24T05:47:35.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.665+0000 7f6a32970700 1 --2- 172.21.15.77:0/3200769128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a2c06a520 0x7f6a2c0b2060 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:35.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.665+0000 7f6a32970700 1 --2- 172.21.15.77:0/3200769128 >> v2:172.21.15.103:3300/0 conn(0x7f6a2c15cc50 0x7f6a2c0b1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:35.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.665+0000 7f6a32970700 1 -- 172.21.15.77:0/3200769128 >> 172.21.15.77:0/3200769128 conn(0x7f6a2c089f80 msgr2=0x7f6a2c09b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:35.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.665+0000 7f6a32970700 1 -- 172.21.15.77:0/3200769128 shutdown_connections 2023-07-24T05:47:35.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.665+0000 7f6a32970700 1 -- 172.21.15.77:0/3200769128 wait complete. 2023-07-24T05:47:35.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.669+0000 7f6a32970700 1 Processor -- start 2023-07-24T05:47:35.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.669+0000 7f6a32970700 1 -- start start 2023-07-24T05:47:35.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.669+0000 7f6a32970700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6a2c06a520 0x7f6a2c14f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:35.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.669+0000 7f6a32970700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a2c15c870 0x7f6a2c158da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:35.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.669+0000 7f6a32970700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a2c15cc50 0x7f6a2c0c6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:35.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.669+0000 7f6a32970700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c15a450 con 0x7f6a2c15cc50 2023-07-24T05:47:35.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.669+0000 7f6a32970700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c15a8e0 con 0x7f6a2c15c870 2023-07-24T05:47:35.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.669+0000 7f6a32970700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2c159840 con 0x7f6a2c06a520 2023-07-24T05:47:35.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.669+0000 7f6a3216f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a2c15cc50 0x7f6a2c0c6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:35.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.669+0000 7f6a3216f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a2c15cc50 0x7f6a2c0c6190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46716/0 (socket says 172.21.15.77:46716) 2023-07-24T05:47:35.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.669+0000 7f6a3216f700 1 -- 172.21.15.77:0/3700425506 learned_addr learned my addr 172.21.15.77:0/3700425506 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:35.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.669+0000 7f6a3116d700 1 --2- 172.21.15.77:0/3700425506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a2c15c870 0x7f6a2c158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:35.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.669+0000 7f6a3196e700 1 --2- 172.21.15.77:0/3700425506 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6a2c06a520 0x7f6a2c14f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:35.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.669+0000 7f6a3216f700 1 -- 172.21.15.77:0/3700425506 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6a2c06a520 msgr2=0x7f6a2c14f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:35.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.669+0000 7f6a3216f700 1 --2- 172.21.15.77:0/3700425506 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6a2c06a520 0x7f6a2c14f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:35.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.669+0000 7f6a3216f700 1 -- 172.21.15.77:0/3700425506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a2c15c870 msgr2=0x7f6a2c158da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:35.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.669+0000 7f6a3216f700 1 --2- 172.21.15.77:0/3700425506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a2c15c870 0x7f6a2c158da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:35.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.669+0000 7f6a3216f700 1 -- 172.21.15.77:0/3700425506 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a24009a70 con 0x7f6a2c15cc50 2023-07-24T05:47:35.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.669+0000 7f6a3116d700 1 --2- 172.21.15.77:0/3700425506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a2c15c870 0x7f6a2c158da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:35.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.673+0000 7f6a3216f700 1 --2- 172.21.15.77:0/3700425506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a2c15cc50 0x7f6a2c0c6190 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6a2400b370 tx=0x7f6a24004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:35.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.673+0000 7f6a227fc700 1 -- 172.21.15.77:0/3700425506 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a24012430 con 0x7f6a2c15cc50 2023-07-24T05:47:35.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.673+0000 7f6a227fc700 1 -- 172.21.15.77:0/3700425506 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a24020070 con 0x7f6a2c15cc50 2023-07-24T05:47:35.679 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.673+0000 7f6a227fc700 1 -- 172.21.15.77:0/3700425506 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a24004280 con 0x7f6a2c15cc50 2023-07-24T05:47:35.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.673+0000 7f6a32970700 1 -- 172.21.15.77:0/3700425506 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a2c159b20 con 0x7f6a2c15cc50 2023-07-24T05:47:35.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.673+0000 7f6a32970700 1 -- 172.21.15.77:0/3700425506 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a2c15a0e0 con 0x7f6a2c15cc50 2023-07-24T05:47:35.680 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.673+0000 7f6a32970700 1 -- 172.21.15.77:0/3700425506 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a2c15a600 con 0x7f6a2c15cc50 2023-07-24T05:47:35.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.677+0000 7f6a227fc700 1 -- 172.21.15.77:0/3700425506 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6a240043e0 con 0x7f6a2c15cc50 2023-07-24T05:47:35.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.677+0000 7f6a227fc700 1 --2- 172.21.15.77:0/3700425506 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6a10066320 0x7f6a100687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:35.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.677+0000 7f6a227fc700 1 -- 172.21.15.77:0/3700425506 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6a24022070 con 0x7f6a2c15cc50 2023-07-24T05:47:35.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.677+0000 7f6a3196e700 1 --2- 172.21.15.77:0/3700425506 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6a10066320 0x7f6a100687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:35.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.677+0000 7f6a3196e700 1 --2- 172.21.15.77:0/3700425506 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6a10066320 0x7f6a100687e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6a28005d90 tx=0x7f6a28007b80 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:35.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.681+0000 7f6a227fc700 1 -- 172.21.15.77:0/3700425506 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6a2c15a600 con 0x7f6a2c15cc50 2023-07-24T05:47:35.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.861+0000 7f6a32970700 1 -- 172.21.15.77:0/3700425506 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6a2c072490 con 0x7f6a2c15cc50 2023-07-24T05:47:35.867 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.861+0000 7f6a227fc700 1 -- 172.21.15.77:0/3700425506 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6a2402c0a0 con 0x7f6a2c15cc50 2023-07-24T05:47:35.868 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2023-07-24T05:47:35.870 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.865+0000 7f6a32970700 1 -- 172.21.15.77:0/3700425506 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6a10066320 msgr2=0x7f6a100687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:35.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.865+0000 7f6a32970700 1 --2- 172.21.15.77:0/3700425506 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6a10066320 0x7f6a100687e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6a28005d90 tx=0x7f6a28007b80 comp rx=0 tx=0).stop 2023-07-24T05:47:35.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.865+0000 7f6a32970700 1 -- 172.21.15.77:0/3700425506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a2c15cc50 msgr2=0x7f6a2c0c6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:35.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.865+0000 7f6a32970700 1 --2- 172.21.15.77:0/3700425506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a2c15cc50 0x7f6a2c0c6190 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6a2400b370 tx=0x7f6a24004af0 comp rx=0 tx=0).stop 2023-07-24T05:47:35.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.865+0000 7f6a32970700 1 -- 172.21.15.77:0/3700425506 shutdown_connections 2023-07-24T05:47:35.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.865+0000 7f6a32970700 1 --2- 172.21.15.77:0/3700425506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a2c15cc50 0x7f6a2c0c6190 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:35.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.865+0000 7f6a32970700 1 --2- 172.21.15.77:0/3700425506 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a2c15c870 0x7f6a2c158da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:35.871 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.865+0000 7f6a32970700 1 --2- 172.21.15.77:0/3700425506 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f6a10066320 0x7f6a100687e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:35.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.865+0000 7f6a32970700 1 --2- 172.21.15.77:0/3700425506 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6a2c06a520 0x7f6a2c14f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:35.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.865+0000 7f6a32970700 1 -- 172.21.15.77:0/3700425506 >> 172.21.15.77:0/3700425506 conn(0x7f6a2c089f80 msgr2=0x7f6a2c151970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:35.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.865+0000 7f6a32970700 1 -- 172.21.15.77:0/3700425506 shutdown_connections 2023-07-24T05:47:35.872 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:35.865+0000 7f6a32970700 1 -- 172.21.15.77:0/3700425506 wait complete. 2023-07-24T05:47:35.893 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-24T05:47:36.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.057+0000 7f10059d2700 1 Processor -- start 2023-07-24T05:47:36.062 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.057+0000 7f10059d2700 1 -- start start 2023-07-24T05:47:36.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.061+0000 7f10059d2700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f100015ca00 0x7f10000d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:36.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.061+0000 7f10059d2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f100006d450 0x7f10000b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:36.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.061+0000 7f10059d2700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10000d0300 con 0x7f10000b4630 2023-07-24T05:47:36.065 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.061+0000 7f10059d2700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10000b4ac0 con 0x7f100006d450 2023-07-24T05:47:36.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.061+0000 7f10059d2700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f100015cde0 con 0x7f100015ca00 2023-07-24T05:47:36.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.061+0000 7f0ffe7fc700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f100006d450 0x7f10000b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:36.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.061+0000 7f0fff7fe700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f10000b4630 0x7f10000b11e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.77:36992/0 (socket says 172.21.15.77:36992) 2023-07-24T05:47:36.066 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.061+0000 7f0fff7fe700 1 -- 172.21.15.77:0/3056198518 learned_addr learned my addr 172.21.15.77:0/3056198518 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:36.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.061+0000 7f0ffeffd700 1 --2- 172.21.15.77:0/3056198518 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f100015ca00 0x7f10000d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:36.067 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.061+0000 7f0ffdffb700 1 -- 172.21.15.77:0/3056198518 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3370914938 0 0) 0x7f10000d0300 con 0x7f10000b4630 2023-07-24T05:47:36.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.061+0000 7f0ffdffb700 1 -- 172.21.15.77:0/3056198518 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fe80035d0 con 0x7f10000b4630 2023-07-24T05:47:36.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.061+0000 7f0ffe7fc700 1 -- 172.21.15.77:0/3056198518 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f100015ca00 msgr2=0x7f10000d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:36.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.061+0000 7f0ffe7fc700 1 --2- 172.21.15.77:0/3056198518 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f100015ca00 0x7f10000d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:36.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.061+0000 7f0ffe7fc700 1 -- 172.21.15.77:0/3056198518 >> v1:172.21.15.103:6789/0 conn(0x7f10000b4630 legacy=0x7f10000b11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:36.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.061+0000 7f0ffe7fc700 1 -- 172.21.15.77:0/3056198518 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10000d2870 con 0x7f100006d450 2023-07-24T05:47:36.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.061+0000 7f0ffeffd700 1 --2- 172.21.15.77:0/3056198518 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f100015ca00 0x7f10000d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:47:36.068 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.061+0000 7f0ffe7fc700 1 --2- 172.21.15.77:0/3056198518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f100006d450 0x7f10000b40f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0ff4009850 tx=0x7f0ff4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f56959f5d9cde2 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:36.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.061+0000 7f0ffdffb700 1 -- 172.21.15.77:0/3056198518 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff4011830 con 0x7f100006d450 2023-07-24T05:47:36.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.061+0000 7f0ffdffb700 1 -- 172.21.15.77:0/3056198518 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff4011990 con 0x7f100006d450 2023-07-24T05:47:36.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.061+0000 7f0ffdffb700 1 -- 172.21.15.77:0/3056198518 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff4011d40 con 0x7f100006d450 2023-07-24T05:47:36.069 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.065+0000 7f10059d2700 1 -- 172.21.15.77:0/3056198518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f100006d450 msgr2=0x7f10000b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:36.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.065+0000 7f10059d2700 1 --2- 172.21.15.77:0/3056198518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f100006d450 0x7f10000b40f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0ff4009850 tx=0x7f0ff4009b60 comp rx=0 tx=0).stop 2023-07-24T05:47:36.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.065+0000 7f10059d2700 1 -- 172.21.15.77:0/3056198518 shutdown_connections 2023-07-24T05:47:36.070 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.065+0000 7f10059d2700 1 --2- 172.21.15.77:0/3056198518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f100006d450 0x7f10000b40f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:36.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.065+0000 7f10059d2700 1 --2- 172.21.15.77:0/3056198518 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f100015ca00 0x7f10000d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:36.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.065+0000 7f10059d2700 1 -- 172.21.15.77:0/3056198518 >> 172.21.15.77:0/3056198518 conn(0x7f10000b7610 msgr2=0x7f10000b7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:36.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.065+0000 7f10059d2700 1 -- 172.21.15.77:0/3056198518 shutdown_connections 2023-07-24T05:47:36.071 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.065+0000 7f10059d2700 1 -- 172.21.15.77:0/3056198518 wait complete. 2023-07-24T05:47:36.072 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.065+0000 7f10059d2700 1 Processor -- start 2023-07-24T05:47:36.073 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.069+0000 7f10059d2700 1 -- start start 2023-07-24T05:47:36.074 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.069+0000 7f10059d2700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f100006d450 0x7f1000158cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:36.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.069+0000 7f10059d2700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f10000b4630 0x7f1000153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:36.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.069+0000 7f10059d2700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f100015ca00 0x7f10000c6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:36.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.069+0000 7f10059d2700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10001536c0 con 0x7f100015ca00 2023-07-24T05:47:36.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.069+0000 7f10059d2700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10001538f0 con 0x7f100006d450 2023-07-24T05:47:36.075 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.069+0000 7f10059d2700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10000c7a00 con 0x7f10000b4630 2023-07-24T05:47:36.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.069+0000 7f0fff7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f100015ca00 0x7f10000c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:36.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.069+0000 7f0fff7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f100015ca00 0x7f10000c6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46718/0 (socket says 172.21.15.77:46718) 2023-07-24T05:47:36.076 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.069+0000 7f0fff7fe700 1 -- 172.21.15.77:0/3331376836 learned_addr learned my addr 172.21.15.77:0/3331376836 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:36.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.069+0000 7f0ffe7fc700 1 --2- 172.21.15.77:0/3331376836 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f10000b4630 0x7f1000153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:36.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.069+0000 7f0ffeffd700 1 --2- 172.21.15.77:0/3331376836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f100006d450 0x7f1000158cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:36.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.069+0000 7f0fff7fe700 1 -- 172.21.15.77:0/3331376836 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f10000b4630 msgr2=0x7f1000153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:36.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.069+0000 7f0fff7fe700 1 --2- 172.21.15.77:0/3331376836 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f10000b4630 0x7f1000153180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:36.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.069+0000 7f0fff7fe700 1 -- 172.21.15.77:0/3331376836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f100006d450 msgr2=0x7f1000158cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:36.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.069+0000 7f0fff7fe700 1 --2- 172.21.15.77:0/3331376836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f100006d450 0x7f1000158cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:36.077 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.069+0000 7f0fff7fe700 1 -- 172.21.15.77:0/3331376836 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff0009450 con 0x7f100015ca00 2023-07-24T05:47:36.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.069+0000 7f0fff7fe700 1 --2- 172.21.15.77:0/3331376836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f100015ca00 0x7f10000c6160 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f0ff800caa0 tx=0x7f0ff800cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:36.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.069+0000 7f0fe7fff700 1 -- 172.21.15.77:0/3331376836 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff8007480 con 0x7f100015ca00 2023-07-24T05:47:36.078 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.069+0000 7f0fe7fff700 1 -- 172.21.15.77:0/3331376836 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff80075e0 con 0x7f100015ca00 2023-07-24T05:47:36.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.069+0000 7f10059d2700 1 -- 172.21.15.77:0/3331376836 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff40094b0 con 0x7f100015ca00 2023-07-24T05:47:36.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.069+0000 7f0fe7fff700 1 -- 172.21.15.77:0/3331376836 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff8007970 con 0x7f100015ca00 2023-07-24T05:47:36.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.073+0000 7f10059d2700 1 -- 172.21.15.77:0/3331376836 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10000c7fc0 con 0x7f100015ca00 2023-07-24T05:47:36.079 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.073+0000 7f10059d2700 1 -- 172.21.15.77:0/3331376836 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10000c81b0 con 0x7f100015ca00 2023-07-24T05:47:36.081 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.077+0000 7f0fe7fff700 1 -- 172.21.15.77:0/3331376836 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0ff801b3b0 con 0x7f100015ca00 2023-07-24T05:47:36.082 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.077+0000 7f0fe7fff700 1 --2- 172.21.15.77:0/3331376836 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f0fec0662f0 0x7f0fec0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:36.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.077+0000 7f0fe7fff700 1 -- 172.21.15.77:0/3331376836 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0ff80839a0 con 0x7f100015ca00 2023-07-24T05:47:36.083 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.077+0000 7f0ffeffd700 1 --2- 172.21.15.77:0/3331376836 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f0fec0662f0 0x7f0fec0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:36.084 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.077+0000 7f0ffeffd700 1 --2- 172.21.15.77:0/3331376836 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f0fec0662f0 0x7f0fec0687b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0009d70 tx=0x7f0ff00091c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:36.087 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.081+0000 7f0fe7fff700 1 -- 172.21.15.77:0/3331376836 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0ff8050af0 con 0x7f100015ca00 2023-07-24T05:47:36.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.285+0000 7f10059d2700 1 -- 172.21.15.77:0/3331376836 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1000072490 con 0x7f100015ca00 2023-07-24T05:47:36.291 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.285+0000 7f0fe7fff700 1 -- 172.21.15.77:0/3331376836 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f0ff8081e60 con 0x7f100015ca00 2023-07-24T05:47:36.292 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:47:36.292 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/4201639271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4201639271},{"type":"v1","addr":"172.21.15.77:6834","nonce":4201639271}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/993116623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":993116623},{"type":"v1","addr":"172.21.15.103:6835","nonce":993116623}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/1196529067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":1196529067},{"type":"v1","addr":"172.21.15.103:6837","nonce":1196529067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-24T05:46:00.395327+0000","modified":"2023-07-24T05:46:27.438873+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6835/2428690206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2428690206},{"type":"v1","addr":"172.21.15.77:6835","nonce":2428690206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-24T05:47:36.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.289+0000 7f10059d2700 1 -- 172.21.15.77:0/3331376836 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f0fec0662f0 msgr2=0x7f0fec0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:36.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.289+0000 7f10059d2700 1 --2- 172.21.15.77:0/3331376836 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f0fec0662f0 0x7f0fec0687b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0009d70 tx=0x7f0ff00091c0 comp rx=0 tx=0).stop 2023-07-24T05:47:36.294 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.289+0000 7f10059d2700 1 -- 172.21.15.77:0/3331376836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f100015ca00 msgr2=0x7f10000c6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:36.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.289+0000 7f10059d2700 1 --2- 172.21.15.77:0/3331376836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f100015ca00 0x7f10000c6160 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f0ff800caa0 tx=0x7f0ff800cad0 comp rx=0 tx=0).stop 2023-07-24T05:47:36.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.289+0000 7f10059d2700 1 -- 172.21.15.77:0/3331376836 shutdown_connections 2023-07-24T05:47:36.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.289+0000 7f10059d2700 1 --2- 172.21.15.77:0/3331376836 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f100015ca00 0x7f10000c6160 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:36.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.289+0000 7f10059d2700 1 --2- 172.21.15.77:0/3331376836 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f0fec0662f0 0x7f0fec0687b0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:36.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.289+0000 7f10059d2700 1 --2- 172.21.15.77:0/3331376836 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f10000b4630 0x7f1000153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:36.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.289+0000 7f10059d2700 1 --2- 172.21.15.77:0/3331376836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f100006d450 0x7f1000158cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:36.295 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.289+0000 7f10059d2700 1 -- 172.21.15.77:0/3331376836 >> 172.21.15.77:0/3331376836 conn(0x7f10000b7610 msgr2=0x7f1000069b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:36.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.289+0000 7f10059d2700 1 -- 172.21.15.77:0/3331376836 shutdown_connections 2023-07-24T05:47:36.296 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.289+0000 7f10059d2700 1 -- 172.21.15.77:0/3331376836 wait complete. 2023-07-24T05:47:36.297 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 9 2023-07-24T05:47:36.316 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-24T05:47:36.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.481+0000 7f727510e700 1 Processor -- start 2023-07-24T05:47:36.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.481+0000 7f727510e700 1 -- start start 2023-07-24T05:47:36.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.481+0000 7f727510e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f72700b13c0 0x7f727006adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:36.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.481+0000 7f727510e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f72700a4580 0x7f727006fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:36.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.481+0000 7f727510e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72700adc40 con 0x7f7270069b10 2023-07-24T05:47:36.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.481+0000 7f727510e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f727006b330 con 0x7f72700a4580 2023-07-24T05:47:36.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.481+0000 7f727510e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72700adee0 con 0x7f72700b13c0 2023-07-24T05:47:36.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.481+0000 7f726ffff700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f72700b13c0 0x7f727006adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:36.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.481+0000 7f726f7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f72700a4580 0x7f727006fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:36.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.481+0000 7f726f7fe700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f72700a4580 0x7f727006fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:51246/0 (socket says 172.21.15.77:51246) 2023-07-24T05:47:36.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.481+0000 7f726f7fe700 1 -- 172.21.15.77:0/66442290 learned_addr learned my addr 172.21.15.77:0/66442290 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:36.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.481+0000 7f726f7fe700 1 -- 172.21.15.77:0/66442290 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f72700b13c0 msgr2=0x7f727006adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:36.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.481+0000 7f726f7fe700 1 --2- 172.21.15.77:0/66442290 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f72700b13c0 0x7f727006adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:36.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.481+0000 7f726f7fe700 1 -- 172.21.15.77:0/66442290 >> v1:172.21.15.103:6789/0 conn(0x7f7270069b10 legacy=0x7f72700ae9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:36.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.481+0000 7f726f7fe700 1 -- 172.21.15.77:0/66442290 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72700ae1c0 con 0x7f72700a4580 2023-07-24T05:47:36.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.485+0000 7f726f7fe700 1 --2- 172.21.15.77:0/66442290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72700a4580 0x7f727006fbe0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7264009910 tx=0x7f7264009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23f7ab592246baeb server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:36.490 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.485+0000 7f726effd700 1 -- 172.21.15.77:0/66442290 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7264011830 con 0x7f72700a4580 2023-07-24T05:47:36.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.485+0000 7f726effd700 1 -- 172.21.15.77:0/66442290 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7264011990 con 0x7f72700a4580 2023-07-24T05:47:36.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.485+0000 7f726effd700 1 -- 172.21.15.77:0/66442290 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7264011d40 con 0x7f72700a4580 2023-07-24T05:47:36.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.485+0000 7f727510e700 1 -- 172.21.15.77:0/66442290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72700a4580 msgr2=0x7f727006fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:36.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.485+0000 7f727510e700 1 --2- 172.21.15.77:0/66442290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72700a4580 0x7f727006fbe0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7264009910 tx=0x7f7264009c20 comp rx=0 tx=0).stop 2023-07-24T05:47:36.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.485+0000 7f727510e700 1 -- 172.21.15.77:0/66442290 shutdown_connections 2023-07-24T05:47:36.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.485+0000 7f727510e700 1 --2- 172.21.15.77:0/66442290 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f72700a4580 0x7f727006fbe0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:36.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.485+0000 7f727510e700 1 --2- 172.21.15.77:0/66442290 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f72700b13c0 0x7f727006adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:36.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.485+0000 7f727510e700 1 -- 172.21.15.77:0/66442290 >> 172.21.15.77:0/66442290 conn(0x7f72700cacc0 msgr2=0x7f72700cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:36.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.485+0000 7f727510e700 1 -- 172.21.15.77:0/66442290 shutdown_connections 2023-07-24T05:47:36.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.485+0000 7f727510e700 1 -- 172.21.15.77:0/66442290 wait complete. 2023-07-24T05:47:36.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.489+0000 7f727510e700 1 Processor -- start 2023-07-24T05:47:36.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.489+0000 7f727510e700 1 -- start start 2023-07-24T05:47:36.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.489+0000 7f727510e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7270069b10 0x7f727009a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:36.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.489+0000 7f727510e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f72700a4580 0x7f72701540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:36.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.489+0000 7f727510e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72700b13c0 0x7f72700c30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:36.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.489+0000 7f727510e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727009a8b0 con 0x7f72700b13c0 2023-07-24T05:47:36.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.489+0000 7f727510e700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727009ab90 con 0x7f7270069b10 2023-07-24T05:47:36.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.489+0000 7f727510e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f727009ae70 con 0x7f72700a4580 2023-07-24T05:47:36.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.489+0000 7f727490d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72700b13c0 0x7f72700c30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:36.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.489+0000 7f726ffff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7270069b10 0x7f727009a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:36.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.489+0000 7f727490d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72700b13c0 0x7f72700c30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46724/0 (socket says 172.21.15.77:46724) 2023-07-24T05:47:36.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.489+0000 7f726ffff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7270069b10 0x7f727009a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:51248/0 (socket says 172.21.15.77:51248) 2023-07-24T05:47:36.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.489+0000 7f727490d700 1 -- 172.21.15.77:0/257604949 learned_addr learned my addr 172.21.15.77:0/257604949 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:36.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.489+0000 7f726f7fe700 1 --2- 172.21.15.77:0/257604949 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f72700a4580 0x7f72701540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:36.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.493+0000 7f726f7fe700 1 -- 172.21.15.77:0/257604949 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7270069b10 msgr2=0x7f727009a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:36.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.493+0000 7f726f7fe700 1 --2- 172.21.15.77:0/257604949 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7270069b10 0x7f727009a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:36.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.493+0000 7f726f7fe700 1 -- 172.21.15.77:0/257604949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72700b13c0 msgr2=0x7f72700c30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:36.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.493+0000 7f726f7fe700 1 --2- 172.21.15.77:0/257604949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72700b13c0 0x7f72700c30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:36.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.493+0000 7f726f7fe700 1 -- 172.21.15.77:0/257604949 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7264009570 con 0x7f72700a4580 2023-07-24T05:47:36.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.493+0000 7f726ffff700 1 --2- 172.21.15.77:0/257604949 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7270069b10 0x7f727009a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:47:36.499 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.493+0000 7f726f7fe700 1 --2- 172.21.15.77:0/257604949 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f72700a4580 0x7f72701540c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7264016000 tx=0x7f7264004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:36.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.493+0000 7f726cff9700 1 -- 172.21.15.77:0/257604949 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7264004510 con 0x7f72700a4580 2023-07-24T05:47:36.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.493+0000 7f726cff9700 1 -- 172.21.15.77:0/257604949 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72640036c0 con 0x7f72700a4580 2023-07-24T05:47:36.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.493+0000 7f726cff9700 1 -- 172.21.15.77:0/257604949 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7264003a70 con 0x7f72700a4580 2023-07-24T05:47:36.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.493+0000 7f727510e700 1 -- 172.21.15.77:0/257604949 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f727009b150 con 0x7f72700a4580 2023-07-24T05:47:36.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.493+0000 7f727510e700 1 -- 172.21.15.77:0/257604949 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7270154600 con 0x7f72700a4580 2023-07-24T05:47:36.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.493+0000 7f727510e700 1 -- 172.21.15.77:0/257604949 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7270072490 con 0x7f72700a4580 2023-07-24T05:47:36.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.497+0000 7f726cff9700 1 -- 172.21.15.77:0/257604949 <== mon.2 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7264003bd0 con 0x7f72700a4580 2023-07-24T05:47:36.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.497+0000 7f726cff9700 1 --2- 172.21.15.77:0/257604949 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f725c0662f0 0x7f725c0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:36.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.497+0000 7f726cff9700 1 -- 172.21.15.77:0/257604949 <== mon.2 v2:172.21.15.103:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7264021030 con 0x7f72700a4580 2023-07-24T05:47:36.504 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.497+0000 7f726ffff700 1 --2- 172.21.15.77:0/257604949 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f725c0662f0 0x7f725c0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:36.505 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.501+0000 7f726ffff700 1 --2- 172.21.15.77:0/257604949 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f725c0662f0 0x7f725c0687b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f72600112c0 tx=0x7f7260009240 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:36.511 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.505+0000 7f726cff9700 1 -- 172.21.15.77:0/257604949 <== mon.2 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7264052740 con 0x7f72700a4580 2023-07-24T05:47:36.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.677+0000 7f727510e700 1 -- 172.21.15.77:0/257604949 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f727009afb0 con 0x7f72700a4580 2023-07-24T05:47:36.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.681+0000 7f726cff9700 1 -- 172.21.15.77:0/257604949 <== mon.2 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20204 (secure 0 0 0) 0x7f727009afb0 con 0x7f72700a4580 2023-07-24T05:47:36.686 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:47:36.687 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":27,"fsid":"5aed5f7b-fb55-4d95-9c02-c6adbb1677b4","created":"2023-07-24T05:45:39.639731+0000","modified":"2023-07-24T05:46:48.442117+0000","last_up_change":"2023-07-24T05:45:52.319670+0000","last_in_change":"2023-07-24T05:45:43.643277+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-24T05:45:52.610430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-24T05:45:52.773787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-24T05:45:58.121732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-24T05:45:59.368726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-24T05:46:03.032057+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ffa0d496-461a-4053-b764-0627d969521b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6812","nonce":825987196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6817","nonce":825987196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6831","nonce":825987196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6824","nonce":825987196}]},"public_addr":"172.21.15.77:6812/825987196","cluster_addr":"172.21.15.77:6817/825987196","heartbeat_back_addr":"172.21.15.77:6831/825987196","heartbeat_front_addr":"172.21.15.77:6824/825987196","state":["exists","up"]},{"osd":1,"uuid":"9f595e5e-5c43-49bc-8ce4-ee70575c90da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6801","nonce":4133026815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6803","nonce":4133026815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6807","nonce":4133026815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6805","nonce":4133026815}]},"public_addr":"172.21.15.77:6801/4133026815","cluster_addr":"172.21.15.77:6803/4133026815","heartbeat_back_addr":"172.21.15.77:6807/4133026815","heartbeat_front_addr":"172.21.15.77:6805/4133026815","state":["exists","up"]},{"osd":2,"uuid":"2ac177aa-4d7d-4262-bd54-d2b9f29f4c3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6811","nonce":2394142159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6819","nonce":2394142159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6830","nonce":2394142159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6825","nonce":2394142159}]},"public_addr":"172.21.15.77:6811/2394142159","cluster_addr":"172.21.15.77:6819/2394142159","heartbeat_back_addr":"172.21.15.77:6830/2394142159","heartbeat_front_addr":"172.21.15.77:6825/2394142159","state":["exists","up"]},{"osd":3,"uuid":"17d7a251-19e8-484c-8172-a578ab3da153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6813","nonce":1492113982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6818","nonce":1492113982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6829","nonce":1492113982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6823","nonce":1492113982}]},"public_addr":"172.21.15.77:6813/1492113982","cluster_addr":"172.21.15.77:6818/1492113982","heartbeat_back_addr":"172.21.15.77:6829/1492113982","heartbeat_front_addr":"172.21.15.77:6823/1492113982","state":["exists","up"]},{"osd":4,"uuid":"bf63ca05-f06d-4e0f-ac44-2a416c70b919","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6825","nonce":1080481057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6827","nonce":1080481057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6831","nonce":1080481057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6829","nonce":1080481057}]},"public_addr":"172.21.15.103:6825/1080481057","cluster_addr":"172.21.15.103:6827/1080481057","heartbeat_back_addr":"172.21.15.103:6831/1080481057","heartbeat_front_addr":"172.21.15.103:6829/1080481057","state":["exists","up"]},{"osd":5,"uuid":"65a11a35-9e9f-4b3c-9fe3-b658d62b9318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6811","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6813","nonce":2756677504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6818","nonce":2756677504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6823","nonce":2756677504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6821","nonce":2756677504}]},"public_addr":"172.21.15.103:6813/2756677504","cluster_addr":"172.21.15.103:6818/2756677504","heartbeat_back_addr":"172.21.15.103:6823/2756677504","heartbeat_front_addr":"172.21.15.103:6821/2756677504","state":["exists","up"]},{"osd":6,"uuid":"750c1f87-686c-40b4-94a1-1a299dc78f3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6809","nonce":568977764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6812","nonce":568977764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6819","nonce":568977764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6815","nonce":568977764}]},"public_addr":"172.21.15.103:6809/568977764","cluster_addr":"172.21.15.103:6812/568977764","heartbeat_back_addr":"172.21.15.103:6819/568977764","heartbeat_front_addr":"172.21.15.103:6815/568977764","state":["exists","up"]},{"osd":7,"uuid":"d5fe4fb6-2e09-4158-885b-403803c85822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6801","nonce":1074557176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6803","nonce":1074557176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6807","nonce":1074557176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6805","nonce":1074557176}]},"public_addr":"172.21.15.103:6801/1074557176","cluster_addr":"172.21.15.103:6803/1074557176","heartbeat_back_addr":"172.21.15.103:6807/1074557176","heartbeat_front_addr":"172.21.15.103:6805/1074557176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.631032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.154109+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.398587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.679089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.311218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.353726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.314372+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.126212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1d","mappings":[{"from":3,"to":2}]},{"pgid":"4.31","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-24T05:47:36.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.685+0000 7f727510e700 1 -- 172.21.15.77:0/257604949 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f725c0662f0 msgr2=0x7f725c0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:36.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.685+0000 7f727510e700 1 --2- 172.21.15.77:0/257604949 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f725c0662f0 0x7f725c0687b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f72600112c0 tx=0x7f7260009240 comp rx=0 tx=0).stop 2023-07-24T05:47:36.690 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.685+0000 7f727510e700 1 -- 172.21.15.77:0/257604949 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f72700a4580 msgr2=0x7f72701540c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:36.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.685+0000 7f727510e700 1 --2- 172.21.15.77:0/257604949 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f72700a4580 0x7f72701540c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7264016000 tx=0x7f7264004770 comp rx=0 tx=0).stop 2023-07-24T05:47:36.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.685+0000 7f727510e700 1 -- 172.21.15.77:0/257604949 shutdown_connections 2023-07-24T05:47:36.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.685+0000 7f727510e700 1 --2- 172.21.15.77:0/257604949 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72700b13c0 0x7f72700c30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:36.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.685+0000 7f727510e700 1 --2- 172.21.15.77:0/257604949 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f725c0662f0 0x7f725c0687b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:36.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.685+0000 7f727510e700 1 --2- 172.21.15.77:0/257604949 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f72700a4580 0x7f72701540c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:36.691 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.685+0000 7f727510e700 1 --2- 172.21.15.77:0/257604949 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7270069b10 0x7f727009a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:36.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.685+0000 7f727510e700 1 -- 172.21.15.77:0/257604949 >> 172.21.15.77:0/257604949 conn(0x7f72700cacc0 msgr2=0x7f72700ae8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:36.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.685+0000 7f727510e700 1 -- 172.21.15.77:0/257604949 shutdown_connections 2023-07-24T05:47:36.692 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.685+0000 7f727510e700 1 -- 172.21.15.77:0/257604949 wait complete. 2023-07-24T05:47:36.714 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-24T05:47:36.714 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-24T05:47:36.884 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.877+0000 7f1a7359e700 1 Processor -- start 2023-07-24T05:47:36.885 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.881+0000 7f1a7359e700 1 -- start start 2023-07-24T05:47:36.888 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.881+0000 7f1a7359e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1a7415ca00 0x7f1a740d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:36.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.881+0000 7f1a7359e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1a7406d450 0x7f1a740b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:36.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.881+0000 7f1a7359e700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1a740b4630 0x7f1a740b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:36.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.881+0000 7f1a7359e700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a740b4ac0 con 0x7f1a740b4630 2023-07-24T05:47:36.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.881+0000 7f1a7359e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a740d0300 con 0x7f1a7406d450 2023-07-24T05:47:36.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.881+0000 7f1a7359e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7415cde0 con 0x7f1a7415ca00 2023-07-24T05:47:36.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.885+0000 7f1a72d9d700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1a740b4630 0x7f1a740b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:36.890 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.885+0000 7f1a72d9d700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1a740b4630 0x7f1a740b11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46732/0 (socket says 172.21.15.77:46732) 2023-07-24T05:47:36.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.885+0000 7f1a72d9d700 1 -- 172.21.15.77:0/104814167 learned_addr learned my addr 172.21.15.77:0/104814167 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:36.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.885+0000 7f1a7259c700 1 --2- 172.21.15.77:0/104814167 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1a7415ca00 0x7f1a740d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:36.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.885+0000 7f1a71d9b700 1 --2- 172.21.15.77:0/104814167 >> v2:172.21.15.103:3300/0 conn(0x7f1a7406d450 0x7f1a740b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:36.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.885+0000 7f1a72d9d700 1 -- 172.21.15.77:0/104814167 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1a7415ca00 msgr2=0x7f1a740d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:36.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.885+0000 7f1a72d9d700 1 --2- 172.21.15.77:0/104814167 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1a7415ca00 0x7f1a740d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:36.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.885+0000 7f1a72d9d700 1 -- 172.21.15.77:0/104814167 >> v2:172.21.15.103:3300/0 conn(0x7f1a7406d450 msgr2=0x7f1a740b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:36.891 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.885+0000 7f1a72d9d700 1 --2- 172.21.15.77:0/104814167 >> v2:172.21.15.103:3300/0 conn(0x7f1a7406d450 0x7f1a740b40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:36.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.885+0000 7f1a72d9d700 1 -- 172.21.15.77:0/104814167 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a740d2870 con 0x7f1a740b4630 2023-07-24T05:47:36.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.885+0000 7f1a7259c700 1 --2- 172.21.15.77:0/104814167 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1a7415ca00 0x7f1a740d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:36.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.885+0000 7f1a72d9d700 1 --2- 172.21.15.77:0/104814167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a740b4630 0x7f1a740b11e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f1a740b51c0 tx=0x7f1a6c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a26b7c6d73c0724c server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:36.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.885+0000 7f1a7159a700 1 -- 172.21.15.77:0/104814167 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c00e070 con 0x7f1a740b4630 2023-07-24T05:47:36.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.885+0000 7f1a7159a700 1 -- 172.21.15.77:0/104814167 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a6c00b9c0 con 0x7f1a740b4630 2023-07-24T05:47:36.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.885+0000 7f1a7159a700 1 -- 172.21.15.77:0/104814167 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c00bd70 con 0x7f1a740b4630 2023-07-24T05:47:36.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.885+0000 7f1a7359e700 1 -- 172.21.15.77:0/104814167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a740b4630 msgr2=0x7f1a740b11e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:36.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.885+0000 7f1a7359e700 1 --2- 172.21.15.77:0/104814167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a740b4630 0x7f1a740b11e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f1a740b51c0 tx=0x7f1a6c00b330 comp rx=0 tx=0).stop 2023-07-24T05:47:36.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.885+0000 7f1a7359e700 1 -- 172.21.15.77:0/104814167 shutdown_connections 2023-07-24T05:47:36.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.885+0000 7f1a7359e700 1 --2- 172.21.15.77:0/104814167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a740b4630 0x7f1a740b11e0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:36.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.885+0000 7f1a7359e700 1 --2- 172.21.15.77:0/104814167 >> v2:172.21.15.103:3300/0 conn(0x7f1a7406d450 0x7f1a740b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:36.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.885+0000 7f1a7359e700 1 --2- 172.21.15.77:0/104814167 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1a7415ca00 0x7f1a740d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:36.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.885+0000 7f1a7359e700 1 -- 172.21.15.77:0/104814167 >> 172.21.15.77:0/104814167 conn(0x7f1a740b7610 msgr2=0x7f1a740b7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:36.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.885+0000 7f1a7359e700 1 -- 172.21.15.77:0/104814167 shutdown_connections 2023-07-24T05:47:36.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.885+0000 7f1a7359e700 1 -- 172.21.15.77:0/104814167 wait complete. 2023-07-24T05:47:36.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.889+0000 7f1a7359e700 1 Processor -- start 2023-07-24T05:47:36.895 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.889+0000 7f1a7359e700 1 -- start start 2023-07-24T05:47:36.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.889+0000 7f1a7359e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a7406d450 0x7f1a7414de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:36.896 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.889+0000 7f1a7359e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1a740b4630 0x7f1a740c8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:36.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.889+0000 7f1a7359e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a7415ca00 0x7f1a740c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:36.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.889+0000 7f1a7359e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a740c7050 con 0x7f1a7415ca00 2023-07-24T05:47:36.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.889+0000 7f1a7359e700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a740c7330 con 0x7f1a7406d450 2023-07-24T05:47:36.897 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.889+0000 7f1a7359e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a740c7610 con 0x7f1a740b4630 2023-07-24T05:47:36.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.889+0000 7f1a72d9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a7415ca00 0x7f1a740c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:36.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.893+0000 7f1a72d9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a7415ca00 0x7f1a740c8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46740/0 (socket says 172.21.15.77:46740) 2023-07-24T05:47:36.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.893+0000 7f1a72d9d700 1 -- 172.21.15.77:0/4008440111 learned_addr learned my addr 172.21.15.77:0/4008440111 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:36.898 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.893+0000 7f1a7259c700 1 --2- 172.21.15.77:0/4008440111 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a7406d450 0x7f1a7414de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:36.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.893+0000 7f1a71d9b700 1 --2- 172.21.15.77:0/4008440111 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1a740b4630 0x7f1a740c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:36.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.893+0000 7f1a72d9d700 1 -- 172.21.15.77:0/4008440111 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1a740b4630 msgr2=0x7f1a740c8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:36.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.893+0000 7f1a72d9d700 1 --2- 172.21.15.77:0/4008440111 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1a740b4630 0x7f1a740c8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:36.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.893+0000 7f1a72d9d700 1 -- 172.21.15.77:0/4008440111 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a7406d450 msgr2=0x7f1a7414de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:36.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.893+0000 7f1a72d9d700 1 --2- 172.21.15.77:0/4008440111 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a7406d450 0x7f1a7414de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:36.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.893+0000 7f1a72d9d700 1 -- 172.21.15.77:0/4008440111 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a6c009b30 con 0x7f1a7415ca00 2023-07-24T05:47:36.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.893+0000 7f1a72d9d700 1 --2- 172.21.15.77:0/4008440111 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a7415ca00 0x7f1a740c8b60 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1a7408c900 tx=0x7f1a6c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:36.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.893+0000 7f1a62ffd700 1 -- 172.21.15.77:0/4008440111 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c0099b0 con 0x7f1a7415ca00 2023-07-24T05:47:36.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.893+0000 7f1a62ffd700 1 -- 172.21.15.77:0/4008440111 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a6c004250 con 0x7f1a7415ca00 2023-07-24T05:47:36.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.893+0000 7f1a7359e700 1 -- 172.21.15.77:0/4008440111 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a740c78f0 con 0x7f1a7415ca00 2023-07-24T05:47:36.900 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.893+0000 7f1a62ffd700 1 -- 172.21.15.77:0/4008440111 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c0045e0 con 0x7f1a7415ca00 2023-07-24T05:47:36.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.893+0000 7f1a7359e700 1 -- 172.21.15.77:0/4008440111 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a740c62f0 con 0x7f1a7415ca00 2023-07-24T05:47:36.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.893+0000 7f1a7359e700 1 -- 172.21.15.77:0/4008440111 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a74072490 con 0x7f1a7415ca00 2023-07-24T05:47:36.901 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.897+0000 7f1a62ffd700 1 -- 172.21.15.77:0/4008440111 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1a6c004740 con 0x7f1a7415ca00 2023-07-24T05:47:36.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.897+0000 7f1a62ffd700 1 --2- 172.21.15.77:0/4008440111 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f1a540662f0 0x7f1a540687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:36.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.897+0000 7f1a62ffd700 1 -- 172.21.15.77:0/4008440111 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1a6c085520 con 0x7f1a7415ca00 2023-07-24T05:47:36.903 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.897+0000 7f1a7259c700 1 --2- 172.21.15.77:0/4008440111 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f1a540662f0 0x7f1a540687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:36.904 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.897+0000 7f1a7259c700 1 --2- 172.21.15.77:0/4008440111 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f1a540662f0 0x7f1a540687b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1a640099e0 tx=0x7f1a64008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:36.908 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:36.901+0000 7f1a62ffd700 1 -- 172.21.15.77:0/4008440111 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1a6c052660 con 0x7f1a7415ca00 2023-07-24T05:47:37.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.108+0000 7f1a7359e700 1 -- 172.21.15.77:0/4008440111 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a740d33c0 con 0x7f1a7415ca00 2023-07-24T05:47:37.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.112+0000 7f1a62ffd700 1 -- 172.21.15.77:0/4008440111 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f1a6c055c80 con 0x7f1a7415ca00 2023-07-24T05:47:37.118 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:47:37.119 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/4201639271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4201639271},{"type":"v1","addr":"172.21.15.77:6834","nonce":4201639271}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/993116623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":993116623},{"type":"v1","addr":"172.21.15.103:6835","nonce":993116623}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/1196529067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":1196529067},{"type":"v1","addr":"172.21.15.103:6837","nonce":1196529067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-24T05:46:00.395327+0000","modified":"2023-07-24T05:46:27.438873+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6835/2428690206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2428690206},{"type":"v1","addr":"172.21.15.77:6835","nonce":2428690206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-24T05:47:37.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.112+0000 7f1a7359e700 1 -- 172.21.15.77:0/4008440111 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f1a540662f0 msgr2=0x7f1a540687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:37.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.112+0000 7f1a7359e700 1 --2- 172.21.15.77:0/4008440111 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f1a540662f0 0x7f1a540687b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1a640099e0 tx=0x7f1a64008040 comp rx=0 tx=0).stop 2023-07-24T05:47:37.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.112+0000 7f1a7359e700 1 -- 172.21.15.77:0/4008440111 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a7415ca00 msgr2=0x7f1a740c8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:37.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.112+0000 7f1a7359e700 1 --2- 172.21.15.77:0/4008440111 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a7415ca00 0x7f1a740c8b60 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1a7408c900 tx=0x7f1a6c004af0 comp rx=0 tx=0).stop 2023-07-24T05:47:37.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.112+0000 7f1a7359e700 1 -- 172.21.15.77:0/4008440111 shutdown_connections 2023-07-24T05:47:37.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.112+0000 7f1a7359e700 1 --2- 172.21.15.77:0/4008440111 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a7415ca00 0x7f1a740c8b60 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:37.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.112+0000 7f1a7359e700 1 --2- 172.21.15.77:0/4008440111 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f1a540662f0 0x7f1a540687b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:37.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.112+0000 7f1a7359e700 1 --2- 172.21.15.77:0/4008440111 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1a740b4630 0x7f1a740c8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:37.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.112+0000 7f1a7359e700 1 --2- 172.21.15.77:0/4008440111 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a7406d450 0x7f1a7414de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:37.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.112+0000 7f1a7359e700 1 -- 172.21.15.77:0/4008440111 >> 172.21.15.77:0/4008440111 conn(0x7f1a740b7610 msgr2=0x7f1a7415aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:37.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.116+0000 7f1a7359e700 1 -- 172.21.15.77:0/4008440111 shutdown_connections 2023-07-24T05:47:37.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.116+0000 7f1a7359e700 1 -- 172.21.15.77:0/4008440111 wait complete. 2023-07-24T05:47:37.123 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 9 2023-07-24T05:47:37.142 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-24T05:47:37.312 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.304+0000 7fe290fca700 1 Processor -- start 2023-07-24T05:47:37.313 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.304+0000 7fe290fca700 1 -- start start 2023-07-24T05:47:37.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.308+0000 7fe290fca700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe28c13d6e0 0x7fe28c13dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:37.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.308+0000 7fe290fca700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe28c0ce710 0x7fe28c15aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:37.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.308+0000 7fe290fca700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe28c0b2030 con 0x7fe28c0c4a20 2023-07-24T05:47:37.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.308+0000 7fe290fca700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe28c15e4c0 con 0x7fe28c13d6e0 2023-07-24T05:47:37.314 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.308+0000 7fe290fca700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c15e7a0 con 0x7fe28c0ce710 2023-07-24T05:47:37.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.308+0000 7fe28b7fe700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe28c13d6e0 0x7fe28c13dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:37.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.308+0000 7fe28b7fe700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe28c13d6e0 0x7fe28c13dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46750/0 (socket says 172.21.15.77:46750) 2023-07-24T05:47:37.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.308+0000 7fe28b7fe700 1 -- 172.21.15.77:0/2285899480 learned_addr learned my addr 172.21.15.77:0/2285899480 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:37.315 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.308+0000 7fe28bfff700 1 --2- 172.21.15.77:0/2285899480 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe28c0ce710 0x7fe28c15aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:37.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.308+0000 7fe28b7fe700 1 -- 172.21.15.77:0/2285899480 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe28c0ce710 msgr2=0x7fe28c15aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:37.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.308+0000 7fe28b7fe700 1 --2- 172.21.15.77:0/2285899480 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe28c0ce710 0x7fe28c15aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:37.316 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.308+0000 7fe28b7fe700 1 -- 172.21.15.77:0/2285899480 >> v1:172.21.15.103:6789/0 conn(0x7fe28c0c4a20 legacy=0x7fe28c0ce000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:37.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.308+0000 7fe28b7fe700 1 -- 172.21.15.77:0/2285899480 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe28c15ea80 con 0x7fe28c13d6e0 2023-07-24T05:47:37.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.308+0000 7fe28b7fe700 1 --2- 172.21.15.77:0/2285899480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe28c13d6e0 0x7fe28c13dc50 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe27c009910 tx=0x7fe27c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edad2721cf177bc3 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:37.317 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.308+0000 7fe28a7fc700 1 -- 172.21.15.77:0/2285899480 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c011830 con 0x7fe28c13d6e0 2023-07-24T05:47:37.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.312+0000 7fe28a7fc700 1 -- 172.21.15.77:0/2285899480 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27c011990 con 0x7fe28c13d6e0 2023-07-24T05:47:37.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.312+0000 7fe28a7fc700 1 -- 172.21.15.77:0/2285899480 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c011d40 con 0x7fe28c13d6e0 2023-07-24T05:47:37.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.312+0000 7fe290fca700 1 -- 172.21.15.77:0/2285899480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe28c13d6e0 msgr2=0x7fe28c13dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:37.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.312+0000 7fe290fca700 1 --2- 172.21.15.77:0/2285899480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe28c13d6e0 0x7fe28c13dc50 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe27c009910 tx=0x7fe27c009c20 comp rx=0 tx=0).stop 2023-07-24T05:47:37.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.312+0000 7fe290fca700 1 -- 172.21.15.77:0/2285899480 shutdown_connections 2023-07-24T05:47:37.318 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.312+0000 7fe290fca700 1 --2- 172.21.15.77:0/2285899480 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe28c0ce710 0x7fe28c15aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:37.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.312+0000 7fe290fca700 1 --2- 172.21.15.77:0/2285899480 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe28c13d6e0 0x7fe28c13dc50 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:37.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.312+0000 7fe290fca700 1 -- 172.21.15.77:0/2285899480 >> 172.21.15.77:0/2285899480 conn(0x7fe28c06ebc0 msgr2=0x7fe28c06efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:37.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.312+0000 7fe290fca700 1 -- 172.21.15.77:0/2285899480 shutdown_connections 2023-07-24T05:47:37.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.312+0000 7fe290fca700 1 -- 172.21.15.77:0/2285899480 wait complete. 2023-07-24T05:47:37.319 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.312+0000 7fe290fca700 1 Processor -- start 2023-07-24T05:47:37.320 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.312+0000 7fe290fca700 1 -- start start 2023-07-24T05:47:37.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.316+0000 7fe290fca700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe28c0c4a20 0x7fe28c13cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:37.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.316+0000 7fe290fca700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe28c0ce710 0x7fe28c13eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:37.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.316+0000 7fe290fca700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe28c13d6e0 0x7fe28c13f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:37.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.316+0000 7fe290fca700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c13d290 con 0x7fe28c0c4a20 2023-07-24T05:47:37.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.316+0000 7fe290fca700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c1f1d80 con 0x7fe28c0ce710 2023-07-24T05:47:37.321 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.316+0000 7fe290fca700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe28c1f2010 con 0x7fe28c13d6e0 2023-07-24T05:47:37.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.316+0000 7fe28b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe28c0c4a20 0x7fe28c13cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:37.322 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.316+0000 7fe28b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe28c0c4a20 0x7fe28c13cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46762/0 (socket says 172.21.15.77:46762) 2023-07-24T05:47:37.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.316+0000 7fe28b7fe700 1 -- 172.21.15.77:0/1244785191 learned_addr learned my addr 172.21.15.77:0/1244785191 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:37.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.316+0000 7fe28bfff700 1 --2- 172.21.15.77:0/1244785191 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe28c13d6e0 0x7fe28c13f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:37.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.316+0000 7fe28affd700 1 --2- 172.21.15.77:0/1244785191 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe28c0ce710 0x7fe28c13eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:37.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.316+0000 7fe28b7fe700 1 -- 172.21.15.77:0/1244785191 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe28c13d6e0 msgr2=0x7fe28c13f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:37.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.316+0000 7fe28b7fe700 1 --2- 172.21.15.77:0/1244785191 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe28c13d6e0 0x7fe28c13f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:37.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.316+0000 7fe28b7fe700 1 -- 172.21.15.77:0/1244785191 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe28c0ce710 msgr2=0x7fe28c13eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:37.323 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.316+0000 7fe28b7fe700 1 --2- 172.21.15.77:0/1244785191 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe28c0ce710 0x7fe28c13eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:37.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.316+0000 7fe28b7fe700 1 -- 172.21.15.77:0/1244785191 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe27c009570 con 0x7fe28c0c4a20 2023-07-24T05:47:37.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.316+0000 7fe28b7fe700 1 --2- 172.21.15.77:0/1244785191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe28c0c4a20 0x7fe28c13cd50 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe28c071f00 tx=0x7fe27c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:37.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.316+0000 7fe273fff700 1 -- 172.21.15.77:0/1244785191 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c004510 con 0x7fe28c0c4a20 2023-07-24T05:47:37.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.316+0000 7fe273fff700 1 -- 172.21.15.77:0/1244785191 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27c01e070 con 0x7fe28c0c4a20 2023-07-24T05:47:37.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.316+0000 7fe273fff700 1 -- 172.21.15.77:0/1244785191 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c003900 con 0x7fe28c0c4a20 2023-07-24T05:47:37.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.316+0000 7fe290fca700 1 -- 172.21.15.77:0/1244785191 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe28c1f22f0 con 0x7fe28c0c4a20 2023-07-24T05:47:37.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.316+0000 7fe290fca700 1 -- 172.21.15.77:0/1244785191 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe28c1f28b0 con 0x7fe28c0c4a20 2023-07-24T05:47:37.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.316+0000 7fe290fca700 1 -- 172.21.15.77:0/1244785191 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe28c072490 con 0x7fe28c0c4a20 2023-07-24T05:47:37.326 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.320+0000 7fe273fff700 1 -- 172.21.15.77:0/1244785191 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe27c003a60 con 0x7fe28c0c4a20 2023-07-24T05:47:37.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.320+0000 7fe273fff700 1 --2- 172.21.15.77:0/1244785191 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe278066320 0x7fe2780687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:37.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.324+0000 7fe273fff700 1 -- 172.21.15.77:0/1244785191 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe27c084c30 con 0x7fe28c0c4a20 2023-07-24T05:47:37.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.324+0000 7fe28affd700 1 --2- 172.21.15.77:0/1244785191 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe278066320 0x7fe2780687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:37.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.324+0000 7fe28affd700 1 --2- 172.21.15.77:0/1244785191 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe278066320 0x7fe2780687e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe28c0b3790 tx=0x7fe280009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:37.334 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.328+0000 7fe273fff700 1 -- 172.21.15.77:0/1244785191 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe27c051e10 con 0x7fe28c0c4a20 2023-07-24T05:47:37.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.532+0000 7fe290fca700 1 -- 172.21.15.77:0/1244785191 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe28c06a810 con 0x7fe28c0c4a20 2023-07-24T05:47:37.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.536+0000 7fe273fff700 1 -- 172.21.15.77:0/1244785191 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7fe27c020090 con 0x7fe28c0c4a20 2023-07-24T05:47:37.541 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:47:37.542 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/4201639271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":4201639271},{"type":"v1","addr":"172.21.15.77:6834","nonce":4201639271}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/993116623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":993116623},{"type":"v1","addr":"172.21.15.103:6835","nonce":993116623}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/1196529067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":1196529067},{"type":"v1","addr":"172.21.15.103:6837","nonce":1196529067}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-24T05:46:00.395327+0000","modified":"2023-07-24T05:46:27.438873+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.77:6835/2428690206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":2428690206},{"type":"v1","addr":"172.21.15.77:6835","nonce":2428690206}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-24T05:47:37.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.536+0000 7fe290fca700 1 -- 172.21.15.77:0/1244785191 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe278066320 msgr2=0x7fe2780687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:37.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.536+0000 7fe290fca700 1 --2- 172.21.15.77:0/1244785191 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe278066320 0x7fe2780687e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe28c0b3790 tx=0x7fe280009040 comp rx=0 tx=0).stop 2023-07-24T05:47:37.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.536+0000 7fe290fca700 1 -- 172.21.15.77:0/1244785191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe28c0c4a20 msgr2=0x7fe28c13cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:37.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.536+0000 7fe290fca700 1 --2- 172.21.15.77:0/1244785191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe28c0c4a20 0x7fe28c13cd50 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe28c071f00 tx=0x7fe27c004770 comp rx=0 tx=0).stop 2023-07-24T05:47:37.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.536+0000 7fe290fca700 1 -- 172.21.15.77:0/1244785191 shutdown_connections 2023-07-24T05:47:37.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.536+0000 7fe290fca700 1 --2- 172.21.15.77:0/1244785191 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe278066320 0x7fe2780687e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:37.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.536+0000 7fe290fca700 1 --2- 172.21.15.77:0/1244785191 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe28c13d6e0 0x7fe28c13f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:37.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.536+0000 7fe290fca700 1 --2- 172.21.15.77:0/1244785191 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe28c0ce710 0x7fe28c13eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:37.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.536+0000 7fe290fca700 1 --2- 172.21.15.77:0/1244785191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe28c0c4a20 0x7fe28c13cd50 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:37.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.536+0000 7fe290fca700 1 -- 172.21.15.77:0/1244785191 >> 172.21.15.77:0/1244785191 conn(0x7fe28c06ebc0 msgr2=0x7fe28c15d720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:37.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.536+0000 7fe290fca700 1 -- 172.21.15.77:0/1244785191 shutdown_connections 2023-07-24T05:47:37.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.536+0000 7fe290fca700 1 -- 172.21.15.77:0/1244785191 wait complete. 2023-07-24T05:47:37.547 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 9 2023-07-24T05:47:37.565 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-24T05:47:37.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.728+0000 7f668bd56700 1 Processor -- start 2023-07-24T05:47:37.737 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.728+0000 7f668bd56700 1 -- start start 2023-07-24T05:47:37.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.732+0000 7f668bd56700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f668406cac0 0x7f668406cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:37.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.732+0000 7f668bd56700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f668415e4c0 0x7f668415e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:37.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.732+0000 7f668bd56700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f668406bb60 con 0x7f6684069b10 2023-07-24T05:47:37.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.732+0000 7f668bd56700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f668415ee60 con 0x7f668415e4c0 2023-07-24T05:47:37.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.732+0000 7f668bd56700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f668415f380 con 0x7f668406cac0 2023-07-24T05:47:37.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.732+0000 7f66892f1700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f668415e4c0 0x7f668415e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:37.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.732+0000 7f6689af2700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f668406cac0 0x7f668406cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:37.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.732+0000 7f6689af2700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f668406cac0 0x7f668406cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.77:48696/0 (socket says 172.21.15.77:48696) 2023-07-24T05:47:37.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.732+0000 7f66892f1700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f668415e4c0 0x7f668415e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46772/0 (socket says 172.21.15.77:46772) 2023-07-24T05:47:37.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.732+0000 7f6689af2700 1 -- 172.21.15.77:0/3966259938 learned_addr learned my addr 172.21.15.77:0/3966259938 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:37.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.732+0000 7f6689af2700 1 -- 172.21.15.77:0/3966259938 >> v2:172.21.15.77:3300/0 conn(0x7f668415e4c0 msgr2=0x7f668415e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:37.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.732+0000 7f6689af2700 1 --2- 172.21.15.77:0/3966259938 >> v2:172.21.15.77:3300/0 conn(0x7f668415e4c0 0x7f668415e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:37.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.732+0000 7f6689af2700 1 -- 172.21.15.77:0/3966259938 >> v1:172.21.15.103:6789/0 conn(0x7f6684069b10 legacy=0x7f6684069fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:37.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.732+0000 7f6689af2700 1 -- 172.21.15.77:0/3966259938 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66840cb950 con 0x7f668406cac0 2023-07-24T05:47:37.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.732+0000 7f6689af2700 1 --2- 172.21.15.77:0/3966259938 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f668406cac0 0x7f668406cea0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6680009ea0 tx=0x7f668000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=669ee65c79d19dbf server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:37.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.736+0000 7f6688af0700 1 -- 172.21.15.77:0/3966259938 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668000e070 con 0x7f668406cac0 2023-07-24T05:47:37.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.736+0000 7f6688af0700 1 -- 172.21.15.77:0/3966259938 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66800090d0 con 0x7f668406cac0 2023-07-24T05:47:37.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.736+0000 7f6688af0700 1 -- 172.21.15.77:0/3966259938 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668000bb50 con 0x7f668406cac0 2023-07-24T05:47:37.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.736+0000 7f668bd56700 1 -- 172.21.15.77:0/3966259938 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f668406cac0 msgr2=0x7f668406cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:37.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.736+0000 7f668bd56700 1 --2- 172.21.15.77:0/3966259938 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f668406cac0 0x7f668406cea0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6680009ea0 tx=0x7f668000b330 comp rx=0 tx=0).stop 2023-07-24T05:47:37.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.736+0000 7f668bd56700 1 -- 172.21.15.77:0/3966259938 shutdown_connections 2023-07-24T05:47:37.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.736+0000 7f668bd56700 1 --2- 172.21.15.77:0/3966259938 >> v2:172.21.15.77:3300/0 conn(0x7f668415e4c0 0x7f668415e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:37.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.736+0000 7f668bd56700 1 --2- 172.21.15.77:0/3966259938 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f668406cac0 0x7f668406cea0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:37.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.736+0000 7f668bd56700 1 -- 172.21.15.77:0/3966259938 >> 172.21.15.77:0/3966259938 conn(0x7f66840ce410 msgr2=0x7f66840ce7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:37.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.736+0000 7f668bd56700 1 -- 172.21.15.77:0/3966259938 shutdown_connections 2023-07-24T05:47:37.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.736+0000 7f668bd56700 1 -- 172.21.15.77:0/3966259938 wait complete. 2023-07-24T05:47:37.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.740+0000 7f668bd56700 1 Processor -- start 2023-07-24T05:47:37.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.740+0000 7f668bd56700 1 -- start start 2023-07-24T05:47:37.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.740+0000 7f668bd56700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6684069b10 0x7f66840c54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:37.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.740+0000 7f668bd56700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f668406cac0 0x7f6684157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:37.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.740+0000 7f668bd56700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f668415e4c0 0x7f6684097940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:37.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.740+0000 7f668bd56700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66840c87f0 con 0x7f668406cac0 2023-07-24T05:47:37.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.740+0000 7f668bd56700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66840c31b0 con 0x7f668415e4c0 2023-07-24T05:47:37.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.740+0000 7f668bd56700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6684097e80 con 0x7f6684069b10 2023-07-24T05:47:37.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.740+0000 7f66892f1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f668406cac0 0x7f6684157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:37.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.740+0000 7f66892f1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f668406cac0 0x7f6684157830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46780/0 (socket says 172.21.15.77:46780) 2023-07-24T05:47:37.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.740+0000 7f66892f1700 1 -- 172.21.15.77:0/3111634417 learned_addr learned my addr 172.21.15.77:0/3111634417 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:37.749 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.740+0000 7f6689af2700 1 --2- 172.21.15.77:0/3111634417 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6684069b10 0x7f66840c54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:37.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.740+0000 7f668a2f3700 1 --2- 172.21.15.77:0/3111634417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f668415e4c0 0x7f6684097940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:37.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.740+0000 7f66892f1700 1 -- 172.21.15.77:0/3111634417 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6684069b10 msgr2=0x7f66840c54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:37.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.740+0000 7f66892f1700 1 --2- 172.21.15.77:0/3111634417 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6684069b10 0x7f66840c54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:37.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.740+0000 7f66892f1700 1 -- 172.21.15.77:0/3111634417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f668415e4c0 msgr2=0x7f6684097940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:37.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.740+0000 7f66892f1700 1 --2- 172.21.15.77:0/3111634417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f668415e4c0 0x7f6684097940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:37.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.744+0000 7f66892f1700 1 -- 172.21.15.77:0/3111634417 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6680009b30 con 0x7f668406cac0 2023-07-24T05:47:37.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.744+0000 7f668a2f3700 1 --2- 172.21.15.77:0/3111634417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f668415e4c0 0x7f6684097940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:37.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.744+0000 7f66892f1700 1 --2- 172.21.15.77:0/3111634417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f668406cac0 0x7f6684157830 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f667400e870 tx=0x7f667400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:37.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.744+0000 7f667a7fc700 1 -- 172.21.15.77:0/3111634417 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66740095a0 con 0x7f668406cac0 2023-07-24T05:47:37.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.744+0000 7f667a7fc700 1 -- 172.21.15.77:0/3111634417 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6674013680 con 0x7f668406cac0 2023-07-24T05:47:37.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.744+0000 7f667a7fc700 1 -- 172.21.15.77:0/3111634417 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66740139f0 con 0x7f668406cac0 2023-07-24T05:47:37.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.744+0000 7f668bd56700 1 -- 172.21.15.77:0/3111634417 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66840c8510 con 0x7f668406cac0 2023-07-24T05:47:37.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.744+0000 7f668bd56700 1 -- 172.21.15.77:0/3111634417 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66840c2dd0 con 0x7f668406cac0 2023-07-24T05:47:37.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.744+0000 7f668bd56700 1 -- 172.21.15.77:0/3111634417 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66840c3420 con 0x7f668406cac0 2023-07-24T05:47:37.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.748+0000 7f667a7fc700 1 -- 172.21.15.77:0/3111634417 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6674013b50 con 0x7f668406cac0 2023-07-24T05:47:37.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.748+0000 7f667a7fc700 1 --2- 172.21.15.77:0/3111634417 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f66680662f0 0x7f66680687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:37.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.748+0000 7f667a7fc700 1 -- 172.21.15.77:0/3111634417 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6674083fe0 con 0x7f668406cac0 2023-07-24T05:47:37.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.748+0000 7f6689af2700 1 --2- 172.21.15.77:0/3111634417 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f66680662f0 0x7f66680687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:37.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.752+0000 7f6689af2700 1 --2- 172.21.15.77:0/3111634417 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f66680662f0 0x7f66680687b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6680000f80 tx=0x7f6680009000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:37.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.756+0000 7f667a7fc700 1 -- 172.21.15.77:0/3111634417 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6674051090 con 0x7f668406cac0 2023-07-24T05:47:37.932 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.924+0000 7f668bd56700 1 -- 172.21.15.77:0/3111634417 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66840c2f90 con 0x7f668406cac0 2023-07-24T05:47:37.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.928+0000 7f667a7fc700 1 -- 172.21.15.77:0/3111634417 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20204 (secure 0 0 0) 0x7f66740546b0 con 0x7f668406cac0 2023-07-24T05:47:37.936 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:47:37.937 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":27,"fsid":"5aed5f7b-fb55-4d95-9c02-c6adbb1677b4","created":"2023-07-24T05:45:39.639731+0000","modified":"2023-07-24T05:46:48.442117+0000","last_up_change":"2023-07-24T05:45:52.319670+0000","last_in_change":"2023-07-24T05:45:43.643277+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-24T05:45:52.610430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-24T05:45:52.773787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-24T05:45:58.121732+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-24T05:45:59.368726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-07-24T05:46:03.032057+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ffa0d496-461a-4053-b764-0627d969521b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6812","nonce":825987196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6817","nonce":825987196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6831","nonce":825987196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6824","nonce":825987196}]},"public_addr":"172.21.15.77:6812/825987196","cluster_addr":"172.21.15.77:6817/825987196","heartbeat_back_addr":"172.21.15.77:6831/825987196","heartbeat_front_addr":"172.21.15.77:6824/825987196","state":["exists","up"]},{"osd":1,"uuid":"9f595e5e-5c43-49bc-8ce4-ee70575c90da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6801","nonce":4133026815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6803","nonce":4133026815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6807","nonce":4133026815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6805","nonce":4133026815}]},"public_addr":"172.21.15.77:6801/4133026815","cluster_addr":"172.21.15.77:6803/4133026815","heartbeat_back_addr":"172.21.15.77:6807/4133026815","heartbeat_front_addr":"172.21.15.77:6805/4133026815","state":["exists","up"]},{"osd":2,"uuid":"2ac177aa-4d7d-4262-bd54-d2b9f29f4c3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6811","nonce":2394142159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6819","nonce":2394142159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6830","nonce":2394142159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6825","nonce":2394142159}]},"public_addr":"172.21.15.77:6811/2394142159","cluster_addr":"172.21.15.77:6819/2394142159","heartbeat_back_addr":"172.21.15.77:6830/2394142159","heartbeat_front_addr":"172.21.15.77:6825/2394142159","state":["exists","up"]},{"osd":3,"uuid":"17d7a251-19e8-484c-8172-a578ab3da153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6813","nonce":1492113982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6818","nonce":1492113982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6829","nonce":1492113982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6823","nonce":1492113982}]},"public_addr":"172.21.15.77:6813/1492113982","cluster_addr":"172.21.15.77:6818/1492113982","heartbeat_back_addr":"172.21.15.77:6829/1492113982","heartbeat_front_addr":"172.21.15.77:6823/1492113982","state":["exists","up"]},{"osd":4,"uuid":"bf63ca05-f06d-4e0f-ac44-2a416c70b919","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6825","nonce":1080481057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6827","nonce":1080481057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6831","nonce":1080481057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6829","nonce":1080481057}]},"public_addr":"172.21.15.103:6825/1080481057","cluster_addr":"172.21.15.103:6827/1080481057","heartbeat_back_addr":"172.21.15.103:6831/1080481057","heartbeat_front_addr":"172.21.15.103:6829/1080481057","state":["exists","up"]},{"osd":5,"uuid":"65a11a35-9e9f-4b3c-9fe3-b658d62b9318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6811","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6813","nonce":2756677504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6818","nonce":2756677504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6823","nonce":2756677504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6821","nonce":2756677504}]},"public_addr":"172.21.15.103:6813/2756677504","cluster_addr":"172.21.15.103:6818/2756677504","heartbeat_back_addr":"172.21.15.103:6823/2756677504","heartbeat_front_addr":"172.21.15.103:6821/2756677504","state":["exists","up"]},{"osd":6,"uuid":"750c1f87-686c-40b4-94a1-1a299dc78f3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6809","nonce":568977764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6812","nonce":568977764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6819","nonce":568977764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6815","nonce":568977764}]},"public_addr":"172.21.15.103:6809/568977764","cluster_addr":"172.21.15.103:6812/568977764","heartbeat_back_addr":"172.21.15.103:6819/568977764","heartbeat_front_addr":"172.21.15.103:6815/568977764","state":["exists","up"]},{"osd":7,"uuid":"d5fe4fb6-2e09-4158-885b-403803c85822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6801","nonce":1074557176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6803","nonce":1074557176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6807","nonce":1074557176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6805","nonce":1074557176}]},"public_addr":"172.21.15.103:6801/1074557176","cluster_addr":"172.21.15.103:6803/1074557176","heartbeat_back_addr":"172.21.15.103:6807/1074557176","heartbeat_front_addr":"172.21.15.103:6805/1074557176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.631032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.154109+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.398587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.679089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.311218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.353726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.314372+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.126212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.1d","mappings":[{"from":3,"to":2}]},{"pgid":"4.31","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-24T05:47:37.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.932+0000 7f668bd56700 1 -- 172.21.15.77:0/3111634417 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f66680662f0 msgr2=0x7f66680687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:37.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.932+0000 7f668bd56700 1 --2- 172.21.15.77:0/3111634417 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f66680662f0 0x7f66680687b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6680000f80 tx=0x7f6680009000 comp rx=0 tx=0).stop 2023-07-24T05:47:37.939 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.932+0000 7f668bd56700 1 -- 172.21.15.77:0/3111634417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f668406cac0 msgr2=0x7f6684157830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:37.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.932+0000 7f668bd56700 1 --2- 172.21.15.77:0/3111634417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f668406cac0 0x7f6684157830 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f667400e870 tx=0x7f667400eb80 comp rx=0 tx=0).stop 2023-07-24T05:47:37.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.932+0000 7f668bd56700 1 -- 172.21.15.77:0/3111634417 shutdown_connections 2023-07-24T05:47:37.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.932+0000 7f668bd56700 1 --2- 172.21.15.77:0/3111634417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f668415e4c0 0x7f6684097940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:37.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.932+0000 7f668bd56700 1 --2- 172.21.15.77:0/3111634417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f668406cac0 0x7f6684157830 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:37.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.932+0000 7f668bd56700 1 --2- 172.21.15.77:0/3111634417 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f66680662f0 0x7f66680687b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:37.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.932+0000 7f668bd56700 1 --2- 172.21.15.77:0/3111634417 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f6684069b10 0x7f66840c54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:37.940 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.932+0000 7f668bd56700 1 -- 172.21.15.77:0/3111634417 >> 172.21.15.77:0/3111634417 conn(0x7f66840ce410 msgr2=0x7f6684071750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:37.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.932+0000 7f668bd56700 1 -- 172.21.15.77:0/3111634417 shutdown_connections 2023-07-24T05:47:37.941 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:37.932+0000 7f668bd56700 1 -- 172.21.15.77:0/3111634417 wait complete. 2023-07-24T05:47:37.959 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-24T05:47:38.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.124+0000 7f43f42eb700 1 Processor -- start 2023-07-24T05:47:38.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.124+0000 7f43f42eb700 1 -- start start 2023-07-24T05:47:38.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.124+0000 7f43f42eb700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f43ec160350 0x7f43ec0ad870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:38.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.124+0000 7f43f42eb700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f43ec0ad320 0x7f43ec0c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:38.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.124+0000 7f43f42eb700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f43ec06ccf0 0x7f43ec06d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:38.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.124+0000 7f43f42eb700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43ec0ccc20 con 0x7f43ec160350 2023-07-24T05:47:38.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.124+0000 7f43f42eb700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43ec06d6c0 con 0x7f43ec06ccf0 2023-07-24T05:47:38.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.124+0000 7f43f42eb700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec0cb870 con 0x7f43ec0ad320 2023-07-24T05:47:38.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.128+0000 7f43f2087700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f43ec160350 0x7f43ec0ad870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:38.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.128+0000 7f43f2087700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f43ec160350 0x7f43ec0ad870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46790/0 (socket says 172.21.15.77:46790) 2023-07-24T05:47:38.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.128+0000 7f43f2087700 1 -- 172.21.15.77:0/3606211353 learned_addr learned my addr 172.21.15.77:0/3606211353 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:38.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.128+0000 7f43f2888700 1 --2- 172.21.15.77:0/3606211353 >> v2:172.21.15.103:3300/0 conn(0x7f43ec06ccf0 0x7f43ec06d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:38.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.128+0000 7f43f1886700 1 --2- 172.21.15.77:0/3606211353 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f43ec0ad320 0x7f43ec0c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:38.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.128+0000 7f43f2087700 1 -- 172.21.15.77:0/3606211353 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f43ec0ad320 msgr2=0x7f43ec0c8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:38.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.128+0000 7f43f2087700 1 --2- 172.21.15.77:0/3606211353 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f43ec0ad320 0x7f43ec0c8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:38.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.128+0000 7f43f2087700 1 -- 172.21.15.77:0/3606211353 >> v2:172.21.15.103:3300/0 conn(0x7f43ec06ccf0 msgr2=0x7f43ec06d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:38.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.128+0000 7f43f2087700 1 --2- 172.21.15.77:0/3606211353 >> v2:172.21.15.103:3300/0 conn(0x7f43ec06ccf0 0x7f43ec06d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:38.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.128+0000 7f43f2087700 1 -- 172.21.15.77:0/3606211353 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ec0cac60 con 0x7f43ec160350 2023-07-24T05:47:38.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.128+0000 7f43f2087700 1 --2- 172.21.15.77:0/3606211353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43ec160350 0x7f43ec0ad870 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f43ec06fde0 tx=0x7f43e8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b3177de8cbf810 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:38.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.128+0000 7f43f1085700 1 -- 172.21.15.77:0/3606211353 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e8005e50 con 0x7f43ec160350 2023-07-24T05:47:38.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.128+0000 7f43f1085700 1 -- 172.21.15.77:0/3606211353 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e8006030 con 0x7f43ec160350 2023-07-24T05:47:38.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.128+0000 7f43f1085700 1 -- 172.21.15.77:0/3606211353 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e80063c0 con 0x7f43ec160350 2023-07-24T05:47:38.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.128+0000 7f43f42eb700 1 -- 172.21.15.77:0/3606211353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43ec160350 msgr2=0x7f43ec0ad870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:38.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.128+0000 7f43f42eb700 1 --2- 172.21.15.77:0/3606211353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43ec160350 0x7f43ec0ad870 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f43ec06fde0 tx=0x7f43e8009bf0 comp rx=0 tx=0).stop 2023-07-24T05:47:38.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.128+0000 7f43f42eb700 1 -- 172.21.15.77:0/3606211353 shutdown_connections 2023-07-24T05:47:38.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.128+0000 7f43f42eb700 1 --2- 172.21.15.77:0/3606211353 >> v2:172.21.15.103:3300/0 conn(0x7f43ec06ccf0 0x7f43ec06d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:38.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.128+0000 7f43f42eb700 1 --2- 172.21.15.77:0/3606211353 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f43ec0ad320 0x7f43ec0c8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:38.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.128+0000 7f43f42eb700 1 --2- 172.21.15.77:0/3606211353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43ec160350 0x7f43ec0ad870 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:38.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.128+0000 7f43f42eb700 1 -- 172.21.15.77:0/3606211353 >> 172.21.15.77:0/3606211353 conn(0x7f43ec0ce410 msgr2=0x7f43ec0ce7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:38.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.128+0000 7f43f42eb700 1 -- 172.21.15.77:0/3606211353 shutdown_connections 2023-07-24T05:47:38.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.128+0000 7f43f42eb700 1 -- 172.21.15.77:0/3606211353 wait complete. 2023-07-24T05:47:38.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.132+0000 7f43f42eb700 1 Processor -- start 2023-07-24T05:47:38.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.132+0000 7f43f42eb700 1 -- start start 2023-07-24T05:47:38.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.132+0000 7f43f42eb700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43ec06ccf0 0x7f43ec159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:38.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.132+0000 7f43f42eb700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f43ec0ad320 0x7f43ec1f69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:38.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.132+0000 7f43f42eb700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43ec160350 0x7f43ec1f7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:38.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.132+0000 7f43f42eb700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec15b770 con 0x7f43ec160350 2023-07-24T05:47:38.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.132+0000 7f43f42eb700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec1f71e0 con 0x7f43ec06ccf0 2023-07-24T05:47:38.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.132+0000 7f43f42eb700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec1f74c0 con 0x7f43ec0ad320 2023-07-24T05:47:38.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.132+0000 7f43f2888700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43ec160350 0x7f43ec1f7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:38.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.132+0000 7f43f2888700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43ec160350 0x7f43ec1f7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46800/0 (socket says 172.21.15.77:46800) 2023-07-24T05:47:38.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.132+0000 7f43f2888700 1 -- 172.21.15.77:0/2715558398 learned_addr learned my addr 172.21.15.77:0/2715558398 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:38.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.136+0000 7f43f2087700 1 --2- 172.21.15.77:0/2715558398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43ec06ccf0 0x7f43ec159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:38.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.136+0000 7f43f1886700 1 --2- 172.21.15.77:0/2715558398 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f43ec0ad320 0x7f43ec1f69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:38.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.136+0000 7f43f2888700 1 -- 172.21.15.77:0/2715558398 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f43ec0ad320 msgr2=0x7f43ec1f69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:38.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.136+0000 7f43f2888700 1 --2- 172.21.15.77:0/2715558398 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f43ec0ad320 0x7f43ec1f69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:38.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.136+0000 7f43f2888700 1 -- 172.21.15.77:0/2715558398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43ec06ccf0 msgr2=0x7f43ec159a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:38.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.136+0000 7f43f2888700 1 --2- 172.21.15.77:0/2715558398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43ec06ccf0 0x7f43ec159a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:38.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.136+0000 7f43f2888700 1 -- 172.21.15.77:0/2715558398 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e8009520 con 0x7f43ec160350 2023-07-24T05:47:38.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.136+0000 7f43f1886700 1 --2- 172.21.15.77:0/2715558398 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f43ec0ad320 0x7f43ec1f69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:38.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.136+0000 7f43f2888700 1 --2- 172.21.15.77:0/2715558398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43ec160350 0x7f43ec1f7b00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f43e4007d20 tx=0x7f43e400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:38.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.136+0000 7f43e2ffd700 1 -- 172.21.15.77:0/2715558398 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e400ede0 con 0x7f43ec160350 2023-07-24T05:47:38.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.136+0000 7f43e2ffd700 1 -- 172.21.15.77:0/2715558398 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e4007e70 con 0x7f43ec160350 2023-07-24T05:47:38.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.136+0000 7f43f42eb700 1 -- 172.21.15.77:0/2715558398 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43ec1f77a0 con 0x7f43ec160350 2023-07-24T05:47:38.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.136+0000 7f43e2ffd700 1 -- 172.21.15.77:0/2715558398 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e4014640 con 0x7f43ec160350 2023-07-24T05:47:38.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.136+0000 7f43f42eb700 1 -- 172.21.15.77:0/2715558398 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43ec15b300 con 0x7f43ec160350 2023-07-24T05:47:38.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.136+0000 7f43f42eb700 1 -- 172.21.15.77:0/2715558398 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43ec15b920 con 0x7f43ec160350 2023-07-24T05:47:38.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.140+0000 7f43e2ffd700 1 -- 172.21.15.77:0/2715558398 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f43e40147a0 con 0x7f43ec160350 2023-07-24T05:47:38.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.140+0000 7f43e2ffd700 1 --2- 172.21.15.77:0/2715558398 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f43d00662f0 0x7f43d00687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:38.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.140+0000 7f43e2ffd700 1 -- 172.21.15.77:0/2715558398 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f43e4084750 con 0x7f43ec160350 2023-07-24T05:47:38.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.140+0000 7f43f2087700 1 --2- 172.21.15.77:0/2715558398 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f43d00662f0 0x7f43d00687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:38.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.140+0000 7f43f2087700 1 --2- 172.21.15.77:0/2715558398 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f43d00662f0 0x7f43d00687b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f43e8000c00 tx=0x7f43e8008070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:38.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.144+0000 7f43e2ffd700 1 -- 172.21.15.77:0/2715558398 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f43ec15b920 con 0x7f43ec160350 2023-07-24T05:47:38.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.352+0000 7f43f42eb700 1 -- 172.21.15.77:0/2715558398 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f43ec15b520 con 0x7f43ec160350 2023-07-24T05:47:38.360 INFO:tasks.ceph.mon.a.smithi077.stderr:2023-07-24T05:47:38.352+0000 7fe5081f4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-24T05:47:38.368 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.360+0000 7f43e2ffd700 1 -- 172.21.15.77:0/2715558398 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f43e4051780 con 0x7f43ec160350 2023-07-24T05:47:38.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.364+0000 7f43f42eb700 1 -- 172.21.15.77:0/2715558398 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f43d00662f0 msgr2=0x7f43d00687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:38.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.364+0000 7f43f42eb700 1 --2- 172.21.15.77:0/2715558398 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f43d00662f0 0x7f43d00687b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f43e8000c00 tx=0x7f43e8008070 comp rx=0 tx=0).stop 2023-07-24T05:47:38.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.364+0000 7f43f42eb700 1 -- 172.21.15.77:0/2715558398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43ec160350 msgr2=0x7f43ec1f7b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:38.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.364+0000 7f43f42eb700 1 --2- 172.21.15.77:0/2715558398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43ec160350 0x7f43ec1f7b00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f43e4007d20 tx=0x7f43e400e3c0 comp rx=0 tx=0).stop 2023-07-24T05:47:38.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.364+0000 7f43f42eb700 1 -- 172.21.15.77:0/2715558398 shutdown_connections 2023-07-24T05:47:38.372 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.364+0000 7f43f42eb700 1 --2- 172.21.15.77:0/2715558398 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43ec160350 0x7f43ec1f7b00 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:38.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.364+0000 7f43f42eb700 1 --2- 172.21.15.77:0/2715558398 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f43d00662f0 0x7f43d00687b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:38.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.364+0000 7f43f42eb700 1 --2- 172.21.15.77:0/2715558398 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f43ec0ad320 0x7f43ec1f69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:38.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.364+0000 7f43f42eb700 1 --2- 172.21.15.77:0/2715558398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43ec06ccf0 0x7f43ec159a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:38.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.364+0000 7f43f42eb700 1 -- 172.21.15.77:0/2715558398 >> 172.21.15.77:0/2715558398 conn(0x7f43ec0ce410 msgr2=0x7f43ec155450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:38.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.364+0000 7f43f42eb700 1 -- 172.21.15.77:0/2715558398 shutdown_connections 2023-07-24T05:47:38.373 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.364+0000 7f43f42eb700 1 -- 172.21.15.77:0/2715558398 wait complete. 2023-07-24T05:47:38.374 INFO:teuthology.orchestra.run.smithi077.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-24T05:47:38.381 INFO:tasks.ceph.mds.c.smithi077.stderr: -5345> 2023-07-24T05:46:05.543+0000 7f4eca77b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-24T05:47:38.391 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-24T05:47:38.445 INFO:tasks.ceph.mds.c.smithi077.stdout:starting mds.c at 2023-07-24T05:47:38.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.564+0000 7fee1d81d700 1 Processor -- start 2023-07-24T05:47:38.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.564+0000 7fee1d81d700 1 -- start start 2023-07-24T05:47:38.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.568+0000 7fee1d81d700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fee1815cac0 0x7fee1806ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:38.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.568+0000 7fee1d81d700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fee180d0c20 0x7fee180d28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:38.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.568+0000 7fee1d81d700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee1806d3c0 con 0x7fee1806b260 2023-07-24T05:47:38.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.568+0000 7fee1d81d700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee180b64d0 con 0x7fee180d0c20 2023-07-24T05:47:38.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.568+0000 7fee1d81d700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee1806d660 con 0x7fee1815cac0 2023-07-24T05:47:38.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.568+0000 7fee167fc700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fee1806b260 0x7fee180d0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:56528/0 (socket says 172.21.15.77:56528) 2023-07-24T05:47:38.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.568+0000 7fee167fc700 1 -- 172.21.15.77:0/651396076 learned_addr learned my addr 172.21.15.77:0/651396076 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:38.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.568+0000 7fee16ffd700 1 --2- 172.21.15.77:0/651396076 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fee1815cac0 0x7fee1806ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:38.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.568+0000 7fee177fe700 1 --2- 172.21.15.77:0/651396076 >> v2:172.21.15.103:3300/0 conn(0x7fee180d0c20 0x7fee180d28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:38.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.568+0000 7fee16ffd700 1 -- 172.21.15.77:0/651396076 >> v2:172.21.15.103:3300/0 conn(0x7fee180d0c20 msgr2=0x7fee180d28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:38.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.568+0000 7fee16ffd700 1 --2- 172.21.15.77:0/651396076 >> v2:172.21.15.103:3300/0 conn(0x7fee180d0c20 0x7fee180d28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:38.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.572+0000 7fee16ffd700 1 -- 172.21.15.77:0/651396076 >> v1:172.21.15.77:6789/0 conn(0x7fee1806b260 legacy=0x7fee180d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:38.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.572+0000 7fee16ffd700 1 -- 172.21.15.77:0/651396076 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee1806d940 con 0x7fee1815cac0 2023-07-24T05:47:38.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.568+0000 7fee15ffb700 1 -- 172.21.15.77:0/651396076 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2312057178 0 0) 0x7fee1806d3c0 con 0x7fee1806b260 2023-07-24T05:47:38.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.572+0000 7fee16ffd700 1 --2- 172.21.15.77:0/651396076 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fee1815cac0 0x7fee1806ad20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fee08009840 tx=0x7fee08009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2074d376a9fb6858 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:38.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.572+0000 7fee15ffb700 1 -- 172.21.15.77:0/651396076 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee08005e50 con 0x7fee1815cac0 2023-07-24T05:47:38.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.572+0000 7fee15ffb700 1 -- 172.21.15.77:0/651396076 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee08006030 con 0x7fee1815cac0 2023-07-24T05:47:38.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.572+0000 7fee15ffb700 1 -- 172.21.15.77:0/651396076 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee080063c0 con 0x7fee1815cac0 2023-07-24T05:47:38.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.572+0000 7fee1d81d700 1 -- 172.21.15.77:0/651396076 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fee1815cac0 msgr2=0x7fee1806ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:38.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.572+0000 7fee1d81d700 1 --2- 172.21.15.77:0/651396076 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fee1815cac0 0x7fee1806ad20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fee08009840 tx=0x7fee08009b50 comp rx=0 tx=0).stop 2023-07-24T05:47:38.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.572+0000 7fee1d81d700 1 -- 172.21.15.77:0/651396076 shutdown_connections 2023-07-24T05:47:38.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.572+0000 7fee1d81d700 1 --2- 172.21.15.77:0/651396076 >> v2:172.21.15.103:3300/0 conn(0x7fee180d0c20 0x7fee180d28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:38.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.572+0000 7fee1d81d700 1 --2- 172.21.15.77:0/651396076 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fee1815cac0 0x7fee1806ad20 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:38.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.572+0000 7fee1d81d700 1 -- 172.21.15.77:0/651396076 >> 172.21.15.77:0/651396076 conn(0x7fee1809bb90 msgr2=0x7fee180b5890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:38.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.572+0000 7fee1d81d700 1 -- 172.21.15.77:0/651396076 shutdown_connections 2023-07-24T05:47:38.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.572+0000 7fee1d81d700 1 -- 172.21.15.77:0/651396076 wait complete. 2023-07-24T05:47:38.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.576+0000 7fee1d81d700 1 Processor -- start 2023-07-24T05:47:38.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.576+0000 7fee1d81d700 1 -- start start 2023-07-24T05:47:38.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.576+0000 7fee1d81d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee1806b260 0x7fee181f1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:38.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.576+0000 7fee1d81d700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee180d0c20 0x7fee1809fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:38.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.576+0000 7fee1d81d700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fee1815cac0 0x7fee180d10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:38.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.576+0000 7fee1d81d700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1809ded0 con 0x7fee1806b260 2023-07-24T05:47:38.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.576+0000 7fee1d81d700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1809ea50 con 0x7fee180d0c20 2023-07-24T05:47:38.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.576+0000 7fee1d81d700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee1809e120 con 0x7fee1815cac0 2023-07-24T05:47:38.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.576+0000 7fee16ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee1806b260 0x7fee181f1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:38.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.576+0000 7fee16ffd700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee1806b260 0x7fee181f1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46810/0 (socket says 172.21.15.77:46810) 2023-07-24T05:47:38.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.576+0000 7fee16ffd700 1 -- 172.21.15.77:0/2875223314 learned_addr learned my addr 172.21.15.77:0/2875223314 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:38.584 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.576+0000 7fee167fc700 1 --2- 172.21.15.77:0/2875223314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee180d0c20 0x7fee1809fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:38.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.576+0000 7fee177fe700 1 --2- 172.21.15.77:0/2875223314 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fee1815cac0 0x7fee180d10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:38.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.576+0000 7fee16ffd700 1 -- 172.21.15.77:0/2875223314 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fee1815cac0 msgr2=0x7fee180d10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:38.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.576+0000 7fee16ffd700 1 --2- 172.21.15.77:0/2875223314 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fee1815cac0 0x7fee180d10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:38.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.576+0000 7fee16ffd700 1 -- 172.21.15.77:0/2875223314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee180d0c20 msgr2=0x7fee1809fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:38.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.576+0000 7fee16ffd700 1 --2- 172.21.15.77:0/2875223314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee180d0c20 0x7fee1809fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:38.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.576+0000 7fee16ffd700 1 -- 172.21.15.77:0/2875223314 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee08009450 con 0x7fee1806b260 2023-07-24T05:47:38.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.576+0000 7fee16ffd700 1 --2- 172.21.15.77:0/2875223314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee1806b260 0x7fee181f1500 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fee08009b90 tx=0x7fee08004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:38.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.576+0000 7fedfffff700 1 -- 172.21.15.77:0/2875223314 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee080066d0 con 0x7fee1806b260 2023-07-24T05:47:38.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.576+0000 7fedfffff700 1 -- 172.21.15.77:0/2875223314 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee08020070 con 0x7fee1806b260 2023-07-24T05:47:38.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.576+0000 7fedfffff700 1 -- 172.21.15.77:0/2875223314 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee08025430 con 0x7fee1806b260 2023-07-24T05:47:38.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.576+0000 7fee1d81d700 1 -- 172.21.15.77:0/2875223314 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee1809e400 con 0x7fee1806b260 2023-07-24T05:47:38.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.580+0000 7fee1d81d700 1 -- 172.21.15.77:0/2875223314 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee181f1a40 con 0x7fee1806b260 2023-07-24T05:47:38.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.580+0000 7fee1d81d700 1 -- 172.21.15.77:0/2875223314 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee1804df10 con 0x7fee1806b260 2023-07-24T05:47:38.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.580+0000 7fedfffff700 1 -- 172.21.15.77:0/2875223314 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fee08022030 con 0x7fee1806b260 2023-07-24T05:47:38.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.584+0000 7fedfffff700 1 --2- 172.21.15.77:0/2875223314 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fee040662f0 0x7fee040687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:38.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.584+0000 7fedfffff700 1 -- 172.21.15.77:0/2875223314 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6957+0+0 (secure 0 0 0) 0x7fee08085600 con 0x7fee1806b260 2023-07-24T05:47:38.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.584+0000 7fee167fc700 1 --2- 172.21.15.77:0/2875223314 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fee040662f0 0x7fee040687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:38.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.584+0000 7fee167fc700 1 --2- 172.21.15.77:0/2875223314 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fee040662f0 0x7fee040687b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fee180d1de0 tx=0x7fee0c007e00 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:38.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.592+0000 7fedfffff700 1 -- 172.21.15.77:0/2875223314 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fee08052810 con 0x7fee1806b260 2023-07-24T05:47:38.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:38.800+0000 7fee1d81d700 1 -- 172.21.15.77:0/2875223314 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fee1809c070 con 0x7fee1806b260 2023-07-24T05:47:39.381 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.372+0000 7fedfffff700 1 -- 172.21.15.77:0/2875223314 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fee08055e30 con 0x7fee1806b260 2023-07-24T05:47:39.384 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.376+0000 7fee1d81d700 1 -- 172.21.15.77:0/2875223314 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fee040662f0 msgr2=0x7fee040687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:39.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.376+0000 7fee1d81d700 1 --2- 172.21.15.77:0/2875223314 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fee040662f0 0x7fee040687b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fee180d1de0 tx=0x7fee0c007e00 comp rx=0 tx=0).stop 2023-07-24T05:47:39.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.376+0000 7fee1d81d700 1 -- 172.21.15.77:0/2875223314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee1806b260 msgr2=0x7fee181f1500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:39.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.376+0000 7fee1d81d700 1 --2- 172.21.15.77:0/2875223314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee1806b260 0x7fee181f1500 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fee08009b90 tx=0x7fee08004770 comp rx=0 tx=0).stop 2023-07-24T05:47:39.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.376+0000 7fee1d81d700 1 -- 172.21.15.77:0/2875223314 shutdown_connections 2023-07-24T05:47:39.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.376+0000 7fee1d81d700 1 --2- 172.21.15.77:0/2875223314 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fee040662f0 0x7fee040687b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:39.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.376+0000 7fee1d81d700 1 --2- 172.21.15.77:0/2875223314 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fee1815cac0 0x7fee180d10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:39.385 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.376+0000 7fee1d81d700 1 --2- 172.21.15.77:0/2875223314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fee180d0c20 0x7fee1809fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:39.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.376+0000 7fee1d81d700 1 --2- 172.21.15.77:0/2875223314 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee1806b260 0x7fee181f1500 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:39.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.376+0000 7fee1d81d700 1 -- 172.21.15.77:0/2875223314 >> 172.21.15.77:0/2875223314 conn(0x7fee1809bb90 msgr2=0x7fee18069ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:39.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.380+0000 7fee1d81d700 1 -- 172.21.15.77:0/2875223314 shutdown_connections 2023-07-24T05:47:39.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.380+0000 7fee1d81d700 1 -- 172.21.15.77:0/2875223314 wait complete. 2023-07-24T05:47:39.408 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-24T05:47:39.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.588+0000 7fc0c4fae700 1 Processor -- start 2023-07-24T05:47:39.595 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.588+0000 7fc0c4fae700 1 -- start start 2023-07-24T05:47:39.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.592+0000 7fc0c4fae700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fc0c00cba60 0x7fc0c015c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:39.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.592+0000 7fc0c4fae700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fc0c006fc60 0x7fc0c015cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:39.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.592+0000 7fc0c4fae700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0c006d4c0 con 0x7fc0c0070200 2023-07-24T05:47:39.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.592+0000 7fc0c4fae700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0c015d040 con 0x7fc0c00cba60 2023-07-24T05:47:39.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.592+0000 7fc0c4fae700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0c006cb90 con 0x7fc0c006fc60 2023-07-24T05:47:39.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.592+0000 7fc0bdd9b700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fc0c0070200 0x7fc0c0160690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:56536/0 (socket says 172.21.15.77:56536) 2023-07-24T05:47:39.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.592+0000 7fc0bdd9b700 1 -- 172.21.15.77:0/3086898199 learned_addr learned my addr 172.21.15.77:0/3086898199 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:39.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.592+0000 7fc0be59c700 1 --2- 172.21.15.77:0/3086898199 >> v2:172.21.15.77:3300/0 conn(0x7fc0c00cba60 0x7fc0c015c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:39.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.592+0000 7fc0bed9d700 1 --2- 172.21.15.77:0/3086898199 >> v2:172.21.15.103:3300/0 conn(0x7fc0c006fc60 0x7fc0c015cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:39.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.592+0000 7fc0bd59a700 1 -- 172.21.15.77:0/3086898199 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1284488291 0 0) 0x7fc0c006d4c0 con 0x7fc0c0070200 2023-07-24T05:47:39.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.592+0000 7fc0bd59a700 1 -- 172.21.15.77:0/3086898199 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0a80035d0 con 0x7fc0c0070200 2023-07-24T05:47:39.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.592+0000 7fc0be59c700 1 -- 172.21.15.77:0/3086898199 >> v2:172.21.15.103:3300/0 conn(0x7fc0c006fc60 msgr2=0x7fc0c015cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:39.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.592+0000 7fc0be59c700 1 --2- 172.21.15.77:0/3086898199 >> v2:172.21.15.103:3300/0 conn(0x7fc0c006fc60 0x7fc0c015cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:39.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.592+0000 7fc0be59c700 1 -- 172.21.15.77:0/3086898199 >> v1:172.21.15.77:6789/0 conn(0x7fc0c0070200 legacy=0x7fc0c0160690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:39.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.592+0000 7fc0be59c700 1 -- 172.21.15.77:0/3086898199 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c006ce70 con 0x7fc0c00cba60 2023-07-24T05:47:39.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.592+0000 7fc0be59c700 1 --2- 172.21.15.77:0/3086898199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0c00cba60 0x7fc0c015c5c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fc0c006e620 tx=0x7fc0b0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81334d0a9943fb4 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:39.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.596+0000 7fc0bd59a700 1 -- 172.21.15.77:0/3086898199 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0011830 con 0x7fc0c00cba60 2023-07-24T05:47:39.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.596+0000 7fc0bd59a700 1 -- 172.21.15.77:0/3086898199 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b0011990 con 0x7fc0c00cba60 2023-07-24T05:47:39.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.596+0000 7fc0bd59a700 1 -- 172.21.15.77:0/3086898199 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0011d20 con 0x7fc0c00cba60 2023-07-24T05:47:39.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.596+0000 7fc0c4fae700 1 -- 172.21.15.77:0/3086898199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0c00cba60 msgr2=0x7fc0c015c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:39.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.596+0000 7fc0c4fae700 1 --2- 172.21.15.77:0/3086898199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0c00cba60 0x7fc0c015c5c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fc0c006e620 tx=0x7fc0b0009b30 comp rx=0 tx=0).stop 2023-07-24T05:47:39.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.596+0000 7fc0c4fae700 1 -- 172.21.15.77:0/3086898199 shutdown_connections 2023-07-24T05:47:39.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.596+0000 7fc0c4fae700 1 --2- 172.21.15.77:0/3086898199 >> v2:172.21.15.103:3300/0 conn(0x7fc0c006fc60 0x7fc0c015cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:39.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.596+0000 7fc0c4fae700 1 --2- 172.21.15.77:0/3086898199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0c00cba60 0x7fc0c015c5c0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:39.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.596+0000 7fc0c4fae700 1 -- 172.21.15.77:0/3086898199 >> 172.21.15.77:0/3086898199 conn(0x7fc0c00cdb30 msgr2=0x7fc0c00d0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:39.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.596+0000 7fc0c4fae700 1 -- 172.21.15.77:0/3086898199 shutdown_connections 2023-07-24T05:47:39.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.596+0000 7fc0c4fae700 1 -- 172.21.15.77:0/3086898199 wait complete. 2023-07-24T05:47:39.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.600+0000 7fc0c4fae700 1 Processor -- start 2023-07-24T05:47:39.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.600+0000 7fc0c4fae700 1 -- start start 2023-07-24T05:47:39.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.600+0000 7fc0c4fae700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc0c006fc60 0x7fc0c00ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:39.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.600+0000 7fc0c4fae700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0c0070200 0x7fc0c00ae430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:39.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.600+0000 7fc0c4fae700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0c00cba60 0x7fc0c00ac710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:39.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.600+0000 7fc0c4fae700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c00caa10 con 0x7fc0c00cba60 2023-07-24T05:47:39.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.600+0000 7fc0c4fae700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c00ae970 con 0x7fc0c0070200 2023-07-24T05:47:39.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.600+0000 7fc0c4fae700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c014f280 con 0x7fc0c006fc60 2023-07-24T05:47:39.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.600+0000 7fc0bed9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0c00cba60 0x7fc0c00ac710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:39.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.600+0000 7fc0bed9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0c00cba60 0x7fc0c00ac710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46830/0 (socket says 172.21.15.77:46830) 2023-07-24T05:47:39.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.600+0000 7fc0bed9d700 1 -- 172.21.15.77:0/2515560059 learned_addr learned my addr 172.21.15.77:0/2515560059 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:39.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.600+0000 7fc0bdd9b700 1 --2- 172.21.15.77:0/2515560059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0c0070200 0x7fc0c00ae430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:39.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.600+0000 7fc0be59c700 1 --2- 172.21.15.77:0/2515560059 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc0c006fc60 0x7fc0c00ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:39.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.600+0000 7fc0bed9d700 1 -- 172.21.15.77:0/2515560059 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc0c006fc60 msgr2=0x7fc0c00ca4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:39.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.600+0000 7fc0bed9d700 1 --2- 172.21.15.77:0/2515560059 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc0c006fc60 0x7fc0c00ca4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:39.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.600+0000 7fc0bed9d700 1 -- 172.21.15.77:0/2515560059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0c0070200 msgr2=0x7fc0c00ae430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:39.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.600+0000 7fc0bed9d700 1 --2- 172.21.15.77:0/2515560059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0c0070200 0x7fc0c00ae430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:39.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.600+0000 7fc0bed9d700 1 -- 172.21.15.77:0/2515560059 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b00094b0 con 0x7fc0c00cba60 2023-07-24T05:47:39.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.600+0000 7fc0be59c700 1 --2- 172.21.15.77:0/2515560059 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc0c006fc60 0x7fc0c00ca4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:39.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.600+0000 7fc0bed9d700 1 --2- 172.21.15.77:0/2515560059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0c00cba60 0x7fc0c00ac710 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8009dd0 tx=0x7fc0b800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:39.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.600+0000 7fc0aeffd700 1 -- 172.21.15.77:0/2515560059 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b8009c40 con 0x7fc0c00cba60 2023-07-24T05:47:39.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.600+0000 7fc0aeffd700 1 -- 172.21.15.77:0/2515560059 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b800f040 con 0x7fc0c00cba60 2023-07-24T05:47:39.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.600+0000 7fc0c4fae700 1 -- 172.21.15.77:0/2515560059 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0c0070a90 con 0x7fc0c00cba60 2023-07-24T05:47:39.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.600+0000 7fc0aeffd700 1 -- 172.21.15.77:0/2515560059 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b8014480 con 0x7fc0c00cba60 2023-07-24T05:47:39.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.604+0000 7fc0c4fae700 1 -- 172.21.15.77:0/2515560059 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0c014e9e0 con 0x7fc0c00cba60 2023-07-24T05:47:39.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.604+0000 7fc0c4fae700 1 -- 172.21.15.77:0/2515560059 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0c00c7840 con 0x7fc0c00cba60 2023-07-24T05:47:39.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.604+0000 7fc0aeffd700 1 -- 172.21.15.77:0/2515560059 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc0b80145e0 con 0x7fc0c00cba60 2023-07-24T05:47:39.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.608+0000 7fc0aeffd700 1 --2- 172.21.15.77:0/2515560059 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc0a00662f0 0x7fc0a00687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:39.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.608+0000 7fc0aeffd700 1 -- 172.21.15.77:0/2515560059 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6957+0+0 (secure 0 0 0) 0x7fc0b8084920 con 0x7fc0c00cba60 2023-07-24T05:47:39.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.608+0000 7fc0be59c700 1 --2- 172.21.15.77:0/2515560059 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc0a00662f0 0x7fc0a00687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:39.615 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.608+0000 7fc0be59c700 1 --2- 172.21.15.77:0/2515560059 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc0a00662f0 0x7fc0a00687b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0000c00 tx=0x7fc0b0008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:39.620 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.612+0000 7fc0aeffd700 1 -- 172.21.15.77:0/2515560059 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc0b8051a20 con 0x7fc0c00cba60 2023-07-24T05:47:39.792 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:39.784+0000 7fc0c4fae700 1 -- 172.21.15.77:0/2515560059 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc0c004df80 con 0x7fc0c00cba60 2023-07-24T05:47:40.458 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.448+0000 7fc0aeffd700 1 -- 172.21.15.77:0/2515560059 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc0b8055040 con 0x7fc0c00cba60 2023-07-24T05:47:40.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.456+0000 7fc0c4fae700 1 -- 172.21.15.77:0/2515560059 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc0a00662f0 msgr2=0x7fc0a00687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:40.463 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.456+0000 7fc0c4fae700 1 --2- 172.21.15.77:0/2515560059 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc0a00662f0 0x7fc0a00687b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0000c00 tx=0x7fc0b0008030 comp rx=0 tx=0).stop 2023-07-24T05:47:40.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.456+0000 7fc0c4fae700 1 -- 172.21.15.77:0/2515560059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0c00cba60 msgr2=0x7fc0c00ac710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:40.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.456+0000 7fc0c4fae700 1 --2- 172.21.15.77:0/2515560059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0c00cba60 0x7fc0c00ac710 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8009dd0 tx=0x7fc0b800c3a0 comp rx=0 tx=0).stop 2023-07-24T05:47:40.464 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.456+0000 7fc0c4fae700 1 -- 172.21.15.77:0/2515560059 shutdown_connections 2023-07-24T05:47:40.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.456+0000 7fc0c4fae700 1 --2- 172.21.15.77:0/2515560059 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc0c00cba60 0x7fc0c00ac710 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:40.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.456+0000 7fc0c4fae700 1 --2- 172.21.15.77:0/2515560059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc0c0070200 0x7fc0c00ae430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:40.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.456+0000 7fc0c4fae700 1 --2- 172.21.15.77:0/2515560059 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fc0a00662f0 0x7fc0a00687b0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:40.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.456+0000 7fc0c4fae700 1 --2- 172.21.15.77:0/2515560059 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fc0c006fc60 0x7fc0c00ca4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:40.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.456+0000 7fc0c4fae700 1 -- 172.21.15.77:0/2515560059 >> 172.21.15.77:0/2515560059 conn(0x7fc0c00cdb30 msgr2=0x7fc0c00b2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:40.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.456+0000 7fc0c4fae700 1 -- 172.21.15.77:0/2515560059 shutdown_connections 2023-07-24T05:47:40.466 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.460+0000 7fc0c4fae700 1 -- 172.21.15.77:0/2515560059 wait complete. 2023-07-24T05:47:40.467 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_metadata' removed 2023-07-24T05:47:40.487 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-24T05:47:40.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.656+0000 7f4cc9501700 1 Processor -- start 2023-07-24T05:47:40.663 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.656+0000 7f4cc9501700 1 -- start start 2023-07-24T05:47:40.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.660+0000 7f4cc9501700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4cc415c9d0 0x7f4cc406bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:40.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.660+0000 7f4cc9501700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4cc4071380 0x7f4cc40cd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:40.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.660+0000 7f4cc9501700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cc415cdb0 con 0x7f4cc406a3a0 2023-07-24T05:47:40.665 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.660+0000 7f4cc9501700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cc40ccf90 con 0x7f4cc415c9d0 2023-07-24T05:47:40.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.660+0000 7f4cc9501700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cc40b4e30 con 0x7f4cc4071380 2023-07-24T05:47:40.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.660+0000 7f4cc2ffd700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4cc415c9d0 0x7f4cc406bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:40.666 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.660+0000 7f4cc2ffd700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f4cc415c9d0 0x7f4cc406bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46842/0 (socket says 172.21.15.77:46842) 2023-07-24T05:47:40.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.660+0000 7f4cc2ffd700 1 -- 172.21.15.77:0/2943141627 learned_addr learned my addr 172.21.15.77:0/2943141627 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:40.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.660+0000 7f4cc37fe700 1 --2- 172.21.15.77:0/2943141627 >> v2:172.21.15.103:3300/0 conn(0x7f4cc4071380 0x7f4cc40cd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:40.667 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.660+0000 7f4cc2ffd700 1 -- 172.21.15.77:0/2943141627 >> v2:172.21.15.103:3300/0 conn(0x7f4cc4071380 msgr2=0x7f4cc40cd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:40.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.660+0000 7f4cc2ffd700 1 --2- 172.21.15.77:0/2943141627 >> v2:172.21.15.103:3300/0 conn(0x7f4cc4071380 0x7f4cc40cd3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:40.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.660+0000 7f4cc2ffd700 1 -- 172.21.15.77:0/2943141627 >> v1:172.21.15.103:6789/0 conn(0x7f4cc406a3a0 legacy=0x7f4cc4070c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:40.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.660+0000 7f4cc2ffd700 1 -- 172.21.15.77:0/2943141627 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cc415d9c0 con 0x7f4cc415c9d0 2023-07-24T05:47:40.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.660+0000 7f4cc2ffd700 1 --2- 172.21.15.77:0/2943141627 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cc415c9d0 0x7f4cc406bbf0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4071a60 tx=0x7f4cb4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e9e691e09967662 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:40.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.660+0000 7f4cc1ffb700 1 -- 172.21.15.77:0/2943141627 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4004230 con 0x7f4cc415c9d0 2023-07-24T05:47:40.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.660+0000 7f4cc1ffb700 1 -- 172.21.15.77:0/2943141627 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cb4004390 con 0x7f4cc415c9d0 2023-07-24T05:47:40.668 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.660+0000 7f4cc1ffb700 1 -- 172.21.15.77:0/2943141627 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb40036c0 con 0x7f4cc415c9d0 2023-07-24T05:47:40.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.660+0000 7f4cc9501700 1 -- 172.21.15.77:0/2943141627 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cc415c9d0 msgr2=0x7f4cc406bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:40.669 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.660+0000 7f4cc9501700 1 --2- 172.21.15.77:0/2943141627 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cc415c9d0 0x7f4cc406bbf0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4071a60 tx=0x7f4cb4009bf0 comp rx=0 tx=0).stop 2023-07-24T05:47:40.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.660+0000 7f4cc9501700 1 -- 172.21.15.77:0/2943141627 shutdown_connections 2023-07-24T05:47:40.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.660+0000 7f4cc9501700 1 --2- 172.21.15.77:0/2943141627 >> v2:172.21.15.103:3300/0 conn(0x7f4cc4071380 0x7f4cc40cd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:40.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.660+0000 7f4cc9501700 1 --2- 172.21.15.77:0/2943141627 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cc415c9d0 0x7f4cc406bbf0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:40.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.660+0000 7f4cc9501700 1 -- 172.21.15.77:0/2943141627 >> 172.21.15.77:0/2943141627 conn(0x7f4cc40cf450 msgr2=0x7f4cc40cf860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:40.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.660+0000 7f4cc9501700 1 -- 172.21.15.77:0/2943141627 shutdown_connections 2023-07-24T05:47:40.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.664+0000 7f4cc9501700 1 -- 172.21.15.77:0/2943141627 wait complete. 2023-07-24T05:47:40.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.664+0000 7f4cc9501700 1 Processor -- start 2023-07-24T05:47:40.671 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.664+0000 7f4cc9501700 1 -- start start 2023-07-24T05:47:40.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.668+0000 7f4cc9501700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cc406a3a0 0x7f4cc4155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:40.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.668+0000 7f4cc9501700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4cc4071380 0x7f4cc40c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:40.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.668+0000 7f4cc9501700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cc415c9d0 0x7f4cc4155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:40.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.668+0000 7f4cc9501700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc40ca4f0 con 0x7f4cc415c9d0 2023-07-24T05:47:40.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.668+0000 7f4cc9501700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc40ca270 con 0x7f4cc406a3a0 2023-07-24T05:47:40.674 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.668+0000 7f4cc9501700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc40c8050 con 0x7f4cc4071380 2023-07-24T05:47:40.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.668+0000 7f4cc37fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cc415c9d0 0x7f4cc4155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:40.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.668+0000 7f4cc27fc700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4cc4071380 0x7f4cc40c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:40.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.668+0000 7f4cc37fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cc415c9d0 0x7f4cc4155590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46848/0 (socket says 172.21.15.77:46848) 2023-07-24T05:47:40.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.668+0000 7f4cc2ffd700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cc406a3a0 0x7f4cc4155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:40.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.668+0000 7f4cc37fe700 1 -- 172.21.15.77:0/1867187 learned_addr learned my addr 172.21.15.77:0/1867187 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:40.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.668+0000 7f4cc37fe700 1 -- 172.21.15.77:0/1867187 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4cc4071380 msgr2=0x7f4cc40c9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:40.675 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.668+0000 7f4cc37fe700 1 --2- 172.21.15.77:0/1867187 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4cc4071380 0x7f4cc40c9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:40.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.668+0000 7f4cc37fe700 1 -- 172.21.15.77:0/1867187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cc406a3a0 msgr2=0x7f4cc4155dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:40.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.668+0000 7f4cc37fe700 1 --2- 172.21.15.77:0/1867187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cc406a3a0 0x7f4cc4155dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:40.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.668+0000 7f4cc37fe700 1 -- 172.21.15.77:0/1867187 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb4009570 con 0x7f4cc415c9d0 2023-07-24T05:47:40.676 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.668+0000 7f4cc37fe700 1 --2- 172.21.15.77:0/1867187 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cc415c9d0 0x7f4cc4155590 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc007e40 tx=0x7f4cbc00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:40.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.668+0000 7f4cab7fe700 1 -- 172.21.15.77:0/1867187 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc00ed30 con 0x7f4cc415c9d0 2023-07-24T05:47:40.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.668+0000 7f4cab7fe700 1 -- 172.21.15.77:0/1867187 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cbc014420 con 0x7f4cc415c9d0 2023-07-24T05:47:40.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.668+0000 7f4cc9501700 1 -- 172.21.15.77:0/1867187 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cc40c8330 con 0x7f4cc415c9d0 2023-07-24T05:47:40.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.668+0000 7f4cab7fe700 1 -- 172.21.15.77:0/1867187 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc0147d0 con 0x7f4cc415c9d0 2023-07-24T05:47:40.677 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.668+0000 7f4cc9501700 1 -- 172.21.15.77:0/1867187 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cc40c88f0 con 0x7f4cc415c9d0 2023-07-24T05:47:40.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.672+0000 7f4cc9501700 1 -- 172.21.15.77:0/1867187 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cc40c8b10 con 0x7f4cc415c9d0 2023-07-24T05:47:40.678 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.672+0000 7f4cab7fe700 1 -- 172.21.15.77:0/1867187 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4cbc014930 con 0x7f4cc415c9d0 2023-07-24T05:47:40.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.676+0000 7f4cab7fe700 1 --2- 172.21.15.77:0/1867187 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f4cb00662f0 0x7f4cb00687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:40.681 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.676+0000 7f4cab7fe700 1 -- 172.21.15.77:0/1867187 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6519+0+0 (secure 0 0 0) 0x7f4cbc084610 con 0x7f4cc415c9d0 2023-07-24T05:47:40.682 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.676+0000 7f4cc2ffd700 1 --2- 172.21.15.77:0/1867187 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f4cb00662f0 0x7f4cb00687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:40.683 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.676+0000 7f4cc2ffd700 1 --2- 172.21.15.77:0/1867187 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f4cb00662f0 0x7f4cb00687b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4071a60 tx=0x7f4cb4008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:40.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.680+0000 7f4cab7fe700 1 -- 172.21.15.77:0/1867187 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4cbc051820 con 0x7f4cc415c9d0 2023-07-24T05:47:40.874 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:40.868+0000 7f4cc9501700 1 -- 172.21.15.77:0/1867187 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4cc4066cc0 con 0x7f4cc415c9d0 2023-07-24T05:47:41.465 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.460+0000 7f4cab7fe700 1 -- 172.21.15.77:0/1867187 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4cbc054e40 con 0x7f4cc415c9d0 2023-07-24T05:47:41.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.464+0000 7f4cc9501700 1 -- 172.21.15.77:0/1867187 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f4cb00662f0 msgr2=0x7f4cb00687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:41.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.464+0000 7f4cc9501700 1 --2- 172.21.15.77:0/1867187 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f4cb00662f0 0x7f4cb00687b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4071a60 tx=0x7f4cb4008030 comp rx=0 tx=0).stop 2023-07-24T05:47:41.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.464+0000 7f4cc9501700 1 -- 172.21.15.77:0/1867187 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cc415c9d0 msgr2=0x7f4cc4155590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:41.470 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.464+0000 7f4cc9501700 1 --2- 172.21.15.77:0/1867187 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cc415c9d0 0x7f4cc4155590 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc007e40 tx=0x7f4cbc00e3c0 comp rx=0 tx=0).stop 2023-07-24T05:47:41.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.464+0000 7f4cc9501700 1 -- 172.21.15.77:0/1867187 shutdown_connections 2023-07-24T05:47:41.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.464+0000 7f4cc9501700 1 --2- 172.21.15.77:0/1867187 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cc415c9d0 0x7f4cc4155590 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:41.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.464+0000 7f4cc9501700 1 --2- 172.21.15.77:0/1867187 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f4cb00662f0 0x7f4cb00687b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:41.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.464+0000 7f4cc9501700 1 --2- 172.21.15.77:0/1867187 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4cc4071380 0x7f4cc40c9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:41.471 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.464+0000 7f4cc9501700 1 --2- 172.21.15.77:0/1867187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4cc406a3a0 0x7f4cc4155dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:41.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.464+0000 7f4cc9501700 1 -- 172.21.15.77:0/1867187 >> 172.21.15.77:0/1867187 conn(0x7f4cc40cf450 msgr2=0x7f4cc415d150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:41.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.464+0000 7f4cc9501700 1 -- 172.21.15.77:0/1867187 shutdown_connections 2023-07-24T05:47:41.472 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.464+0000 7f4cc9501700 1 -- 172.21.15.77:0/1867187 wait complete. 2023-07-24T05:47:41.472 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_data' removed 2023-07-24T05:47:41.494 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-07-24T05:47:41.672 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.664+0000 7f885e8c4700 1 Processor -- start 2023-07-24T05:47:41.673 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.668+0000 7f885e8c4700 1 -- start start 2023-07-24T05:47:41.684 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.676+0000 7f885e8c4700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f88580b04d0 0x7f88580cc240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:41.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.676+0000 7f885e8c4700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88580cd410 con 0x7f885815a830 2023-07-24T05:47:41.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.676+0000 7f885e8c4700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88580b1780 con 0x7f8858069b10 2023-07-24T05:47:41.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.676+0000 7f885e8c4700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88580cc890 con 0x7f88580b04d0 2023-07-24T05:47:41.685 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.680+0000 7f885e0c3700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f88580b04d0 0x7f88580cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:41.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.680+0000 7f885e0c3700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f88580b04d0 0x7f88580cc240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46858/0 (socket says 172.21.15.77:46858) 2023-07-24T05:47:41.686 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.680+0000 7f885e0c3700 1 -- 172.21.15.77:0/1933834186 learned_addr learned my addr 172.21.15.77:0/1933834186 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:41.687 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.680+0000 7f885e0c3700 1 -- 172.21.15.77:0/1933834186 >> v1:172.21.15.103:6789/0 conn(0x7f8858069b10 legacy=0x7f88580b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:41.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.680+0000 7f885e0c3700 1 -- 172.21.15.77:0/1933834186 >> v1:172.21.15.77:6789/0 conn(0x7f885815a830 legacy=0x7f88580afdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:41.688 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.680+0000 7f885e0c3700 1 -- 172.21.15.77:0/1933834186 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88580ccb70 con 0x7f88580b04d0 2023-07-24T05:47:41.695 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.684+0000 7f885e0c3700 1 --2- 172.21.15.77:0/1933834186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88580b04d0 0x7f88580cc240 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8850009e50 tx=0x7f885000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17c10d65a7a96b81 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:41.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.688+0000 7f885c8c0700 1 -- 172.21.15.77:0/1933834186 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885000e070 con 0x7f88580b04d0 2023-07-24T05:47:41.698 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.688+0000 7f885c8c0700 1 -- 172.21.15.77:0/1933834186 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885000b9c0 con 0x7f88580b04d0 2023-07-24T05:47:41.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.688+0000 7f885c8c0700 1 -- 172.21.15.77:0/1933834186 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885000bd70 con 0x7f88580b04d0 2023-07-24T05:47:41.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.692+0000 7f885e8c4700 1 -- 172.21.15.77:0/1933834186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88580b04d0 msgr2=0x7f88580cc240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:41.699 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.692+0000 7f885e8c4700 1 --2- 172.21.15.77:0/1933834186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88580b04d0 0x7f88580cc240 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f8850009e50 tx=0x7f885000b330 comp rx=0 tx=0).stop 2023-07-24T05:47:41.702 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.696+0000 7f885e8c4700 1 -- 172.21.15.77:0/1933834186 shutdown_connections 2023-07-24T05:47:41.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.696+0000 7f885e8c4700 1 --2- 172.21.15.77:0/1933834186 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88580b04d0 0x7f88580cc240 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:41.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.696+0000 7f885e8c4700 1 -- 172.21.15.77:0/1933834186 >> 172.21.15.77:0/1933834186 conn(0x7f88580b3f20 msgr2=0x7f88580cadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:41.703 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.696+0000 7f885e8c4700 1 -- 172.21.15.77:0/1933834186 shutdown_connections 2023-07-24T05:47:41.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.700+0000 7f885e8c4700 1 -- 172.21.15.77:0/1933834186 wait complete. 2023-07-24T05:47:41.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.700+0000 7f885e8c4700 1 Processor -- start 2023-07-24T05:47:41.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.700+0000 7f885e8c4700 1 -- start start 2023-07-24T05:47:41.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.704+0000 7f885e8c4700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8858069b10 0x7f88580adc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:41.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.704+0000 7f885e8c4700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f88580b04d0 0x7f885814c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:41.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.704+0000 7f885e8c4700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f885815a830 0x7f885806fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:41.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.704+0000 7f885e8c4700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8858070680 con 0x7f8858069b10 2023-07-24T05:47:41.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.704+0000 7f885e8c4700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8858070960 con 0x7f885815a830 2023-07-24T05:47:41.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.704+0000 7f885e8c4700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f885815c9e0 con 0x7f88580b04d0 2023-07-24T05:47:41.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.704+0000 7f885d0c1700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f88580b04d0 0x7f885814c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:41.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.704+0000 7f885d0c1700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f88580b04d0 0x7f885814c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.77:48778/0 (socket says 172.21.15.77:48778) 2023-07-24T05:47:41.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.704+0000 7f885d0c1700 1 -- 172.21.15.77:0/3973317157 learned_addr learned my addr 172.21.15.77:0/3973317157 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:41.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.704+0000 7f885d8c2700 1 --2- 172.21.15.77:0/3973317157 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8858069b10 0x7f88580adc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:41.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.704+0000 7f885d8c2700 1 -- 172.21.15.77:0/3973317157 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f88580b04d0 msgr2=0x7f885814c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:41.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.704+0000 7f885d8c2700 1 --2- 172.21.15.77:0/3973317157 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f88580b04d0 0x7f885814c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:41.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.704+0000 7f885d8c2700 1 -- 172.21.15.77:0/3973317157 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f885815a830 msgr2=0x7f885806fb80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-24T05:47:41.712 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.704+0000 7f885d8c2700 1 --2- 172.21.15.77:0/3973317157 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f885815a830 0x7f885806fb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:41.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.704+0000 7f885d8c2700 1 -- 172.21.15.77:0/3973317157 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8850009b30 con 0x7f8858069b10 2023-07-24T05:47:41.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.704+0000 7f885d8c2700 1 --2- 172.21.15.77:0/3973317157 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8858069b10 0x7f88580adc80 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f885400c3e0 tx=0x7f885400c6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:41.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.704+0000 7f884e7fc700 1 -- 172.21.15.77:0/3973317157 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885400cea0 con 0x7f8858069b10 2023-07-24T05:47:41.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.704+0000 7f884e7fc700 1 -- 172.21.15.77:0/3973317157 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88540052d0 con 0x7f8858069b10 2023-07-24T05:47:41.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.704+0000 7f884e7fc700 1 -- 172.21.15.77:0/3973317157 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8854006880 con 0x7f8858069b10 2023-07-24T05:47:41.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.708+0000 7f885e8c4700 1 -- 172.21.15.77:0/3973317157 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f885815ccc0 con 0x7f8858069b10 2023-07-24T05:47:41.714 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.708+0000 7f885e8c4700 1 -- 172.21.15.77:0/3973317157 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f885815c6d0 con 0x7f8858069b10 2023-07-24T05:47:41.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.712+0000 7f884e7fc700 1 -- 172.21.15.77:0/3973317157 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f88540069e0 con 0x7f8858069b10 2023-07-24T05:47:41.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.712+0000 7f885e8c4700 1 -- 172.21.15.77:0/3973317157 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f885815cee0 con 0x7f8858069b10 2023-07-24T05:47:41.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.712+0000 7f884e7fc700 1 --2- 172.21.15.77:0/3973317157 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f883c0663c0 0x7f883c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:41.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.712+0000 7f884e7fc700 1 -- 172.21.15.77:0/3973317157 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f8854082e20 con 0x7f8858069b10 2023-07-24T05:47:41.721 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.712+0000 7f885d0c1700 1 --2- 172.21.15.77:0/3973317157 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f883c0663c0 0x7f883c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:41.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.716+0000 7f885d0c1700 1 --2- 172.21.15.77:0/3973317157 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f883c0663c0 0x7f883c068880 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f88580aff90 tx=0x7f8848009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:41.725 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.720+0000 7f884e7fc700 1 -- 172.21.15.77:0/3973317157 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8854050290 con 0x7f8858069b10 2023-07-24T05:47:41.899 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:41.892+0000 7f885e8c4700 1 -- 172.21.15.77:0/3973317157 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f885804df10 con 0x7f8858069b10 2023-07-24T05:47:42.474 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.468+0000 7f884e7fc700 1 -- 172.21.15.77:0/3973317157 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) v1 ==== 178+0+0 (secure 0 0 0) 0x7f8854059020 con 0x7f8858069b10 2023-07-24T05:47:42.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.472+0000 7f885e8c4700 1 -- 172.21.15.77:0/3973317157 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f883c0663c0 msgr2=0x7f883c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:42.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.472+0000 7f885e8c4700 1 --2- 172.21.15.77:0/3973317157 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f883c0663c0 0x7f883c068880 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f88580aff90 tx=0x7f8848009040 comp rx=0 tx=0).stop 2023-07-24T05:47:42.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.472+0000 7f885e8c4700 1 -- 172.21.15.77:0/3973317157 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8858069b10 msgr2=0x7f88580adc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:42.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.472+0000 7f885e8c4700 1 --2- 172.21.15.77:0/3973317157 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8858069b10 0x7f88580adc80 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f885400c3e0 tx=0x7f885400c6f0 comp rx=0 tx=0).stop 2023-07-24T05:47:42.479 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.472+0000 7f885e8c4700 1 -- 172.21.15.77:0/3973317157 shutdown_connections 2023-07-24T05:47:42.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.472+0000 7f885e8c4700 1 --2- 172.21.15.77:0/3973317157 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f885815a830 0x7f885806fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:42.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.472+0000 7f885e8c4700 1 --2- 172.21.15.77:0/3973317157 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f883c0663c0 0x7f883c068880 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:42.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.472+0000 7f885e8c4700 1 --2- 172.21.15.77:0/3973317157 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f88580b04d0 0x7f885814c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:42.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.472+0000 7f885e8c4700 1 --2- 172.21.15.77:0/3973317157 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8858069b10 0x7f88580adc80 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:42.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.472+0000 7f885e8c4700 1 -- 172.21.15.77:0/3973317157 >> 172.21.15.77:0/3973317157 conn(0x7f88580b3f20 msgr2=0x7f88580c46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:42.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.472+0000 7f885e8c4700 1 -- 172.21.15.77:0/3973317157 shutdown_connections 2023-07-24T05:47:42.480 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.472+0000 7f885e8c4700 1 -- 172.21.15.77:0/3973317157 wait complete. 2023-07-24T05:47:42.481 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_data_ec' removed 2023-07-24T05:47:42.501 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-24T05:47:42.502 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-24T05:47:42.502 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-24T05:47:42.502 INFO:teuthology.orchestra.run:waiting for 300 2023-07-24T05:47:42.502 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-24T05:47:42.503 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-24T05:47:42.503 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-24T05:47:42.503 INFO:teuthology.orchestra.run:waiting for 300 2023-07-24T05:47:42.503 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-24T05:47:42.503 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-24T05:47:42.504 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-24T05:47:42.504 INFO:teuthology.orchestra.run:waiting for 300 2023-07-24T05:47:42.504 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-24T05:47:42.504 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-24T05:47:42.505 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-24T05:47:42.505 INFO:teuthology.orchestra.run:waiting for 300 2023-07-24T05:47:42.521 INFO:tasks.ceph.mds.c:Stopped 2023-07-24T05:47:42.522 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-24T05:47:42.522 INFO:tasks.ceph.mds.b:Stopped 2023-07-24T05:47:42.523 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-24T05:47:42.525 INFO:tasks.ceph.mds.a:Stopped 2023-07-24T05:47:42.525 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-24T05:47:42.526 INFO:tasks.ceph.mds.d:Stopped 2023-07-24T05:47:42.527 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-24T05:47:42.574 INFO:tasks.ceph.mds.c:Started 2023-07-24T05:47:42.574 DEBUG:teuthology.parallel:result is None 2023-07-24T05:47:42.577 INFO:tasks.ceph.mds.a:Started 2023-07-24T05:47:42.578 DEBUG:teuthology.parallel:result is None 2023-07-24T05:47:42.578 INFO:tasks.ceph.mds.b:Started 2023-07-24T05:47:42.579 DEBUG:teuthology.parallel:result is None 2023-07-24T05:47:42.582 INFO:tasks.ceph.mds.d:Started 2023-07-24T05:47:42.582 DEBUG:teuthology.parallel:result is None 2023-07-24T05:47:42.582 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-24T05:47:42.688 INFO:tasks.ceph.mds.a.smithi077.stdout:starting mds.a at 2023-07-24T05:47:42.690 INFO:tasks.ceph.mds.c.smithi077.stdout:starting mds.c at 2023-07-24T05:47:42.697 INFO:tasks.ceph.mds.b.smithi103.stdout:starting mds.b at 2023-07-24T05:47:42.698 INFO:tasks.ceph.mds.d.smithi103.stdout:starting mds.d at 2023-07-24T05:47:42.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.748+0000 7fe1f0369700 1 Processor -- start 2023-07-24T05:47:42.756 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.748+0000 7fe1f0369700 1 -- start start 2023-07-24T05:47:42.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.752+0000 7fe1f0369700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe1e806cac0 0x7fe1e806cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:42.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.752+0000 7fe1f0369700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe1e815e4c0 0x7fe1e815e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:42.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.752+0000 7fe1f0369700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe1e8069b10 0x7fe1e8069fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:42.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.752+0000 7fe1f0369700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1e815ee90 con 0x7fe1e815e4c0 2023-07-24T05:47:42.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.752+0000 7fe1f0369700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1e806bb60 con 0x7fe1e806cac0 2023-07-24T05:47:42.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.752+0000 7fe1f0369700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e815f380 con 0x7fe1e8069b10 2023-07-24T05:47:42.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.752+0000 7fe1ed904700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe1e815e4c0 0x7fe1e815e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:42.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.752+0000 7fe1ee105700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe1e806cac0 0x7fe1e806cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:42.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.752+0000 7fe1ed904700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe1e815e4c0 0x7fe1e815e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46886/0 (socket says 172.21.15.77:46886) 2023-07-24T05:47:42.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.752+0000 7fe1ed904700 1 -- 172.21.15.77:0/1642502942 learned_addr learned my addr 172.21.15.77:0/1642502942 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:42.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.752+0000 7fe1ee906700 1 --2- 172.21.15.77:0/1642502942 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe1e8069b10 0x7fe1e8069fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:42.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.752+0000 7fe1ed904700 1 -- 172.21.15.77:0/1642502942 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe1e8069b10 msgr2=0x7fe1e8069fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:42.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.752+0000 7fe1ed904700 1 --2- 172.21.15.77:0/1642502942 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe1e8069b10 0x7fe1e8069fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:42.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.752+0000 7fe1ed904700 1 -- 172.21.15.77:0/1642502942 >> v2:172.21.15.103:3300/0 conn(0x7fe1e806cac0 msgr2=0x7fe1e806cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:42.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.752+0000 7fe1ed904700 1 --2- 172.21.15.77:0/1642502942 >> v2:172.21.15.103:3300/0 conn(0x7fe1e806cac0 0x7fe1e806cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:42.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.752+0000 7fe1ed904700 1 -- 172.21.15.77:0/1642502942 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e806d3e0 con 0x7fe1e815e4c0 2023-07-24T05:47:42.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.752+0000 7fe1ee105700 1 --2- 172.21.15.77:0/1642502942 >> v2:172.21.15.103:3300/0 conn(0x7fe1e806cac0 0x7fe1e806cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:47:42.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.752+0000 7fe1ed904700 1 --2- 172.21.15.77:0/1642502942 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1e815e4c0 0x7fe1e815e950 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8066fd0 tx=0x7fe1d8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da4fca386f8ece41 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:42.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.752+0000 7fe1ed103700 1 -- 172.21.15.77:0/1642502942 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8011830 con 0x7fe1e815e4c0 2023-07-24T05:47:42.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.752+0000 7fe1ed103700 1 -- 172.21.15.77:0/1642502942 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d8011990 con 0x7fe1e815e4c0 2023-07-24T05:47:42.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.752+0000 7fe1ed103700 1 -- 172.21.15.77:0/1642502942 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8011d20 con 0x7fe1e815e4c0 2023-07-24T05:47:42.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.756+0000 7fe1f0369700 1 -- 172.21.15.77:0/1642502942 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1e815e4c0 msgr2=0x7fe1e815e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:42.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.756+0000 7fe1f0369700 1 --2- 172.21.15.77:0/1642502942 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1e815e4c0 0x7fe1e815e950 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe1e8066fd0 tx=0x7fe1d8009bf0 comp rx=0 tx=0).stop 2023-07-24T05:47:42.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.756+0000 7fe1f0369700 1 -- 172.21.15.77:0/1642502942 shutdown_connections 2023-07-24T05:47:42.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.756+0000 7fe1f0369700 1 --2- 172.21.15.77:0/1642502942 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe1e8069b10 0x7fe1e8069fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:42.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.756+0000 7fe1f0369700 1 --2- 172.21.15.77:0/1642502942 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1e815e4c0 0x7fe1e815e950 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:42.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.756+0000 7fe1f0369700 1 --2- 172.21.15.77:0/1642502942 >> v2:172.21.15.103:3300/0 conn(0x7fe1e806cac0 0x7fe1e806cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:42.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.756+0000 7fe1f0369700 1 -- 172.21.15.77:0/1642502942 >> 172.21.15.77:0/1642502942 conn(0x7fe1e80ce410 msgr2=0x7fe1e80ce7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:42.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.756+0000 7fe1f0369700 1 -- 172.21.15.77:0/1642502942 shutdown_connections 2023-07-24T05:47:42.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.756+0000 7fe1f0369700 1 -- 172.21.15.77:0/1642502942 wait complete. 2023-07-24T05:47:42.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.756+0000 7fe1f0369700 1 Processor -- start 2023-07-24T05:47:42.765 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.756+0000 7fe1f0369700 1 -- start start 2023-07-24T05:47:42.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.760+0000 7fe1f0369700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe1e8069b10 0x7fe1e80cda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:42.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.760+0000 7fe1f0369700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1e806cac0 0x7fe1e80c3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:42.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.760+0000 7fe1f0369700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1e815e4c0 0x7fe1e80c1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:42.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.760+0000 7fe1f0369700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e80c5f10 con 0x7fe1e815e4c0 2023-07-24T05:47:42.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.760+0000 7fe1f0369700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e80c5d80 con 0x7fe1e806cac0 2023-07-24T05:47:42.767 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.760+0000 7fe1f0369700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e81594d0 con 0x7fe1e8069b10 2023-07-24T05:47:42.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.760+0000 7fe1ee906700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1e815e4c0 0x7fe1e80c1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:42.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.760+0000 7fe1ee906700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1e815e4c0 0x7fe1e80c1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46890/0 (socket says 172.21.15.77:46890) 2023-07-24T05:47:42.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.760+0000 7fe1ee906700 1 -- 172.21.15.77:0/4022947242 learned_addr learned my addr 172.21.15.77:0/4022947242 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:42.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.760+0000 7fe1ee105700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe1e8069b10 0x7fe1e80cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:42.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.760+0000 7fe1ed904700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1e806cac0 0x7fe1e80c3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:42.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.760+0000 7fe1ee906700 1 -- 172.21.15.77:0/4022947242 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe1e8069b10 msgr2=0x7fe1e80cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:42.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.760+0000 7fe1ee906700 1 --2- 172.21.15.77:0/4022947242 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe1e8069b10 0x7fe1e80cda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:42.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.760+0000 7fe1ee906700 1 -- 172.21.15.77:0/4022947242 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1e806cac0 msgr2=0x7fe1e80c3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:42.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.760+0000 7fe1ee906700 1 --2- 172.21.15.77:0/4022947242 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1e806cac0 0x7fe1e80c3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:42.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.760+0000 7fe1ee906700 1 -- 172.21.15.77:0/4022947242 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e4009450 con 0x7fe1e815e4c0 2023-07-24T05:47:42.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.760+0000 7fe1ee906700 1 --2- 172.21.15.77:0/4022947242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1e815e4c0 0x7fe1e80c1f40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe1e000efc0 tx=0x7fe1e000c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:42.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.760+0000 7fe1deffd700 1 -- 172.21.15.77:0/4022947242 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e000cad0 con 0x7fe1e815e4c0 2023-07-24T05:47:42.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.760+0000 7fe1deffd700 1 -- 172.21.15.77:0/4022947242 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e000f040 con 0x7fe1e815e4c0 2023-07-24T05:47:42.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.760+0000 7fe1f0369700 1 -- 172.21.15.77:0/4022947242 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1d8009570 con 0x7fe1e815e4c0 2023-07-24T05:47:42.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.760+0000 7fe1deffd700 1 -- 172.21.15.77:0/4022947242 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e000ce70 con 0x7fe1e815e4c0 2023-07-24T05:47:42.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.760+0000 7fe1f0369700 1 -- 172.21.15.77:0/4022947242 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e8158660 con 0x7fe1e815e4c0 2023-07-24T05:47:42.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.764+0000 7fe1f0369700 1 -- 172.21.15.77:0/4022947242 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1e80c9e40 con 0x7fe1e815e4c0 2023-07-24T05:47:42.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.764+0000 7fe1deffd700 1 -- 172.21.15.77:0/4022947242 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe1e0014480 con 0x7fe1e815e4c0 2023-07-24T05:47:42.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.768+0000 7fe1deffd700 1 --2- 172.21.15.77:0/4022947242 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe1cc0662f0 0x7fe1cc0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:42.773 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.768+0000 7fe1deffd700 1 -- 172.21.15.77:0/4022947242 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5616+0+0 (secure 0 0 0) 0x7fe1e0084240 con 0x7fe1e815e4c0 2023-07-24T05:47:42.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.768+0000 7fe1ee105700 1 --2- 172.21.15.77:0/4022947242 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe1cc0662f0 0x7fe1cc0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:42.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.768+0000 7fe1ee105700 1 --2- 172.21.15.77:0/4022947242 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe1cc0662f0 0x7fe1cc0687b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4009c50 tx=0x7fe1e40091c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:42.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.772+0000 7fe1deffd700 1 -- 172.21.15.77:0/4022947242 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe1e80c9e40 con 0x7fe1e815e4c0 2023-07-24T05:47:42.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:42.952+0000 7fe1f0369700 1 -- 172.21.15.77:0/4022947242 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe1e80c6080 con 0x7fe1e815e4c0 2023-07-24T05:47:43.509 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.500+0000 7fe1deffd700 1 -- 172.21.15.77:0/4022947242 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v33) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe1e80c6080 con 0x7fe1e815e4c0 2023-07-24T05:47:43.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.504+0000 7fe1f0369700 1 -- 172.21.15.77:0/4022947242 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe1cc0662f0 msgr2=0x7fe1cc0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:43.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.504+0000 7fe1f0369700 1 --2- 172.21.15.77:0/4022947242 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe1cc0662f0 0x7fe1cc0687b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe1e4009c50 tx=0x7fe1e40091c0 comp rx=0 tx=0).stop 2023-07-24T05:47:43.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.504+0000 7fe1f0369700 1 -- 172.21.15.77:0/4022947242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1e815e4c0 msgr2=0x7fe1e80c1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:43.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.504+0000 7fe1f0369700 1 --2- 172.21.15.77:0/4022947242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1e815e4c0 0x7fe1e80c1f40 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe1e000efc0 tx=0x7fe1e000c0c0 comp rx=0 tx=0).stop 2023-07-24T05:47:43.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.504+0000 7fe1f0369700 1 -- 172.21.15.77:0/4022947242 shutdown_connections 2023-07-24T05:47:43.513 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.504+0000 7fe1f0369700 1 --2- 172.21.15.77:0/4022947242 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe1e815e4c0 0x7fe1e80c1f40 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:43.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.504+0000 7fe1f0369700 1 --2- 172.21.15.77:0/4022947242 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1e806cac0 0x7fe1e80c3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:43.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.504+0000 7fe1f0369700 1 --2- 172.21.15.77:0/4022947242 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe1cc0662f0 0x7fe1cc0687b0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:43.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.504+0000 7fe1f0369700 1 --2- 172.21.15.77:0/4022947242 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe1e8069b10 0x7fe1e80cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:43.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.504+0000 7fe1f0369700 1 -- 172.21.15.77:0/4022947242 >> 172.21.15.77:0/4022947242 conn(0x7fe1e80ce410 msgr2=0x7fe1e80ac180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:43.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.504+0000 7fe1f0369700 1 -- 172.21.15.77:0/4022947242 shutdown_connections 2023-07-24T05:47:43.514 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.504+0000 7fe1f0369700 1 -- 172.21.15.77:0/4022947242 wait complete. 2023-07-24T05:47:43.516 INFO:teuthology.orchestra.run.smithi077.stderr: removed all blocklist entries 2023-07-24T05:47:43.538 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-24T05:47:43.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.696+0000 7f2c0c9a6700 1 Processor -- start 2023-07-24T05:47:43.704 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.696+0000 7f2c0c9a6700 1 -- start start 2023-07-24T05:47:43.705 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.700+0000 7f2c0c9a6700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2c08160d20 0x7f2c080adba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:43.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.700+0000 7f2c0c9a6700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2c080b17a0 0x7f2c080af700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:43.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.700+0000 7f2c0c9a6700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c080af170 con 0x7f2c080ae0e0 2023-07-24T05:47:43.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.700+0000 7f2c0c9a6700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c080ae5f0 con 0x7f2c08160d20 2023-07-24T05:47:43.706 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.700+0000 7f2c0c9a6700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c080ae8d0 con 0x7f2c080b17a0 2023-07-24T05:47:43.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.700+0000 7f2c06d9d700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2c08160d20 0x7f2c080adba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:43.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.700+0000 7f2c0759e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2c080b17a0 0x7f2c080af700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:43.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.700+0000 7f2c0759e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f2c080b17a0 0x7f2c080af700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:43454/0 (socket says 172.21.15.77:43454) 2023-07-24T05:47:43.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.700+0000 7f2c06d9d700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f2c08160d20 0x7f2c080adba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42250/0 (socket says 172.21.15.77:42250) 2023-07-24T05:47:43.707 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.700+0000 7f2c0759e700 1 -- 172.21.15.77:0/3340618246 learned_addr learned my addr 172.21.15.77:0/3340618246 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:43.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.700+0000 7f2c0759e700 1 -- 172.21.15.77:0/3340618246 >> v2:172.21.15.77:3300/0 conn(0x7f2c08160d20 msgr2=0x7f2c080adba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:43.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.700+0000 7f2c0759e700 1 --2- 172.21.15.77:0/3340618246 >> v2:172.21.15.77:3300/0 conn(0x7f2c08160d20 0x7f2c080adba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:43.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.700+0000 7f2c0759e700 1 -- 172.21.15.77:0/3340618246 >> v1:172.21.15.103:6789/0 conn(0x7f2c080ae0e0 legacy=0x7f2c080b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:43.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.700+0000 7f2c0759e700 1 -- 172.21.15.77:0/3340618246 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c080aebb0 con 0x7f2c080b17a0 2023-07-24T05:47:43.708 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.700+0000 7f2c0759e700 1 --2- 172.21.15.77:0/3340618246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c080b17a0 0x7f2c080af700 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2c0806b770 tx=0x7f2c0000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d67edb60eaf2803 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:43.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.700+0000 7f2c05d9b700 1 -- 172.21.15.77:0/3340618246 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0000e070 con 0x7f2c080b17a0 2023-07-24T05:47:43.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.700+0000 7f2c05d9b700 1 -- 172.21.15.77:0/3340618246 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0000b910 con 0x7f2c080b17a0 2023-07-24T05:47:43.709 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.700+0000 7f2c05d9b700 1 -- 172.21.15.77:0/3340618246 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0000bcc0 con 0x7f2c080b17a0 2023-07-24T05:47:43.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.704+0000 7f2c0c9a6700 1 -- 172.21.15.77:0/3340618246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c080b17a0 msgr2=0x7f2c080af700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:43.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.704+0000 7f2c0c9a6700 1 --2- 172.21.15.77:0/3340618246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c080b17a0 0x7f2c080af700 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2c0806b770 tx=0x7f2c0000b330 comp rx=0 tx=0).stop 2023-07-24T05:47:43.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.704+0000 7f2c0c9a6700 1 -- 172.21.15.77:0/3340618246 shutdown_connections 2023-07-24T05:47:43.710 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.704+0000 7f2c0c9a6700 1 --2- 172.21.15.77:0/3340618246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c080b17a0 0x7f2c080af700 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:43.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.704+0000 7f2c0c9a6700 1 --2- 172.21.15.77:0/3340618246 >> v2:172.21.15.77:3300/0 conn(0x7f2c08160d20 0x7f2c080adba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:43.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.704+0000 7f2c0c9a6700 1 -- 172.21.15.77:0/3340618246 >> 172.21.15.77:0/3340618246 conn(0x7f2c080cacc0 msgr2=0x7f2c080cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:43.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.704+0000 7f2c0c9a6700 1 -- 172.21.15.77:0/3340618246 shutdown_connections 2023-07-24T05:47:43.711 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.704+0000 7f2c0c9a6700 1 -- 172.21.15.77:0/3340618246 wait complete. 2023-07-24T05:47:43.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.708+0000 7f2c0c9a6700 1 Processor -- start 2023-07-24T05:47:43.713 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.708+0000 7f2c0c9a6700 1 -- start start 2023-07-24T05:47:43.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.708+0000 7f2c0c9a6700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2c080ae0e0 0x7f2c080c3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:43.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.708+0000 7f2c0c9a6700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c080b17a0 0x7f2c0809bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:43.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.708+0000 7f2c0c9a6700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c08160d20 0x7f2c080c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:43.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.708+0000 7f2c0c9a6700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0809b8d0 con 0x7f2c08160d20 2023-07-24T05:47:43.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.708+0000 7f2c0c9a6700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c080c36c0 con 0x7f2c080b17a0 2023-07-24T05:47:43.715 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.708+0000 7f2c0c9a6700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c080c39a0 con 0x7f2c080ae0e0 2023-07-24T05:47:43.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.708+0000 7f2c0759e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c08160d20 0x7f2c080c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:43.716 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.708+0000 7f2c0759e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c08160d20 0x7f2c080c4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42266/0 (socket says 172.21.15.77:42266) 2023-07-24T05:47:43.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.708+0000 7f2c0759e700 1 -- 172.21.15.77:0/20941437 learned_addr learned my addr 172.21.15.77:0/20941437 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:43.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.708+0000 7f2c0659c700 1 --2- 172.21.15.77:0/20941437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c080b17a0 0x7f2c0809bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:43.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.708+0000 7f2c06d9d700 1 --2- 172.21.15.77:0/20941437 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2c080ae0e0 0x7f2c080c3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:43.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.708+0000 7f2c0759e700 1 -- 172.21.15.77:0/20941437 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2c080ae0e0 msgr2=0x7f2c080c3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:43.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.708+0000 7f2c0759e700 1 --2- 172.21.15.77:0/20941437 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2c080ae0e0 0x7f2c080c3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:43.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.708+0000 7f2c0759e700 1 -- 172.21.15.77:0/20941437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c080b17a0 msgr2=0x7f2c0809bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:43.717 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.708+0000 7f2c0759e700 1 --2- 172.21.15.77:0/20941437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c080b17a0 0x7f2c0809bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:43.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.708+0000 7f2c0759e700 1 -- 172.21.15.77:0/20941437 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c00009b30 con 0x7f2c08160d20 2023-07-24T05:47:43.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.708+0000 7f2c06d9d700 1 --2- 172.21.15.77:0/20941437 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2c080ae0e0 0x7f2c080c3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:43.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.708+0000 7f2c0759e700 1 --2- 172.21.15.77:0/20941437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c08160d20 0x7f2c080c4760 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2c080aea10 tx=0x7f2c00004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:43.718 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.712+0000 7f2bef7fe700 1 -- 172.21.15.77:0/20941437 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c00004930 con 0x7f2c08160d20 2023-07-24T05:47:43.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.712+0000 7f2bef7fe700 1 -- 172.21.15.77:0/20941437 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c000092e0 con 0x7f2c08160d20 2023-07-24T05:47:43.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.712+0000 7f2c0c9a6700 1 -- 172.21.15.77:0/20941437 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c080c3c80 con 0x7f2c08160d20 2023-07-24T05:47:43.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.712+0000 7f2bef7fe700 1 -- 172.21.15.77:0/20941437 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0001c660 con 0x7f2c08160d20 2023-07-24T05:47:43.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.712+0000 7f2c0c9a6700 1 -- 172.21.15.77:0/20941437 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c080c4240 con 0x7f2c08160d20 2023-07-24T05:47:43.719 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.712+0000 7f2c0c9a6700 1 -- 172.21.15.77:0/20941437 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c080c4430 con 0x7f2c08160d20 2023-07-24T05:47:43.720 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.712+0000 7f2bef7fe700 1 -- 172.21.15.77:0/20941437 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2c0001c7c0 con 0x7f2c08160d20 2023-07-24T05:47:43.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.716+0000 7f2bef7fe700 1 --2- 172.21.15.77:0/20941437 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2bf40662f0 0x7f2bf40687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:43.722 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.716+0000 7f2bef7fe700 1 -- 172.21.15.77:0/20941437 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f2c00085460 con 0x7f2c08160d20 2023-07-24T05:47:43.723 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.716+0000 7f2c06d9d700 1 --2- 172.21.15.77:0/20941437 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2bf40662f0 0x7f2bf40687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:43.724 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.716+0000 7f2c06d9d700 1 --2- 172.21.15.77:0/20941437 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2bf40662f0 0x7f2bf40687b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8009ba0 tx=0x7f2bf8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:43.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.720+0000 7f2bef7fe700 1 -- 172.21.15.77:0/20941437 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2c00052a50 con 0x7f2c08160d20 2023-07-24T05:47:43.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.948+0000 7f2c0c9a6700 1 -- 172.21.15.77:0/20941437 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f2c08072490 con 0x7f2c08160d20 2023-07-24T05:47:43.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.952+0000 7f2bef7fe700 1 -- 172.21.15.77:0/20941437 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f2c00056070 con 0x7f2c08160d20 2023-07-24T05:47:43.958 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:47:43.958 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-07-24T05:47:43.958 INFO:teuthology.orchestra.run.smithi077.stdout: "auth_dump": [ 2023-07-24T05:47:43.958 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-07-24T05:47:43.958 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.a", 2023-07-24T05:47:43.958 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDZD75kyrimHhAA9e4pjzVTIl81nh9mOuzLTQ==", 2023-07-24T05:47:43.959 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-07-24T05:47:43.959 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-07-24T05:47:43.959 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-07-24T05:47:43.959 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-07-24T05:47:43.959 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-07-24T05:47:43.959 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-07-24T05:47:43.959 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-07-24T05:47:43.960 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-07-24T05:47:43.960 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.b", 2023-07-24T05:47:43.960 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDZD75klhavMRAAHUGKT/W/E4MYK0fiFr8big==", 2023-07-24T05:47:43.960 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-07-24T05:47:43.960 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-07-24T05:47:43.960 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-07-24T05:47:43.960 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-07-24T05:47:43.960 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-07-24T05:47:43.961 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-07-24T05:47:43.961 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-07-24T05:47:43.961 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-07-24T05:47:43.961 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.c", 2023-07-24T05:47:43.961 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDZD75kb4SAKRAApZSXVDdsSXVc/5MNaHd6Eg==", 2023-07-24T05:47:43.961 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-07-24T05:47:43.961 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-07-24T05:47:43.962 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-07-24T05:47:43.962 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-07-24T05:47:43.962 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-07-24T05:47:43.962 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-07-24T05:47:43.962 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-07-24T05:47:43.962 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-07-24T05:47:43.962 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mds.d", 2023-07-24T05:47:43.962 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDaD75kTLPEABAABZvTNIYWM9rnWr0UzTZt5w==", 2023-07-24T05:47:43.963 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-07-24T05:47:43.963 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-07-24T05:47:43.963 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-07-24T05:47:43.963 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-07-24T05:47:43.963 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-07-24T05:47:43.963 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-07-24T05:47:43.963 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-07-24T05:47:43.964 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-07-24T05:47:43.964 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.0", 2023-07-24T05:47:43.964 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDdD75kP/pGMRAA7m3kivqywo82g3CxnxBMWQ==", 2023-07-24T05:47:43.964 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-07-24T05:47:43.964 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-07-24T05:47:43.964 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-07-24T05:47:43.964 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-07-24T05:47:43.964 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-07-24T05:47:43.965 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-07-24T05:47:43.965 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-07-24T05:47:43.965 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.1", 2023-07-24T05:47:43.965 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDhD75ksbkuBBAAtwyQCB8BPs1EvpWUXxcJVw==", 2023-07-24T05:47:43.965 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-07-24T05:47:43.965 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-07-24T05:47:43.965 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-07-24T05:47:43.965 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-07-24T05:47:43.966 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-07-24T05:47:43.966 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-07-24T05:47:43.966 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-07-24T05:47:43.966 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.2", 2023-07-24T05:47:43.966 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDkD75k5UJYERAADTemwoGGKi2hv+EO7spgjw==", 2023-07-24T05:47:43.966 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-07-24T05:47:43.966 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-07-24T05:47:43.966 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-07-24T05:47:43.967 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-07-24T05:47:43.967 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-07-24T05:47:43.967 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-07-24T05:47:43.967 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-07-24T05:47:43.967 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.3", 2023-07-24T05:47:43.967 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDnD75kX3g0HhAADGimfbP+bY3lLHIo+AhgvQ==", 2023-07-24T05:47:43.967 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-07-24T05:47:43.967 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-07-24T05:47:43.968 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-07-24T05:47:43.968 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-07-24T05:47:43.968 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-07-24T05:47:43.968 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-07-24T05:47:43.968 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-07-24T05:47:43.968 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.4", 2023-07-24T05:47:43.968 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDtD75kZXMvMxAAtWJy1bRiI4KGgg/zwHdvug==", 2023-07-24T05:47:43.968 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-07-24T05:47:43.969 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-07-24T05:47:43.969 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-07-24T05:47:43.969 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-07-24T05:47:43.969 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-07-24T05:47:43.969 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-07-24T05:47:43.969 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-07-24T05:47:43.969 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.5", 2023-07-24T05:47:43.970 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDxD75kazj9BhAAUZtCi+AYYw9qy817fJhhjw==", 2023-07-24T05:47:43.970 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-07-24T05:47:43.970 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-07-24T05:47:43.970 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-07-24T05:47:43.970 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-07-24T05:47:43.970 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-07-24T05:47:43.970 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-07-24T05:47:43.970 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-07-24T05:47:43.971 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.6", 2023-07-24T05:47:43.971 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQD0D75kRMUIFBAAVRjqGfPu49i+tmbxM4Ofkw==", 2023-07-24T05:47:43.971 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-07-24T05:47:43.971 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-07-24T05:47:43.971 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-07-24T05:47:43.971 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-07-24T05:47:43.971 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-07-24T05:47:43.971 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-07-24T05:47:43.972 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-07-24T05:47:43.972 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "osd.7", 2023-07-24T05:47:43.972 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQD3D75kSFY/IBAAS4QWZXMRq4TspsxAzB9/LQ==", 2023-07-24T05:47:43.972 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-07-24T05:47:43.972 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow profile osd", 2023-07-24T05:47:43.972 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile osd", 2023-07-24T05:47:43.972 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-07-24T05:47:43.973 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-07-24T05:47:43.973 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-07-24T05:47:43.973 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-07-24T05:47:43.973 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.0", 2023-07-24T05:47:43.973 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDaD75kFKS1BxAA0KR0wkYow59oiBtAVGaXrQ==", 2023-07-24T05:47:43.973 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-07-24T05:47:43.973 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-07-24T05:47:43.973 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow r", 2023-07-24T05:47:43.974 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow rw", 2023-07-24T05:47:43.974 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rwx" 2023-07-24T05:47:43.974 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-07-24T05:47:43.974 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-07-24T05:47:43.974 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-07-24T05:47:43.974 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.1", 2023-07-24T05:47:43.974 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDaD75kHmsMFBAAOs6CcawB5trFW+S7lrlJ6A==", 2023-07-24T05:47:43.974 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-07-24T05:47:43.975 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-07-24T05:47:43.975 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow r", 2023-07-24T05:47:43.975 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow rw", 2023-07-24T05:47:43.975 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rwx" 2023-07-24T05:47:43.975 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-07-24T05:47:43.975 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-07-24T05:47:43.975 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-07-24T05:47:43.975 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.2", 2023-07-24T05:47:43.976 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDaD75kMW/iDRAAl/iArAQLiih575SlR0Wavg==", 2023-07-24T05:47:43.976 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-07-24T05:47:43.976 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-07-24T05:47:43.976 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow r", 2023-07-24T05:47:43.976 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow rw", 2023-07-24T05:47:43.976 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rwx" 2023-07-24T05:47:43.976 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-07-24T05:47:43.977 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-07-24T05:47:43.977 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-07-24T05:47:43.977 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.3", 2023-07-24T05:47:43.977 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDaD75kvo34GRAAwzA4zjIfycj/5gUY25WlvA==", 2023-07-24T05:47:43.977 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-07-24T05:47:43.977 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow", 2023-07-24T05:47:43.977 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow r", 2023-07-24T05:47:43.977 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow rw", 2023-07-24T05:47:43.978 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow rwx" 2023-07-24T05:47:43.978 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-07-24T05:47:43.978 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-07-24T05:47:43.978 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-07-24T05:47:43.978 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.admin", 2023-07-24T05:47:43.978 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDYD75kh1t9MBAAExO6qebNSWQP3et+p9GmvA==", 2023-07-24T05:47:43.978 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-07-24T05:47:43.978 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow *", 2023-07-24T05:47:43.979 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr": "allow *", 2023-07-24T05:47:43.979 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow *", 2023-07-24T05:47:43.979 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-07-24T05:47:43.979 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-07-24T05:47:43.979 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-07-24T05:47:43.979 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-07-24T05:47:43.979 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.bootstrap-mds", 2023-07-24T05:47:43.979 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQADEL5k31YzJhAATXspMAaOXYI5Xi2ye5FJTA==", 2023-07-24T05:47:43.980 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-07-24T05:47:43.980 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile bootstrap-mds" 2023-07-24T05:47:43.980 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-07-24T05:47:43.980 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-07-24T05:47:43.980 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-07-24T05:47:43.980 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.bootstrap-mgr", 2023-07-24T05:47:43.980 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQADEL5kPW0zJhAAsGfhDOhXNRj1t8z8285xmg==", 2023-07-24T05:47:43.980 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-07-24T05:47:43.981 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile bootstrap-mgr" 2023-07-24T05:47:43.981 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-07-24T05:47:43.981 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-07-24T05:47:43.981 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-07-24T05:47:43.981 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.bootstrap-osd", 2023-07-24T05:47:43.981 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQADEL5kKX8zJhAAPnV9C9Ym1isr/ATuzD2OYA==", 2023-07-24T05:47:43.981 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-07-24T05:47:43.981 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile bootstrap-osd" 2023-07-24T05:47:43.982 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-07-24T05:47:43.982 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-07-24T05:47:43.982 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-07-24T05:47:43.982 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.bootstrap-rbd", 2023-07-24T05:47:43.982 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQADEL5k9JAzJhAApk9KYKtCKki69l8idenN+g==", 2023-07-24T05:47:43.982 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-07-24T05:47:43.982 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile bootstrap-rbd" 2023-07-24T05:47:43.982 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-07-24T05:47:43.983 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-07-24T05:47:43.983 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-07-24T05:47:43.983 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-07-24T05:47:43.983 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQADEL5k1aIzJhAAisG4UnwGWir/BvlJgE3YgA==", 2023-07-24T05:47:43.983 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-07-24T05:47:43.983 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-07-24T05:47:43.983 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-07-24T05:47:43.984 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-07-24T05:47:43.984 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-07-24T05:47:43.984 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "client.bootstrap-rgw", 2023-07-24T05:47:43.984 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQADEL5k7rUzJhAAxEjs617GhFajTEPPBNB83A==", 2023-07-24T05:47:43.984 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-07-24T05:47:43.984 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile bootstrap-rgw" 2023-07-24T05:47:43.984 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-07-24T05:47:43.984 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-07-24T05:47:43.985 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-07-24T05:47:43.985 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mgr.x", 2023-07-24T05:47:43.985 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDZD75kFr5NFxAAtdZZnyzOfnc3qbEl7xIFQQ==", 2023-07-24T05:47:43.985 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-07-24T05:47:43.985 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow *", 2023-07-24T05:47:43.985 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile mgr", 2023-07-24T05:47:43.985 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-07-24T05:47:43.985 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-07-24T05:47:43.986 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-07-24T05:47:43.986 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-07-24T05:47:43.986 INFO:teuthology.orchestra.run.smithi077.stdout: "entity": "mgr.y", 2023-07-24T05:47:43.986 INFO:teuthology.orchestra.run.smithi077.stdout: "key": "AQDZD75kyzQHERAAXNMpCEKlSx8tG5obur9x8A==", 2023-07-24T05:47:43.986 INFO:teuthology.orchestra.run.smithi077.stdout: "caps": { 2023-07-24T05:47:43.986 INFO:teuthology.orchestra.run.smithi077.stdout: "mds": "allow *", 2023-07-24T05:47:43.986 INFO:teuthology.orchestra.run.smithi077.stdout: "mon": "allow profile mgr", 2023-07-24T05:47:43.986 INFO:teuthology.orchestra.run.smithi077.stdout: "osd": "allow *" 2023-07-24T05:47:43.987 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-07-24T05:47:43.987 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-07-24T05:47:43.987 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2023-07-24T05:47:43.987 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-07-24T05:47:43.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.956+0000 7f2c0c9a6700 1 -- 172.21.15.77:0/20941437 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2bf40662f0 msgr2=0x7f2bf40687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:43.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.956+0000 7f2c0c9a6700 1 --2- 172.21.15.77:0/20941437 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2bf40662f0 0x7f2bf40687b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8009ba0 tx=0x7f2bf8008040 comp rx=0 tx=0).stop 2023-07-24T05:47:43.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.956+0000 7f2c0c9a6700 1 -- 172.21.15.77:0/20941437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c08160d20 msgr2=0x7f2c080c4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:43.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.956+0000 7f2c0c9a6700 1 --2- 172.21.15.77:0/20941437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c08160d20 0x7f2c080c4760 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2c080aea10 tx=0x7f2c00004af0 comp rx=0 tx=0).stop 2023-07-24T05:47:43.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.956+0000 7f2c0c9a6700 1 -- 172.21.15.77:0/20941437 shutdown_connections 2023-07-24T05:47:43.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.956+0000 7f2c0c9a6700 1 --2- 172.21.15.77:0/20941437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c08160d20 0x7f2c080c4760 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:43.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.956+0000 7f2c0c9a6700 1 --2- 172.21.15.77:0/20941437 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c080b17a0 0x7f2c0809bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:43.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.956+0000 7f2c0c9a6700 1 --2- 172.21.15.77:0/20941437 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f2bf40662f0 0x7f2bf40687b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:43.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.956+0000 7f2c0c9a6700 1 --2- 172.21.15.77:0/20941437 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f2c080ae0e0 0x7f2c080c3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:43.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.956+0000 7f2c0c9a6700 1 -- 172.21.15.77:0/20941437 >> 172.21.15.77:0/20941437 conn(0x7f2c080cacc0 msgr2=0x7f2c0806d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:43.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.956+0000 7f2c0c9a6700 1 -- 172.21.15.77:0/20941437 shutdown_connections 2023-07-24T05:47:43.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:43.956+0000 7f2c0c9a6700 1 -- 172.21.15.77:0/20941437 wait complete. 2023-07-24T05:47:43.990 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-07-24T05:47:44.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.156+0000 7fa1ad37e700 1 Processor -- start 2023-07-24T05:47:44.163 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.156+0000 7fa1ad37e700 1 -- start start 2023-07-24T05:47:44.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.160+0000 7fa1ad37e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa1a806ac20 0x7fa1a80b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:44.165 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.160+0000 7fa1ad37e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fa1a80b2990 0x7fa1a80cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:44.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.160+0000 7fa1ad37e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1a80cce50 con 0x7fa1a80ae5a0 2023-07-24T05:47:44.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.160+0000 7fa1ad37e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1a8159bf0 con 0x7fa1a80b2990 2023-07-24T05:47:44.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.160+0000 7fa1ad37e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a80cd130 con 0x7fa1a806ac20 2023-07-24T05:47:44.166 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.160+0000 7fa1a6ffd700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa1a806ac20 0x7fa1a80b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:44.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.160+0000 7fa19e7fc700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7fa1a80ae5a0 0x7fa1a806b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.77:52926/0 (socket says 172.21.15.77:52926) 2023-07-24T05:47:44.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.160+0000 7fa19e7fc700 1 -- 172.21.15.77:0/1289071301 learned_addr learned my addr 172.21.15.77:0/1289071301 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:44.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.160+0000 7fa1a77fe700 1 --2- 172.21.15.77:0/1289071301 >> v2:172.21.15.103:3300/0 conn(0x7fa1a80b2990 0x7fa1a80cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:44.167 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.160+0000 7fa1a67fc700 1 -- 172.21.15.77:0/1289071301 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1730579529 0 0) 0x7fa1a80cce50 con 0x7fa1a80ae5a0 2023-07-24T05:47:44.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.160+0000 7fa1a67fc700 1 -- 172.21.15.77:0/1289071301 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1940035d0 con 0x7fa1a80ae5a0 2023-07-24T05:47:44.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.160+0000 7fa1a6ffd700 1 -- 172.21.15.77:0/1289071301 >> v2:172.21.15.103:3300/0 conn(0x7fa1a80b2990 msgr2=0x7fa1a80cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:44.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.160+0000 7fa1a6ffd700 1 --2- 172.21.15.77:0/1289071301 >> v2:172.21.15.103:3300/0 conn(0x7fa1a80b2990 0x7fa1a80cdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:44.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.160+0000 7fa1a6ffd700 1 -- 172.21.15.77:0/1289071301 >> v1:172.21.15.103:6789/0 conn(0x7fa1a80ae5a0 legacy=0x7fa1a806b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:44.168 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.160+0000 7fa1a6ffd700 1 -- 172.21.15.77:0/1289071301 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a80cd410 con 0x7fa1a806ac20 2023-07-24T05:47:44.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.160+0000 7fa1a6ffd700 1 --2- 172.21.15.77:0/1289071301 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa1a806ac20 0x7fa1a80b1670 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa198009850 tx=0x7fa198009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46df45b7bd385cd6 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:44.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.160+0000 7fa1a67fc700 1 -- 172.21.15.77:0/1289071301 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa198011830 con 0x7fa1a806ac20 2023-07-24T05:47:44.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.160+0000 7fa1a67fc700 1 -- 172.21.15.77:0/1289071301 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa198011990 con 0x7fa1a806ac20 2023-07-24T05:47:44.169 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.160+0000 7fa1a67fc700 1 -- 172.21.15.77:0/1289071301 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa198011d40 con 0x7fa1a806ac20 2023-07-24T05:47:44.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.164+0000 7fa1ad37e700 1 -- 172.21.15.77:0/1289071301 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa1a806ac20 msgr2=0x7fa1a80b1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:44.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.164+0000 7fa1ad37e700 1 --2- 172.21.15.77:0/1289071301 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa1a806ac20 0x7fa1a80b1670 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa198009850 tx=0x7fa198009b60 comp rx=0 tx=0).stop 2023-07-24T05:47:44.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.164+0000 7fa1ad37e700 1 -- 172.21.15.77:0/1289071301 shutdown_connections 2023-07-24T05:47:44.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.164+0000 7fa1ad37e700 1 --2- 172.21.15.77:0/1289071301 >> v2:172.21.15.103:3300/0 conn(0x7fa1a80b2990 0x7fa1a80cdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:44.170 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.164+0000 7fa1ad37e700 1 --2- 172.21.15.77:0/1289071301 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa1a806ac20 0x7fa1a80b1670 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:44.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.164+0000 7fa1ad37e700 1 -- 172.21.15.77:0/1289071301 >> 172.21.15.77:0/1289071301 conn(0x7fa1a80cacc0 msgr2=0x7fa1a80cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:44.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.164+0000 7fa1ad37e700 1 -- 172.21.15.77:0/1289071301 shutdown_connections 2023-07-24T05:47:44.171 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.164+0000 7fa1ad37e700 1 -- 172.21.15.77:0/1289071301 wait complete. 2023-07-24T05:47:44.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.164+0000 7fa1ad37e700 1 Processor -- start 2023-07-24T05:47:44.172 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.164+0000 7fa1ad37e700 1 -- start start 2023-07-24T05:47:44.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.168+0000 7fa1ad37e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa1a806ac20 0x7fa1a8159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:44.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.168+0000 7fa1ad37e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1a80ae5a0 0x7fa1a80c61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:44.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.168+0000 7fa1ad37e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1a80b2990 0x7fa1a809aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:44.174 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.168+0000 7fa1ad37e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a809beb0 con 0x7fa1a80b2990 2023-07-24T05:47:44.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.168+0000 7fa1ad37e700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a80c6730 con 0x7fa1a80ae5a0 2023-07-24T05:47:44.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.168+0000 7fa1ad37e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a809af90 con 0x7fa1a806ac20 2023-07-24T05:47:44.175 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.168+0000 7fa1a77fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1a80b2990 0x7fa1a809aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:44.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.168+0000 7fa1a77fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1a80b2990 0x7fa1a809aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42282/0 (socket says 172.21.15.77:42282) 2023-07-24T05:47:44.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.168+0000 7fa1a77fe700 1 -- 172.21.15.77:0/2605466787 learned_addr learned my addr 172.21.15.77:0/2605466787 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:44.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.168+0000 7fa1a6ffd700 1 --2- 172.21.15.77:0/2605466787 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa1a806ac20 0x7fa1a8159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:44.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.168+0000 7fa19e7fc700 1 --2- 172.21.15.77:0/2605466787 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1a80ae5a0 0x7fa1a80c61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:44.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.168+0000 7fa1a77fe700 1 -- 172.21.15.77:0/2605466787 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa1a806ac20 msgr2=0x7fa1a8159230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:44.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.168+0000 7fa1a77fe700 1 --2- 172.21.15.77:0/2605466787 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa1a806ac20 0x7fa1a8159230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:44.176 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.168+0000 7fa1a77fe700 1 -- 172.21.15.77:0/2605466787 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1a80ae5a0 msgr2=0x7fa1a80c61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:44.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.168+0000 7fa1a77fe700 1 --2- 172.21.15.77:0/2605466787 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1a80ae5a0 0x7fa1a80c61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:44.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.168+0000 7fa1a77fe700 1 -- 172.21.15.77:0/2605466787 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1980094b0 con 0x7fa1a80b2990 2023-07-24T05:47:44.177 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.168+0000 7fa19e7fc700 1 --2- 172.21.15.77:0/2605466787 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1a80ae5a0 0x7fa1a80c61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:44.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.168+0000 7fa1a77fe700 1 --2- 172.21.15.77:0/2605466787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1a80b2990 0x7fa1a809aa50 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fa1a000e7f0 tx=0x7fa1a000eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:44.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.168+0000 7fa19ffff700 1 -- 172.21.15.77:0/2605466787 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a00095c0 con 0x7fa1a80b2990 2023-07-24T05:47:44.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.168+0000 7fa19ffff700 1 -- 172.21.15.77:0/2605466787 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a0013680 con 0x7fa1a80b2990 2023-07-24T05:47:44.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.168+0000 7fa1ad37e700 1 -- 172.21.15.77:0/2605466787 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1a809b230 con 0x7fa1a80b2990 2023-07-24T05:47:44.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.168+0000 7fa19ffff700 1 -- 172.21.15.77:0/2605466787 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a0013a10 con 0x7fa1a80b2990 2023-07-24T05:47:44.178 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.168+0000 7fa1ad37e700 1 -- 172.21.15.77:0/2605466787 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1a809b7f0 con 0x7fa1a80b2990 2023-07-24T05:47:44.179 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.172+0000 7fa1ad37e700 1 -- 172.21.15.77:0/2605466787 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1a8072490 con 0x7fa1a80b2990 2023-07-24T05:47:44.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.172+0000 7fa19ffff700 1 -- 172.21.15.77:0/2605466787 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa1a0013b70 con 0x7fa1a80b2990 2023-07-24T05:47:44.181 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.176+0000 7fa19ffff700 1 --2- 172.21.15.77:0/2605466787 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa188066320 0x7fa1880687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:44.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.176+0000 7fa19ffff700 1 -- 172.21.15.77:0/2605466787 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fa1a0083ae0 con 0x7fa1a80b2990 2023-07-24T05:47:44.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.176+0000 7fa1a6ffd700 1 --2- 172.21.15.77:0/2605466787 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa188066320 0x7fa1880687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:44.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.176+0000 7fa1a6ffd700 1 --2- 172.21.15.77:0/2605466787 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa188066320 0x7fa1880687e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa1980090b0 tx=0x7fa198008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:44.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.180+0000 7fa19ffff700 1 -- 172.21.15.77:0/2605466787 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa1a00510d0 con 0x7fa1a80b2990 2023-07-24T05:47:44.424 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.416+0000 7fa1ad37e700 1 -- 172.21.15.77:0/2605466787 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fa1a80ae380 con 0x7fa1a80b2990 2023-07-24T05:47:44.434 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.428+0000 7fa19ffff700 1 -- 172.21.15.77:0/2605466787 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa1a00170a0 con 0x7fa1a80b2990 2023-07-24T05:47:44.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.432+0000 7fa1ad37e700 1 -- 172.21.15.77:0/2605466787 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa188066320 msgr2=0x7fa1880687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:44.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.432+0000 7fa1ad37e700 1 --2- 172.21.15.77:0/2605466787 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa188066320 0x7fa1880687e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa1980090b0 tx=0x7fa198008030 comp rx=0 tx=0).stop 2023-07-24T05:47:44.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.432+0000 7fa1ad37e700 1 -- 172.21.15.77:0/2605466787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1a80b2990 msgr2=0x7fa1a809aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:44.438 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.432+0000 7fa1ad37e700 1 --2- 172.21.15.77:0/2605466787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1a80b2990 0x7fa1a809aa50 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fa1a000e7f0 tx=0x7fa1a000eb00 comp rx=0 tx=0).stop 2023-07-24T05:47:44.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.432+0000 7fa1ad37e700 1 -- 172.21.15.77:0/2605466787 shutdown_connections 2023-07-24T05:47:44.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.432+0000 7fa1ad37e700 1 --2- 172.21.15.77:0/2605466787 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1a80b2990 0x7fa1a809aa50 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:44.439 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.432+0000 7fa1ad37e700 1 --2- 172.21.15.77:0/2605466787 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1a80ae5a0 0x7fa1a80c61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:44.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.432+0000 7fa1ad37e700 1 --2- 172.21.15.77:0/2605466787 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fa188066320 0x7fa1880687e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:44.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.432+0000 7fa1ad37e700 1 --2- 172.21.15.77:0/2605466787 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fa1a806ac20 0x7fa1a8159230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:44.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.432+0000 7fa1ad37e700 1 -- 172.21.15.77:0/2605466787 >> 172.21.15.77:0/2605466787 conn(0x7fa1a80cacc0 msgr2=0x7fa1a8069b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:44.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.432+0000 7fa1ad37e700 1 -- 172.21.15.77:0/2605466787 shutdown_connections 2023-07-24T05:47:44.440 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.432+0000 7fa1ad37e700 1 -- 172.21.15.77:0/2605466787 wait complete. 2023-07-24T05:47:44.460 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-07-24T05:47:44.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.624+0000 7ff9fffff700 1 Processor -- start 2023-07-24T05:47:44.631 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.624+0000 7ff9fffff700 1 -- start start 2023-07-24T05:47:44.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.624+0000 7ff9fffff700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ffa000b13c0 0x7ffa0006adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:44.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.624+0000 7ff9fffff700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ffa00069b10 0x7ffa00069fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:44.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.624+0000 7ff9fffff700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa000702f0 con 0x7ffa000a4580 2023-07-24T05:47:44.633 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.624+0000 7ff9fffff700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa0006a500 con 0x7ffa000b13c0 2023-07-24T05:47:44.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.624+0000 7ff9fffff700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa000adc40 con 0x7ffa00069b10 2023-07-24T05:47:44.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.628+0000 7ff9feffd700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ffa000b13c0 0x7ffa0006adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:44.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.628+0000 7ff9feffd700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ffa000b13c0 0x7ffa0006adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42290/0 (socket says 172.21.15.77:42290) 2023-07-24T05:47:44.634 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.628+0000 7ff9feffd700 1 -- 172.21.15.77:0/824167356 learned_addr learned my addr 172.21.15.77:0/824167356 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:44.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.628+0000 7ff9feffd700 1 -- 172.21.15.77:0/824167356 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ffa00069b10 msgr2=0x7ffa00069fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:44.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.628+0000 7ff9feffd700 1 --2- 172.21.15.77:0/824167356 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ffa00069b10 0x7ffa00069fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:44.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.628+0000 7ff9feffd700 1 -- 172.21.15.77:0/824167356 >> v1:172.21.15.103:6789/0 conn(0x7ffa000a4580 legacy=0x7ffa0006fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:44.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.628+0000 7ff9feffd700 1 -- 172.21.15.77:0/824167356 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0006b330 con 0x7ffa000b13c0 2023-07-24T05:47:44.635 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.628+0000 7ff9feffd700 1 --2- 172.21.15.77:0/824167356 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa000b13c0 0x7ffa0006adf0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0009910 tx=0x7ff9f0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=362adfbc98e2dcd9 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:44.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.628+0000 7ff9fdffb700 1 -- 172.21.15.77:0/824167356 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f0004230 con 0x7ffa000b13c0 2023-07-24T05:47:44.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.628+0000 7ff9fdffb700 1 -- 172.21.15.77:0/824167356 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f0004390 con 0x7ffa000b13c0 2023-07-24T05:47:44.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.628+0000 7ff9fdffb700 1 -- 172.21.15.77:0/824167356 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f0009e60 con 0x7ffa000b13c0 2023-07-24T05:47:44.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.628+0000 7ff9fffff700 1 -- 172.21.15.77:0/824167356 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa000b13c0 msgr2=0x7ffa0006adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:44.636 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.628+0000 7ff9fffff700 1 --2- 172.21.15.77:0/824167356 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa000b13c0 0x7ffa0006adf0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0009910 tx=0x7ff9f0009c20 comp rx=0 tx=0).stop 2023-07-24T05:47:44.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.628+0000 7ff9fffff700 1 -- 172.21.15.77:0/824167356 shutdown_connections 2023-07-24T05:47:44.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.628+0000 7ff9fffff700 1 --2- 172.21.15.77:0/824167356 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ffa00069b10 0x7ffa00069fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:44.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.628+0000 7ff9fffff700 1 --2- 172.21.15.77:0/824167356 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa000b13c0 0x7ffa0006adf0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:44.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.628+0000 7ff9fffff700 1 -- 172.21.15.77:0/824167356 >> 172.21.15.77:0/824167356 conn(0x7ffa000cacc0 msgr2=0x7ffa000cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:44.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.628+0000 7ff9fffff700 1 -- 172.21.15.77:0/824167356 shutdown_connections 2023-07-24T05:47:44.637 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.628+0000 7ff9fffff700 1 -- 172.21.15.77:0/824167356 wait complete. 2023-07-24T05:47:44.638 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.632+0000 7ff9fffff700 1 Processor -- start 2023-07-24T05:47:44.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.632+0000 7ff9fffff700 1 -- start start 2023-07-24T05:47:44.641 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.636+0000 7ff9fffff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa00069b10 0x7ffa00153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:44.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.636+0000 7ff9fffff700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ffa000a4580 0x7ffa00071530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:44.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.636+0000 7ff9fffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa000b13c0 0x7ffa000c1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:44.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.636+0000 7ff9fffff700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa00155040 con 0x7ffa000b13c0 2023-07-24T05:47:44.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.636+0000 7ff9fffff700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0015d790 con 0x7ffa00069b10 2023-07-24T05:47:44.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.636+0000 7ff9fffff700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0015da00 con 0x7ffa000a4580 2023-07-24T05:47:44.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.636+0000 7ff9ff7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa000b13c0 0x7ffa000c1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:44.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.636+0000 7ff9ff7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa000b13c0 0x7ffa000c1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42296/0 (socket says 172.21.15.77:42296) 2023-07-24T05:47:44.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.636+0000 7ff9ff7fe700 1 -- 172.21.15.77:0/3902843944 learned_addr learned my addr 172.21.15.77:0/3902843944 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:44.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.636+0000 7ff9feffd700 1 --2- 172.21.15.77:0/3902843944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa00069b10 0x7ffa00153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:44.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.636+0000 7ff9fe7fc700 1 --2- 172.21.15.77:0/3902843944 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ffa000a4580 0x7ffa00071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:44.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.636+0000 7ff9ff7fe700 1 -- 172.21.15.77:0/3902843944 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ffa000a4580 msgr2=0x7ffa00071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:44.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.636+0000 7ff9ff7fe700 1 --2- 172.21.15.77:0/3902843944 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ffa000a4580 0x7ffa00071530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:44.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.636+0000 7ff9ff7fe700 1 -- 172.21.15.77:0/3902843944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa00069b10 msgr2=0x7ffa00153590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:44.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.636+0000 7ff9ff7fe700 1 --2- 172.21.15.77:0/3902843944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa00069b10 0x7ffa00153590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:44.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.636+0000 7ff9ff7fe700 1 -- 172.21.15.77:0/3902843944 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f0009570 con 0x7ffa000b13c0 2023-07-24T05:47:44.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.636+0000 7ff9ff7fe700 1 --2- 172.21.15.77:0/3902843944 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa000b13c0 0x7ffa000c1d70 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ff9f800b970 tx=0x7ff9f800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:44.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.636+0000 7ff9e7fff700 1 -- 172.21.15.77:0/3902843944 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f800c930 con 0x7ffa000b13c0 2023-07-24T05:47:44.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.636+0000 7ff9e7fff700 1 -- 172.21.15.77:0/3902843944 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9f800cab0 con 0x7ffa000b13c0 2023-07-24T05:47:44.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.636+0000 7ff9e7fff700 1 -- 172.21.15.77:0/3902843944 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9f800ce60 con 0x7ffa000b13c0 2023-07-24T05:47:44.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.636+0000 7ff9fffff700 1 -- 172.21.15.77:0/3902843944 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa0015dce0 con 0x7ffa000b13c0 2023-07-24T05:47:44.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.636+0000 7ff9fffff700 1 -- 172.21.15.77:0/3902843944 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa00071a70 con 0x7ffa000b13c0 2023-07-24T05:47:44.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.640+0000 7ff9fffff700 1 -- 172.21.15.77:0/3902843944 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa001551b0 con 0x7ffa000b13c0 2023-07-24T05:47:44.646 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.640+0000 7ff9e7fff700 1 -- 172.21.15.77:0/3902843944 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff9f801d3b0 con 0x7ffa000b13c0 2023-07-24T05:47:44.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.640+0000 7ff9e7fff700 1 --2- 172.21.15.77:0/3902843944 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff9ec0662f0 0x7ff9ec0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:44.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.640+0000 7ff9e7fff700 1 -- 172.21.15.77:0/3902843944 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7ff9f80837c0 con 0x7ffa000b13c0 2023-07-24T05:47:44.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.640+0000 7ff9feffd700 1 --2- 172.21.15.77:0/3902843944 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff9ec0662f0 0x7ff9ec0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:44.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.644+0000 7ff9feffd700 1 --2- 172.21.15.77:0/3902843944 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff9ec0662f0 0x7ff9ec0687b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0009910 tx=0x7ff9f0008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:44.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.648+0000 7ff9e7fff700 1 -- 172.21.15.77:0/3902843944 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff9f8050e50 con 0x7ffa000b13c0 2023-07-24T05:47:44.879 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.872+0000 7ff9fffff700 1 -- 172.21.15.77:0/3902843944 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7ffa000ae470 con 0x7ffa000b13c0 2023-07-24T05:47:44.889 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.884+0000 7ff9e7fff700 1 -- 172.21.15.77:0/3902843944 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff9f8054470 con 0x7ffa000b13c0 2023-07-24T05:47:44.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.884+0000 7ff9fffff700 1 -- 172.21.15.77:0/3902843944 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff9ec0662f0 msgr2=0x7ff9ec0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:44.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.884+0000 7ff9fffff700 1 --2- 172.21.15.77:0/3902843944 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff9ec0662f0 0x7ff9ec0687b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff9f0009910 tx=0x7ff9f0008030 comp rx=0 tx=0).stop 2023-07-24T05:47:44.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.884+0000 7ff9fffff700 1 -- 172.21.15.77:0/3902843944 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa000b13c0 msgr2=0x7ffa000c1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:44.892 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.884+0000 7ff9fffff700 1 --2- 172.21.15.77:0/3902843944 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa000b13c0 0x7ffa000c1d70 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ff9f800b970 tx=0x7ff9f800bc80 comp rx=0 tx=0).stop 2023-07-24T05:47:44.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.884+0000 7ff9fffff700 1 -- 172.21.15.77:0/3902843944 shutdown_connections 2023-07-24T05:47:44.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.884+0000 7ff9fffff700 1 --2- 172.21.15.77:0/3902843944 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffa000b13c0 0x7ffa000c1d70 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:44.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.884+0000 7ff9fffff700 1 --2- 172.21.15.77:0/3902843944 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff9ec0662f0 0x7ff9ec0687b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:44.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.884+0000 7ff9fffff700 1 --2- 172.21.15.77:0/3902843944 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ffa000a4580 0x7ffa00071530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:44.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.884+0000 7ff9fffff700 1 --2- 172.21.15.77:0/3902843944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa00069b10 0x7ffa00153590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:44.893 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.884+0000 7ff9fffff700 1 -- 172.21.15.77:0/3902843944 >> 172.21.15.77:0/3902843944 conn(0x7ffa000cacc0 msgr2=0x7ffa000afde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:44.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.884+0000 7ff9fffff700 1 -- 172.21.15.77:0/3902843944 shutdown_connections 2023-07-24T05:47:44.894 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:44.884+0000 7ff9fffff700 1 -- 172.21.15.77:0/3902843944 wait complete. 2023-07-24T05:47:44.916 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-07-24T05:47:45.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.084+0000 7fb48b13a700 1 Processor -- start 2023-07-24T05:47:45.093 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.088+0000 7fb48b13a700 1 -- start start 2023-07-24T05:47:45.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.088+0000 7fb48b13a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fb4840ad330 0x7fb484164410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:45.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.088+0000 7fb48b13a700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4840cefa0 con 0x7fb48415dcb0 2023-07-24T05:47:45.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.088+0000 7fb48b13a700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4840cf280 con 0x7fb484071010 2023-07-24T05:47:45.095 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.088+0000 7fb48b13a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4840cca00 con 0x7fb4840ad330 2023-07-24T05:47:45.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.088+0000 7fb488ed6700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fb48415dcb0 0x7fb48415e090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55834/0 (socket says 172.21.15.77:55834) 2023-07-24T05:47:45.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.088+0000 7fb488ed6700 1 -- 172.21.15.77:0/935239558 learned_addr learned my addr 172.21.15.77:0/935239558 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:45.096 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.088+0000 7fb4896d7700 1 --2- 172.21.15.77:0/935239558 >> v2:172.21.15.103:3300/0 conn(0x7fb4840ad330 0x7fb484164410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:45.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.092+0000 7fb47b7fe700 1 -- 172.21.15.77:0/935239558 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 223715444 0 0) 0x7fb4840cf280 con 0x7fb484071010 2023-07-24T05:47:45.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.092+0000 7fb47b7fe700 1 -- 172.21.15.77:0/935239558 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb46c0057e0 con 0x7fb484071010 2023-07-24T05:47:45.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.092+0000 7fb47b7fe700 1 -- 172.21.15.77:0/935239558 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4096407383 0 0) 0x7fb4840cefa0 con 0x7fb48415dcb0 2023-07-24T05:47:45.097 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.092+0000 7fb47b7fe700 1 -- 172.21.15.77:0/935239558 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4840cf280 con 0x7fb48415dcb0 2023-07-24T05:47:45.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.092+0000 7fb4896d7700 1 -- 172.21.15.77:0/935239558 >> v1:172.21.15.103:6789/0 conn(0x7fb484071010 legacy=0x7fb484160ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:45.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.092+0000 7fb4896d7700 1 -- 172.21.15.77:0/935239558 >> v1:172.21.15.77:6789/0 conn(0x7fb48415dcb0 legacy=0x7fb48415e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:45.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.092+0000 7fb4896d7700 1 -- 172.21.15.77:0/935239558 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4840ccce0 con 0x7fb4840ad330 2023-07-24T05:47:45.098 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.092+0000 7fb4896d7700 1 --2- 172.21.15.77:0/935239558 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4840ad330 0x7fb484164410 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb47c009d90 tx=0x7fb47c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc2706b8dbbb6aaa server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:45.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.092+0000 7fb47b7fe700 1 -- 172.21.15.77:0/935239558 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47c00e070 con 0x7fb4840ad330 2023-07-24T05:47:45.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.092+0000 7fb47b7fe700 1 -- 172.21.15.77:0/935239558 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb47c00bb20 con 0x7fb4840ad330 2023-07-24T05:47:45.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.092+0000 7fb47b7fe700 1 -- 172.21.15.77:0/935239558 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47c012430 con 0x7fb4840ad330 2023-07-24T05:47:45.099 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.092+0000 7fb48b13a700 1 -- 172.21.15.77:0/935239558 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4840ad330 msgr2=0x7fb484164410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:45.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.092+0000 7fb48b13a700 1 --2- 172.21.15.77:0/935239558 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4840ad330 0x7fb484164410 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb47c009d90 tx=0x7fb47c00b330 comp rx=0 tx=0).stop 2023-07-24T05:47:45.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.092+0000 7fb48b13a700 1 -- 172.21.15.77:0/935239558 shutdown_connections 2023-07-24T05:47:45.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.092+0000 7fb48b13a700 1 --2- 172.21.15.77:0/935239558 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4840ad330 0x7fb484164410 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:45.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.092+0000 7fb48b13a700 1 -- 172.21.15.77:0/935239558 >> 172.21.15.77:0/935239558 conn(0x7fb4840ce410 msgr2=0x7fb4840ce7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:45.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.092+0000 7fb48b13a700 1 -- 172.21.15.77:0/935239558 shutdown_connections 2023-07-24T05:47:45.100 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.092+0000 7fb48b13a700 1 -- 172.21.15.77:0/935239558 wait complete. 2023-07-24T05:47:45.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.096+0000 7fb48b13a700 1 Processor -- start 2023-07-24T05:47:45.102 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.096+0000 7fb48b13a700 1 -- start start 2023-07-24T05:47:45.103 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.096+0000 7fb48b13a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb484071010 0x7fb4840c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:45.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.096+0000 7fb48b13a700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4840ad330 0x7fb484154300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:45.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.096+0000 7fb48b13a700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb48415dcb0 0x7fb48406cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:45.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.096+0000 7fb48b13a700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4840c2ca0 con 0x7fb484071010 2023-07-24T05:47:45.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.096+0000 7fb48b13a700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4840c6560 con 0x7fb4840ad330 2023-07-24T05:47:45.104 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.096+0000 7fb48b13a700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4840c69f0 con 0x7fb48415dcb0 2023-07-24T05:47:45.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.096+0000 7fb488ed6700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb484071010 0x7fb4840c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:45.105 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.096+0000 7fb488ed6700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb484071010 0x7fb4840c8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42302/0 (socket says 172.21.15.77:42302) 2023-07-24T05:47:45.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.096+0000 7fb488ed6700 1 -- 172.21.15.77:0/3527735063 learned_addr learned my addr 172.21.15.77:0/3527735063 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:45.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.096+0000 7fb4896d7700 1 --2- 172.21.15.77:0/3527735063 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb48415dcb0 0x7fb48406cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:45.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.096+0000 7fb47bfff700 1 --2- 172.21.15.77:0/3527735063 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4840ad330 0x7fb484154300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:45.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.096+0000 7fb488ed6700 1 -- 172.21.15.77:0/3527735063 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb48415dcb0 msgr2=0x7fb48406cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:45.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.096+0000 7fb488ed6700 1 --2- 172.21.15.77:0/3527735063 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb48415dcb0 0x7fb48406cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:45.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.096+0000 7fb488ed6700 1 -- 172.21.15.77:0/3527735063 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4840ad330 msgr2=0x7fb484154300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:45.106 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.096+0000 7fb488ed6700 1 --2- 172.21.15.77:0/3527735063 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4840ad330 0x7fb484154300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:45.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.096+0000 7fb488ed6700 1 -- 172.21.15.77:0/3527735063 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb47c009a70 con 0x7fb484071010 2023-07-24T05:47:45.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.100+0000 7fb488ed6700 1 --2- 172.21.15.77:0/3527735063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb484071010 0x7fb4840c8000 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb48000c500 tx=0x7fb48000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:45.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.100+0000 7fb4797fa700 1 -- 172.21.15.77:0/3527735063 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4800074e0 con 0x7fb484071010 2023-07-24T05:47:45.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.100+0000 7fb4797fa700 1 -- 172.21.15.77:0/3527735063 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb480007640 con 0x7fb484071010 2023-07-24T05:47:45.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.100+0000 7fb48b13a700 1 -- 172.21.15.77:0/3527735063 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4840c5950 con 0x7fb484071010 2023-07-24T05:47:45.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.100+0000 7fb4797fa700 1 -- 172.21.15.77:0/3527735063 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb480005a90 con 0x7fb484071010 2023-07-24T05:47:45.107 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.100+0000 7fb48b13a700 1 -- 172.21.15.77:0/3527735063 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4840c5f10 con 0x7fb484071010 2023-07-24T05:47:45.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.100+0000 7fb48b13a700 1 -- 172.21.15.77:0/3527735063 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb48404df10 con 0x7fb484071010 2023-07-24T05:47:45.108 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.100+0000 7fb4797fa700 1 -- 172.21.15.77:0/3527735063 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb480005bf0 con 0x7fb484071010 2023-07-24T05:47:45.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.104+0000 7fb4797fa700 1 --2- 172.21.15.77:0/3527735063 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb4700662f0 0x7fb4700687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:45.109 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.104+0000 7fb4797fa700 1 -- 172.21.15.77:0/3527735063 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fb480082f80 con 0x7fb484071010 2023-07-24T05:47:45.110 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.104+0000 7fb47bfff700 1 --2- 172.21.15.77:0/3527735063 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb4700662f0 0x7fb4700687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:45.111 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.104+0000 7fb47bfff700 1 --2- 172.21.15.77:0/3527735063 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb4700662f0 0x7fb4700687b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb474007fd0 tx=0x7fb474009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:45.115 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.108+0000 7fb4797fa700 1 -- 172.21.15.77:0/3527735063 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb480050630 con 0x7fb484071010 2023-07-24T05:47:45.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.336+0000 7fb48b13a700 1 -- 172.21.15.77:0/3527735063 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fb4840c1cc0 con 0x7fb484071010 2023-07-24T05:47:45.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.344+0000 7fb4797fa700 1 -- 172.21.15.77:0/3527735063 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb4800170a0 con 0x7fb484071010 2023-07-24T05:47:45.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.348+0000 7fb48b13a700 1 -- 172.21.15.77:0/3527735063 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb4700662f0 msgr2=0x7fb4700687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:45.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.348+0000 7fb48b13a700 1 --2- 172.21.15.77:0/3527735063 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb4700662f0 0x7fb4700687b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb474007fd0 tx=0x7fb474009040 comp rx=0 tx=0).stop 2023-07-24T05:47:45.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.348+0000 7fb48b13a700 1 -- 172.21.15.77:0/3527735063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb484071010 msgr2=0x7fb4840c8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:45.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.348+0000 7fb48b13a700 1 --2- 172.21.15.77:0/3527735063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb484071010 0x7fb4840c8000 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb48000c500 tx=0x7fb48000c810 comp rx=0 tx=0).stop 2023-07-24T05:47:45.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.348+0000 7fb48b13a700 1 -- 172.21.15.77:0/3527735063 shutdown_connections 2023-07-24T05:47:45.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.348+0000 7fb48b13a700 1 --2- 172.21.15.77:0/3527735063 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fb4700662f0 0x7fb4700687b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:45.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.348+0000 7fb48b13a700 1 --2- 172.21.15.77:0/3527735063 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fb48415dcb0 0x7fb48406cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:45.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.348+0000 7fb48b13a700 1 --2- 172.21.15.77:0/3527735063 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4840ad330 0x7fb484154300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:45.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.348+0000 7fb48b13a700 1 --2- 172.21.15.77:0/3527735063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb484071010 0x7fb4840c8000 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:45.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.348+0000 7fb48b13a700 1 -- 172.21.15.77:0/3527735063 >> 172.21.15.77:0/3527735063 conn(0x7fb4840ce410 msgr2=0x7fb4840aafe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:45.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.348+0000 7fb48b13a700 1 -- 172.21.15.77:0/3527735063 shutdown_connections 2023-07-24T05:47:45.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.352+0000 7fb48b13a700 1 -- 172.21.15.77:0/3527735063 wait complete. 2023-07-24T05:47:45.378 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-07-24T05:47:45.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.544+0000 7f5afffae700 1 Processor -- start 2023-07-24T05:47:45.550 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.544+0000 7f5afffae700 1 -- start start 2023-07-24T05:47:45.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.544+0000 7f5afffae700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f5af8161030 0x7f5af80c13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:45.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.544+0000 7f5afffae700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5af8069ef0 0x7f5af80c1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:45.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.544+0000 7f5afffae700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5af80cac90 0x7f5af8164b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:45.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.544+0000 7f5afffae700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af806b810 con 0x7f5af80cac90 2023-07-24T05:47:45.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.544+0000 7f5afffae700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af80cb230 con 0x7f5af8161030 2023-07-24T05:47:45.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.544+0000 7f5afffae700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af80cb510 con 0x7f5af8069ef0 2023-07-24T05:47:45.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.544+0000 7f5afe54b700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5af80cac90 0x7f5af8164b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:45.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.548+0000 7f5afd549700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5af8069ef0 0x7f5af80c1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:45.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.548+0000 7f5afd549700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5af8069ef0 0x7f5af80c1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.77:55732/0 (socket says 172.21.15.77:55732) 2023-07-24T05:47:45.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.548+0000 7f5afd549700 1 -- 172.21.15.77:0/3156421684 learned_addr learned my addr 172.21.15.77:0/3156421684 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:45.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.548+0000 7f5afdd4a700 1 --2- 172.21.15.77:0/3156421684 >> v2:172.21.15.103:3300/0 conn(0x7f5af8161030 0x7f5af80c13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:45.554 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.548+0000 7f5afd549700 1 -- 172.21.15.77:0/3156421684 >> v2:172.21.15.103:3300/0 conn(0x7f5af8161030 msgr2=0x7f5af80c13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:45.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.548+0000 7f5afd549700 1 --2- 172.21.15.77:0/3156421684 >> v2:172.21.15.103:3300/0 conn(0x7f5af8161030 0x7f5af80c13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:45.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.548+0000 7f5afd549700 1 -- 172.21.15.77:0/3156421684 >> v2:172.21.15.77:3300/0 conn(0x7f5af80cac90 msgr2=0x7f5af8164b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:45.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.548+0000 7f5afd549700 1 --2- 172.21.15.77:0/3156421684 >> v2:172.21.15.77:3300/0 conn(0x7f5af80cac90 0x7f5af8164b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:45.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.548+0000 7f5afd549700 1 -- 172.21.15.77:0/3156421684 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af80cb7f0 con 0x7f5af8069ef0 2023-07-24T05:47:45.555 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.548+0000 7f5afe54b700 1 --2- 172.21.15.77:0/3156421684 >> v2:172.21.15.77:3300/0 conn(0x7f5af80cac90 0x7f5af8164b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:47:45.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.548+0000 7f5afd549700 1 --2- 172.21.15.77:0/3156421684 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5af8069ef0 0x7f5af80c1920 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5af806e260 tx=0x7f5ae8009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec50d4472c01760f server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:45.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.548+0000 7f5afcd48700 1 -- 172.21.15.77:0/3156421684 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8011830 con 0x7f5af8069ef0 2023-07-24T05:47:45.556 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.548+0000 7f5afcd48700 1 -- 172.21.15.77:0/3156421684 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae8011990 con 0x7f5af8069ef0 2023-07-24T05:47:45.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.548+0000 7f5afcd48700 1 -- 172.21.15.77:0/3156421684 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae8011d20 con 0x7f5af8069ef0 2023-07-24T05:47:45.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.548+0000 7f5afffae700 1 -- 172.21.15.77:0/3156421684 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5af8069ef0 msgr2=0x7f5af80c1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:45.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.548+0000 7f5afffae700 1 --2- 172.21.15.77:0/3156421684 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5af8069ef0 0x7f5af80c1920 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f5af806e260 tx=0x7f5ae8009bf0 comp rx=0 tx=0).stop 2023-07-24T05:47:45.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.548+0000 7f5afffae700 1 -- 172.21.15.77:0/3156421684 shutdown_connections 2023-07-24T05:47:45.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.548+0000 7f5afffae700 1 --2- 172.21.15.77:0/3156421684 >> v2:172.21.15.77:3300/0 conn(0x7f5af80cac90 0x7f5af8164b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:45.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.548+0000 7f5afffae700 1 --2- 172.21.15.77:0/3156421684 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5af8069ef0 0x7f5af80c1920 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:45.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.548+0000 7f5afffae700 1 --2- 172.21.15.77:0/3156421684 >> v2:172.21.15.103:3300/0 conn(0x7f5af8161030 0x7f5af80c13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:45.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.548+0000 7f5afffae700 1 -- 172.21.15.77:0/3156421684 >> 172.21.15.77:0/3156421684 conn(0x7f5af80ce410 msgr2=0x7f5af80ce7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:45.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.548+0000 7f5afffae700 1 -- 172.21.15.77:0/3156421684 shutdown_connections 2023-07-24T05:47:45.558 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.548+0000 7f5afffae700 1 -- 172.21.15.77:0/3156421684 wait complete. 2023-07-24T05:47:45.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.552+0000 7f5afffae700 1 Processor -- start 2023-07-24T05:47:45.559 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.552+0000 7f5afffae700 1 -- start start 2023-07-24T05:47:45.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.552+0000 7f5afffae700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5af8069ef0 0x7f5af8161970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:45.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.552+0000 7f5afffae700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5af80cac90 0x7f5af80ac500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:45.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.552+0000 7f5afffae700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5af8161030 0x7f5af8156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:45.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.552+0000 7f5afffae700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af80c6700 con 0x7f5af8069ef0 2023-07-24T05:47:45.561 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.552+0000 7f5afffae700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af80c5a80 con 0x7f5af80cac90 2023-07-24T05:47:45.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.552+0000 7f5afffae700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af80c5d60 con 0x7f5af8161030 2023-07-24T05:47:45.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.556+0000 7f5afdd4a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5af8069ef0 0x7f5af8161970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:45.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.556+0000 7f5afdd4a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5af8069ef0 0x7f5af8161970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42316/0 (socket says 172.21.15.77:42316) 2023-07-24T05:47:45.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.556+0000 7f5afdd4a700 1 -- 172.21.15.77:0/783562249 learned_addr learned my addr 172.21.15.77:0/783562249 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:45.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.556+0000 7f5afd549700 1 --2- 172.21.15.77:0/783562249 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5af80cac90 0x7f5af80ac500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:45.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.556+0000 7f5afe54b700 1 --2- 172.21.15.77:0/783562249 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5af8161030 0x7f5af8156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:45.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.556+0000 7f5afdd4a700 1 -- 172.21.15.77:0/783562249 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5af8161030 msgr2=0x7f5af8156460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:45.563 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.556+0000 7f5afdd4a700 1 --2- 172.21.15.77:0/783562249 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5af8161030 0x7f5af8156460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:45.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.556+0000 7f5afdd4a700 1 -- 172.21.15.77:0/783562249 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5af80cac90 msgr2=0x7f5af80ac500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:45.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.556+0000 7f5afdd4a700 1 --2- 172.21.15.77:0/783562249 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5af80cac90 0x7f5af80ac500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:45.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.556+0000 7f5afdd4a700 1 -- 172.21.15.77:0/783562249 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af0009a70 con 0x7f5af8069ef0 2023-07-24T05:47:45.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.556+0000 7f5afdd4a700 1 --2- 172.21.15.77:0/783562249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5af8069ef0 0x7f5af8161970 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5af400e9b0 tx=0x7f5af400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:45.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.556+0000 7f5aee7fc700 1 -- 172.21.15.77:0/783562249 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af4009670 con 0x7f5af8069ef0 2023-07-24T05:47:45.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.556+0000 7f5aee7fc700 1 -- 172.21.15.77:0/783562249 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af400eea0 con 0x7f5af8069ef0 2023-07-24T05:47:45.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.556+0000 7f5afffae700 1 -- 172.21.15.77:0/783562249 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ae8009570 con 0x7f5af8069ef0 2023-07-24T05:47:45.564 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.556+0000 7f5aee7fc700 1 -- 172.21.15.77:0/783562249 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af400ca50 con 0x7f5af8069ef0 2023-07-24T05:47:45.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.556+0000 7f5afffae700 1 -- 172.21.15.77:0/783562249 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5af80c6320 con 0x7f5af8069ef0 2023-07-24T05:47:45.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.556+0000 7f5afffae700 1 -- 172.21.15.77:0/783562249 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5af80c6970 con 0x7f5af8069ef0 2023-07-24T05:47:45.565 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.560+0000 7f5aee7fc700 1 -- 172.21.15.77:0/783562249 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5af400cbb0 con 0x7f5af8069ef0 2023-07-24T05:47:45.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.560+0000 7f5aee7fc700 1 --2- 172.21.15.77:0/783562249 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f5adc0662f0 0x7f5adc0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:45.567 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.560+0000 7f5aee7fc700 1 -- 172.21.15.77:0/783562249 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f5af4083e40 con 0x7f5af8069ef0 2023-07-24T05:47:45.568 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.560+0000 7f5afd549700 1 --2- 172.21.15.77:0/783562249 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f5adc0662f0 0x7f5adc0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:45.569 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.564+0000 7f5afd549700 1 --2- 172.21.15.77:0/783562249 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f5adc0662f0 0x7f5adc0687b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5af806e260 tx=0x7f5ae8008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:45.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.564+0000 7f5aee7fc700 1 -- 172.21.15.77:0/783562249 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5af4054ff0 con 0x7f5af8069ef0 2023-07-24T05:47:45.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.796+0000 7f5afffae700 1 -- 172.21.15.77:0/783562249 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f5af804df10 con 0x7f5af8069ef0 2023-07-24T05:47:45.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.804+0000 7f5aee7fc700 1 -- 172.21.15.77:0/783562249 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5af40210a0 con 0x7f5af8069ef0 2023-07-24T05:47:45.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.808+0000 7f5afffae700 1 -- 172.21.15.77:0/783562249 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f5adc0662f0 msgr2=0x7f5adc0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:45.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.808+0000 7f5afffae700 1 --2- 172.21.15.77:0/783562249 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f5adc0662f0 0x7f5adc0687b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5af806e260 tx=0x7f5ae8008030 comp rx=0 tx=0).stop 2023-07-24T05:47:45.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.808+0000 7f5afffae700 1 -- 172.21.15.77:0/783562249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5af8069ef0 msgr2=0x7f5af8161970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:45.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.808+0000 7f5afffae700 1 --2- 172.21.15.77:0/783562249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5af8069ef0 0x7f5af8161970 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5af400e9b0 tx=0x7f5af400ecc0 comp rx=0 tx=0).stop 2023-07-24T05:47:45.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.808+0000 7f5afffae700 1 -- 172.21.15.77:0/783562249 shutdown_connections 2023-07-24T05:47:45.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.808+0000 7f5afffae700 1 --2- 172.21.15.77:0/783562249 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f5adc0662f0 0x7f5adc0687b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:45.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.808+0000 7f5afffae700 1 --2- 172.21.15.77:0/783562249 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5af8161030 0x7f5af8156460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:45.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.808+0000 7f5afffae700 1 --2- 172.21.15.77:0/783562249 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5af80cac90 0x7f5af80ac500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:45.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.808+0000 7f5afffae700 1 --2- 172.21.15.77:0/783562249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5af8069ef0 0x7f5af8161970 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:45.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.808+0000 7f5afffae700 1 -- 172.21.15.77:0/783562249 >> 172.21.15.77:0/783562249 conn(0x7f5af80ce410 msgr2=0x7f5af80c8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:45.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.808+0000 7f5afffae700 1 -- 172.21.15.77:0/783562249 shutdown_connections 2023-07-24T05:47:45.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:45.808+0000 7f5afffae700 1 -- 172.21.15.77:0/783562249 wait complete. 2023-07-24T05:47:45.837 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-07-24T05:47:46.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.008+0000 7f1d1e62c700 1 Processor -- start 2023-07-24T05:47:46.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.008+0000 7f1d1e62c700 1 -- start start 2023-07-24T05:47:46.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.012+0000 7f1d1e62c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f1d180ca890 0x7f1d180cbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:46.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.012+0000 7f1d1e62c700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1d180cc520 0x7f1d180c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:46.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.012+0000 7f1d1e62c700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d1806a5c0 con 0x7f1d180cde50 2023-07-24T05:47:46.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.012+0000 7f1d1e62c700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d180cac70 con 0x7f1d180cc520 2023-07-24T05:47:46.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.012+0000 7f1d1e62c700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d1806a8a0 con 0x7f1d180ca890 2023-07-24T05:47:46.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.012+0000 7f1d1cbc9700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1d180cc520 0x7f1d180c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:46.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.012+0000 7f1d1cbc9700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f1d180cc520 0x7f1d180c8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42322/0 (socket says 172.21.15.77:42322) 2023-07-24T05:47:46.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.012+0000 7f1d1cbc9700 1 -- 172.21.15.77:0/1657200961 learned_addr learned my addr 172.21.15.77:0/1657200961 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:46.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.012+0000 7f1d17fff700 1 --2- 172.21.15.77:0/1657200961 >> v2:172.21.15.103:3300/0 conn(0x7f1d180ca890 0x7f1d180cbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:46.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.012+0000 7f1d1cbc9700 1 -- 172.21.15.77:0/1657200961 >> v2:172.21.15.103:3300/0 conn(0x7f1d180ca890 msgr2=0x7f1d180cbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:46.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.012+0000 7f1d1cbc9700 1 --2- 172.21.15.77:0/1657200961 >> v2:172.21.15.103:3300/0 conn(0x7f1d180ca890 0x7f1d180cbfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:46.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.012+0000 7f1d1cbc9700 1 -- 172.21.15.77:0/1657200961 >> v1:172.21.15.103:6789/0 conn(0x7f1d180cde50 legacy=0x7f1d1806cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:46.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.012+0000 7f1d1cbc9700 1 -- 172.21.15.77:0/1657200961 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1806ab80 con 0x7f1d180cc520 2023-07-24T05:47:46.022 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.016+0000 7f1d1cbc9700 1 --2- 172.21.15.77:0/1657200961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d180cc520 0x7f1d180c8a60 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f1d1806dcc0 tx=0x7f1d1000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38f477258fa35f0f server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:46.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.016+0000 7f1d177fe700 1 -- 172.21.15.77:0/1657200961 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1000e070 con 0x7f1d180cc520 2023-07-24T05:47:46.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.016+0000 7f1d177fe700 1 -- 172.21.15.77:0/1657200961 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d1000b9c0 con 0x7f1d180cc520 2023-07-24T05:47:46.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.016+0000 7f1d177fe700 1 -- 172.21.15.77:0/1657200961 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1000bd70 con 0x7f1d180cc520 2023-07-24T05:47:46.023 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.016+0000 7f1d1e62c700 1 -- 172.21.15.77:0/1657200961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d180cc520 msgr2=0x7f1d180c8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:46.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.016+0000 7f1d1e62c700 1 --2- 172.21.15.77:0/1657200961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d180cc520 0x7f1d180c8a60 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f1d1806dcc0 tx=0x7f1d1000b330 comp rx=0 tx=0).stop 2023-07-24T05:47:46.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.016+0000 7f1d1e62c700 1 -- 172.21.15.77:0/1657200961 shutdown_connections 2023-07-24T05:47:46.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.016+0000 7f1d1e62c700 1 --2- 172.21.15.77:0/1657200961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d180cc520 0x7f1d180c8a60 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:46.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.016+0000 7f1d1e62c700 1 --2- 172.21.15.77:0/1657200961 >> v2:172.21.15.103:3300/0 conn(0x7f1d180ca890 0x7f1d180cbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:46.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.016+0000 7f1d1e62c700 1 -- 172.21.15.77:0/1657200961 >> 172.21.15.77:0/1657200961 conn(0x7f1d180ce410 msgr2=0x7f1d180ce7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:46.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.016+0000 7f1d1e62c700 1 -- 172.21.15.77:0/1657200961 shutdown_connections 2023-07-24T05:47:46.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.016+0000 7f1d1e62c700 1 -- 172.21.15.77:0/1657200961 wait complete. 2023-07-24T05:47:46.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.020+0000 7f1d1e62c700 1 Processor -- start 2023-07-24T05:47:46.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.020+0000 7f1d1e62c700 1 -- start start 2023-07-24T05:47:46.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.020+0000 7f1d1e62c700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1d180ca890 0x7f1d1806b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:46.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.020+0000 7f1d1e62c700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d180cc520 0x7f1d1806bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:46.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.020+0000 7f1d1e62c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d180cde50 0x7f1d181448b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:46.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.020+0000 7f1d1e62c700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d18070ed0 con 0x7f1d180cde50 2023-07-24T05:47:46.028 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.020+0000 7f1d1e62c700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d180711b0 con 0x7f1d180cc520 2023-07-24T05:47:46.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.020+0000 7f1d1e62c700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d18071490 con 0x7f1d180ca890 2023-07-24T05:47:46.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.020+0000 7f1d1cbc9700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d180cde50 0x7f1d181448b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:46.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.020+0000 7f1d1cbc9700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d180cde50 0x7f1d181448b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42328/0 (socket says 172.21.15.77:42328) 2023-07-24T05:47:46.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.020+0000 7f1d1cbc9700 1 -- 172.21.15.77:0/3842033877 learned_addr learned my addr 172.21.15.77:0/3842033877 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:46.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.020+0000 7f1d17fff700 1 --2- 172.21.15.77:0/3842033877 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1d180ca890 0x7f1d1806b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:46.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.020+0000 7f1d0ffff700 1 --2- 172.21.15.77:0/3842033877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d180cc520 0x7f1d1806bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:46.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.024+0000 7f1d1cbc9700 1 -- 172.21.15.77:0/3842033877 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1d180ca890 msgr2=0x7f1d1806b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:46.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.024+0000 7f1d1cbc9700 1 --2- 172.21.15.77:0/3842033877 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1d180ca890 0x7f1d1806b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:46.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.024+0000 7f1d1cbc9700 1 -- 172.21.15.77:0/3842033877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d180cc520 msgr2=0x7f1d1806bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:46.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.024+0000 7f1d1cbc9700 1 --2- 172.21.15.77:0/3842033877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d180cc520 0x7f1d1806bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:46.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.024+0000 7f1d1cbc9700 1 -- 172.21.15.77:0/3842033877 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d10009b30 con 0x7f1d180cde50 2023-07-24T05:47:46.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.024+0000 7f1d17fff700 1 --2- 172.21.15.77:0/3842033877 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1d180ca890 0x7f1d1806b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:46.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.024+0000 7f1d1cbc9700 1 --2- 172.21.15.77:0/3842033877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d180cde50 0x7f1d181448b0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f1d1000b730 tx=0x7f1d10004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:46.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.024+0000 7f1d157fa700 1 -- 172.21.15.77:0/3842033877 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d10004250 con 0x7f1d180cde50 2023-07-24T05:47:46.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.024+0000 7f1d157fa700 1 -- 172.21.15.77:0/3842033877 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d100043b0 con 0x7f1d180cde50 2023-07-24T05:47:46.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.024+0000 7f1d157fa700 1 -- 172.21.15.77:0/3842033877 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d10004720 con 0x7f1d180cde50 2023-07-24T05:47:46.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.024+0000 7f1d1e62c700 1 -- 172.21.15.77:0/3842033877 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d18071770 con 0x7f1d180cde50 2023-07-24T05:47:46.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.024+0000 7f1d1e62c700 1 -- 172.21.15.77:0/3842033877 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d180c9eb0 con 0x7f1d180cde50 2023-07-24T05:47:46.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.024+0000 7f1d1e62c700 1 -- 172.21.15.77:0/3842033877 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d180cd040 con 0x7f1d180cde50 2023-07-24T05:47:46.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.028+0000 7f1d157fa700 1 -- 172.21.15.77:0/3842033877 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1d1001c440 con 0x7f1d180cde50 2023-07-24T05:47:46.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.028+0000 7f1d157fa700 1 --2- 172.21.15.77:0/3842033877 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f1cf80662f0 0x7f1cf80687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:46.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.028+0000 7f1d157fa700 1 -- 172.21.15.77:0/3842033877 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f1d100851c0 con 0x7f1d180cde50 2023-07-24T05:47:46.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.028+0000 7f1d17fff700 1 --2- 172.21.15.77:0/3842033877 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f1cf80662f0 0x7f1cf80687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:46.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.032+0000 7f1d17fff700 1 --2- 172.21.15.77:0/3842033877 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f1cf80662f0 0x7f1cf80687b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1d08006fd0 tx=0x7f1d08008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:46.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.036+0000 7f1d157fa700 1 -- 172.21.15.77:0/3842033877 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1d10056260 con 0x7f1d180cde50 2023-07-24T05:47:46.274 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.268+0000 7f1d1e62c700 1 -- 172.21.15.77:0/3842033877 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f1d18071c90 con 0x7f1d180cde50 2023-07-24T05:47:46.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.276+0000 7f1d157fa700 1 -- 172.21.15.77:0/3842033877 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1d18071c90 con 0x7f1d180cde50 2023-07-24T05:47:46.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.276+0000 7f1d1e62c700 1 -- 172.21.15.77:0/3842033877 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f1cf80662f0 msgr2=0x7f1cf80687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:46.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.276+0000 7f1d1e62c700 1 --2- 172.21.15.77:0/3842033877 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f1cf80662f0 0x7f1cf80687b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1d08006fd0 tx=0x7f1d08008040 comp rx=0 tx=0).stop 2023-07-24T05:47:46.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.276+0000 7f1d1e62c700 1 -- 172.21.15.77:0/3842033877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d180cde50 msgr2=0x7f1d181448b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:46.284 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.276+0000 7f1d1e62c700 1 --2- 172.21.15.77:0/3842033877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d180cde50 0x7f1d181448b0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f1d1000b730 tx=0x7f1d10004af0 comp rx=0 tx=0).stop 2023-07-24T05:47:46.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.276+0000 7f1d1e62c700 1 -- 172.21.15.77:0/3842033877 shutdown_connections 2023-07-24T05:47:46.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.276+0000 7f1d1e62c700 1 --2- 172.21.15.77:0/3842033877 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1d180cde50 0x7f1d181448b0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:46.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.276+0000 7f1d1e62c700 1 --2- 172.21.15.77:0/3842033877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d180cc520 0x7f1d1806bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:46.285 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.276+0000 7f1d1e62c700 1 --2- 172.21.15.77:0/3842033877 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f1cf80662f0 0x7f1cf80687b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:46.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.276+0000 7f1d1e62c700 1 --2- 172.21.15.77:0/3842033877 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f1d180ca890 0x7f1d1806b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:46.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.276+0000 7f1d1e62c700 1 -- 172.21.15.77:0/3842033877 >> 172.21.15.77:0/3842033877 conn(0x7f1d180ce410 msgr2=0x7f1d180ab350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:46.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.276+0000 7f1d1e62c700 1 -- 172.21.15.77:0/3842033877 shutdown_connections 2023-07-24T05:47:46.286 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.276+0000 7f1d1e62c700 1 -- 172.21.15.77:0/3842033877 wait complete. 2023-07-24T05:47:46.306 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-07-24T05:47:46.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.476+0000 7fdcbee47700 1 Processor -- start 2023-07-24T05:47:46.482 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.476+0000 7fdcbee47700 1 -- start start 2023-07-24T05:47:46.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.476+0000 7fdcbee47700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdcb8161100 0x7fdcb80b1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:46.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.476+0000 7fdcbee47700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fdcb80b15d0 0x7fdcb80af700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:46.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.476+0000 7fdcbee47700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcb80af170 con 0x7fdcb8160d20 2023-07-24T05:47:46.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.476+0000 7fdcbee47700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcb80b19d0 con 0x7fdcb8161100 2023-07-24T05:47:46.484 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.476+0000 7fdcbee47700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcb80ae5f0 con 0x7fdcb80b15d0 2023-07-24T05:47:46.485 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.476+0000 7fdcbd644700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdcb8161100 0x7fdcb80b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:46.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.476+0000 7fdcbd644700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fdcb8161100 0x7fdcb80b1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42344/0 (socket says 172.21.15.77:42344) 2023-07-24T05:47:46.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.476+0000 7fdcbd644700 1 -- 172.21.15.77:0/1791226457 learned_addr learned my addr 172.21.15.77:0/1791226457 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:46.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.480+0000 7fdcbe646700 1 --2- 172.21.15.77:0/1791226457 >> v2:172.21.15.103:3300/0 conn(0x7fdcb80b15d0 0x7fdcb80af700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:46.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.480+0000 7fdcbd644700 1 -- 172.21.15.77:0/1791226457 >> v2:172.21.15.103:3300/0 conn(0x7fdcb80b15d0 msgr2=0x7fdcb80af700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:46.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.480+0000 7fdcbd644700 1 --2- 172.21.15.77:0/1791226457 >> v2:172.21.15.103:3300/0 conn(0x7fdcb80b15d0 0x7fdcb80af700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:46.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.480+0000 7fdcbd644700 1 -- 172.21.15.77:0/1791226457 >> v1:172.21.15.103:6789/0 conn(0x7fdcb8160d20 legacy=0x7fdcb80adba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:46.486 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.480+0000 7fdcbd644700 1 -- 172.21.15.77:0/1791226457 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb80ae8d0 con 0x7fdcb8161100 2023-07-24T05:47:46.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.480+0000 7fdcbd644700 1 --2- 172.21.15.77:0/1791226457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcb8161100 0x7fdcb80b1090 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fdcb806b770 tx=0x7fdca8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c82da4b6387e1c6e server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:46.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.480+0000 7fdcbce43700 1 -- 172.21.15.77:0/1791226457 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca8011830 con 0x7fdcb8161100 2023-07-24T05:47:46.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.480+0000 7fdcbce43700 1 -- 172.21.15.77:0/1791226457 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca8011990 con 0x7fdcb8161100 2023-07-24T05:47:46.487 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.480+0000 7fdcbce43700 1 -- 172.21.15.77:0/1791226457 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca8011d20 con 0x7fdcb8161100 2023-07-24T05:47:46.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.480+0000 7fdcbee47700 1 -- 172.21.15.77:0/1791226457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcb8161100 msgr2=0x7fdcb80b1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:46.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.480+0000 7fdcbee47700 1 --2- 172.21.15.77:0/1791226457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcb8161100 0x7fdcb80b1090 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fdcb806b770 tx=0x7fdca8009bf0 comp rx=0 tx=0).stop 2023-07-24T05:47:46.488 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.480+0000 7fdcbee47700 1 -- 172.21.15.77:0/1791226457 shutdown_connections 2023-07-24T05:47:46.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.480+0000 7fdcbee47700 1 --2- 172.21.15.77:0/1791226457 >> v2:172.21.15.103:3300/0 conn(0x7fdcb80b15d0 0x7fdcb80af700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:46.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.480+0000 7fdcbee47700 1 --2- 172.21.15.77:0/1791226457 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcb8161100 0x7fdcb80b1090 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:46.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.480+0000 7fdcbee47700 1 -- 172.21.15.77:0/1791226457 >> 172.21.15.77:0/1791226457 conn(0x7fdcb80cacc0 msgr2=0x7fdcb80cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:46.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.480+0000 7fdcbee47700 1 -- 172.21.15.77:0/1791226457 shutdown_connections 2023-07-24T05:47:46.489 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.480+0000 7fdcbee47700 1 -- 172.21.15.77:0/1791226457 wait complete. 2023-07-24T05:47:46.491 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.484+0000 7fdcbee47700 1 Processor -- start 2023-07-24T05:47:46.492 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.484+0000 7fdcbee47700 1 -- start start 2023-07-24T05:47:46.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.488+0000 7fdcbee47700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdcb80b15d0 0x7fdcb80989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:46.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.488+0000 7fdcbee47700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcb8160d20 0x7fdcb8098f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:46.493 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.488+0000 7fdcbee47700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdcb8161100 0x7fdcb8099470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:46.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.488+0000 7fdcbee47700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb8161590 con 0x7fdcb8160d20 2023-07-24T05:47:46.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.488+0000 7fdcbee47700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb81617e0 con 0x7fdcb80b15d0 2023-07-24T05:47:46.494 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.488+0000 7fdcbee47700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb8161ac0 con 0x7fdcb8161100 2023-07-24T05:47:46.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.488+0000 7fdcbd644700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcb8160d20 0x7fdcb8098f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:46.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.488+0000 7fdcbd644700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcb8160d20 0x7fdcb8098f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42348/0 (socket says 172.21.15.77:42348) 2023-07-24T05:47:46.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.488+0000 7fdcbd644700 1 -- 172.21.15.77:0/3981637163 learned_addr learned my addr 172.21.15.77:0/3981637163 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:46.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.488+0000 7fdcbe646700 1 --2- 172.21.15.77:0/3981637163 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdcb8161100 0x7fdcb8099470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:46.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.488+0000 7fdcbde45700 1 --2- 172.21.15.77:0/3981637163 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdcb80b15d0 0x7fdcb80989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:46.495 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.488+0000 7fdcbd644700 1 -- 172.21.15.77:0/3981637163 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdcb8161100 msgr2=0x7fdcb8099470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:46.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.488+0000 7fdcbd644700 1 --2- 172.21.15.77:0/3981637163 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdcb8161100 0x7fdcb8099470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:46.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.488+0000 7fdcbd644700 1 -- 172.21.15.77:0/3981637163 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdcb80b15d0 msgr2=0x7fdcb80989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:46.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.488+0000 7fdcbd644700 1 --2- 172.21.15.77:0/3981637163 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdcb80b15d0 0x7fdcb80989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:46.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.488+0000 7fdcbd644700 1 -- 172.21.15.77:0/3981637163 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca8009570 con 0x7fdcb8160d20 2023-07-24T05:47:46.496 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.488+0000 7fdcbe646700 1 --2- 172.21.15.77:0/3981637163 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdcb8161100 0x7fdcb8099470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:46.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.488+0000 7fdcbd644700 1 --2- 172.21.15.77:0/3981637163 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcb8160d20 0x7fdcb8098f30 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fdcb806e160 tx=0x7fdca8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:46.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.488+0000 7fdcae7fc700 1 -- 172.21.15.77:0/3981637163 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca8004550 con 0x7fdcb8160d20 2023-07-24T05:47:46.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.488+0000 7fdcae7fc700 1 -- 172.21.15.77:0/3981637163 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca801f070 con 0x7fdcb8160d20 2023-07-24T05:47:46.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.488+0000 7fdcae7fc700 1 -- 172.21.15.77:0/3981637163 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca8003900 con 0x7fdcb8160d20 2023-07-24T05:47:46.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.488+0000 7fdcbee47700 1 -- 172.21.15.77:0/3981637163 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcb8161da0 con 0x7fdcb8160d20 2023-07-24T05:47:46.497 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.488+0000 7fdcbee47700 1 -- 172.21.15.77:0/3981637163 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcb8162360 con 0x7fdcb8160d20 2023-07-24T05:47:46.498 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.492+0000 7fdcbee47700 1 -- 172.21.15.77:0/3981637163 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcb8162580 con 0x7fdcb8160d20 2023-07-24T05:47:46.500 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.492+0000 7fdcae7fc700 1 -- 172.21.15.77:0/3981637163 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdca8003a60 con 0x7fdcb8160d20 2023-07-24T05:47:46.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.496+0000 7fdcae7fc700 1 --2- 172.21.15.77:0/3981637163 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fdc9c0662f0 0x7fdc9c0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:46.501 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.496+0000 7fdcae7fc700 1 -- 172.21.15.77:0/3981637163 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fdca8021070 con 0x7fdcb8160d20 2023-07-24T05:47:46.502 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.496+0000 7fdcbde45700 1 --2- 172.21.15.77:0/3981637163 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fdc9c0662f0 0x7fdc9c0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:46.503 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.496+0000 7fdcbde45700 1 --2- 172.21.15.77:0/3981637163 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fdc9c0662f0 0x7fdc9c0687b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4000f60 tx=0x7fdcb4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:46.508 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.500+0000 7fdcae7fc700 1 -- 172.21.15.77:0/3981637163 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdca8052620 con 0x7fdcb8160d20 2023-07-24T05:47:46.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.732+0000 7fdcbee47700 1 -- 172.21.15.77:0/3981637163 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fdcb8072490 con 0x7fdcb8160d20 2023-07-24T05:47:46.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.740+0000 7fdcae7fc700 1 -- 172.21.15.77:0/3981637163 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fdca80150a0 con 0x7fdcb8160d20 2023-07-24T05:47:46.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.744+0000 7fdcbee47700 1 -- 172.21.15.77:0/3981637163 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fdc9c0662f0 msgr2=0x7fdc9c0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:46.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.744+0000 7fdcbee47700 1 --2- 172.21.15.77:0/3981637163 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fdc9c0662f0 0x7fdc9c0687b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fdcb4000f60 tx=0x7fdcb4009040 comp rx=0 tx=0).stop 2023-07-24T05:47:46.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.744+0000 7fdcbee47700 1 -- 172.21.15.77:0/3981637163 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcb8160d20 msgr2=0x7fdcb8098f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:46.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.744+0000 7fdcbee47700 1 --2- 172.21.15.77:0/3981637163 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcb8160d20 0x7fdcb8098f30 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fdcb806e160 tx=0x7fdca8004770 comp rx=0 tx=0).stop 2023-07-24T05:47:46.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.744+0000 7fdcbee47700 1 -- 172.21.15.77:0/3981637163 shutdown_connections 2023-07-24T05:47:46.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.744+0000 7fdcbee47700 1 --2- 172.21.15.77:0/3981637163 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fdc9c0662f0 0x7fdc9c0687b0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:46.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.744+0000 7fdcbee47700 1 --2- 172.21.15.77:0/3981637163 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fdcb8161100 0x7fdcb8099470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:46.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.744+0000 7fdcbee47700 1 --2- 172.21.15.77:0/3981637163 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdcb8160d20 0x7fdcb8098f30 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:46.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.744+0000 7fdcbee47700 1 --2- 172.21.15.77:0/3981637163 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdcb80b15d0 0x7fdcb80989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:46.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.744+0000 7fdcbee47700 1 -- 172.21.15.77:0/3981637163 >> 172.21.15.77:0/3981637163 conn(0x7fdcb80cacc0 msgr2=0x7fdcb80cbcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:46.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.744+0000 7fdcbee47700 1 -- 172.21.15.77:0/3981637163 shutdown_connections 2023-07-24T05:47:46.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.744+0000 7fdcbee47700 1 -- 172.21.15.77:0/3981637163 wait complete. 2023-07-24T05:47:46.774 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-24T05:47:46.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.936+0000 7ff31641e700 1 Processor -- start 2023-07-24T05:47:46.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.936+0000 7ff31641e700 1 -- start start 2023-07-24T05:47:46.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.936+0000 7ff31641e700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff31015ca90 0x7ff3100b8280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:46.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.936+0000 7ff31641e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff3100b4420 0x7ff3100b4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:46.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.936+0000 7ff31641e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3100b5a00 con 0x7ff310160770 2023-07-24T05:47:46.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.936+0000 7ff31641e700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff31006a8a0 con 0x7ff31015ca90 2023-07-24T05:47:46.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.936+0000 7ff31641e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff310069c90 con 0x7ff3100b4420 2023-07-24T05:47:46.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.936+0000 7ff30ffff700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff31015ca90 0x7ff3100b8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:46.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.936+0000 7ff30ffff700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7ff31015ca90 0x7ff3100b8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42352/0 (socket says 172.21.15.77:42352) 2023-07-24T05:47:46.945 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.936+0000 7ff30ffff700 1 -- 172.21.15.77:0/4078242223 learned_addr learned my addr 172.21.15.77:0/4078242223 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:46.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.936+0000 7ff307fff700 1 --2- 172.21.15.77:0/4078242223 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff3100b4420 0x7ff3100b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:46.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.936+0000 7ff30ffff700 1 -- 172.21.15.77:0/4078242223 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff3100b4420 msgr2=0x7ff3100b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:46.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.936+0000 7ff30ffff700 1 --2- 172.21.15.77:0/4078242223 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff3100b4420 0x7ff3100b4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:46.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.936+0000 7ff30ffff700 1 -- 172.21.15.77:0/4078242223 >> v1:172.21.15.103:6789/0 conn(0x7ff310160770 legacy=0x7ff310160bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:46.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.940+0000 7ff30ffff700 1 -- 172.21.15.77:0/4078242223 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3100b4dc0 con 0x7ff31015ca90 2023-07-24T05:47:46.946 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.940+0000 7ff307fff700 1 --2- 172.21.15.77:0/4078242223 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff3100b4420 0x7ff3100b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:47:46.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.940+0000 7ff30ffff700 1 --2- 172.21.15.77:0/4078242223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff31015ca90 0x7ff3100b8280 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff300009910 tx=0x7ff300009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cc34e87a1a66599 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:46.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.940+0000 7ff30f7fe700 1 -- 172.21.15.77:0/4078242223 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30000ba60 con 0x7ff31015ca90 2023-07-24T05:47:46.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.940+0000 7ff30f7fe700 1 -- 172.21.15.77:0/4078242223 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff30000bbc0 con 0x7ff31015ca90 2023-07-24T05:47:46.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.940+0000 7ff30f7fe700 1 -- 172.21.15.77:0/4078242223 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff300009e60 con 0x7ff31015ca90 2023-07-24T05:47:46.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.940+0000 7ff31641e700 1 -- 172.21.15.77:0/4078242223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff31015ca90 msgr2=0x7ff3100b8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:46.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.940+0000 7ff31641e700 1 --2- 172.21.15.77:0/4078242223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff31015ca90 0x7ff3100b8280 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff300009910 tx=0x7ff300009c20 comp rx=0 tx=0).stop 2023-07-24T05:47:46.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.940+0000 7ff31641e700 1 -- 172.21.15.77:0/4078242223 shutdown_connections 2023-07-24T05:47:46.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.940+0000 7ff31641e700 1 --2- 172.21.15.77:0/4078242223 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff3100b4420 0x7ff3100b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:46.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.940+0000 7ff31641e700 1 --2- 172.21.15.77:0/4078242223 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff31015ca90 0x7ff3100b8280 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:46.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.940+0000 7ff31641e700 1 -- 172.21.15.77:0/4078242223 >> 172.21.15.77:0/4078242223 conn(0x7ff3100cf420 msgr2=0x7ff3100cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:46.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.940+0000 7ff31641e700 1 -- 172.21.15.77:0/4078242223 shutdown_connections 2023-07-24T05:47:46.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.940+0000 7ff31641e700 1 -- 172.21.15.77:0/4078242223 wait complete. 2023-07-24T05:47:46.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.940+0000 7ff31641e700 1 Processor -- start 2023-07-24T05:47:46.949 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.944+0000 7ff31641e700 1 -- start start 2023-07-24T05:47:46.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.944+0000 7ff31641e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3100b4420 0x7ff31014d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:46.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.944+0000 7ff31641e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff31015ca90 0x7ff3101e66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:46.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.944+0000 7ff31641e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff310160770 0x7ff3100aa5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:46.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.944+0000 7ff31641e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3100a92b0 con 0x7ff3100b4420 2023-07-24T05:47:46.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.944+0000 7ff31641e700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31014df00 con 0x7ff31015ca90 2023-07-24T05:47:46.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.944+0000 7ff31641e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3100a9500 con 0x7ff310160770 2023-07-24T05:47:46.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.944+0000 7ff30ffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3100b4420 0x7ff31014d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:46.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.944+0000 7ff30ffff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3100b4420 0x7ff31014d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42354/0 (socket says 172.21.15.77:42354) 2023-07-24T05:47:46.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.944+0000 7ff30ffff700 1 -- 172.21.15.77:0/1213808688 learned_addr learned my addr 172.21.15.77:0/1213808688 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:46.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.944+0000 7ff30ffff700 1 -- 172.21.15.77:0/1213808688 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff310160770 msgr2=0x7ff3100aa5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:46.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.944+0000 7ff30ffff700 1 --2- 172.21.15.77:0/1213808688 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff310160770 0x7ff3100aa5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:46.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.944+0000 7ff30ffff700 1 -- 172.21.15.77:0/1213808688 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff31015ca90 msgr2=0x7ff3101e66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:46.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.944+0000 7ff307fff700 1 --2- 172.21.15.77:0/1213808688 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff31015ca90 0x7ff3101e66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:46.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.944+0000 7ff30ffff700 1 --2- 172.21.15.77:0/1213808688 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff31015ca90 0x7ff3101e66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:46.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.944+0000 7ff30ffff700 1 -- 172.21.15.77:0/1213808688 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff300009570 con 0x7ff3100b4420 2023-07-24T05:47:46.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.944+0000 7ff307fff700 1 --2- 172.21.15.77:0/1213808688 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff31015ca90 0x7ff3101e66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:47:46.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.944+0000 7ff30ffff700 1 --2- 172.21.15.77:0/1213808688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3100b4420 0x7ff31014d9c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff30000b3c0 tx=0x7ff300004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:46.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.944+0000 7ff30d7fa700 1 -- 172.21.15.77:0/1213808688 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3000036c0 con 0x7ff3100b4420 2023-07-24T05:47:46.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.944+0000 7ff31641e700 1 -- 172.21.15.77:0/1213808688 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3100a97e0 con 0x7ff3100b4420 2023-07-24T05:47:46.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.944+0000 7ff30d7fa700 1 -- 172.21.15.77:0/1213808688 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff30001f070 con 0x7ff3100b4420 2023-07-24T05:47:46.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.944+0000 7ff30d7fa700 1 -- 172.21.15.77:0/1213808688 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff300003a60 con 0x7ff3100b4420 2023-07-24T05:47:46.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.944+0000 7ff31641e700 1 -- 172.21.15.77:0/1213808688 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3100a9da0 con 0x7ff3100b4420 2023-07-24T05:47:46.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.948+0000 7ff31641e700 1 -- 172.21.15.77:0/1213808688 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff31004df10 con 0x7ff3100b4420 2023-07-24T05:47:46.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.948+0000 7ff30d7fa700 1 -- 172.21.15.77:0/1213808688 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff300003bc0 con 0x7ff3100b4420 2023-07-24T05:47:46.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.948+0000 7ff30d7fa700 1 --2- 172.21.15.77:0/1213808688 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff2f00662f0 0x7ff2f00687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:46.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.948+0000 7ff30d7fa700 1 -- 172.21.15.77:0/1213808688 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7ff300021070 con 0x7ff3100b4420 2023-07-24T05:47:46.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.948+0000 7ff307fff700 1 --2- 172.21.15.77:0/1213808688 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff2f00662f0 0x7ff2f00687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:46.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.952+0000 7ff307fff700 1 --2- 172.21.15.77:0/1213808688 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff2f00662f0 0x7ff2f00687b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff3101f5880 tx=0x7ff2f8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:46.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:46.956+0000 7ff30d7fa700 1 -- 172.21.15.77:0/1213808688 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff300052b90 con 0x7ff3100b4420 2023-07-24T05:47:47.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.136+0000 7ff31641e700 1 -- 172.21.15.77:0/1213808688 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3100b3d00 con 0x7ff3100b4420 2023-07-24T05:47:47.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.136+0000 7ff30d7fa700 1 -- 172.21.15.77:0/1213808688 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+14832 (secure 0 0 0) 0x7ff3000561b0 con 0x7ff3100b4420 2023-07-24T05:47:47.144 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:47:47.144 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":35,"fsid":"5aed5f7b-fb55-4d95-9c02-c6adbb1677b4","created":"2023-07-24T05:45:39.639731+0000","modified":"2023-07-24T05:47:43.520473+0000","last_up_change":"2023-07-24T05:45:52.319670+0000","last_in_change":"2023-07-24T05:45:43.643277+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-24T05:45:52.610430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-24T05:45:52.773787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ffa0d496-461a-4053-b764-0627d969521b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6812","nonce":825987196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6817","nonce":825987196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6831","nonce":825987196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6824","nonce":825987196}]},"public_addr":"172.21.15.77:6812/825987196","cluster_addr":"172.21.15.77:6817/825987196","heartbeat_back_addr":"172.21.15.77:6831/825987196","heartbeat_front_addr":"172.21.15.77:6824/825987196","state":["exists","up"]},{"osd":1,"uuid":"9f595e5e-5c43-49bc-8ce4-ee70575c90da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6801","nonce":4133026815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6803","nonce":4133026815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6807","nonce":4133026815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6805","nonce":4133026815}]},"public_addr":"172.21.15.77:6801/4133026815","cluster_addr":"172.21.15.77:6803/4133026815","heartbeat_back_addr":"172.21.15.77:6807/4133026815","heartbeat_front_addr":"172.21.15.77:6805/4133026815","state":["exists","up"]},{"osd":2,"uuid":"2ac177aa-4d7d-4262-bd54-d2b9f29f4c3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6811","nonce":2394142159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6819","nonce":2394142159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6830","nonce":2394142159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6825","nonce":2394142159}]},"public_addr":"172.21.15.77:6811/2394142159","cluster_addr":"172.21.15.77:6819/2394142159","heartbeat_back_addr":"172.21.15.77:6830/2394142159","heartbeat_front_addr":"172.21.15.77:6825/2394142159","state":["exists","up"]},{"osd":3,"uuid":"17d7a251-19e8-484c-8172-a578ab3da153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6813","nonce":1492113982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6818","nonce":1492113982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6829","nonce":1492113982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6823","nonce":1492113982}]},"public_addr":"172.21.15.77:6813/1492113982","cluster_addr":"172.21.15.77:6818/1492113982","heartbeat_back_addr":"172.21.15.77:6829/1492113982","heartbeat_front_addr":"172.21.15.77:6823/1492113982","state":["exists","up"]},{"osd":4,"uuid":"bf63ca05-f06d-4e0f-ac44-2a416c70b919","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6825","nonce":1080481057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6827","nonce":1080481057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6831","nonce":1080481057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6829","nonce":1080481057}]},"public_addr":"172.21.15.103:6825/1080481057","cluster_addr":"172.21.15.103:6827/1080481057","heartbeat_back_addr":"172.21.15.103:6831/1080481057","heartbeat_front_addr":"172.21.15.103:6829/1080481057","state":["exists","up"]},{"osd":5,"uuid":"65a11a35-9e9f-4b3c-9fe3-b658d62b9318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6811","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6813","nonce":2756677504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6818","nonce":2756677504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6823","nonce":2756677504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6821","nonce":2756677504}]},"public_addr":"172.21.15.103:6813/2756677504","cluster_addr":"172.21.15.103:6818/2756677504","heartbeat_back_addr":"172.21.15.103:6823/2756677504","heartbeat_front_addr":"172.21.15.103:6821/2756677504","state":["exists","up"]},{"osd":6,"uuid":"750c1f87-686c-40b4-94a1-1a299dc78f3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6809","nonce":568977764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6812","nonce":568977764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6819","nonce":568977764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6815","nonce":568977764}]},"public_addr":"172.21.15.103:6809/568977764","cluster_addr":"172.21.15.103:6812/568977764","heartbeat_back_addr":"172.21.15.103:6819/568977764","heartbeat_front_addr":"172.21.15.103:6815/568977764","state":["exists","up"]},{"osd":7,"uuid":"d5fe4fb6-2e09-4158-885b-403803c85822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6801","nonce":1074557176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6803","nonce":1074557176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6807","nonce":1074557176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6805","nonce":1074557176}]},"public_addr":"172.21.15.103:6801/1074557176","cluster_addr":"172.21.15.103:6803/1074557176","heartbeat_back_addr":"172.21.15.103:6807/1074557176","heartbeat_front_addr":"172.21.15.103:6805/1074557176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.631032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.154109+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.398587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.679089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.311218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.353726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.314372+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.126212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-24T05:47:47.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.140+0000 7ff31641e700 1 -- 172.21.15.77:0/1213808688 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff2f00662f0 msgr2=0x7ff2f00687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:47.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.140+0000 7ff31641e700 1 --2- 172.21.15.77:0/1213808688 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff2f00662f0 0x7ff2f00687b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff3101f5880 tx=0x7ff2f8008040 comp rx=0 tx=0).stop 2023-07-24T05:47:47.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.140+0000 7ff31641e700 1 -- 172.21.15.77:0/1213808688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3100b4420 msgr2=0x7ff31014d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:47.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.140+0000 7ff31641e700 1 --2- 172.21.15.77:0/1213808688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3100b4420 0x7ff31014d9c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff30000b3c0 tx=0x7ff300004770 comp rx=0 tx=0).stop 2023-07-24T05:47:47.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.140+0000 7ff31641e700 1 -- 172.21.15.77:0/1213808688 shutdown_connections 2023-07-24T05:47:47.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.140+0000 7ff31641e700 1 --2- 172.21.15.77:0/1213808688 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7ff2f00662f0 0x7ff2f00687b0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:47.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.140+0000 7ff31641e700 1 --2- 172.21.15.77:0/1213808688 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7ff310160770 0x7ff3100aa5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:47.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.140+0000 7ff31641e700 1 --2- 172.21.15.77:0/1213808688 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff31015ca90 0x7ff3101e66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:47.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.140+0000 7ff31641e700 1 --2- 172.21.15.77:0/1213808688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3100b4420 0x7ff31014d9c0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:47.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.140+0000 7ff31641e700 1 -- 172.21.15.77:0/1213808688 >> 172.21.15.77:0/1213808688 conn(0x7ff3100cf420 msgr2=0x7ff31015db60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:47.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.140+0000 7ff31641e700 1 -- 172.21.15.77:0/1213808688 shutdown_connections 2023-07-24T05:47:47.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.140+0000 7ff31641e700 1 -- 172.21.15.77:0/1213808688 wait complete. 2023-07-24T05:47:47.167 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-24T05:45:52.610430+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-24T05:45:52.773787+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-24T05:47:47.167 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-24T05:47:47.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.332+0000 7f3324bb1700 1 Processor -- start 2023-07-24T05:47:47.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.332+0000 7f3324bb1700 1 -- start start 2023-07-24T05:47:47.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.336+0000 7f3324bb1700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f332006afc0 0x7f33200b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:47.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.336+0000 7f3324bb1700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f33200d2fc0 0x7f33200d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:47.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.336+0000 7f3324bb1700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3320160fa0 con 0x7f332015db20 2023-07-24T05:47:47.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.336+0000 7f3324bb1700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33200d0360 con 0x7f33200d2fc0 2023-07-24T05:47:47.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.336+0000 7f3324bb1700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33200b20b0 con 0x7f332006afc0 2023-07-24T05:47:47.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.336+0000 7f331e59c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f332006afc0 0x7f33200b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:47.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.336+0000 7f331ed9d700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f33200d2fc0 0x7f33200d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:47.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.336+0000 7f3315d9b700 1 --1- >> v1:172.21.15.103:6789/0 conn(0x7f332015db20 0x7f33200d28b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.77:52976/0 (socket says 172.21.15.77:52976) 2023-07-24T05:47:47.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.336+0000 7f3315d9b700 1 -- 172.21.15.77:0/1074800110 learned_addr learned my addr 172.21.15.77:0/1074800110 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:47.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.336+0000 7f331e59c700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f332006afc0 0x7f33200b1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:43588/0 (socket says 172.21.15.77:43588) 2023-07-24T05:47:47.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.336+0000 7f331dd9b700 1 -- 172.21.15.77:0/1074800110 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4278681598 0 0) 0x7f3320160fa0 con 0x7f332015db20 2023-07-24T05:47:47.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.336+0000 7f331dd9b700 1 -- 172.21.15.77:0/1074800110 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f330c0035d0 con 0x7f332015db20 2023-07-24T05:47:47.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.336+0000 7f331e59c700 1 -- 172.21.15.77:0/1074800110 >> v2:172.21.15.77:3300/0 conn(0x7f33200d2fc0 msgr2=0x7f33200d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:47.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.336+0000 7f331e59c700 1 --2- 172.21.15.77:0/1074800110 >> v2:172.21.15.77:3300/0 conn(0x7f33200d2fc0 0x7f33200d1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:47.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.336+0000 7f331e59c700 1 -- 172.21.15.77:0/1074800110 >> v1:172.21.15.103:6789/0 conn(0x7f332015db20 legacy=0x7f33200d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:47.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.336+0000 7f331e59c700 1 -- 172.21.15.77:0/1074800110 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3320160670 con 0x7f332006afc0 2023-07-24T05:47:47.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.336+0000 7f331ed9d700 1 --2- 172.21.15.77:0/1074800110 >> v2:172.21.15.77:3300/0 conn(0x7f33200d2fc0 0x7f33200d1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:47:47.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.340+0000 7f331e59c700 1 --2- 172.21.15.77:0/1074800110 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f332006afc0 0x7f33200b1a20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f332006dc40 tx=0x7f331000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29637fd9612fef20 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:47.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.340+0000 7f331dd9b700 1 -- 172.21.15.77:0/1074800110 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331000e070 con 0x7f332006afc0 2023-07-24T05:47:47.346 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.340+0000 7f331dd9b700 1 -- 172.21.15.77:0/1074800110 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f331000bb20 con 0x7f332006afc0 2023-07-24T05:47:47.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.340+0000 7f331dd9b700 1 -- 172.21.15.77:0/1074800110 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3310012430 con 0x7f332006afc0 2023-07-24T05:47:47.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.340+0000 7f3324bb1700 1 -- 172.21.15.77:0/1074800110 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f332006afc0 msgr2=0x7f33200b1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:47.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.340+0000 7f3324bb1700 1 --2- 172.21.15.77:0/1074800110 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f332006afc0 0x7f33200b1a20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f332006dc40 tx=0x7f331000b330 comp rx=0 tx=0).stop 2023-07-24T05:47:47.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.340+0000 7f3324bb1700 1 -- 172.21.15.77:0/1074800110 shutdown_connections 2023-07-24T05:47:47.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.340+0000 7f3324bb1700 1 --2- 172.21.15.77:0/1074800110 >> v2:172.21.15.77:3300/0 conn(0x7f33200d2fc0 0x7f33200d1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:47.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.340+0000 7f3324bb1700 1 --2- 172.21.15.77:0/1074800110 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f332006afc0 0x7f33200b1a20 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:47.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.340+0000 7f3324bb1700 1 -- 172.21.15.77:0/1074800110 >> 172.21.15.77:0/1074800110 conn(0x7f332009bc20 msgr2=0x7f33200b7920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:47.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.340+0000 7f3324bb1700 1 -- 172.21.15.77:0/1074800110 shutdown_connections 2023-07-24T05:47:47.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.340+0000 7f3324bb1700 1 -- 172.21.15.77:0/1074800110 wait complete. 2023-07-24T05:47:47.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.344+0000 7f3324bb1700 1 Processor -- start 2023-07-24T05:47:47.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.344+0000 7f3324bb1700 1 -- start start 2023-07-24T05:47:47.351 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.344+0000 7f3324bb1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f332006afc0 0x7f3320156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:47.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.344+0000 7f3324bb1700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33200d2fc0 0x7f33201e7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:47.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.344+0000 7f3324bb1700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f332015db20 0x7f33200cd740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:47.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.344+0000 7f3324bb1700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33201e7040 con 0x7f332006afc0 2023-07-24T05:47:47.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.344+0000 7f3324bb1700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33201e6730 con 0x7f332015db20 2023-07-24T05:47:47.352 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.344+0000 7f3324bb1700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3320156fa0 con 0x7f33200d2fc0 2023-07-24T05:47:47.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.344+0000 7f331e59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f332006afc0 0x7f3320156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:47.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.344+0000 7f331e59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f332006afc0 0x7f3320156a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42370/0 (socket says 172.21.15.77:42370) 2023-07-24T05:47:47.353 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.344+0000 7f331e59c700 1 -- 172.21.15.77:0/3556666352 learned_addr learned my addr 172.21.15.77:0/3556666352 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:47.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.344+0000 7f331ed9d700 1 --2- 172.21.15.77:0/3556666352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f332015db20 0x7f33200cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:47.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.344+0000 7f3315d9b700 1 --2- 172.21.15.77:0/3556666352 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33200d2fc0 0x7f33201e7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:47.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.344+0000 7f331e59c700 1 -- 172.21.15.77:0/3556666352 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33200d2fc0 msgr2=0x7f33201e7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:47.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.344+0000 7f331e59c700 1 --2- 172.21.15.77:0/3556666352 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33200d2fc0 0x7f33201e7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:47.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.344+0000 7f331e59c700 1 -- 172.21.15.77:0/3556666352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f332015db20 msgr2=0x7f33200cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:47.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.344+0000 7f331e59c700 1 --2- 172.21.15.77:0/3556666352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f332015db20 0x7f33200cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:47.354 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.344+0000 7f331e59c700 1 -- 172.21.15.77:0/3556666352 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33180094b0 con 0x7f332006afc0 2023-07-24T05:47:47.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.344+0000 7f3315d9b700 1 --2- 172.21.15.77:0/3556666352 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33200d2fc0 0x7f33201e7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:47:47.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.348+0000 7f331e59c700 1 --2- 172.21.15.77:0/3556666352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f332006afc0 0x7f3320156a60 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f3310014040 tx=0x7f3310004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:47.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.348+0000 7f33177fe700 1 -- 172.21.15.77:0/3556666352 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3310004960 con 0x7f332006afc0 2023-07-24T05:47:47.355 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.348+0000 7f3324bb1700 1 -- 172.21.15.77:0/3556666352 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3310009a70 con 0x7f332006afc0 2023-07-24T05:47:47.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.348+0000 7f33177fe700 1 -- 172.21.15.77:0/3556666352 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3310020070 con 0x7f332006afc0 2023-07-24T05:47:47.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.348+0000 7f33177fe700 1 -- 172.21.15.77:0/3556666352 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33100276c0 con 0x7f332006afc0 2023-07-24T05:47:47.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.348+0000 7f3324bb1700 1 -- 172.21.15.77:0/3556666352 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33201e6980 con 0x7f332006afc0 2023-07-24T05:47:47.356 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.348+0000 7f3324bb1700 1 -- 172.21.15.77:0/3556666352 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33201e7180 con 0x7f332006afc0 2023-07-24T05:47:47.357 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.352+0000 7f33177fe700 1 -- 172.21.15.77:0/3556666352 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3310027820 con 0x7f332006afc0 2023-07-24T05:47:47.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.352+0000 7f33177fe700 1 --2- 172.21.15.77:0/3556666352 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f33000662f0 0x7f33000687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:47.358 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.352+0000 7f33177fe700 1 -- 172.21.15.77:0/3556666352 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f3310022070 con 0x7f332006afc0 2023-07-24T05:47:47.359 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.352+0000 7f3315d9b700 1 --2- 172.21.15.77:0/3556666352 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f33000662f0 0x7f33000687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:47.360 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.352+0000 7f3315d9b700 1 --2- 172.21.15.77:0/3556666352 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f33000662f0 0x7f33000687b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f33200ccd00 tx=0x7f3308009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:47.364 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.356+0000 7f33177fe700 1 -- 172.21.15.77:0/3556666352 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f33201e7180 con 0x7f332006afc0 2023-07-24T05:47:47.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.528+0000 7f3324bb1700 1 -- 172.21.15.77:0/3556666352 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f33201e7180 con 0x7f332006afc0 2023-07-24T05:47:47.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.528+0000 7f33177fe700 1 -- 172.21.15.77:0/3556666352 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f331002c020 con 0x7f332006afc0 2023-07-24T05:47:47.537 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2023-07-24T05:47:47.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.532+0000 7f3324bb1700 1 -- 172.21.15.77:0/3556666352 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f33000662f0 msgr2=0x7f33000687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:47.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.532+0000 7f3324bb1700 1 --2- 172.21.15.77:0/3556666352 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f33000662f0 0x7f33000687b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f33200ccd00 tx=0x7f3308009040 comp rx=0 tx=0).stop 2023-07-24T05:47:47.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.532+0000 7f3324bb1700 1 -- 172.21.15.77:0/3556666352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f332006afc0 msgr2=0x7f3320156a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:47.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.532+0000 7f3324bb1700 1 --2- 172.21.15.77:0/3556666352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f332006afc0 0x7f3320156a60 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f3310014040 tx=0x7f3310004af0 comp rx=0 tx=0).stop 2023-07-24T05:47:47.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.532+0000 7f3324bb1700 1 -- 172.21.15.77:0/3556666352 shutdown_connections 2023-07-24T05:47:47.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.532+0000 7f3324bb1700 1 --2- 172.21.15.77:0/3556666352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f332015db20 0x7f33200cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:47.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.532+0000 7f3324bb1700 1 --2- 172.21.15.77:0/3556666352 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f33000662f0 0x7f33000687b0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:47.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.532+0000 7f3324bb1700 1 --2- 172.21.15.77:0/3556666352 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33200d2fc0 0x7f33201e7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:47.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.532+0000 7f3324bb1700 1 --2- 172.21.15.77:0/3556666352 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f332006afc0 0x7f3320156a60 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:47.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.532+0000 7f3324bb1700 1 -- 172.21.15.77:0/3556666352 >> 172.21.15.77:0/3556666352 conn(0x7f332009bc20 msgr2=0x7f33200b54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:47.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.532+0000 7f3324bb1700 1 -- 172.21.15.77:0/3556666352 shutdown_connections 2023-07-24T05:47:47.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.532+0000 7f3324bb1700 1 -- 172.21.15.77:0/3556666352 wait complete. 2023-07-24T05:47:47.559 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-24T05:47:47.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.728+0000 7f0bc32b2700 1 Processor -- start 2023-07-24T05:47:47.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.728+0000 7f0bc32b2700 1 -- start start 2023-07-24T05:47:47.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.732+0000 7f0bc32b2700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0bbc06a220 0x7f0bbc06d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:47.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.732+0000 7f0bc32b2700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bbc0b2620 con 0x7f0bbc15a950 2023-07-24T05:47:47.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.732+0000 7f0bc32b2700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bbc06b000 con 0x7f0bbc0c4e70 2023-07-24T05:47:47.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.732+0000 7f0bc32b2700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc0b1ac0 con 0x7f0bbc06a220 2023-07-24T05:47:47.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.732+0000 7f0bc22b0700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f0bbc15a950 0x7f0bbc0b1f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55836/0 (socket says 172.21.15.77:55836) 2023-07-24T05:47:47.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.732+0000 7f0bc22b0700 1 -- 172.21.15.77:0/2774596493 learned_addr learned my addr 172.21.15.77:0/2774596493 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:47.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.732+0000 7f0bc2ab1700 1 --2- 172.21.15.77:0/2774596493 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0bbc06a220 0x7f0bbc06d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:47.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.732+0000 7f0bc12ae700 1 -- 172.21.15.77:0/2774596493 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2092126387 0 0) 0x7f0bbc0b2620 con 0x7f0bbc15a950 2023-07-24T05:47:47.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.732+0000 7f0bc12ae700 1 -- 172.21.15.77:0/2774596493 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ba80035d0 con 0x7f0bbc15a950 2023-07-24T05:47:47.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.732+0000 7f0bc12ae700 1 -- 172.21.15.77:0/2774596493 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 936406829 0 0) 0x7f0bbc06b000 con 0x7f0bbc0c4e70 2023-07-24T05:47:47.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.732+0000 7f0bc12ae700 1 -- 172.21.15.77:0/2774596493 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bbc0b2620 con 0x7f0bbc0c4e70 2023-07-24T05:47:47.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.732+0000 7f0bc12ae700 1 -- 172.21.15.77:0/2774596493 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1567264230 0 0) 0x7f0ba80035d0 con 0x7f0bbc15a950 2023-07-24T05:47:47.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.732+0000 7f0bc12ae700 1 -- 172.21.15.77:0/2774596493 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0bbc06a220 msgr2=0x7f0bbc06d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:47.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.732+0000 7f0bc12ae700 1 --2- 172.21.15.77:0/2774596493 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0bbc06a220 0x7f0bbc06d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:47.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.732+0000 7f0bc12ae700 1 -- 172.21.15.77:0/2774596493 >> v1:172.21.15.103:6789/0 conn(0x7f0bbc0c4e70 legacy=0x7f0bbc069b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:47.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.732+0000 7f0bc12ae700 1 -- 172.21.15.77:0/2774596493 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bbc06a7c0 con 0x7f0bbc15a950 2023-07-24T05:47:47.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.732+0000 7f0bc12ae700 1 -- 172.21.15.77:0/2774596493 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4109865209 0 0) 0x7f0bb8001970 con 0x7f0bbc15a950 2023-07-24T05:47:47.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.732+0000 7f0bc12ae700 1 -- 172.21.15.77:0/2774596493 >> v1:172.21.15.77:6789/0 conn(0x7f0bbc15a950 legacy=0x7f0bbc0b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:47.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.732+0000 7f0bc12ae700 1 --2- 172.21.15.77:0/2774596493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ba8003be0 0x7f0ba8003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:47.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.732+0000 7f0bc12ae700 1 --2- 172.21.15.77:0/2774596493 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0bbc06a220 0x7f0ba8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:47.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.732+0000 7f0bc12ae700 1 --2- 172.21.15.77:0/2774596493 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ba8004db0 0x7f0ba8005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:47.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.732+0000 7f0bc12ae700 1 -- 172.21.15.77:0/2774596493 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc0b1ac0 con 0x7f0ba8004db0 2023-07-24T05:47:47.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.732+0000 7f0bc12ae700 1 -- 172.21.15.77:0/2774596493 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba800bc70 con 0x7f0ba8003be0 2023-07-24T05:47:47.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.732+0000 7f0bc12ae700 1 -- 172.21.15.77:0/2774596493 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba800be30 con 0x7f0bbc06a220 2023-07-24T05:47:47.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.736+0000 7f0bc1aaf700 1 --2- 172.21.15.77:0/2774596493 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0bbc06a220 0x7f0ba8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:47.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.736+0000 7f0bc2ab1700 1 --2- 172.21.15.77:0/2774596493 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ba8004db0 0x7f0ba8005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:47.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.736+0000 7f0bc22b0700 1 --2- 172.21.15.77:0/2774596493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ba8003be0 0x7f0ba8003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:47.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.736+0000 7f0bc2ab1700 1 -- 172.21.15.77:0/2774596493 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0bbc06a220 msgr2=0x7f0ba8004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:47.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.736+0000 7f0bc2ab1700 1 --2- 172.21.15.77:0/2774596493 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0bbc06a220 0x7f0ba8004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:47.744 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.736+0000 7f0bc2ab1700 1 -- 172.21.15.77:0/2774596493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ba8003be0 msgr2=0x7f0ba8003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:47.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.736+0000 7f0bc2ab1700 1 --2- 172.21.15.77:0/2774596493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ba8003be0 0x7f0ba8003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:47.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.736+0000 7f0bc2ab1700 1 -- 172.21.15.77:0/2774596493 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba80035d0 con 0x7f0ba8004db0 2023-07-24T05:47:47.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.736+0000 7f0bc2ab1700 1 --2- 172.21.15.77:0/2774596493 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ba8004db0 0x7f0ba8005230 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4009b70 tx=0x7f0ba80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a704aa89aac79d0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:47.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.736+0000 7f0bc12ae700 1 -- 172.21.15.77:0/2774596493 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb400e6c0 con 0x7f0ba8004db0 2023-07-24T05:47:47.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.736+0000 7f0bc12ae700 1 -- 172.21.15.77:0/2774596493 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb400e820 con 0x7f0ba8004db0 2023-07-24T05:47:47.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.736+0000 7f0bc12ae700 1 -- 172.21.15.77:0/2774596493 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb400eb90 con 0x7f0ba8004db0 2023-07-24T05:47:47.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.736+0000 7f0bc32b2700 1 -- 172.21.15.77:0/2774596493 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ba8004db0 msgr2=0x7f0ba8005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:47.745 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.736+0000 7f0bc32b2700 1 --2- 172.21.15.77:0/2774596493 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0ba8004db0 0x7f0ba8005230 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4009b70 tx=0x7f0ba80058a0 comp rx=0 tx=0).stop 2023-07-24T05:47:47.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.736+0000 7f0bc2ab1700 1 -- 172.21.15.77:0/2774596493 reap_dead start 2023-07-24T05:47:47.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.736+0000 7f0bc32b2700 1 -- 172.21.15.77:0/2774596493 shutdown_connections 2023-07-24T05:47:47.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.736+0000 7f0bc32b2700 1 -- 172.21.15.77:0/2774596493 >> 172.21.15.77:0/2774596493 conn(0x7f0bbc0ce260 msgr2=0x7f0bbc0ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:47.746 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.736+0000 7f0bc32b2700 1 -- 172.21.15.77:0/2774596493 shutdown_connections 2023-07-24T05:47:47.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.736+0000 7f0bc32b2700 1 -- 172.21.15.77:0/2774596493 wait complete. 2023-07-24T05:47:47.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.740+0000 7f0bc32b2700 1 Processor -- start 2023-07-24T05:47:47.748 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.740+0000 7f0bc32b2700 1 -- start start 2023-07-24T05:47:47.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.744+0000 7f0bc32b2700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ba8004db0 0x7f0bbc1573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:47.750 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.744+0000 7f0bc32b2700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0bbc0b09c0 0x7f0bbc0adcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:47.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.744+0000 7f0bc32b2700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bbc1494d0 0x7f0bbc0c9740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:47.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.744+0000 7f0bc32b2700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc0ae200 con 0x7f0bbc1494d0 2023-07-24T05:47:47.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.744+0000 7f0bc32b2700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc0afc00 con 0x7f0ba8004db0 2023-07-24T05:47:47.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.744+0000 7f0bc32b2700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc0afee0 con 0x7f0bbc0b09c0 2023-07-24T05:47:47.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.744+0000 7f0bc2ab1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bbc1494d0 0x7f0bbc0c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:47.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.744+0000 7f0bc2ab1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bbc1494d0 0x7f0bbc0c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42386/0 (socket says 172.21.15.77:42386) 2023-07-24T05:47:47.751 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.744+0000 7f0bc2ab1700 1 -- 172.21.15.77:0/1595184592 learned_addr learned my addr 172.21.15.77:0/1595184592 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:47.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.744+0000 7f0bc1aaf700 1 --2- 172.21.15.77:0/1595184592 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0bbc0b09c0 0x7f0bbc0adcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:47.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.744+0000 7f0bc22b0700 1 --2- 172.21.15.77:0/1595184592 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ba8004db0 0x7f0bbc1573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:47.752 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.744+0000 7f0bc2ab1700 1 -- 172.21.15.77:0/1595184592 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0bbc0b09c0 msgr2=0x7f0bbc0adcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:47.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.744+0000 7f0bc2ab1700 1 --2- 172.21.15.77:0/1595184592 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0bbc0b09c0 0x7f0bbc0adcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:47.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.744+0000 7f0bc2ab1700 1 -- 172.21.15.77:0/1595184592 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ba8004db0 msgr2=0x7f0bbc1573c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:47.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.744+0000 7f0bc2ab1700 1 --2- 172.21.15.77:0/1595184592 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ba8004db0 0x7f0bbc1573c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:47.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.744+0000 7f0bc2ab1700 1 -- 172.21.15.77:0/1595184592 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bbc0b01c0 con 0x7f0bbc1494d0 2023-07-24T05:47:47.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.744+0000 7f0bc2ab1700 1 --2- 172.21.15.77:0/1595184592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bbc1494d0 0x7f0bbc0c9740 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4016000 tx=0x7f0bb40047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:47.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.744+0000 7f0bb2ffd700 1 -- 172.21.15.77:0/1595184592 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb400e6c0 con 0x7f0bbc1494d0 2023-07-24T05:47:47.753 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.744+0000 7f0bb2ffd700 1 -- 172.21.15.77:0/1595184592 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb40044a0 con 0x7f0bbc1494d0 2023-07-24T05:47:47.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.744+0000 7f0bc32b2700 1 -- 172.21.15.77:0/1595184592 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bbc0b04a0 con 0x7f0bbc1494d0 2023-07-24T05:47:47.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.744+0000 7f0bb2ffd700 1 -- 172.21.15.77:0/1595184592 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb4004610 con 0x7f0bbc1494d0 2023-07-24T05:47:47.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.744+0000 7f0bc32b2700 1 -- 172.21.15.77:0/1595184592 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bbc149980 con 0x7f0bbc1494d0 2023-07-24T05:47:47.754 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.748+0000 7f0bc32b2700 1 -- 172.21.15.77:0/1595184592 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bbc149c30 con 0x7f0bbc1494d0 2023-07-24T05:47:47.755 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.748+0000 7f0bb2ffd700 1 -- 172.21.15.77:0/1595184592 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0bb40139e0 con 0x7f0bbc1494d0 2023-07-24T05:47:47.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.752+0000 7f0bb2ffd700 1 --2- 172.21.15.77:0/1595184592 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f0ba0066320 0x7f0ba00687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:47.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.752+0000 7f0bb2ffd700 1 -- 172.21.15.77:0/1595184592 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f0bb4084940 con 0x7f0bbc1494d0 2023-07-24T05:47:47.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.752+0000 7f0bc22b0700 1 --2- 172.21.15.77:0/1595184592 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f0ba0066320 0x7f0ba00687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:47.759 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.752+0000 7f0bc22b0700 1 --2- 172.21.15.77:0/1595184592 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f0ba0066320 0x7f0ba00687e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8007280 tx=0x7f0bb8006040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:47.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.756+0000 7f0bb2ffd700 1 -- 172.21.15.77:0/1595184592 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0bbc149c30 con 0x7f0bbc1494d0 2023-07-24T05:47:47.933 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.924+0000 7f0bc32b2700 1 -- 172.21.15.77:0/1595184592 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0bbc149c30 con 0x7f0bbc1494d0 2023-07-24T05:47:47.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.928+0000 7f0bb2ffd700 1 -- 172.21.15.77:0/1595184592 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v35) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0bbc149c30 con 0x7f0bbc1494d0 2023-07-24T05:47:47.934 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 8 2023-07-24T05:47:47.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.928+0000 7f0bc32b2700 1 -- 172.21.15.77:0/1595184592 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f0ba0066320 msgr2=0x7f0ba00687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:47.936 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.928+0000 7f0bc32b2700 1 --2- 172.21.15.77:0/1595184592 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f0ba0066320 0x7f0ba00687e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0bb8007280 tx=0x7f0bb8006040 comp rx=0 tx=0).stop 2023-07-24T05:47:47.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.928+0000 7f0bc32b2700 1 -- 172.21.15.77:0/1595184592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bbc1494d0 msgr2=0x7f0bbc0c9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:47.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.928+0000 7f0bc32b2700 1 --2- 172.21.15.77:0/1595184592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bbc1494d0 0x7f0bbc0c9740 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4016000 tx=0x7f0bb40047e0 comp rx=0 tx=0).stop 2023-07-24T05:47:47.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.928+0000 7f0bc32b2700 1 -- 172.21.15.77:0/1595184592 shutdown_connections 2023-07-24T05:47:47.937 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.928+0000 7f0bc32b2700 1 --2- 172.21.15.77:0/1595184592 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0bbc1494d0 0x7f0bbc0c9740 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:47.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.928+0000 7f0bc32b2700 1 --2- 172.21.15.77:0/1595184592 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f0ba0066320 0x7f0ba00687e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:47.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.928+0000 7f0bc32b2700 1 --2- 172.21.15.77:0/1595184592 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0bbc0b09c0 0x7f0bbc0adcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:47.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.928+0000 7f0bc32b2700 1 --2- 172.21.15.77:0/1595184592 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ba8004db0 0x7f0bbc1573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:47.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.928+0000 7f0bc32b2700 1 -- 172.21.15.77:0/1595184592 >> 172.21.15.77:0/1595184592 conn(0x7f0bbc0ce260 msgr2=0x7f0bbc1586b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:47.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.932+0000 7f0bc32b2700 1 -- 172.21.15.77:0/1595184592 shutdown_connections 2023-07-24T05:47:47.938 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:47.932+0000 7f0bc32b2700 1 -- 172.21.15.77:0/1595184592 wait complete. 2023-07-24T05:47:47.956 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-24T05:47:48.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.124+0000 7f999dcdf700 1 Processor -- start 2023-07-24T05:47:48.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.124+0000 7f999dcdf700 1 -- start start 2023-07-24T05:47:48.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.124+0000 7f999dcdf700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f9998161030 0x7f99980c13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:48.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.124+0000 7f999dcdf700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f9998069ef0 0x7f99980c1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:48.132 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.124+0000 7f999dcdf700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f999806b810 con 0x7f99980cac90 2023-07-24T05:47:48.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.124+0000 7f999dcdf700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f999806ccb0 con 0x7f9998161030 2023-07-24T05:47:48.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.124+0000 7f999dcdf700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99980cb230 con 0x7f9998069ef0 2023-07-24T05:47:48.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.124+0000 7f9997fff700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f99980cac90 0x7f9998164b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55844/0 (socket says 172.21.15.77:55844) 2023-07-24T05:47:48.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.124+0000 7f9997fff700 1 -- 172.21.15.77:0/3323703603 learned_addr learned my addr 172.21.15.77:0/3323703603 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:48.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.124+0000 7f99977fe700 1 --2- 172.21.15.77:0/3323703603 >> v2:172.21.15.77:3300/0 conn(0x7f9998161030 0x7f99980c13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:48.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.128+0000 7f998effd700 1 --2- 172.21.15.77:0/3323703603 >> v2:172.21.15.103:3300/0 conn(0x7f9998069ef0 0x7f99980c1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:48.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.128+0000 7f9996ffd700 1 -- 172.21.15.77:0/3323703603 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2317264300 0 0) 0x7f999806b810 con 0x7f99980cac90 2023-07-24T05:47:48.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.128+0000 7f9996ffd700 1 -- 172.21.15.77:0/3323703603 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99840035d0 con 0x7f99980cac90 2023-07-24T05:47:48.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.128+0000 7f9996ffd700 1 -- 172.21.15.77:0/3323703603 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3539492024 0 0) 0x7f99840035d0 con 0x7f99980cac90 2023-07-24T05:47:48.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.128+0000 7f9996ffd700 1 -- 172.21.15.77:0/3323703603 >> v2:172.21.15.103:3300/0 conn(0x7f9998069ef0 msgr2=0x7f99980c1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:48.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.128+0000 7f9996ffd700 1 --2- 172.21.15.77:0/3323703603 >> v2:172.21.15.103:3300/0 conn(0x7f9998069ef0 0x7f99980c1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:48.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.128+0000 7f9996ffd700 1 -- 172.21.15.77:0/3323703603 >> v2:172.21.15.77:3300/0 conn(0x7f9998161030 msgr2=0x7f99980c13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:48.135 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.128+0000 7f9996ffd700 1 --2- 172.21.15.77:0/3323703603 >> v2:172.21.15.77:3300/0 conn(0x7f9998161030 0x7f99980c13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:48.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.128+0000 7f9996ffd700 1 -- 172.21.15.77:0/3323703603 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99980cb510 con 0x7f99980cac90 2023-07-24T05:47:48.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.128+0000 7f9996ffd700 1 -- 172.21.15.77:0/3323703603 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4109865209 0 0) 0x7f9990001670 con 0x7f99980cac90 2023-07-24T05:47:48.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.128+0000 7f9996ffd700 1 -- 172.21.15.77:0/3323703603 >> v1:172.21.15.77:6789/0 conn(0x7f99980cac90 legacy=0x7f9998164b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:48.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.128+0000 7f9996ffd700 1 --2- 172.21.15.77:0/3323703603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9984003a70 0x7f9984003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:48.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.128+0000 7f9996ffd700 1 --2- 172.21.15.77:0/3323703603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9984004870 0x7f9984004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:48.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.128+0000 7f9996ffd700 1 --2- 172.21.15.77:0/3323703603 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9984005230 0x7f998400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:48.136 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.128+0000 7f9996ffd700 1 -- 172.21.15.77:0/3323703603 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f999806ccb0 con 0x7f9984004870 2023-07-24T05:47:48.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.128+0000 7f9996ffd700 1 -- 172.21.15.77:0/3323703603 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99980cb230 con 0x7f9984003a70 2023-07-24T05:47:48.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.128+0000 7f9996ffd700 1 -- 172.21.15.77:0/3323703603 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f998400c020 con 0x7f9984005230 2023-07-24T05:47:48.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.128+0000 7f99977fe700 1 --2- 172.21.15.77:0/3323703603 >> v2:172.21.15.77:3300/0 conn(0x7f9998161030 0x7f99980c13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:47:48.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.128+0000 7f998effd700 1 --2- 172.21.15.77:0/3323703603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9984004870 0x7f9984004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:48.137 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.128+0000 7f9997fff700 1 --2- 172.21.15.77:0/3323703603 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9984005230 0x7f998400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:48.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.128+0000 7f998effd700 1 -- 172.21.15.77:0/3323703603 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9984005230 msgr2=0x7f998400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:48.138 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.128+0000 7f998effd700 1 --2- 172.21.15.77:0/3323703603 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9984005230 0x7f998400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:48.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.128+0000 7f998effd700 1 -- 172.21.15.77:0/3323703603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9984003a70 msgr2=0x7f9984003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:48.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.128+0000 7f998effd700 1 --2- 172.21.15.77:0/3323703603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9984003a70 0x7f9984003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:48.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.128+0000 7f998effd700 1 -- 172.21.15.77:0/3323703603 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99840035d0 con 0x7f9984004870 2023-07-24T05:47:48.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.128+0000 7f9997fff700 1 --2- 172.21.15.77:0/3323703603 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f9984005230 0x7f998400ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:47:48.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.128+0000 7f9997fff700 1 -- 172.21.15.77:0/3323703603 reap_dead start 2023-07-24T05:47:48.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.128+0000 7f998effd700 1 --2- 172.21.15.77:0/3323703603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9984004870 0x7f9984004cf0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f9980009f90 tx=0x7f99840058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3c753dbd78a4522 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:48.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.128+0000 7f9996ffd700 1 -- 172.21.15.77:0/3323703603 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998000ec30 con 0x7f9984004870 2023-07-24T05:47:48.139 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.128+0000 7f9996ffd700 1 -- 172.21.15.77:0/3323703603 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f998000f040 con 0x7f9984004870 2023-07-24T05:47:48.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.128+0000 7f9996ffd700 1 -- 172.21.15.77:0/3323703603 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9980014480 con 0x7f9984004870 2023-07-24T05:47:48.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.128+0000 7f999dcdf700 1 -- 172.21.15.77:0/3323703603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9984004870 msgr2=0x7f9984004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:48.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.128+0000 7f999dcdf700 1 --2- 172.21.15.77:0/3323703603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9984004870 0x7f9984004cf0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f9980009f90 tx=0x7f99840058a0 comp rx=0 tx=0).stop 2023-07-24T05:47:48.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.128+0000 7f999dcdf700 1 -- 172.21.15.77:0/3323703603 shutdown_connections 2023-07-24T05:47:48.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.128+0000 7f999dcdf700 1 --2- 172.21.15.77:0/3323703603 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9984004870 0x7f9984004cf0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:48.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.128+0000 7f999dcdf700 1 -- 172.21.15.77:0/3323703603 >> 172.21.15.77:0/3323703603 conn(0x7f99980ce410 msgr2=0x7f99980ce7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:48.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.132+0000 7f999dcdf700 1 -- 172.21.15.77:0/3323703603 shutdown_connections 2023-07-24T05:47:48.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.132+0000 7f999dcdf700 1 -- 172.21.15.77:0/3323703603 wait complete. 2023-07-24T05:47:48.141 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.132+0000 7f999dcdf700 1 Processor -- start 2023-07-24T05:47:48.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.132+0000 7f999dcdf700 1 -- start start 2023-07-24T05:47:48.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.132+0000 7f999dcdf700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9984004870 0x7f999814a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:48.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.132+0000 7f999dcdf700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f99980acb10 0x7f99980b0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:48.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.132+0000 7f999dcdf700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99980b0bd0 0x7f999815f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:48.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.132+0000 7f999dcdf700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99980ac680 con 0x7f99980b0bd0 2023-07-24T05:47:48.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.132+0000 7f999dcdf700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f999814ad10 con 0x7f9984004870 2023-07-24T05:47:48.142 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.132+0000 7f999dcdf700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9998163f50 con 0x7f99980acb10 2023-07-24T05:47:48.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.136+0000 7f9997fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99980b0bd0 0x7f999815f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:48.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.136+0000 7f9997fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99980b0bd0 0x7f999815f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42410/0 (socket says 172.21.15.77:42410) 2023-07-24T05:47:48.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.136+0000 7f998effd700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f99980acb10 0x7f99980b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:48.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.136+0000 7f9997fff700 1 -- 172.21.15.77:0/3340785924 learned_addr learned my addr 172.21.15.77:0/3340785924 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:48.143 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.136+0000 7f99977fe700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9984004870 0x7f999814a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:48.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.136+0000 7f9997fff700 1 -- 172.21.15.77:0/3340785924 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f99980acb10 msgr2=0x7f99980b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:48.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.136+0000 7f9997fff700 1 --2- 172.21.15.77:0/3340785924 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f99980acb10 0x7f99980b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:48.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.136+0000 7f9997fff700 1 -- 172.21.15.77:0/3340785924 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9984004870 msgr2=0x7f999814a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:48.144 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.136+0000 7f9997fff700 1 --2- 172.21.15.77:0/3340785924 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9984004870 0x7f999814a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:48.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.136+0000 7f9997fff700 1 -- 172.21.15.77:0/3340785924 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9998164230 con 0x7f99980b0bd0 2023-07-24T05:47:48.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.136+0000 7f9997fff700 1 --2- 172.21.15.77:0/3340785924 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99980b0bd0 0x7f999815f1b0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f9998164af0 tx=0x7f999000d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:48.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.136+0000 7f9994ff9700 1 -- 172.21.15.77:0/3340785924 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9990004ca0 con 0x7f99980b0bd0 2023-07-24T05:47:48.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.136+0000 7f9994ff9700 1 -- 172.21.15.77:0/3340785924 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9990004e40 con 0x7f99980b0bd0 2023-07-24T05:47:48.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.136+0000 7f9994ff9700 1 -- 172.21.15.77:0/3340785924 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99900072b0 con 0x7f99980b0bd0 2023-07-24T05:47:48.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.136+0000 7f999dcdf700 1 -- 172.21.15.77:0/3340785924 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99980ac030 con 0x7f99980b0bd0 2023-07-24T05:47:48.145 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.136+0000 7f999dcdf700 1 -- 172.21.15.77:0/3340785924 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f999814dfd0 con 0x7f99980b0bd0 2023-07-24T05:47:48.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.136+0000 7f999dcdf700 1 -- 172.21.15.77:0/3340785924 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9998165230 con 0x7f99980b0bd0 2023-07-24T05:47:48.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.140+0000 7f9994ff9700 1 -- 172.21.15.77:0/3340785924 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9990007410 con 0x7f99980b0bd0 2023-07-24T05:47:48.146 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.140+0000 7f9994ff9700 1 --2- 172.21.15.77:0/3340785924 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f9978066320 0x7f99780687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:48.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.140+0000 7f9994ff9700 1 -- 172.21.15.77:0/3340785924 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f9990082fe0 con 0x7f99980b0bd0 2023-07-24T05:47:48.147 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.140+0000 7f99977fe700 1 --2- 172.21.15.77:0/3340785924 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f9978066320 0x7f99780687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:48.148 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.140+0000 7f99977fe700 1 --2- 172.21.15.77:0/3340785924 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f9978066320 0x7f99780687e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9988009420 tx=0x7f99880096d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:48.152 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.144+0000 7f9994ff9700 1 -- 172.21.15.77:0/3340785924 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f99900505d0 con 0x7f99980b0bd0 2023-07-24T05:47:48.324 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.316+0000 7f999dcdf700 1 -- 172.21.15.77:0/3340785924 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f999804df10 con 0x7f99980b0bd0 2023-07-24T05:47:48.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.316+0000 7f9994ff9700 1 -- 172.21.15.77:0/3340785924 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) v1 ==== 84+0+126 (secure 0 0 0) 0x7f999001a020 con 0x7f99980b0bd0 2023-07-24T05:47:48.325 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:47:48.325 INFO:teuthology.orchestra.run.smithi077.stdout:[ 2023-07-24T05:47:48.325 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-07-24T05:47:48.325 INFO:teuthology.orchestra.run.smithi077.stdout: "poolnum": 1, 2023-07-24T05:47:48.325 INFO:teuthology.orchestra.run.smithi077.stdout: "poolname": ".mgr" 2023-07-24T05:47:48.326 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-07-24T05:47:48.326 INFO:teuthology.orchestra.run.smithi077.stdout: { 2023-07-24T05:47:48.326 INFO:teuthology.orchestra.run.smithi077.stdout: "poolnum": 2, 2023-07-24T05:47:48.326 INFO:teuthology.orchestra.run.smithi077.stdout: "poolname": "rbd" 2023-07-24T05:47:48.326 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-07-24T05:47:48.326 INFO:teuthology.orchestra.run.smithi077.stdout:] 2023-07-24T05:47:48.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.320+0000 7f999dcdf700 1 -- 172.21.15.77:0/3340785924 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f9978066320 msgr2=0x7f99780687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:48.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.320+0000 7f999dcdf700 1 --2- 172.21.15.77:0/3340785924 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f9978066320 0x7f99780687e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9988009420 tx=0x7f99880096d0 comp rx=0 tx=0).stop 2023-07-24T05:47:48.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.320+0000 7f999dcdf700 1 -- 172.21.15.77:0/3340785924 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99980b0bd0 msgr2=0x7f999815f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:48.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.320+0000 7f999dcdf700 1 --2- 172.21.15.77:0/3340785924 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99980b0bd0 0x7f999815f1b0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f9998164af0 tx=0x7f999000d9d0 comp rx=0 tx=0).stop 2023-07-24T05:47:48.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.320+0000 7f999dcdf700 1 -- 172.21.15.77:0/3340785924 shutdown_connections 2023-07-24T05:47:48.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.320+0000 7f999dcdf700 1 --2- 172.21.15.77:0/3340785924 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f99980b0bd0 0x7f999815f1b0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:48.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.320+0000 7f999dcdf700 1 --2- 172.21.15.77:0/3340785924 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f9978066320 0x7f99780687e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:48.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.320+0000 7f999dcdf700 1 --2- 172.21.15.77:0/3340785924 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f99980acb10 0x7f99980b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:48.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.320+0000 7f999dcdf700 1 --2- 172.21.15.77:0/3340785924 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9984004870 0x7f999814a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:48.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.320+0000 7f999dcdf700 1 -- 172.21.15.77:0/3340785924 >> 172.21.15.77:0/3340785924 conn(0x7f99980ce410 msgr2=0x7f9998164b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:48.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.320+0000 7f999dcdf700 1 -- 172.21.15.77:0/3340785924 shutdown_connections 2023-07-24T05:47:48.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.320+0000 7f999dcdf700 1 -- 172.21.15.77:0/3340785924 wait complete. 2023-07-24T05:47:48.351 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-24T05:47:48.351 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-24T05:47:48.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.524+0000 7f33c580f700 1 Processor -- start 2023-07-24T05:47:48.533 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.528+0000 7f33c580f700 1 -- start start 2023-07-24T05:47:48.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.528+0000 7f33c580f700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f33c00afdc0 0x7f33c006aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:48.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.528+0000 7f33c580f700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f33c006a4d0 0x7f33c00b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:48.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.528+0000 7f33c580f700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33c00b06e0 con 0x7f33c006c0e0 2023-07-24T05:47:48.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.528+0000 7f33c580f700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33c00b31d0 con 0x7f33c006a4d0 2023-07-24T05:47:48.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.528+0000 7f33c580f700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33c0159c20 con 0x7f33c00afdc0 2023-07-24T05:47:48.537 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.528+0000 7f33c500e700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f33c006c0e0 0x7f33c006c570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55848/0 (socket says 172.21.15.77:55848) 2023-07-24T05:47:48.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.528+0000 7f33c500e700 1 -- 172.21.15.77:0/2664807750 learned_addr learned my addr 172.21.15.77:0/2664807750 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:48.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.532+0000 7f33c480d700 1 --2- 172.21.15.77:0/2664807750 >> v2:172.21.15.103:3300/0 conn(0x7f33c00afdc0 0x7f33c006aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:48.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.532+0000 7f33bffff700 1 --2- 172.21.15.77:0/2664807750 >> v2:172.21.15.77:3300/0 conn(0x7f33c006a4d0 0x7f33c00b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:48.538 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.532+0000 7f33bffff700 1 -- 172.21.15.77:0/2664807750 >> v2:172.21.15.103:3300/0 conn(0x7f33c00afdc0 msgr2=0x7f33c006aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:48.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.532+0000 7f33bffff700 1 --2- 172.21.15.77:0/2664807750 >> v2:172.21.15.103:3300/0 conn(0x7f33c00afdc0 0x7f33c006aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:48.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.532+0000 7f33bffff700 1 -- 172.21.15.77:0/2664807750 >> v1:172.21.15.77:6789/0 conn(0x7f33c006c0e0 legacy=0x7f33c006c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:48.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.532+0000 7f33bffff700 1 -- 172.21.15.77:0/2664807750 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c006aa20 con 0x7f33c006a4d0 2023-07-24T05:47:48.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.532+0000 7f33bf7fe700 1 -- 172.21.15.77:0/2664807750 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1545827514 0 0) 0x7f33c00b06e0 con 0x7f33c006c0e0 2023-07-24T05:47:48.539 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.532+0000 7f33bffff700 1 --2- 172.21.15.77:0/2664807750 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33c006a4d0 0x7f33c00b01a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f33c00b09d0 tx=0x7f33ac009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4db49104dc68d0c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:48.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.532+0000 7f33bf7fe700 1 -- 172.21.15.77:0/2664807750 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac011830 con 0x7f33c006a4d0 2023-07-24T05:47:48.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.532+0000 7f33bf7fe700 1 -- 172.21.15.77:0/2664807750 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ac011990 con 0x7f33c006a4d0 2023-07-24T05:47:48.540 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.532+0000 7f33bf7fe700 1 -- 172.21.15.77:0/2664807750 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac011d20 con 0x7f33c006a4d0 2023-07-24T05:47:48.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.532+0000 7f33c580f700 1 -- 172.21.15.77:0/2664807750 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33c006a4d0 msgr2=0x7f33c00b01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:48.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.532+0000 7f33c580f700 1 --2- 172.21.15.77:0/2664807750 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33c006a4d0 0x7f33c00b01a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f33c00b09d0 tx=0x7f33ac009b60 comp rx=0 tx=0).stop 2023-07-24T05:47:48.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.532+0000 7f33c580f700 1 -- 172.21.15.77:0/2664807750 shutdown_connections 2023-07-24T05:47:48.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.532+0000 7f33c580f700 1 --2- 172.21.15.77:0/2664807750 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33c006a4d0 0x7f33c00b01a0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:48.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.532+0000 7f33c580f700 1 --2- 172.21.15.77:0/2664807750 >> v2:172.21.15.103:3300/0 conn(0x7f33c00afdc0 0x7f33c006aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:48.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.532+0000 7f33c580f700 1 -- 172.21.15.77:0/2664807750 >> 172.21.15.77:0/2664807750 conn(0x7f33c00b3f20 msgr2=0x7f33c00cadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:48.541 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.532+0000 7f33c580f700 1 -- 172.21.15.77:0/2664807750 shutdown_connections 2023-07-24T05:47:48.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.532+0000 7f33c580f700 1 -- 172.21.15.77:0/2664807750 wait complete. 2023-07-24T05:47:48.542 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.536+0000 7f33c580f700 1 Processor -- start 2023-07-24T05:47:48.543 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.536+0000 7f33c580f700 1 -- start start 2023-07-24T05:47:48.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.536+0000 7f33c580f700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33c006a4d0 0x7f33c015c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:48.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.536+0000 7f33c580f700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33c006c0e0 0x7f33c00c1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:48.544 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.536+0000 7f33c580f700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33c00afdc0 0x7f33c015a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:48.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.536+0000 7f33c580f700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c015b340 con 0x7f33c00afdc0 2023-07-24T05:47:48.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.536+0000 7f33c580f700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c015cc60 con 0x7f33c006c0e0 2023-07-24T05:47:48.545 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.536+0000 7f33c580f700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33c006fdb0 con 0x7f33c006a4d0 2023-07-24T05:47:48.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.536+0000 7f33c500e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33c00afdc0 0x7f33c015a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:48.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.536+0000 7f33c500e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33c00afdc0 0x7f33c015a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42422/0 (socket says 172.21.15.77:42422) 2023-07-24T05:47:48.546 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.536+0000 7f33c500e700 1 -- 172.21.15.77:0/32987319 learned_addr learned my addr 172.21.15.77:0/32987319 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:48.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.540+0000 7f33bffff700 1 --2- 172.21.15.77:0/32987319 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33c006c0e0 0x7f33c00c1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:48.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.540+0000 7f33c480d700 1 --2- 172.21.15.77:0/32987319 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33c006a4d0 0x7f33c015c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:48.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.540+0000 7f33c500e700 1 -- 172.21.15.77:0/32987319 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33c006a4d0 msgr2=0x7f33c015c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:48.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.540+0000 7f33c500e700 1 --2- 172.21.15.77:0/32987319 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33c006a4d0 0x7f33c015c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:48.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.540+0000 7f33c500e700 1 -- 172.21.15.77:0/32987319 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33c006c0e0 msgr2=0x7f33c00c1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:48.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.540+0000 7f33c500e700 1 --2- 172.21.15.77:0/32987319 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33c006c0e0 0x7f33c00c1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:48.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.540+0000 7f33c500e700 1 -- 172.21.15.77:0/32987319 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ac0094b0 con 0x7f33c00afdc0 2023-07-24T05:47:48.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.540+0000 7f33c500e700 1 --2- 172.21.15.77:0/32987319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33c00afdc0 0x7f33c015a6c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f33b8002230 tx=0x7f33b800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:48.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.540+0000 7f33bd7fa700 1 -- 172.21.15.77:0/32987319 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b800aac0 con 0x7f33c00afdc0 2023-07-24T05:47:48.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.540+0000 7f33bd7fa700 1 -- 172.21.15.77:0/32987319 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b800ac40 con 0x7f33c00afdc0 2023-07-24T05:47:48.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.540+0000 7f33c580f700 1 -- 172.21.15.77:0/32987319 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33c00c2390 con 0x7f33c00afdc0 2023-07-24T05:47:48.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.540+0000 7f33bd7fa700 1 -- 172.21.15.77:0/32987319 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b80070d0 con 0x7f33c00afdc0 2023-07-24T05:47:48.548 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.540+0000 7f33c580f700 1 -- 172.21.15.77:0/32987319 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33c00705a0 con 0x7f33c00afdc0 2023-07-24T05:47:48.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.540+0000 7f33c580f700 1 -- 172.21.15.77:0/32987319 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33c004df10 con 0x7f33c00afdc0 2023-07-24T05:47:48.549 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.544+0000 7f33bd7fa700 1 -- 172.21.15.77:0/32987319 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f33b8007250 con 0x7f33c00afdc0 2023-07-24T05:47:48.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.544+0000 7f33bd7fa700 1 --2- 172.21.15.77:0/32987319 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f33a4066320 0x7f33a40687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:48.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.544+0000 7f33bd7fa700 1 -- 172.21.15.77:0/32987319 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f33b80837b0 con 0x7f33c00afdc0 2023-07-24T05:47:48.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.544+0000 7f33c480d700 1 --2- 172.21.15.77:0/32987319 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f33a4066320 0x7f33a40687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:48.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.544+0000 7f33c480d700 1 --2- 172.21.15.77:0/32987319 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f33a4066320 0x7f33a40687e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f33c006dae0 tx=0x7f33b40091c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:48.557 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.552+0000 7f33bd7fa700 1 -- 172.21.15.77:0/32987319 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f33b8050ed0 con 0x7f33c00afdc0 2023-07-24T05:47:48.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:48.724+0000 7f33c580f700 1 -- 172.21.15.77:0/32987319 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f33c006add0 con 0x7f33c00afdc0 2023-07-24T05:47:49.547 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.540+0000 7f33bd7fa700 1 -- 172.21.15.77:0/32987319 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v36) v1 ==== 138+0+0 (secure 0 0 0) 0x7f33b80544f0 con 0x7f33c00afdc0 2023-07-24T05:47:49.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.544+0000 7f33c580f700 1 -- 172.21.15.77:0/32987319 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f33a4066320 msgr2=0x7f33a40687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:49.551 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.544+0000 7f33c580f700 1 --2- 172.21.15.77:0/32987319 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f33a4066320 0x7f33a40687e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f33c006dae0 tx=0x7f33b40091c0 comp rx=0 tx=0).stop 2023-07-24T05:47:49.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.544+0000 7f33c580f700 1 -- 172.21.15.77:0/32987319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33c00afdc0 msgr2=0x7f33c015a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:49.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.544+0000 7f33c580f700 1 --2- 172.21.15.77:0/32987319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33c00afdc0 0x7f33c015a6c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f33b8002230 tx=0x7f33b800cf50 comp rx=0 tx=0).stop 2023-07-24T05:47:49.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.544+0000 7f33c580f700 1 -- 172.21.15.77:0/32987319 shutdown_connections 2023-07-24T05:47:49.552 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.544+0000 7f33c580f700 1 --2- 172.21.15.77:0/32987319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f33c00afdc0 0x7f33c015a6c0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:49.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.544+0000 7f33c580f700 1 --2- 172.21.15.77:0/32987319 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33c006c0e0 0x7f33c00c1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:49.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.544+0000 7f33c580f700 1 --2- 172.21.15.77:0/32987319 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f33a4066320 0x7f33a40687e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:49.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.544+0000 7f33c580f700 1 --2- 172.21.15.77:0/32987319 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f33c006a4d0 0x7f33c015c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:49.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.544+0000 7f33c580f700 1 -- 172.21.15.77:0/32987319 >> 172.21.15.77:0/32987319 conn(0x7f33c00b3f20 msgr2=0x7f33c00b0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:49.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.544+0000 7f33c580f700 1 -- 172.21.15.77:0/32987319 shutdown_connections 2023-07-24T05:47:49.553 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.544+0000 7f33c580f700 1 -- 172.21.15.77:0/32987319 wait complete. 2023-07-24T05:47:49.554 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_metadata' created 2023-07-24T05:47:49.574 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-24T05:47:49.757 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.752+0000 7fed3f59e700 1 Processor -- start 2023-07-24T05:47:49.758 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.752+0000 7fed3f59e700 1 -- start start 2023-07-24T05:47:49.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.752+0000 7fed3f59e700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fed4015ca50 0x7fed400b38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:49.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.752+0000 7fed3f59e700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed400d2a90 con 0x7fed400b1770 2023-07-24T05:47:49.760 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.752+0000 7fed3f59e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed400b2280 con 0x7fed400cfd20 2023-07-24T05:47:49.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.752+0000 7fed3f59e700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed4015ce30 con 0x7fed4015ca50 2023-07-24T05:47:49.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.752+0000 7fed3e59c700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fed4015ca50 0x7fed400b38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:49.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.752+0000 7fed3e59c700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fed4015ca50 0x7fed400b38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42430/0 (socket says 172.21.15.77:42430) 2023-07-24T05:47:49.761 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.752+0000 7fed3e59c700 1 -- 172.21.15.77:0/479413043 learned_addr learned my addr 172.21.15.77:0/479413043 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:49.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.756+0000 7fed3e59c700 1 -- 172.21.15.77:0/479413043 >> v1:172.21.15.103:6789/0 conn(0x7fed400cfd20 legacy=0x7fed401604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:49.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.756+0000 7fed3e59c700 1 -- 172.21.15.77:0/479413043 >> v1:172.21.15.77:6789/0 conn(0x7fed400b1770 legacy=0x7fed400cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:49.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.756+0000 7fed3e59c700 1 -- 172.21.15.77:0/479413043 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed400b1cc0 con 0x7fed4015ca50 2023-07-24T05:47:49.762 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.756+0000 7fed3e59c700 1 --2- 172.21.15.77:0/479413043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed4015ca50 0x7fed400b38e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fed30009940 tx=0x7fed30009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fdedf67a2c0e989 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:49.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.756+0000 7fed3d59a700 1 -- 172.21.15.77:0/479413043 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed30004230 con 0x7fed4015ca50 2023-07-24T05:47:49.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.756+0000 7fed3d59a700 1 -- 172.21.15.77:0/479413043 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed30009e90 con 0x7fed4015ca50 2023-07-24T05:47:49.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.756+0000 7fed3d59a700 1 -- 172.21.15.77:0/479413043 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed300045b0 con 0x7fed4015ca50 2023-07-24T05:47:49.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.756+0000 7fed3f59e700 1 -- 172.21.15.77:0/479413043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed4015ca50 msgr2=0x7fed400b38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:49.763 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.756+0000 7fed3f59e700 1 --2- 172.21.15.77:0/479413043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed4015ca50 0x7fed400b38e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fed30009940 tx=0x7fed30009c50 comp rx=0 tx=0).stop 2023-07-24T05:47:49.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.756+0000 7fed3f59e700 1 -- 172.21.15.77:0/479413043 shutdown_connections 2023-07-24T05:47:49.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.756+0000 7fed3f59e700 1 --2- 172.21.15.77:0/479413043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed4015ca50 0x7fed400b38e0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:49.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.756+0000 7fed3f59e700 1 -- 172.21.15.77:0/479413043 >> 172.21.15.77:0/479413043 conn(0x7fed400b5610 msgr2=0x7fed400b5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:49.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.756+0000 7fed3f59e700 1 -- 172.21.15.77:0/479413043 shutdown_connections 2023-07-24T05:47:49.764 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.756+0000 7fed3f59e700 1 -- 172.21.15.77:0/479413043 wait complete. 2023-07-24T05:47:49.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.760+0000 7fed3f59e700 1 Processor -- start 2023-07-24T05:47:49.766 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.760+0000 7fed3f59e700 1 -- start start 2023-07-24T05:47:49.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.760+0000 7fed3f59e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed400b1770 0x7fed401590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:49.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.760+0000 7fed3f59e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fed400cfd20 0x7fed4015d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:49.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.760+0000 7fed3f59e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed4015ca50 0x7fed4015dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:49.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.760+0000 7fed3f59e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4015f220 con 0x7fed4015ca50 2023-07-24T05:47:49.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.760+0000 7fed3f59e700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed401f22f0 con 0x7fed400b1770 2023-07-24T05:47:49.768 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.760+0000 7fed3f59e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed40159630 con 0x7fed400cfd20 2023-07-24T05:47:49.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.760+0000 7fed3ed9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed4015ca50 0x7fed4015dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:49.769 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.760+0000 7fed3ed9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed4015ca50 0x7fed4015dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42444/0 (socket says 172.21.15.77:42444) 2023-07-24T05:47:49.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.760+0000 7fed3ed9d700 1 -- 172.21.15.77:0/2073834100 learned_addr learned my addr 172.21.15.77:0/2073834100 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:49.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.760+0000 7fed3e59c700 1 --2- 172.21.15.77:0/2073834100 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed400b1770 0x7fed401590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:49.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.760+0000 7fed3dd9b700 1 --2- 172.21.15.77:0/2073834100 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fed400cfd20 0x7fed4015d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:49.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.764+0000 7fed3ed9d700 1 -- 172.21.15.77:0/2073834100 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fed400cfd20 msgr2=0x7fed4015d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:49.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.764+0000 7fed3ed9d700 1 --2- 172.21.15.77:0/2073834100 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fed400cfd20 0x7fed4015d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:49.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.764+0000 7fed3ed9d700 1 -- 172.21.15.77:0/2073834100 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed400b1770 msgr2=0x7fed401590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:49.770 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.764+0000 7fed3ed9d700 1 --2- 172.21.15.77:0/2073834100 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed400b1770 0x7fed401590f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:49.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.764+0000 7fed3ed9d700 1 -- 172.21.15.77:0/2073834100 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed30009570 con 0x7fed4015ca50 2023-07-24T05:47:49.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.764+0000 7fed3ed9d700 1 --2- 172.21.15.77:0/2073834100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed4015ca50 0x7fed4015dec0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fed3800cc40 tx=0x7fed3800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:49.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.764+0000 7fed2effd700 1 -- 172.21.15.77:0/2073834100 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed38004c10 con 0x7fed4015ca50 2023-07-24T05:47:49.771 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.764+0000 7fed2effd700 1 -- 172.21.15.77:0/2073834100 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed38004d70 con 0x7fed4015ca50 2023-07-24T05:47:49.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.764+0000 7fed2effd700 1 -- 172.21.15.77:0/2073834100 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3800ab10 con 0x7fed4015ca50 2023-07-24T05:47:49.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.764+0000 7fed3f59e700 1 -- 172.21.15.77:0/2073834100 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed4015e400 con 0x7fed4015ca50 2023-07-24T05:47:49.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.764+0000 7fed3f59e700 1 -- 172.21.15.77:0/2073834100 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed4015e980 con 0x7fed4015ca50 2023-07-24T05:47:49.772 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.764+0000 7fed3f59e700 1 -- 172.21.15.77:0/2073834100 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed401f2480 con 0x7fed4015ca50 2023-07-24T05:47:49.774 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.768+0000 7fed2effd700 1 -- 172.21.15.77:0/2073834100 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fed3800ac70 con 0x7fed4015ca50 2023-07-24T05:47:49.776 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.768+0000 7fed2effd700 1 --2- 172.21.15.77:0/2073834100 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fed200662f0 0x7fed200687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:49.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.772+0000 7fed2effd700 1 -- 172.21.15.77:0/2073834100 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5900+0+0 (secure 0 0 0) 0x7fed38084300 con 0x7fed4015ca50 2023-07-24T05:47:49.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.772+0000 7fed3e59c700 1 --2- 172.21.15.77:0/2073834100 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fed200662f0 0x7fed200687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:49.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.772+0000 7fed3e59c700 1 --2- 172.21.15.77:0/2073834100 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fed200662f0 0x7fed200687b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fed30000c00 tx=0x7fed30008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:49.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.776+0000 7fed2effd700 1 -- 172.21.15.77:0/2073834100 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fed38051780 con 0x7fed4015ca50 2023-07-24T05:47:49.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:49.948+0000 7fed3f59e700 1 -- 172.21.15.77:0/2073834100 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fed40072490 con 0x7fed4015ca50 2023-07-24T05:47:50.562 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.556+0000 7fed2effd700 1 -- 172.21.15.77:0/2073834100 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v37) v1 ==== 170+0+0 (secure 0 0 0) 0x7fed38054da0 con 0x7fed4015ca50 2023-07-24T05:47:50.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.564+0000 7fed3f59e700 1 -- 172.21.15.77:0/2073834100 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fed200662f0 msgr2=0x7fed200687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:50.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.564+0000 7fed3f59e700 1 --2- 172.21.15.77:0/2073834100 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fed200662f0 0x7fed200687b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fed30000c00 tx=0x7fed30008030 comp rx=0 tx=0).stop 2023-07-24T05:47:50.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.568+0000 7fed3f59e700 1 -- 172.21.15.77:0/2073834100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed4015ca50 msgr2=0x7fed4015dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:50.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.568+0000 7fed3f59e700 1 --2- 172.21.15.77:0/2073834100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed4015ca50 0x7fed4015dec0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fed3800cc40 tx=0x7fed3800cf50 comp rx=0 tx=0).stop 2023-07-24T05:47:50.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.568+0000 7fed3f59e700 1 -- 172.21.15.77:0/2073834100 shutdown_connections 2023-07-24T05:47:50.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.568+0000 7fed3f59e700 1 --2- 172.21.15.77:0/2073834100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed4015ca50 0x7fed4015dec0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:50.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.568+0000 7fed3f59e700 1 --2- 172.21.15.77:0/2073834100 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fed200662f0 0x7fed200687b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:50.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.568+0000 7fed3f59e700 1 --2- 172.21.15.77:0/2073834100 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fed400cfd20 0x7fed4015d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:50.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.568+0000 7fed3f59e700 1 --2- 172.21.15.77:0/2073834100 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed400b1770 0x7fed401590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:50.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.568+0000 7fed3f59e700 1 -- 172.21.15.77:0/2073834100 >> 172.21.15.77:0/2073834100 conn(0x7fed400b5610 msgr2=0x7fed400b7680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:50.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.568+0000 7fed3f59e700 1 -- 172.21.15.77:0/2073834100 shutdown_connections 2023-07-24T05:47:50.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.568+0000 7fed3f59e700 1 -- 172.21.15.77:0/2073834100 wait complete. 2023-07-24T05:47:50.584 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_data' created 2023-07-24T05:47:50.603 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-24T05:47:50.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.768+0000 7f66eb11a700 1 Processor -- start 2023-07-24T05:47:50.775 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.768+0000 7f66eb11a700 1 -- start start 2023-07-24T05:47:50.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.772+0000 7f66eb11a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f66e40b09c0 0x7f66e40cbb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:50.777 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.772+0000 7f66eb11a700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f66e40b21c0 0x7f66e40b25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:50.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.772+0000 7f66eb11a700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66e40b2b30 con 0x7f66e415c9e0 2023-07-24T05:47:50.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.772+0000 7f66eb11a700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66e40b0fd0 con 0x7f66e40b21c0 2023-07-24T05:47:50.778 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.772+0000 7f66eb11a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66e40cb050 con 0x7f66e40b09c0 2023-07-24T05:47:50.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.772+0000 7f66e96b7700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f66e40b21c0 0x7f66e40b25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:50.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.772+0000 7f66e96b7700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f66e40b21c0 0x7f66e40b25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42452/0 (socket says 172.21.15.77:42452) 2023-07-24T05:47:50.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.772+0000 7f66e96b7700 1 -- 172.21.15.77:0/1996037403 learned_addr learned my addr 172.21.15.77:0/1996037403 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:50.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.772+0000 7f66e3fff700 1 --2- 172.21.15.77:0/1996037403 >> v2:172.21.15.103:3300/0 conn(0x7f66e40b09c0 0x7f66e40cbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:50.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.772+0000 7f66e96b7700 1 -- 172.21.15.77:0/1996037403 >> v2:172.21.15.103:3300/0 conn(0x7f66e40b09c0 msgr2=0x7f66e40cbb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:50.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.772+0000 7f66e96b7700 1 --2- 172.21.15.77:0/1996037403 >> v2:172.21.15.103:3300/0 conn(0x7f66e40b09c0 0x7f66e40cbb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:50.779 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.772+0000 7f66e96b7700 1 -- 172.21.15.77:0/1996037403 >> v1:172.21.15.103:6789/0 conn(0x7f66e415c9e0 legacy=0x7f66e40cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:50.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.772+0000 7f66e96b7700 1 -- 172.21.15.77:0/1996037403 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e40cb330 con 0x7f66e40b21c0 2023-07-24T05:47:50.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.772+0000 7f66e96b7700 1 --2- 172.21.15.77:0/1996037403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66e40b21c0 0x7f66e40b25f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f66e40cc820 tx=0x7f66dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=821c52a31a7b9d1f server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:50.780 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.772+0000 7f66e37fe700 1 -- 172.21.15.77:0/1996037403 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66dc00e070 con 0x7f66e40b21c0 2023-07-24T05:47:50.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.772+0000 7f66e37fe700 1 -- 172.21.15.77:0/1996037403 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66dc00b910 con 0x7f66e40b21c0 2023-07-24T05:47:50.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.772+0000 7f66e37fe700 1 -- 172.21.15.77:0/1996037403 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66dc00bcc0 con 0x7f66e40b21c0 2023-07-24T05:47:50.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.776+0000 7f66eb11a700 1 -- 172.21.15.77:0/1996037403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66e40b21c0 msgr2=0x7f66e40b25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:50.781 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.776+0000 7f66eb11a700 1 --2- 172.21.15.77:0/1996037403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66e40b21c0 0x7f66e40b25f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f66e40cc820 tx=0x7f66dc00b330 comp rx=0 tx=0).stop 2023-07-24T05:47:50.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.776+0000 7f66eb11a700 1 -- 172.21.15.77:0/1996037403 shutdown_connections 2023-07-24T05:47:50.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.776+0000 7f66eb11a700 1 --2- 172.21.15.77:0/1996037403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66e40b21c0 0x7f66e40b25f0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:50.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.776+0000 7f66eb11a700 1 --2- 172.21.15.77:0/1996037403 >> v2:172.21.15.103:3300/0 conn(0x7f66e40b09c0 0x7f66e40cbb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:50.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.776+0000 7f66eb11a700 1 -- 172.21.15.77:0/1996037403 >> 172.21.15.77:0/1996037403 conn(0x7f66e40d0740 msgr2=0x7f66e40d0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:50.782 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.776+0000 7f66eb11a700 1 -- 172.21.15.77:0/1996037403 shutdown_connections 2023-07-24T05:47:50.783 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.776+0000 7f66eb11a700 1 -- 172.21.15.77:0/1996037403 wait complete. 2023-07-24T05:47:50.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.776+0000 7f66eb11a700 1 Processor -- start 2023-07-24T05:47:50.784 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.776+0000 7f66eb11a700 1 -- start start 2023-07-24T05:47:50.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.780+0000 7f66eb11a700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f66e40b09c0 0x7f66e4155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:50.785 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.780+0000 7f66eb11a700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66e40b21c0 0x7f66e415cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:50.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.780+0000 7f66eb11a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66e415c9e0 0x7f66e415f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:50.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.780+0000 7f66eb11a700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e415e7d0 con 0x7f66e415c9e0 2023-07-24T05:47:50.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.780+0000 7f66eb11a700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e415d730 con 0x7f66e40b21c0 2023-07-24T05:47:50.786 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.780+0000 7f66eb11a700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e415da10 con 0x7f66e40b09c0 2023-07-24T05:47:50.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.780+0000 7f66e96b7700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66e415c9e0 0x7f66e415f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:50.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.780+0000 7f66e96b7700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66e415c9e0 0x7f66e415f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42464/0 (socket says 172.21.15.77:42464) 2023-07-24T05:47:50.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.780+0000 7f66e96b7700 1 -- 172.21.15.77:0/3212510431 learned_addr learned my addr 172.21.15.77:0/3212510431 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:50.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.780+0000 7f66e3fff700 1 --2- 172.21.15.77:0/3212510431 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66e40b21c0 0x7f66e415cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:50.787 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.780+0000 7f66e8eb6700 1 --2- 172.21.15.77:0/3212510431 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f66e40b09c0 0x7f66e4155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:50.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.780+0000 7f66e96b7700 1 -- 172.21.15.77:0/3212510431 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f66e40b09c0 msgr2=0x7f66e4155900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:50.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.780+0000 7f66e96b7700 1 --2- 172.21.15.77:0/3212510431 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f66e40b09c0 0x7f66e4155900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:50.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.780+0000 7f66e96b7700 1 -- 172.21.15.77:0/3212510431 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66e40b21c0 msgr2=0x7f66e415cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:50.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.780+0000 7f66e96b7700 1 --2- 172.21.15.77:0/3212510431 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66e40b21c0 0x7f66e415cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:50.788 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.780+0000 7f66e96b7700 1 -- 172.21.15.77:0/3212510431 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66dc009b30 con 0x7f66e415c9e0 2023-07-24T05:47:50.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.780+0000 7f66e96b7700 1 --2- 172.21.15.77:0/3212510431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66e415c9e0 0x7f66e415f2f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f66e40b3160 tx=0x7f66dc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:50.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.780+0000 7f66e17fa700 1 -- 172.21.15.77:0/3212510431 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66dc004880 con 0x7f66e415c9e0 2023-07-24T05:47:50.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.780+0000 7f66e17fa700 1 -- 172.21.15.77:0/3212510431 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66dc0099b0 con 0x7f66e415c9e0 2023-07-24T05:47:50.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.780+0000 7f66eb11a700 1 -- 172.21.15.77:0/3212510431 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66e415dcf0 con 0x7f66e415c9e0 2023-07-24T05:47:50.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.780+0000 7f66e17fa700 1 -- 172.21.15.77:0/3212510431 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66dc01c680 con 0x7f66e415c9e0 2023-07-24T05:47:50.789 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.780+0000 7f66eb11a700 1 -- 172.21.15.77:0/3212510431 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66e415e2b0 con 0x7f66e415c9e0 2023-07-24T05:47:50.790 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.784+0000 7f66eb11a700 1 -- 172.21.15.77:0/3212510431 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66e404df10 con 0x7f66e415c9e0 2023-07-24T05:47:50.791 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.784+0000 7f66e17fa700 1 -- 172.21.15.77:0/3212510431 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f66dc01c7e0 con 0x7f66e415c9e0 2023-07-24T05:47:50.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.784+0000 7f66e17fa700 1 --2- 172.21.15.77:0/3212510431 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f66c80662f0 0x7f66c80687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:50.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.788+0000 7f66e17fa700 1 -- 172.21.15.77:0/3212510431 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6282+0+0 (secure 0 0 0) 0x7f66dc085760 con 0x7f66e415c9e0 2023-07-24T05:47:50.793 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.788+0000 7f66e8eb6700 1 --2- 172.21.15.77:0/3212510431 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f66c80662f0 0x7f66c80687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:50.794 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.788+0000 7f66e8eb6700 1 --2- 172.21.15.77:0/3212510431 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f66c80662f0 0x7f66c80687b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f66d8000f60 tx=0x7f66d8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:50.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:50.792+0000 7f66e17fa700 1 -- 172.21.15.77:0/3212510431 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f66dc052c10 con 0x7f66e415c9e0 2023-07-24T05:47:51.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.004+0000 7f66eb11a700 1 -- 172.21.15.77:0/3212510431 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f66e40b1f50 con 0x7f66e415c9e0 2023-07-24T05:47:51.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.592+0000 7f66e17fa700 1 -- 172.21.15.77:0/3212510431 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f66dc056230 con 0x7f66e415c9e0 2023-07-24T05:47:51.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.604+0000 7f66eb11a700 1 -- 172.21.15.77:0/3212510431 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f66c80662f0 msgr2=0x7f66c80687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:51.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.604+0000 7f66eb11a700 1 --2- 172.21.15.77:0/3212510431 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f66c80662f0 0x7f66c80687b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f66d8000f60 tx=0x7f66d8009040 comp rx=0 tx=0).stop 2023-07-24T05:47:51.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.604+0000 7f66eb11a700 1 -- 172.21.15.77:0/3212510431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66e415c9e0 msgr2=0x7f66e415f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:51.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.604+0000 7f66eb11a700 1 --2- 172.21.15.77:0/3212510431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66e415c9e0 0x7f66e415f2f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f66e40b3160 tx=0x7f66dc004af0 comp rx=0 tx=0).stop 2023-07-24T05:47:51.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.604+0000 7f66eb11a700 1 -- 172.21.15.77:0/3212510431 shutdown_connections 2023-07-24T05:47:51.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.604+0000 7f66eb11a700 1 --2- 172.21.15.77:0/3212510431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f66e415c9e0 0x7f66e415f2f0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:51.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.604+0000 7f66eb11a700 1 --2- 172.21.15.77:0/3212510431 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66e40b21c0 0x7f66e415cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:51.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.604+0000 7f66eb11a700 1 --2- 172.21.15.77:0/3212510431 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f66c80662f0 0x7f66c80687b0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:51.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.604+0000 7f66eb11a700 1 --2- 172.21.15.77:0/3212510431 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f66e40b09c0 0x7f66e4155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:51.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.604+0000 7f66eb11a700 1 -- 172.21.15.77:0/3212510431 >> 172.21.15.77:0/3212510431 conn(0x7f66e40d0740 msgr2=0x7f66e40d0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:51.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.604+0000 7f66eb11a700 1 -- 172.21.15.77:0/3212510431 shutdown_connections 2023-07-24T05:47:51.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.604+0000 7f66eb11a700 1 -- 172.21.15.77:0/3212510431 wait complete. 2023-07-24T05:47:51.614 INFO:teuthology.orchestra.run.smithi077.stderr:new fs with metadata pool 6 and data pool 7 2023-07-24T05:47:51.631 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-24T05:47:51.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.788+0000 7f00db59e700 1 Processor -- start 2023-07-24T05:47:51.797 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.792+0000 7f00db59e700 1 -- start start 2023-07-24T05:47:51.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.792+0000 7f00db59e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f00dc161100 0x7f00dc0b1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:51.798 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.792+0000 7f00db59e700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00dc0af170 con 0x7f00dc0b15d0 2023-07-24T05:47:51.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.792+0000 7f00db59e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00dc0b19d0 con 0x7f00dc160d20 2023-07-24T05:47:51.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.792+0000 7f00db59e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00dc0ae5f0 con 0x7f00dc161100 2023-07-24T05:47:51.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.792+0000 7f00dad9d700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f00dc0b15d0 0x7f00dc0af700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55862/0 (socket says 172.21.15.77:55862) 2023-07-24T05:47:51.799 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.792+0000 7f00dad9d700 1 -- 172.21.15.77:0/513856159 learned_addr learned my addr 172.21.15.77:0/513856159 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:51.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.792+0000 7f00d1d9b700 1 --2- 172.21.15.77:0/513856159 >> v2:172.21.15.103:3300/0 conn(0x7f00dc161100 0x7f00dc0b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:51.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.792+0000 7f00d9d9b700 1 -- 172.21.15.77:0/513856159 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4156982355 0 0) 0x7f00dc0af170 con 0x7f00dc0b15d0 2023-07-24T05:47:51.800 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.792+0000 7f00d9d9b700 1 -- 172.21.15.77:0/513856159 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00c80035d0 con 0x7f00dc0b15d0 2023-07-24T05:47:51.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.792+0000 7f00d1d9b700 1 -- 172.21.15.77:0/513856159 >> v1:172.21.15.103:6789/0 conn(0x7f00dc160d20 legacy=0x7f00dc0adba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:51.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.792+0000 7f00d1d9b700 1 -- 172.21.15.77:0/513856159 >> v1:172.21.15.77:6789/0 conn(0x7f00dc0b15d0 legacy=0x7f00dc0af700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:51.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.792+0000 7f00d1d9b700 1 -- 172.21.15.77:0/513856159 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00dc0ae8d0 con 0x7f00dc161100 2023-07-24T05:47:51.801 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.796+0000 7f00d1d9b700 1 --2- 172.21.15.77:0/513856159 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00dc161100 0x7f00dc0b1090 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f00c4009850 tx=0x7f00c4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8e81930d7ffc06 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:51.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.796+0000 7f00d9d9b700 1 -- 172.21.15.77:0/513856159 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c4011830 con 0x7f00dc161100 2023-07-24T05:47:51.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.796+0000 7f00d9d9b700 1 -- 172.21.15.77:0/513856159 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c4011990 con 0x7f00dc161100 2023-07-24T05:47:51.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.796+0000 7f00d9d9b700 1 -- 172.21.15.77:0/513856159 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c4011d00 con 0x7f00dc161100 2023-07-24T05:47:51.802 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.796+0000 7f00db59e700 1 -- 172.21.15.77:0/513856159 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00dc161100 msgr2=0x7f00dc0b1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:51.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.796+0000 7f00db59e700 1 --2- 172.21.15.77:0/513856159 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00dc161100 0x7f00dc0b1090 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f00c4009850 tx=0x7f00c4009b60 comp rx=0 tx=0).stop 2023-07-24T05:47:51.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.796+0000 7f00db59e700 1 -- 172.21.15.77:0/513856159 shutdown_connections 2023-07-24T05:47:51.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.796+0000 7f00db59e700 1 --2- 172.21.15.77:0/513856159 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00dc161100 0x7f00dc0b1090 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:51.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.796+0000 7f00db59e700 1 -- 172.21.15.77:0/513856159 >> 172.21.15.77:0/513856159 conn(0x7f00dc0cacc0 msgr2=0x7f00dc0cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:51.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.796+0000 7f00db59e700 1 -- 172.21.15.77:0/513856159 shutdown_connections 2023-07-24T05:47:51.803 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.796+0000 7f00db59e700 1 -- 172.21.15.77:0/513856159 wait complete. 2023-07-24T05:47:51.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.800+0000 7f00db59e700 1 Processor -- start 2023-07-24T05:47:51.806 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.800+0000 7f00db59e700 1 -- start start 2023-07-24T05:47:51.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.800+0000 7f00db59e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00dc0b15d0 0x7f00dc15d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:51.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.800+0000 7f00db59e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00dc160d20 0x7f00dc06cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:51.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.800+0000 7f00db59e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00dc161100 0x7f00dc06d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:51.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.800+0000 7f00db59e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc0c2710 con 0x7f00dc0b15d0 2023-07-24T05:47:51.808 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.800+0000 7f00db59e700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc0cdec0 con 0x7f00dc160d20 2023-07-24T05:47:51.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.800+0000 7f00db59e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc09bd20 con 0x7f00dc161100 2023-07-24T05:47:51.809 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.800+0000 7f00da59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00dc0b15d0 0x7f00dc15d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:51.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.800+0000 7f00da59c700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00dc0b15d0 0x7f00dc15d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42478/0 (socket says 172.21.15.77:42478) 2023-07-24T05:47:51.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.800+0000 7f00da59c700 1 -- 172.21.15.77:0/3704175523 learned_addr learned my addr 172.21.15.77:0/3704175523 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:51.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.800+0000 7f00d1d9b700 1 --2- 172.21.15.77:0/3704175523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00dc160d20 0x7f00dc06cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:51.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.800+0000 7f00dad9d700 1 --2- 172.21.15.77:0/3704175523 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00dc161100 0x7f00dc06d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:51.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.804+0000 7f00da59c700 1 -- 172.21.15.77:0/3704175523 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00dc161100 msgr2=0x7f00dc06d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:51.810 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.804+0000 7f00da59c700 1 --2- 172.21.15.77:0/3704175523 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00dc161100 0x7f00dc06d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:51.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.804+0000 7f00da59c700 1 -- 172.21.15.77:0/3704175523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00dc160d20 msgr2=0x7f00dc06cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:51.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.804+0000 7f00da59c700 1 --2- 172.21.15.77:0/3704175523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00dc160d20 0x7f00dc06cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:51.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.804+0000 7f00da59c700 1 -- 172.21.15.77:0/3704175523 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c40094b0 con 0x7f00dc0b15d0 2023-07-24T05:47:51.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.804+0000 7f00dad9d700 1 --2- 172.21.15.77:0/3704175523 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00dc161100 0x7f00dc06d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:51.811 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.804+0000 7f00da59c700 1 --2- 172.21.15.77:0/3704175523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00dc0b15d0 0x7f00dc15d0e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f00cc00c410 tx=0x7f00cc00c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:51.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.804+0000 7f00d37fe700 1 -- 172.21.15.77:0/3704175523 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc0052d0 con 0x7f00dc0b15d0 2023-07-24T05:47:51.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.804+0000 7f00d37fe700 1 -- 172.21.15.77:0/3704175523 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00cc005430 con 0x7f00dc0b15d0 2023-07-24T05:47:51.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.804+0000 7f00db59e700 1 -- 172.21.15.77:0/3704175523 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00dc09b760 con 0x7f00dc0b15d0 2023-07-24T05:47:51.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.804+0000 7f00d37fe700 1 -- 172.21.15.77:0/3704175523 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00cc0055a0 con 0x7f00dc0b15d0 2023-07-24T05:47:51.812 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.804+0000 7f00db59e700 1 -- 172.21.15.77:0/3704175523 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00dc0c2960 con 0x7f00dc0b15d0 2023-07-24T05:47:51.813 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.804+0000 7f00db59e700 1 -- 172.21.15.77:0/3704175523 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00dc072490 con 0x7f00dc0b15d0 2023-07-24T05:47:51.814 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.808+0000 7f00d37fe700 1 -- 172.21.15.77:0/3704175523 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f00cc0036a0 con 0x7f00dc0b15d0 2023-07-24T05:47:51.815 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.808+0000 7f00d37fe700 1 --2- 172.21.15.77:0/3704175523 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f00bc0662f0 0x7f00bc0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:51.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.808+0000 7f00d37fe700 1 -- 172.21.15.77:0/3704175523 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f00cc0830c0 con 0x7f00dc0b15d0 2023-07-24T05:47:51.816 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.808+0000 7f00d1d9b700 1 --2- 172.21.15.77:0/3704175523 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f00bc0662f0 0x7f00bc0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:51.817 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.812+0000 7f00d1d9b700 1 --2- 172.21.15.77:0/3704175523 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f00bc0662f0 0x7f00bc0687b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f00c40090b0 tx=0x7f00c4008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:51.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.812+0000 7f00d37fe700 1 -- 172.21.15.77:0/3704175523 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f00cc050360 con 0x7f00dc0b15d0 2023-07-24T05:47:51.990 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.984+0000 7f00db59e700 1 -- 172.21.15.77:0/3704175523 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00dc0aee60 con 0x7f00dc0b15d0 2023-07-24T05:47:51.992 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.984+0000 7f00d37fe700 1 -- 172.21.15.77:0/3704175523 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18501 (secure 0 0 0) 0x7f00cc053980 con 0x7f00dc0b15d0 2023-07-24T05:47:51.993 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:47:51.993 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":38,"fsid":"5aed5f7b-fb55-4d95-9c02-c6adbb1677b4","created":"2023-07-24T05:45:39.639731+0000","modified":"2023-07-24T05:47:51.009776+0000","last_up_change":"2023-07-24T05:45:52.319670+0000","last_in_change":"2023-07-24T05:45:43.643277+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-24T05:45:52.610430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-24T05:45:52.773787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-24T05:47:48.791472+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-24T05:47:50.021778+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ffa0d496-461a-4053-b764-0627d969521b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6812","nonce":825987196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6817","nonce":825987196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6831","nonce":825987196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6824","nonce":825987196}]},"public_addr":"172.21.15.77:6812/825987196","cluster_addr":"172.21.15.77:6817/825987196","heartbeat_back_addr":"172.21.15.77:6831/825987196","heartbeat_front_addr":"172.21.15.77:6824/825987196","state":["exists","up"]},{"osd":1,"uuid":"9f595e5e-5c43-49bc-8ce4-ee70575c90da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6801","nonce":4133026815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6803","nonce":4133026815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6807","nonce":4133026815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6805","nonce":4133026815}]},"public_addr":"172.21.15.77:6801/4133026815","cluster_addr":"172.21.15.77:6803/4133026815","heartbeat_back_addr":"172.21.15.77:6807/4133026815","heartbeat_front_addr":"172.21.15.77:6805/4133026815","state":["exists","up"]},{"osd":2,"uuid":"2ac177aa-4d7d-4262-bd54-d2b9f29f4c3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6811","nonce":2394142159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6819","nonce":2394142159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6830","nonce":2394142159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6825","nonce":2394142159}]},"public_addr":"172.21.15.77:6811/2394142159","cluster_addr":"172.21.15.77:6819/2394142159","heartbeat_back_addr":"172.21.15.77:6830/2394142159","heartbeat_front_addr":"172.21.15.77:6825/2394142159","state":["exists","up"]},{"osd":3,"uuid":"17d7a251-19e8-484c-8172-a578ab3da153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6813","nonce":1492113982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6818","nonce":1492113982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6829","nonce":1492113982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6823","nonce":1492113982}]},"public_addr":"172.21.15.77:6813/1492113982","cluster_addr":"172.21.15.77:6818/1492113982","heartbeat_back_addr":"172.21.15.77:6829/1492113982","heartbeat_front_addr":"172.21.15.77:6823/1492113982","state":["exists","up"]},{"osd":4,"uuid":"bf63ca05-f06d-4e0f-ac44-2a416c70b919","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6825","nonce":1080481057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6827","nonce":1080481057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6831","nonce":1080481057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6829","nonce":1080481057}]},"public_addr":"172.21.15.103:6825/1080481057","cluster_addr":"172.21.15.103:6827/1080481057","heartbeat_back_addr":"172.21.15.103:6831/1080481057","heartbeat_front_addr":"172.21.15.103:6829/1080481057","state":["exists","up"]},{"osd":5,"uuid":"65a11a35-9e9f-4b3c-9fe3-b658d62b9318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6811","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6813","nonce":2756677504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6818","nonce":2756677504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6823","nonce":2756677504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6821","nonce":2756677504}]},"public_addr":"172.21.15.103:6813/2756677504","cluster_addr":"172.21.15.103:6818/2756677504","heartbeat_back_addr":"172.21.15.103:6823/2756677504","heartbeat_front_addr":"172.21.15.103:6821/2756677504","state":["exists","up"]},{"osd":6,"uuid":"750c1f87-686c-40b4-94a1-1a299dc78f3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6809","nonce":568977764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6812","nonce":568977764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6819","nonce":568977764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6815","nonce":568977764}]},"public_addr":"172.21.15.103:6809/568977764","cluster_addr":"172.21.15.103:6812/568977764","heartbeat_back_addr":"172.21.15.103:6819/568977764","heartbeat_front_addr":"172.21.15.103:6815/568977764","state":["exists","up"]},{"osd":7,"uuid":"d5fe4fb6-2e09-4158-885b-403803c85822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6801","nonce":1074557176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6803","nonce":1074557176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6807","nonce":1074557176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6805","nonce":1074557176}]},"public_addr":"172.21.15.103:6801/1074557176","cluster_addr":"172.21.15.103:6803/1074557176","heartbeat_back_addr":"172.21.15.103:6807/1074557176","heartbeat_front_addr":"172.21.15.103:6805/1074557176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.631032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.154109+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.398587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.679089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.311218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.353726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.314372+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.126212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-24T05:47:51.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.988+0000 7f00db59e700 1 -- 172.21.15.77:0/3704175523 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f00bc0662f0 msgr2=0x7f00bc0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:51.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.988+0000 7f00db59e700 1 --2- 172.21.15.77:0/3704175523 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f00bc0662f0 0x7f00bc0687b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f00c40090b0 tx=0x7f00c4008030 comp rx=0 tx=0).stop 2023-07-24T05:47:51.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.988+0000 7f00db59e700 1 -- 172.21.15.77:0/3704175523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00dc0b15d0 msgr2=0x7f00dc15d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:51.995 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.988+0000 7f00db59e700 1 --2- 172.21.15.77:0/3704175523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00dc0b15d0 0x7f00dc15d0e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f00cc00c410 tx=0x7f00cc00c720 comp rx=0 tx=0).stop 2023-07-24T05:47:51.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.988+0000 7f00db59e700 1 -- 172.21.15.77:0/3704175523 shutdown_connections 2023-07-24T05:47:51.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.988+0000 7f00db59e700 1 --2- 172.21.15.77:0/3704175523 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f00bc0662f0 0x7f00bc0687b0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:51.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.988+0000 7f00db59e700 1 --2- 172.21.15.77:0/3704175523 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f00dc161100 0x7f00dc06d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:51.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.988+0000 7f00db59e700 1 --2- 172.21.15.77:0/3704175523 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00dc160d20 0x7f00dc06cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:51.996 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.988+0000 7f00db59e700 1 --2- 172.21.15.77:0/3704175523 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00dc0b15d0 0x7f00dc15d0e0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:51.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.988+0000 7f00db59e700 1 -- 172.21.15.77:0/3704175523 >> 172.21.15.77:0/3704175523 conn(0x7f00dc0cacc0 msgr2=0x7f00dc069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:51.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.988+0000 7f00db59e700 1 -- 172.21.15.77:0/3704175523 shutdown_connections 2023-07-24T05:47:51.997 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:51.988+0000 7f00db59e700 1 -- 172.21.15.77:0/3704175523 wait complete. 2023-07-24T05:47:52.018 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-24T05:47:52.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.184+0000 7f88e8c9a700 1 Processor -- start 2023-07-24T05:47:52.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.184+0000 7f88e8c9a700 1 -- start start 2023-07-24T05:47:52.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.184+0000 7f88e8c9a700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f88e415ca00 0x7f88e40d2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:52.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.184+0000 7f88e8c9a700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f88e406d450 0x7f88e40b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:52.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.184+0000 7f88e8c9a700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88e40b4a80 con 0x7f88e40b4630 2023-07-24T05:47:52.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.184+0000 7f88e8c9a700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88e40d0300 con 0x7f88e415ca00 2023-07-24T05:47:52.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.184+0000 7f88e8c9a700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88e415cde0 con 0x7f88e406d450 2023-07-24T05:47:52.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.184+0000 7f88e37fe700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f88e415ca00 0x7f88e40d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:52.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.184+0000 7f88e3fff700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f88e40b4630 0x7f88e40b11e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:55872/0 (socket says 172.21.15.77:55872) 2023-07-24T05:47:52.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.184+0000 7f88e3fff700 1 -- 172.21.15.77:0/1665274716 learned_addr learned my addr 172.21.15.77:0/1665274716 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:52.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.184+0000 7f88daffd700 1 --2- 172.21.15.77:0/1665274716 >> v2:172.21.15.103:3300/0 conn(0x7f88e406d450 0x7f88e40b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:52.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.188+0000 7f88daffd700 1 -- 172.21.15.77:0/1665274716 >> v2:172.21.15.77:3300/0 conn(0x7f88e415ca00 msgr2=0x7f88e40d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:52.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.188+0000 7f88daffd700 1 --2- 172.21.15.77:0/1665274716 >> v2:172.21.15.77:3300/0 conn(0x7f88e415ca00 0x7f88e40d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:52.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.188+0000 7f88daffd700 1 -- 172.21.15.77:0/1665274716 >> v1:172.21.15.77:6789/0 conn(0x7f88e40b4630 legacy=0x7f88e40b11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:52.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.188+0000 7f88daffd700 1 -- 172.21.15.77:0/1665274716 --> v2:172.21.15.103:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e40d2870 con 0x7f88e406d450 2023-07-24T05:47:52.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.188+0000 7f88e2ffd700 1 -- 172.21.15.77:0/1665274716 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1615528074 0 0) 0x7f88dc001490 con 0x7f88e40b4630 2023-07-24T05:47:52.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.188+0000 7f88daffd700 1 --2- 172.21.15.77:0/1665274716 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88e406d450 0x7f88e40b40f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f88e40b5190 tx=0x7f88cc009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8525221e7d33cc6f server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:52.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.188+0000 7f88e2ffd700 1 -- 172.21.15.77:0/1665274716 <== mon.1 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88cc011830 con 0x7f88e406d450 2023-07-24T05:47:52.195 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.188+0000 7f88e2ffd700 1 -- 172.21.15.77:0/1665274716 <== mon.1 v2:172.21.15.103:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88cc011990 con 0x7f88e406d450 2023-07-24T05:47:52.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.188+0000 7f88e2ffd700 1 -- 172.21.15.77:0/1665274716 <== mon.1 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88cc011d20 con 0x7f88e406d450 2023-07-24T05:47:52.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.188+0000 7f88e8c9a700 1 -- 172.21.15.77:0/1665274716 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88e406d450 msgr2=0x7f88e40b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:52.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.188+0000 7f88e8c9a700 1 --2- 172.21.15.77:0/1665274716 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88e406d450 0x7f88e40b40f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f88e40b5190 tx=0x7f88cc009b30 comp rx=0 tx=0).stop 2023-07-24T05:47:52.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.188+0000 7f88e8c9a700 1 -- 172.21.15.77:0/1665274716 shutdown_connections 2023-07-24T05:47:52.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.188+0000 7f88e8c9a700 1 --2- 172.21.15.77:0/1665274716 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88e406d450 0x7f88e40b40f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:52.196 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.188+0000 7f88e8c9a700 1 --2- 172.21.15.77:0/1665274716 >> v2:172.21.15.77:3300/0 conn(0x7f88e415ca00 0x7f88e40d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:52.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.188+0000 7f88e8c9a700 1 -- 172.21.15.77:0/1665274716 >> 172.21.15.77:0/1665274716 conn(0x7f88e40b7610 msgr2=0x7f88e40b7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:52.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.188+0000 7f88e8c9a700 1 -- 172.21.15.77:0/1665274716 shutdown_connections 2023-07-24T05:47:52.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.188+0000 7f88e8c9a700 1 -- 172.21.15.77:0/1665274716 wait complete. 2023-07-24T05:47:52.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.192+0000 7f88e8c9a700 1 Processor -- start 2023-07-24T05:47:52.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.192+0000 7f88e8c9a700 1 -- start start 2023-07-24T05:47:52.199 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.192+0000 7f88e8c9a700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88e406d450 0x7f88e4156800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:52.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.192+0000 7f88e8c9a700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f88e40b4630 0x7f88e4150960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:52.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.192+0000 7f88e8c9a700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88e415ca00 0x7f88e4150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:52.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.192+0000 7f88e8c9a700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e41f2260 con 0x7f88e406d450 2023-07-24T05:47:52.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.192+0000 7f88e8c9a700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e41f6570 con 0x7f88e415ca00 2023-07-24T05:47:52.200 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.192+0000 7f88e8c9a700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e41f2510 con 0x7f88e40b4630 2023-07-24T05:47:52.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.192+0000 7f88e37fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88e406d450 0x7f88e4156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:52.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.192+0000 7f88e37fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88e406d450 0x7f88e4156800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42510/0 (socket says 172.21.15.77:42510) 2023-07-24T05:47:52.201 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.192+0000 7f88e37fe700 1 -- 172.21.15.77:0/79854607 learned_addr learned my addr 172.21.15.77:0/79854607 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:52.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.192+0000 7f88e3fff700 1 --2- 172.21.15.77:0/79854607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88e415ca00 0x7f88e4150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:52.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.192+0000 7f88daffd700 1 --2- 172.21.15.77:0/79854607 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f88e40b4630 0x7f88e4150960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:52.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.192+0000 7f88e37fe700 1 -- 172.21.15.77:0/79854607 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f88e40b4630 msgr2=0x7f88e4150960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:52.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.192+0000 7f88e37fe700 1 --2- 172.21.15.77:0/79854607 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f88e40b4630 0x7f88e4150960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:52.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.192+0000 7f88e37fe700 1 -- 172.21.15.77:0/79854607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88e415ca00 msgr2=0x7f88e4150ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:52.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.192+0000 7f88e37fe700 1 --2- 172.21.15.77:0/79854607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88e415ca00 0x7f88e4150ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:52.202 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.192+0000 7f88e37fe700 1 -- 172.21.15.77:0/79854607 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88cc0094b0 con 0x7f88e406d450 2023-07-24T05:47:52.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.196+0000 7f88e37fe700 1 --2- 172.21.15.77:0/79854607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88e406d450 0x7f88e4156800 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f88d400e9b0 tx=0x7f88d400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:52.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.196+0000 7f88e0ff9700 1 -- 172.21.15.77:0/79854607 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d4009670 con 0x7f88e406d450 2023-07-24T05:47:52.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.196+0000 7f88e0ff9700 1 -- 172.21.15.77:0/79854607 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d400eea0 con 0x7f88e406d450 2023-07-24T05:47:52.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.196+0000 7f88e8c9a700 1 -- 172.21.15.77:0/79854607 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88e41f27f0 con 0x7f88e406d450 2023-07-24T05:47:52.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.196+0000 7f88e0ff9700 1 -- 172.21.15.77:0/79854607 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d400ca50 con 0x7f88e406d450 2023-07-24T05:47:52.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.196+0000 7f88e8c9a700 1 -- 172.21.15.77:0/79854607 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88e4156d40 con 0x7f88e406d450 2023-07-24T05:47:52.204 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.196+0000 7f88e8c9a700 1 -- 172.21.15.77:0/79854607 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88e4156f30 con 0x7f88e406d450 2023-07-24T05:47:52.205 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.200+0000 7f88e0ff9700 1 -- 172.21.15.77:0/79854607 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f88d400cbb0 con 0x7f88e406d450 2023-07-24T05:47:52.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.200+0000 7f88e0ff9700 1 --2- 172.21.15.77:0/79854607 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f88c80662f0 0x7f88c80687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:52.206 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.200+0000 7f88e0ff9700 1 -- 172.21.15.77:0/79854607 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f88d4083ee0 con 0x7f88e406d450 2023-07-24T05:47:52.207 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.200+0000 7f88daffd700 1 --2- 172.21.15.77:0/79854607 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f88c80662f0 0x7f88c80687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:52.208 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.200+0000 7f88daffd700 1 --2- 172.21.15.77:0/79854607 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f88c80662f0 0x7f88c80687b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f88cc0090b0 tx=0x7f88cc008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:52.212 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.204+0000 7f88e0ff9700 1 -- 172.21.15.77:0/79854607 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f88d4054c10 con 0x7f88e406d450 2023-07-24T05:47:52.386 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.380+0000 7f88e8c9a700 1 -- 172.21.15.77:0/79854607 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88e40d2e10 con 0x7f88e406d450 2023-07-24T05:47:52.389 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.384+0000 7f88e0ff9700 1 -- 172.21.15.77:0/79854607 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+18501 (secure 0 0 0) 0x7f88e40d2e10 con 0x7f88e406d450 2023-07-24T05:47:52.390 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:47:52.390 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":38,"fsid":"5aed5f7b-fb55-4d95-9c02-c6adbb1677b4","created":"2023-07-24T05:45:39.639731+0000","modified":"2023-07-24T05:47:51.009776+0000","last_up_change":"2023-07-24T05:45:52.319670+0000","last_in_change":"2023-07-24T05:45:43.643277+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-24T05:45:52.610430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-24T05:45:52.773787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-24T05:47:48.791472+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-24T05:47:50.021778+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ffa0d496-461a-4053-b764-0627d969521b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6812","nonce":825987196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6817","nonce":825987196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6831","nonce":825987196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6824","nonce":825987196}]},"public_addr":"172.21.15.77:6812/825987196","cluster_addr":"172.21.15.77:6817/825987196","heartbeat_back_addr":"172.21.15.77:6831/825987196","heartbeat_front_addr":"172.21.15.77:6824/825987196","state":["exists","up"]},{"osd":1,"uuid":"9f595e5e-5c43-49bc-8ce4-ee70575c90da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6801","nonce":4133026815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6803","nonce":4133026815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6807","nonce":4133026815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6805","nonce":4133026815}]},"public_addr":"172.21.15.77:6801/4133026815","cluster_addr":"172.21.15.77:6803/4133026815","heartbeat_back_addr":"172.21.15.77:6807/4133026815","heartbeat_front_addr":"172.21.15.77:6805/4133026815","state":["exists","up"]},{"osd":2,"uuid":"2ac177aa-4d7d-4262-bd54-d2b9f29f4c3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6811","nonce":2394142159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6819","nonce":2394142159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6830","nonce":2394142159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6825","nonce":2394142159}]},"public_addr":"172.21.15.77:6811/2394142159","cluster_addr":"172.21.15.77:6819/2394142159","heartbeat_back_addr":"172.21.15.77:6830/2394142159","heartbeat_front_addr":"172.21.15.77:6825/2394142159","state":["exists","up"]},{"osd":3,"uuid":"17d7a251-19e8-484c-8172-a578ab3da153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6813","nonce":1492113982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6818","nonce":1492113982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6829","nonce":1492113982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6823","nonce":1492113982}]},"public_addr":"172.21.15.77:6813/1492113982","cluster_addr":"172.21.15.77:6818/1492113982","heartbeat_back_addr":"172.21.15.77:6829/1492113982","heartbeat_front_addr":"172.21.15.77:6823/1492113982","state":["exists","up"]},{"osd":4,"uuid":"bf63ca05-f06d-4e0f-ac44-2a416c70b919","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6825","nonce":1080481057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6827","nonce":1080481057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6831","nonce":1080481057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6829","nonce":1080481057}]},"public_addr":"172.21.15.103:6825/1080481057","cluster_addr":"172.21.15.103:6827/1080481057","heartbeat_back_addr":"172.21.15.103:6831/1080481057","heartbeat_front_addr":"172.21.15.103:6829/1080481057","state":["exists","up"]},{"osd":5,"uuid":"65a11a35-9e9f-4b3c-9fe3-b658d62b9318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6811","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6813","nonce":2756677504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6818","nonce":2756677504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6823","nonce":2756677504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6821","nonce":2756677504}]},"public_addr":"172.21.15.103:6813/2756677504","cluster_addr":"172.21.15.103:6818/2756677504","heartbeat_back_addr":"172.21.15.103:6823/2756677504","heartbeat_front_addr":"172.21.15.103:6821/2756677504","state":["exists","up"]},{"osd":6,"uuid":"750c1f87-686c-40b4-94a1-1a299dc78f3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6809","nonce":568977764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6812","nonce":568977764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6819","nonce":568977764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6815","nonce":568977764}]},"public_addr":"172.21.15.103:6809/568977764","cluster_addr":"172.21.15.103:6812/568977764","heartbeat_back_addr":"172.21.15.103:6819/568977764","heartbeat_front_addr":"172.21.15.103:6815/568977764","state":["exists","up"]},{"osd":7,"uuid":"d5fe4fb6-2e09-4158-885b-403803c85822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6801","nonce":1074557176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6803","nonce":1074557176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6807","nonce":1074557176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6805","nonce":1074557176}]},"public_addr":"172.21.15.103:6801/1074557176","cluster_addr":"172.21.15.103:6803/1074557176","heartbeat_back_addr":"172.21.15.103:6807/1074557176","heartbeat_front_addr":"172.21.15.103:6805/1074557176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.631032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.154109+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.398587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.679089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.311218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.353726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.314372+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.126212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-24T05:47:52.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.388+0000 7f88e8c9a700 1 -- 172.21.15.77:0/79854607 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f88c80662f0 msgr2=0x7f88c80687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:52.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.388+0000 7f88e8c9a700 1 --2- 172.21.15.77:0/79854607 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f88c80662f0 0x7f88c80687b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f88cc0090b0 tx=0x7f88cc008030 comp rx=0 tx=0).stop 2023-07-24T05:47:52.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.388+0000 7f88e8c9a700 1 -- 172.21.15.77:0/79854607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88e406d450 msgr2=0x7f88e4156800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:52.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.388+0000 7f88e8c9a700 1 --2- 172.21.15.77:0/79854607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88e406d450 0x7f88e4156800 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f88d400e9b0 tx=0x7f88d400ecc0 comp rx=0 tx=0).stop 2023-07-24T05:47:52.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.388+0000 7f88e8c9a700 1 -- 172.21.15.77:0/79854607 shutdown_connections 2023-07-24T05:47:52.394 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.388+0000 7f88e8c9a700 1 --2- 172.21.15.77:0/79854607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f88e415ca00 0x7f88e4150ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:52.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.388+0000 7f88e8c9a700 1 --2- 172.21.15.77:0/79854607 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f88c80662f0 0x7f88c80687b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:52.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.388+0000 7f88e8c9a700 1 --2- 172.21.15.77:0/79854607 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f88e40b4630 0x7f88e4150960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:52.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.388+0000 7f88e8c9a700 1 --2- 172.21.15.77:0/79854607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88e406d450 0x7f88e4156800 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:52.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.388+0000 7f88e8c9a700 1 -- 172.21.15.77:0/79854607 >> 172.21.15.77:0/79854607 conn(0x7f88e40b7610 msgr2=0x7f88e40cf5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:52.395 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.388+0000 7f88e8c9a700 1 -- 172.21.15.77:0/79854607 shutdown_connections 2023-07-24T05:47:52.396 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.388+0000 7f88e8c9a700 1 -- 172.21.15.77:0/79854607 wait complete. 2023-07-24T05:47:52.415 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-24T05:47:52.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.592+0000 7f8bf61af700 1 Processor -- start 2023-07-24T05:47:52.598 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.592+0000 7f8bf61af700 1 -- start start 2023-07-24T05:47:52.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.592+0000 7f8bf61af700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8bf015c870 0x7f8bf00cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:52.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.592+0000 7f8bf61af700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8bf00b2230 0x7f8bf00cd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:52.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.592+0000 7f8bf61af700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bf00cf520 con 0x7f8bf015cc50 2023-07-24T05:47:52.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.592+0000 7f8bf61af700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bf006aaa0 con 0x7f8bf015c870 2023-07-24T05:47:52.600 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.592+0000 7f8bf61af700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bf006ad80 con 0x7f8bf00b2230 2023-07-24T05:47:52.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.592+0000 7f8bf51ad700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8bf015c870 0x7f8bf00cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:52.601 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.592+0000 7f8bf59ae700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8bf00b2230 0x7f8bf00cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:52.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.592+0000 7f8bf51ad700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f8bf015c870 0x7f8bf00cefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42522/0 (socket says 172.21.15.77:42522) 2023-07-24T05:47:52.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.592+0000 7f8bf51ad700 1 -- 172.21.15.77:0/3279021437 learned_addr learned my addr 172.21.15.77:0/3279021437 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:52.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.592+0000 7f8bf51ad700 1 -- 172.21.15.77:0/3279021437 >> v2:172.21.15.103:3300/0 conn(0x7f8bf00b2230 msgr2=0x7f8bf00cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:52.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.592+0000 7f8bf51ad700 1 --2- 172.21.15.77:0/3279021437 >> v2:172.21.15.103:3300/0 conn(0x7f8bf00b2230 0x7f8bf00cd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:52.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.592+0000 7f8bf51ad700 1 -- 172.21.15.77:0/3279021437 >> v1:172.21.15.103:6789/0 conn(0x7f8bf015cc50 legacy=0x7f8bf00b1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:52.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.592+0000 7f8bf51ad700 1 -- 172.21.15.77:0/3279021437 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf006b060 con 0x7f8bf015c870 2023-07-24T05:47:52.602 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.596+0000 7f8bf51ad700 1 --2- 172.21.15.77:0/3279021437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bf015c870 0x7f8bf00cefe0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f8bf00b5160 tx=0x7f8bec009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f84cc4668eb509f5 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:52.603 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.596+0000 7f8be7fff700 1 -- 172.21.15.77:0/3279021437 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bec005e50 con 0x7f8bf015c870 2023-07-24T05:47:52.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.596+0000 7f8be7fff700 1 -- 172.21.15.77:0/3279021437 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bec006030 con 0x7f8bf015c870 2023-07-24T05:47:52.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.596+0000 7f8be7fff700 1 -- 172.21.15.77:0/3279021437 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bec0063c0 con 0x7f8bf015c870 2023-07-24T05:47:52.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.596+0000 7f8bf61af700 1 -- 172.21.15.77:0/3279021437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bf015c870 msgr2=0x7f8bf00cefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:52.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.596+0000 7f8bf61af700 1 --2- 172.21.15.77:0/3279021437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bf015c870 0x7f8bf00cefe0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f8bf00b5160 tx=0x7f8bec009bf0 comp rx=0 tx=0).stop 2023-07-24T05:47:52.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.596+0000 7f8bf61af700 1 -- 172.21.15.77:0/3279021437 shutdown_connections 2023-07-24T05:47:52.604 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.596+0000 7f8bf61af700 1 --2- 172.21.15.77:0/3279021437 >> v2:172.21.15.103:3300/0 conn(0x7f8bf00b2230 0x7f8bf00cd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:52.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.596+0000 7f8bf61af700 1 --2- 172.21.15.77:0/3279021437 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bf015c870 0x7f8bf00cefe0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:52.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.596+0000 7f8bf61af700 1 -- 172.21.15.77:0/3279021437 >> 172.21.15.77:0/3279021437 conn(0x7f8bf0089f80 msgr2=0x7f8bf009b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:52.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.596+0000 7f8bf61af700 1 -- 172.21.15.77:0/3279021437 shutdown_connections 2023-07-24T05:47:52.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.596+0000 7f8bf61af700 1 -- 172.21.15.77:0/3279021437 wait complete. 2023-07-24T05:47:52.605 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.600+0000 7f8bf61af700 1 Processor -- start 2023-07-24T05:47:52.606 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.600+0000 7f8bf61af700 1 -- start start 2023-07-24T05:47:52.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.600+0000 7f8bf61af700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8bf00b2230 0x7f8bf0152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:52.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.600+0000 7f8bf61af700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bf015c870 0x7f8bf015a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:52.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.600+0000 7f8bf61af700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bf015cc50 0x7f8bf0150740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:52.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.600+0000 7f8bf61af700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf01513c0 con 0x7f8bf015cc50 2023-07-24T05:47:52.607 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.600+0000 7f8bf61af700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf01516a0 con 0x7f8bf015c870 2023-07-24T05:47:52.608 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.600+0000 7f8bf61af700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf0151980 con 0x7f8bf00b2230 2023-07-24T05:47:52.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.600+0000 7f8bf59ae700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bf015cc50 0x7f8bf0150740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:52.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.600+0000 7f8bf51ad700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8bf00b2230 0x7f8bf0152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:52.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.600+0000 7f8bf49ac700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bf015c870 0x7f8bf015a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:52.609 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.600+0000 7f8bf51ad700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8bf00b2230 0x7f8bf0152ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.77:55900/0 (socket says 172.21.15.77:55900) 2023-07-24T05:47:52.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.600+0000 7f8bf59ae700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bf015cc50 0x7f8bf0150740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42538/0 (socket says 172.21.15.77:42538) 2023-07-24T05:47:52.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.600+0000 7f8bf51ad700 1 -- 172.21.15.77:0/1069881513 learned_addr learned my addr 172.21.15.77:0/1069881513 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:52.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.600+0000 7f8bf59ae700 1 -- 172.21.15.77:0/1069881513 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8bf00b2230 msgr2=0x7f8bf0152ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:52.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.600+0000 7f8bf59ae700 1 --2- 172.21.15.77:0/1069881513 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8bf00b2230 0x7f8bf0152ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:52.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.600+0000 7f8bf59ae700 1 -- 172.21.15.77:0/1069881513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bf015c870 msgr2=0x7f8bf015a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:52.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.600+0000 7f8bf59ae700 1 --2- 172.21.15.77:0/1069881513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bf015c870 0x7f8bf015a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:52.610 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.600+0000 7f8bf59ae700 1 -- 172.21.15.77:0/1069881513 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bec009520 con 0x7f8bf015cc50 2023-07-24T05:47:52.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.600+0000 7f8bf51ad700 1 --2- 172.21.15.77:0/1069881513 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8bf00b2230 0x7f8bf0152ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:47:52.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.600+0000 7f8bf49ac700 1 --2- 172.21.15.77:0/1069881513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bf015c870 0x7f8bf015a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:47:52.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.600+0000 7f8bf59ae700 1 --2- 172.21.15.77:0/1069881513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bf015cc50 0x7f8bf0150740 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f8be800ef90 tx=0x7f8be800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:52.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.600+0000 7f8be5ffb700 1 -- 172.21.15.77:0/1069881513 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be800cc90 con 0x7f8bf015cc50 2023-07-24T05:47:52.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.600+0000 7f8bf61af700 1 -- 172.21.15.77:0/1069881513 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bf0151c60 con 0x7f8bf015cc50 2023-07-24T05:47:52.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.600+0000 7f8be5ffb700 1 -- 172.21.15.77:0/1069881513 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be800f040 con 0x7f8bf015cc50 2023-07-24T05:47:52.611 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.600+0000 7f8be5ffb700 1 -- 172.21.15.77:0/1069881513 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be80146c0 con 0x7f8bf015cc50 2023-07-24T05:47:52.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.604+0000 7f8bf61af700 1 -- 172.21.15.77:0/1069881513 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bf00aff30 con 0x7f8bf015cc50 2023-07-24T05:47:52.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.604+0000 7f8bf61af700 1 -- 172.21.15.77:0/1069881513 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bf006c530 con 0x7f8bf015cc50 2023-07-24T05:47:52.612 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.604+0000 7f8be5ffb700 1 -- 172.21.15.77:0/1069881513 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8be8014820 con 0x7f8bf015cc50 2023-07-24T05:47:52.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.604+0000 7f8be5ffb700 1 --2- 172.21.15.77:0/1069881513 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f8bd40662f0 0x7f8bd40687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:52.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.604+0000 7f8be5ffb700 1 -- 172.21.15.77:0/1069881513 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f8be8084930 con 0x7f8bf015cc50 2023-07-24T05:47:52.613 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.608+0000 7f8bf51ad700 1 --2- 172.21.15.77:0/1069881513 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f8bd40662f0 0x7f8bd40687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:52.614 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.608+0000 7f8bf51ad700 1 --2- 172.21.15.77:0/1069881513 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f8bd40662f0 0x7f8bd40687b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8bec00a010 tx=0x7f8bec008070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:52.618 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.612+0000 7f8be5ffb700 1 -- 172.21.15.77:0/1069881513 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8be8051c80 con 0x7f8bf015cc50 2023-07-24T05:47:52.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:52.820+0000 7f8bf61af700 1 -- 172.21.15.77:0/1069881513 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8bf0072490 con 0x7f8bf015cc50 2023-07-24T05:47:53.617 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.612+0000 7f8be5ffb700 1 -- 172.21.15.77:0/1069881513 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8be8009e60 con 0x7f8bf015cc50 2023-07-24T05:47:53.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.616+0000 7f8bf61af700 1 -- 172.21.15.77:0/1069881513 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f8bd40662f0 msgr2=0x7f8bd40687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:53.621 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.616+0000 7f8bf61af700 1 --2- 172.21.15.77:0/1069881513 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f8bd40662f0 0x7f8bd40687b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8bec00a010 tx=0x7f8bec008070 comp rx=0 tx=0).stop 2023-07-24T05:47:53.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.616+0000 7f8bf61af700 1 -- 172.21.15.77:0/1069881513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bf015cc50 msgr2=0x7f8bf0150740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:53.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.616+0000 7f8bf61af700 1 --2- 172.21.15.77:0/1069881513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bf015cc50 0x7f8bf0150740 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f8be800ef90 tx=0x7f8be800c3a0 comp rx=0 tx=0).stop 2023-07-24T05:47:53.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.616+0000 7f8bf61af700 1 -- 172.21.15.77:0/1069881513 shutdown_connections 2023-07-24T05:47:53.622 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.616+0000 7f8bf61af700 1 --2- 172.21.15.77:0/1069881513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8bf015cc50 0x7f8bf0150740 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:53.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.616+0000 7f8bf61af700 1 --2- 172.21.15.77:0/1069881513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bf015c870 0x7f8bf015a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:53.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.616+0000 7f8bf61af700 1 --2- 172.21.15.77:0/1069881513 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f8bd40662f0 0x7f8bd40687b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:53.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.616+0000 7f8bf61af700 1 --2- 172.21.15.77:0/1069881513 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8bf00b2230 0x7f8bf0152ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:53.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.616+0000 7f8bf61af700 1 -- 172.21.15.77:0/1069881513 >> 172.21.15.77:0/1069881513 conn(0x7f8bf0089f80 msgr2=0x7f8bf006cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:53.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.616+0000 7f8bf61af700 1 -- 172.21.15.77:0/1069881513 shutdown_connections 2023-07-24T05:47:53.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.616+0000 7f8bf61af700 1 -- 172.21.15.77:0/1069881513 wait complete. 2023-07-24T05:47:53.644 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-24T05:47:53.644 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-24T05:47:53.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.816+0000 7f4bed651700 1 Processor -- start 2023-07-24T05:47:53.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.820+0000 7f4bed651700 1 -- start start 2023-07-24T05:47:53.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.820+0000 7f4bed651700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4be80aaf50 0x7f4be80abb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:53.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.820+0000 7f4bed651700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4be806a520 0x7f4be80ab330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:53.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.820+0000 7f4bed651700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4be806cf70 con 0x7f4be806d400 2023-07-24T05:47:53.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.820+0000 7f4bed651700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4be80ac400 con 0x7f4be80aaf50 2023-07-24T05:47:53.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.820+0000 7f4bed651700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be80ab870 con 0x7f4be806a520 2023-07-24T05:47:53.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.820+0000 7f4be67fc700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4be806a520 0x7f4be80ab330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:53.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.820+0000 7f4be6ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4be80aaf50 0x7f4be80abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:53.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.820+0000 7f4be6ffd700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f4be80aaf50 0x7f4be80abb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.77:41996/0 (socket says 172.21.15.77:41996) 2023-07-24T05:47:53.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.820+0000 7f4be6ffd700 1 -- 172.21.15.77:0/1889916019 learned_addr learned my addr 172.21.15.77:0/1889916019 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:53.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.820+0000 7f4be67fc700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4be806a520 0x7f4be80ab330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.77:48564/0 (socket says 172.21.15.77:48564) 2023-07-24T05:47:53.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.820+0000 7f4be77fe700 1 --1- 172.21.15.77:0/1889916019 >> v1:172.21.15.103:6789/0 conn(0x7f4be806d400 0x7f4be80b10b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.103:6789/0 says I am v1:172.21.15.77:55908/0 (socket says 172.21.15.77:55908) 2023-07-24T05:47:53.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.820+0000 7f4be67fc700 1 -- 172.21.15.77:0/1889916019 >> v2:172.21.15.103:3300/0 conn(0x7f4be80aaf50 msgr2=0x7f4be80abb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:53.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.820+0000 7f4be67fc700 1 --2- 172.21.15.77:0/1889916019 >> v2:172.21.15.103:3300/0 conn(0x7f4be80aaf50 0x7f4be80abb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:53.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.820+0000 7f4be67fc700 1 -- 172.21.15.77:0/1889916019 >> v1:172.21.15.103:6789/0 conn(0x7f4be806d400 legacy=0x7f4be80b10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:53.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.820+0000 7f4be67fc700 1 -- 172.21.15.77:0/1889916019 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be806ac90 con 0x7f4be806a520 2023-07-24T05:47:53.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.824+0000 7f4be67fc700 1 --2- 172.21.15.77:0/1889916019 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4be806a520 0x7f4be80ab330 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc009850 tx=0x7f4bdc009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50e1df3d768859d7 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:53.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.824+0000 7f4be5ffb700 1 -- 172.21.15.77:0/1889916019 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc011830 con 0x7f4be806a520 2023-07-24T05:47:53.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.824+0000 7f4be5ffb700 1 -- 172.21.15.77:0/1889916019 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bdc011990 con 0x7f4be806a520 2023-07-24T05:47:53.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.824+0000 7f4be5ffb700 1 -- 172.21.15.77:0/1889916019 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bdc011d40 con 0x7f4be806a520 2023-07-24T05:47:53.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.824+0000 7f4bed651700 1 -- 172.21.15.77:0/1889916019 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4be806a520 msgr2=0x7f4be80ab330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:53.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.824+0000 7f4bed651700 1 --2- 172.21.15.77:0/1889916019 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4be806a520 0x7f4be80ab330 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc009850 tx=0x7f4bdc009b60 comp rx=0 tx=0).stop 2023-07-24T05:47:53.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.824+0000 7f4bed651700 1 -- 172.21.15.77:0/1889916019 shutdown_connections 2023-07-24T05:47:53.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.824+0000 7f4bed651700 1 --2- 172.21.15.77:0/1889916019 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4be806a520 0x7f4be80ab330 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:53.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.824+0000 7f4bed651700 1 --2- 172.21.15.77:0/1889916019 >> v2:172.21.15.103:3300/0 conn(0x7f4be80aaf50 0x7f4be80abb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:53.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.824+0000 7f4bed651700 1 -- 172.21.15.77:0/1889916019 >> 172.21.15.77:0/1889916019 conn(0x7f4be80ce260 msgr2=0x7f4be80ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:53.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.824+0000 7f4bed651700 1 -- 172.21.15.77:0/1889916019 shutdown_connections 2023-07-24T05:47:53.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.824+0000 7f4bed651700 1 -- 172.21.15.77:0/1889916019 wait complete. 2023-07-24T05:47:53.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.828+0000 7f4bed651700 1 Processor -- start 2023-07-24T05:47:53.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.828+0000 7f4bed651700 1 -- start start 2023-07-24T05:47:53.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.832+0000 7f4bed651700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4be806a520 0x7f4be814e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:53.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.832+0000 7f4bed651700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4be806d400 0x7f4be80c4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:53.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.832+0000 7f4bed651700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4be80aaf50 0x7f4be80cce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:53.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.832+0000 7f4bed651700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be80c2210 con 0x7f4be806d400 2023-07-24T05:47:53.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.832+0000 7f4bed651700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be80c24f0 con 0x7f4be80aaf50 2023-07-24T05:47:53.838 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.832+0000 7f4bed651700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be80c27d0 con 0x7f4be806a520 2023-07-24T05:47:53.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.832+0000 7f4be67fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4be806d400 0x7f4be80c4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:53.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.832+0000 7f4be67fc700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4be806d400 0x7f4be80c4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41506/0 (socket says 172.21.15.77:41506) 2023-07-24T05:47:53.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.832+0000 7f4be67fc700 1 -- 172.21.15.77:0/3833973431 learned_addr learned my addr 172.21.15.77:0/3833973431 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:53.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.832+0000 7f4be6ffd700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4be806a520 0x7f4be814e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:53.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.832+0000 7f4be77fe700 1 --2- 172.21.15.77:0/3833973431 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4be80aaf50 0x7f4be80cce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:53.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.832+0000 7f4be6ffd700 1 -- 172.21.15.77:0/3833973431 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4be80aaf50 msgr2=0x7f4be80cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:53.840 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.832+0000 7f4be6ffd700 1 --2- 172.21.15.77:0/3833973431 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4be80aaf50 0x7f4be80cce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:53.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.832+0000 7f4be6ffd700 1 -- 172.21.15.77:0/3833973431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4be806d400 msgr2=0x7f4be80c4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:53.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.832+0000 7f4be6ffd700 1 --2- 172.21.15.77:0/3833973431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4be806d400 0x7f4be80c4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:53.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.832+0000 7f4be6ffd700 1 -- 172.21.15.77:0/3833973431 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bdc0094b0 con 0x7f4be806a520 2023-07-24T05:47:53.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.832+0000 7f4be6ffd700 1 --2- 172.21.15.77:0/3833973431 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4be806a520 0x7f4be814e700 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4bd800e870 tx=0x7f4bd800eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:53.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.832+0000 7f4bcf7fe700 1 -- 172.21.15.77:0/3833973431 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd8013680 con 0x7f4be806a520 2023-07-24T05:47:53.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.832+0000 7f4bcf7fe700 1 -- 172.21.15.77:0/3833973431 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bd80137e0 con 0x7f4be806a520 2023-07-24T05:47:53.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.832+0000 7f4bcf7fe700 1 -- 172.21.15.77:0/3833973431 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd8013b50 con 0x7f4be806a520 2023-07-24T05:47:53.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.832+0000 7f4bed651700 1 -- 172.21.15.77:0/3833973431 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4be80c2ab0 con 0x7f4be806a520 2023-07-24T05:47:53.842 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.836+0000 7f4bed651700 1 -- 172.21.15.77:0/3833973431 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4be814ec40 con 0x7f4be806a520 2023-07-24T05:47:53.843 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.836+0000 7f4bed651700 1 -- 172.21.15.77:0/3833973431 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4be80ac760 con 0x7f4be806a520 2023-07-24T05:47:53.844 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.836+0000 7f4bcf7fe700 1 -- 172.21.15.77:0/3833973431 <== mon.2 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4bd803b080 con 0x7f4be806a520 2023-07-24T05:47:53.845 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.840+0000 7f4bcf7fe700 1 --2- 172.21.15.77:0/3833973431 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f4bd40662f0 0x7f4bd40687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:53.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.840+0000 7f4bcf7fe700 1 -- 172.21.15.77:0/3833973431 <== mon.2 v2:172.21.15.103:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4bd8083ed0 con 0x7f4be806a520 2023-07-24T05:47:53.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.840+0000 7f4be67fc700 1 --2- 172.21.15.77:0/3833973431 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f4bd40662f0 0x7f4bd40687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:53.847 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.840+0000 7f4be67fc700 1 --2- 172.21.15.77:0/3833973431 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f4bd40662f0 0x7f4bd40687b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4be81f5580 tx=0x7f4bdc008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:53.853 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:53.844+0000 7f4bcf7fe700 1 -- 172.21.15.77:0/3833973431 <== mon.2 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4bd8051280 con 0x7f4be806a520 2023-07-24T05:47:54.061 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.056+0000 7f4bed651700 1 -- 172.21.15.77:0/3833973431 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4be80c2c40 con 0x7f4be806a520 2023-07-24T05:47:54.511 INFO:tasks.ceph.mds.d.smithi103.stderr:2023-07-24T05:47:54.505+0000 7f28380d3700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-24T05:47:54.623 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.616+0000 7f4bcf7fe700 1 -- 172.21.15.77:0/3833973431 <== mon.2 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4bd8013cb0 con 0x7f4be806a520 2023-07-24T05:47:54.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.620+0000 7f4bed651700 1 -- 172.21.15.77:0/3833973431 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f4bd40662f0 msgr2=0x7f4bd40687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:54.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.620+0000 7f4bed651700 1 --2- 172.21.15.77:0/3833973431 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f4bd40662f0 0x7f4bd40687b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4be81f5580 tx=0x7f4bdc008030 comp rx=0 tx=0).stop 2023-07-24T05:47:54.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.620+0000 7f4bed651700 1 -- 172.21.15.77:0/3833973431 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4be806a520 msgr2=0x7f4be814e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:54.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.620+0000 7f4bed651700 1 --2- 172.21.15.77:0/3833973431 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4be806a520 0x7f4be814e700 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4bd800e870 tx=0x7f4bd800eb80 comp rx=0 tx=0).stop 2023-07-24T05:47:54.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.620+0000 7f4bed651700 1 -- 172.21.15.77:0/3833973431 shutdown_connections 2023-07-24T05:47:54.628 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.620+0000 7f4bed651700 1 --2- 172.21.15.77:0/3833973431 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4be80aaf50 0x7f4be80cce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:54.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.620+0000 7f4bed651700 1 --2- 172.21.15.77:0/3833973431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4be806d400 0x7f4be80c4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:54.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.620+0000 7f4bed651700 1 --2- 172.21.15.77:0/3833973431 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f4bd40662f0 0x7f4bd40687b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:54.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.620+0000 7f4bed651700 1 --2- 172.21.15.77:0/3833973431 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f4be806a520 0x7f4be814e700 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:54.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.620+0000 7f4bed651700 1 -- 172.21.15.77:0/3833973431 >> 172.21.15.77:0/3833973431 conn(0x7f4be80ce260 msgr2=0x7f4be80ca3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:54.629 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.620+0000 7f4bed651700 1 -- 172.21.15.77:0/3833973431 shutdown_connections 2023-07-24T05:47:54.630 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.620+0000 7f4bed651700 1 -- 172.21.15.77:0/3833973431 wait complete. 2023-07-24T05:47:54.650 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-24T05:47:54.651 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-24T05:47:54.820 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.812+0000 7f8e8d835700 1 Processor -- start 2023-07-24T05:47:54.821 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.812+0000 7f8e8d835700 1 -- start start 2023-07-24T05:47:54.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.816+0000 7f8e8d835700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8e8806b050 0x7f8e880ca370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:54.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.816+0000 7f8e8d835700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f8e880b1090 0x7f8e880b1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:54.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.816+0000 7f8e8d835700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e88161220 con 0x7f8e880c9f90 2023-07-24T05:47:54.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.816+0000 7f8e8d835700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e8815ceb0 con 0x7f8e880b1090 2023-07-24T05:47:54.822 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.816+0000 7f8e8d835700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e880b1a60 con 0x7f8e8806b050 2023-07-24T05:47:54.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.816+0000 7f8e8c833700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f8e880c9f90 0x7f8e8815d9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:60966/0 (socket says 172.21.15.77:60966) 2023-07-24T05:47:54.823 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.816+0000 7f8e8c833700 1 -- 172.21.15.77:0/211401613 learned_addr learned my addr 172.21.15.77:0/211401613 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:54.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.816+0000 7f8e7f7fe700 1 -- 172.21.15.77:0/211401613 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 794104115 0 0) 0x7f8e88161220 con 0x7f8e880c9f90 2023-07-24T05:47:54.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.816+0000 7f8e7f7fe700 1 -- 172.21.15.77:0/211401613 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e700035d0 con 0x7f8e880c9f90 2023-07-24T05:47:54.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.816+0000 7f8e8d034700 1 --2- 172.21.15.77:0/211401613 >> v2:172.21.15.103:3300/0 conn(0x7f8e880b1090 0x7f8e880b1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:54.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.816+0000 7f8e7ffff700 1 --2- 172.21.15.77:0/211401613 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8e8806b050 0x7f8e880ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:54.824 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.816+0000 7f8e7f7fe700 1 -- 172.21.15.77:0/211401613 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3160213309 0 0) 0x7f8e700035d0 con 0x7f8e880c9f90 2023-07-24T05:47:54.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.816+0000 7f8e7f7fe700 1 -- 172.21.15.77:0/211401613 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8e8806b050 msgr2=0x7f8e880ca370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:54.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.816+0000 7f8e7f7fe700 1 --2- 172.21.15.77:0/211401613 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8e8806b050 0x7f8e880ca370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:54.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.816+0000 7f8e7f7fe700 1 -- 172.21.15.77:0/211401613 >> v2:172.21.15.103:3300/0 conn(0x7f8e880b1090 msgr2=0x7f8e880b1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:54.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.816+0000 7f8e7f7fe700 1 --2- 172.21.15.77:0/211401613 >> v2:172.21.15.103:3300/0 conn(0x7f8e880b1090 0x7f8e880b1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:54.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.816+0000 7f8e7f7fe700 1 -- 172.21.15.77:0/211401613 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e88160610 con 0x7f8e880c9f90 2023-07-24T05:47:54.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.816+0000 7f8e7f7fe700 1 -- 172.21.15.77:0/211401613 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4109865209 0 0) 0x7f8e840019f0 con 0x7f8e880c9f90 2023-07-24T05:47:54.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.816+0000 7f8e7f7fe700 1 -- 172.21.15.77:0/211401613 >> v1:172.21.15.77:6789/0 conn(0x7f8e880c9f90 legacy=0x7f8e8815d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:54.825 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.816+0000 7f8e7f7fe700 1 --2- 172.21.15.77:0/211401613 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e70003a20 0x7f8e70003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:54.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.816+0000 7f8e7f7fe700 1 --2- 172.21.15.77:0/211401613 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8e8806b050 0x7f8e70004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:54.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.816+0000 7f8e7f7fe700 1 --2- 172.21.15.77:0/211401613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e70004db0 0x7f8e70005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:54.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.816+0000 7f8e7f7fe700 1 -- 172.21.15.77:0/211401613 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8815ceb0 con 0x7f8e70003a20 2023-07-24T05:47:54.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.816+0000 7f8e7f7fe700 1 -- 172.21.15.77:0/211401613 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e880b1a60 con 0x7f8e70004db0 2023-07-24T05:47:54.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.816+0000 7f8e7f7fe700 1 -- 172.21.15.77:0/211401613 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7000bae0 con 0x7f8e8806b050 2023-07-24T05:47:54.826 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.816+0000 7f8e8c833700 1 --2- 172.21.15.77:0/211401613 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e70003a20 0x7f8e70003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:54.827 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.816+0000 7f8e7ffff700 1 --2- 172.21.15.77:0/211401613 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8e8806b050 0x7f8e70004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:54.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.816+0000 7f8e8d034700 1 --2- 172.21.15.77:0/211401613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e70004db0 0x7f8e70005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:54.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.816+0000 7f8e8c833700 1 -- 172.21.15.77:0/211401613 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8e8806b050 msgr2=0x7f8e70004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:54.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.816+0000 7f8e8c833700 1 --2- 172.21.15.77:0/211401613 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8e8806b050 0x7f8e70004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:54.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.816+0000 7f8e8c833700 1 -- 172.21.15.77:0/211401613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e70004db0 msgr2=0x7f8e70005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:54.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.816+0000 7f8e8c833700 1 --2- 172.21.15.77:0/211401613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e70004db0 0x7f8e70005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:54.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.816+0000 7f8e8c833700 1 -- 172.21.15.77:0/211401613 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e700035d0 con 0x7f8e70003a20 2023-07-24T05:47:54.828 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.820+0000 7f8e8c833700 1 --2- 172.21.15.77:0/211401613 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e70003a20 0x7f8e70003e40 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f8e8400a890 tx=0x7f8e700058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=808a890d8c2fd5cc server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:54.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.820+0000 7f8e7f7fe700 1 -- 172.21.15.77:0/211401613 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e840072d0 con 0x7f8e70003a20 2023-07-24T05:47:54.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.820+0000 7f8e7f7fe700 1 -- 172.21.15.77:0/211401613 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e84007450 con 0x7f8e70003a20 2023-07-24T05:47:54.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.820+0000 7f8e7f7fe700 1 -- 172.21.15.77:0/211401613 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e84007800 con 0x7f8e70003a20 2023-07-24T05:47:54.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.820+0000 7f8e8d835700 1 -- 172.21.15.77:0/211401613 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e70003a20 msgr2=0x7f8e70003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:54.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.820+0000 7f8e8d835700 1 --2- 172.21.15.77:0/211401613 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e70003a20 0x7f8e70003e40 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f8e8400a890 tx=0x7f8e700058a0 comp rx=0 tx=0).stop 2023-07-24T05:47:54.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.820+0000 7f8e8d034700 1 -- 172.21.15.77:0/211401613 reap_dead start 2023-07-24T05:47:54.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.820+0000 7f8e8d835700 1 -- 172.21.15.77:0/211401613 shutdown_connections 2023-07-24T05:47:54.829 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.820+0000 7f8e8d835700 1 -- 172.21.15.77:0/211401613 >> 172.21.15.77:0/211401613 conn(0x7f8e880cacc0 msgr2=0x7f8e880cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:54.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.820+0000 7f8e8d835700 1 -- 172.21.15.77:0/211401613 shutdown_connections 2023-07-24T05:47:54.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.820+0000 7f8e8d835700 1 -- 172.21.15.77:0/211401613 wait complete. 2023-07-24T05:47:54.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.824+0000 7f8e8d835700 1 Processor -- start 2023-07-24T05:47:54.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.824+0000 7f8e8d835700 1 -- start start 2023-07-24T05:47:54.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.824+0000 7f8e8d835700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e70003a20 0x7f8e880adba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:54.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.824+0000 7f8e8d835700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e8815c380 0x7f8e881f1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:54.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.824+0000 7f8e8d835700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8e880989f0 0x7f8e8809ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:54.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.824+0000 7f8e8d835700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e880a95f0 con 0x7f8e70003a20 2023-07-24T05:47:54.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.824+0000 7f8e8d835700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e88099bf0 con 0x7f8e8815c380 2023-07-24T05:47:54.832 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.824+0000 7f8e8d835700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e88099ed0 con 0x7f8e880989f0 2023-07-24T05:47:54.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.824+0000 7f8e8c833700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e70003a20 0x7f8e880adba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:54.833 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.824+0000 7f8e8c833700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e70003a20 0x7f8e880adba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41528/0 (socket says 172.21.15.77:41528) 2023-07-24T05:47:54.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.824+0000 7f8e8c833700 1 -- 172.21.15.77:0/601858417 learned_addr learned my addr 172.21.15.77:0/601858417 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:54.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.824+0000 7f8e8d034700 1 --2- 172.21.15.77:0/601858417 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8e880989f0 0x7f8e8809ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:54.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.824+0000 7f8e7ffff700 1 --2- 172.21.15.77:0/601858417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e8815c380 0x7f8e881f1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:54.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.828+0000 7f8e8c833700 1 -- 172.21.15.77:0/601858417 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8e880989f0 msgr2=0x7f8e8809ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:54.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.828+0000 7f8e8c833700 1 --2- 172.21.15.77:0/601858417 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8e880989f0 0x7f8e8809ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:54.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.828+0000 7f8e8c833700 1 -- 172.21.15.77:0/601858417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e8815c380 msgr2=0x7f8e881f1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:54.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.828+0000 7f8e8c833700 1 --2- 172.21.15.77:0/601858417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e8815c380 0x7f8e881f1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:54.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.828+0000 7f8e8c833700 1 -- 172.21.15.77:0/601858417 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e880aae80 con 0x7f8e70003a20 2023-07-24T05:47:54.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.828+0000 7f8e8d034700 1 --2- 172.21.15.77:0/601858417 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8e880989f0 0x7f8e8809ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:54.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.828+0000 7f8e8c833700 1 --2- 172.21.15.77:0/601858417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e70003a20 0x7f8e880adba0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f8e70005850 tx=0x7f8e84001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:54.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.828+0000 7f8e7d7fa700 1 -- 172.21.15.77:0/601858417 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e84012400 con 0x7f8e70003a20 2023-07-24T05:47:54.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.828+0000 7f8e7d7fa700 1 -- 172.21.15.77:0/601858417 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e84012560 con 0x7f8e70003a20 2023-07-24T05:47:54.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.828+0000 7f8e7d7fa700 1 -- 172.21.15.77:0/601858417 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e84012910 con 0x7f8e70003a20 2023-07-24T05:47:54.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.828+0000 7f8e8d835700 1 -- 172.21.15.77:0/601858417 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e880ab160 con 0x7f8e70003a20 2023-07-24T05:47:54.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.828+0000 7f8e8d835700 1 -- 172.21.15.77:0/601858417 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e880998e0 con 0x7f8e70003a20 2023-07-24T05:47:54.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.828+0000 7f8e8d835700 1 -- 172.21.15.77:0/601858417 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e880ab320 con 0x7f8e70003a20 2023-07-24T05:47:54.837 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.832+0000 7f8e7d7fa700 1 -- 172.21.15.77:0/601858417 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8e8401a070 con 0x7f8e70003a20 2023-07-24T05:47:54.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.832+0000 7f8e7d7fa700 1 --2- 172.21.15.77:0/601858417 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f8e740662f0 0x7f8e740687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:54.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.832+0000 7f8e7d7fa700 1 -- 172.21.15.77:0/601858417 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f8e84085da0 con 0x7f8e70003a20 2023-07-24T05:47:54.839 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.832+0000 7f8e7ffff700 1 --2- 172.21.15.77:0/601858417 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f8e740662f0 0x7f8e740687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:54.841 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.836+0000 7f8e7ffff700 1 --2- 172.21.15.77:0/601858417 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f8e740662f0 0x7f8e740687b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8e8815c810 tx=0x7f8e78008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:54.846 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:54.840+0000 7f8e7d7fa700 1 -- 172.21.15.77:0/601858417 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8e84053190 con 0x7f8e70003a20 2023-07-24T05:47:55.023 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:47:55.030 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:47:55.053 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.048+0000 7f8e8d835700 1 -- 172.21.15.77:0/601858417 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e88072490 con 0x7f8e70003a20 2023-07-24T05:47:55.054 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.048+0000 7f8e7d7fa700 1 -- 172.21.15.77:0/601858417 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4671 (secure 0 0 0) 0x7f8e84023090 con 0x7f8e70003a20 2023-07-24T05:47:55.054 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:47:55.054 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5596,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3507550644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3507550644},{"type":"v1","addr":"172.21.15.77:6835","nonce":3507550644}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5599,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/93827363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":93827363},{"type":"v1","addr":"172.21.15.103:6836","nonce":93827363}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/1812124332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1812124332},{"type":"v1","addr":"172.21.15.77:6834","nonce":1812124332}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-24T05:47:51.010765+0000","modified":"2023-07-24T05:47:54.611783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5685},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5685":{"gid":5685,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.103:6837/3210395971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":3210395971},{"type":"v1","addr":"172.21.15.103:6837","nonce":3210395971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-24T05:47:55.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.048+0000 7f8e8d835700 1 -- 172.21.15.77:0/601858417 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f8e740662f0 msgr2=0x7f8e740687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:55.056 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.048+0000 7f8e8d835700 1 --2- 172.21.15.77:0/601858417 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f8e740662f0 0x7f8e740687b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8e8815c810 tx=0x7f8e78008040 comp rx=0 tx=0).stop 2023-07-24T05:47:55.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.048+0000 7f8e8d835700 1 -- 172.21.15.77:0/601858417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e70003a20 msgr2=0x7f8e880adba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:55.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.048+0000 7f8e8d835700 1 --2- 172.21.15.77:0/601858417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e70003a20 0x7f8e880adba0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f8e70005850 tx=0x7f8e84001d80 comp rx=0 tx=0).stop 2023-07-24T05:47:55.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.048+0000 7f8e8d835700 1 -- 172.21.15.77:0/601858417 shutdown_connections 2023-07-24T05:47:55.057 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.048+0000 7f8e8d835700 1 --2- 172.21.15.77:0/601858417 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f8e740662f0 0x7f8e740687b0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:55.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.048+0000 7f8e8d835700 1 --2- 172.21.15.77:0/601858417 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f8e880989f0 0x7f8e8809ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:55.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.048+0000 7f8e8d835700 1 --2- 172.21.15.77:0/601858417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e8815c380 0x7f8e881f1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:55.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.048+0000 7f8e8d835700 1 --2- 172.21.15.77:0/601858417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8e70003a20 0x7f8e880adba0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:55.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.048+0000 7f8e8d835700 1 -- 172.21.15.77:0/601858417 >> 172.21.15.77:0/601858417 conn(0x7f8e880cacc0 msgr2=0x7f8e880cbdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:55.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.052+0000 7f8e8d835700 1 -- 172.21.15.77:0/601858417 shutdown_connections 2023-07-24T05:47:55.058 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.052+0000 7f8e8d835700 1 -- 172.21.15.77:0/601858417 wait complete. 2023-07-24T05:47:55.059 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 18 2023-07-24T05:47:55.078 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-24T05:47:55.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.316+0000 7fec4a427700 1 Processor -- start 2023-07-24T05:47:55.325 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.320+0000 7fec4a427700 1 -- start start 2023-07-24T05:47:55.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.320+0000 7fec4a427700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec4406b050 0x7fec440ca370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:55.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.320+0000 7fec4a427700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec44161220 con 0x7fec440b1090 2023-07-24T05:47:55.327 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.320+0000 7fec4a427700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec44160610 con 0x7fec440c9f90 2023-07-24T05:47:55.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.320+0000 7fec4a427700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec4415ceb0 con 0x7fec4406b050 2023-07-24T05:47:55.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.320+0000 7fec49c26700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fec440b1090 0x7fec440afbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:60970/0 (socket says 172.21.15.77:60970) 2023-07-24T05:47:55.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.320+0000 7fec49c26700 1 -- 172.21.15.77:0/4120326796 learned_addr learned my addr 172.21.15.77:0/4120326796 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:55.328 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.320+0000 7fec48c24700 1 --2- 172.21.15.77:0/4120326796 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec4406b050 0x7fec440ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:55.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.320+0000 7fec3bfff700 1 -- 172.21.15.77:0/4120326796 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3918403832 0 0) 0x7fec44161220 con 0x7fec440b1090 2023-07-24T05:47:55.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.324+0000 7fec3bfff700 1 -- 172.21.15.77:0/4120326796 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec300035d0 con 0x7fec440b1090 2023-07-24T05:47:55.329 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.324+0000 7fec3bfff700 1 -- 172.21.15.77:0/4120326796 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2257032330 0 0) 0x7fec44160610 con 0x7fec440c9f90 2023-07-24T05:47:55.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.324+0000 7fec3bfff700 1 -- 172.21.15.77:0/4120326796 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec44161220 con 0x7fec440c9f90 2023-07-24T05:47:55.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.324+0000 7fec48c24700 1 -- 172.21.15.77:0/4120326796 >> v1:172.21.15.103:6789/0 conn(0x7fec440c9f90 legacy=0x7fec4415d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:55.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.324+0000 7fec48c24700 1 -- 172.21.15.77:0/4120326796 >> v1:172.21.15.77:6789/0 conn(0x7fec440b1090 legacy=0x7fec440afbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:55.330 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.324+0000 7fec48c24700 1 -- 172.21.15.77:0/4120326796 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec441608f0 con 0x7fec4406b050 2023-07-24T05:47:55.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.324+0000 7fec48c24700 1 --2- 172.21.15.77:0/4120326796 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec4406b050 0x7fec440ca370 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fec34009880 tx=0x7fec34009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebf1a5efdbc78b88 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:55.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.324+0000 7fec3bfff700 1 -- 172.21.15.77:0/4120326796 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec34011830 con 0x7fec4406b050 2023-07-24T05:47:55.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.324+0000 7fec3bfff700 1 -- 172.21.15.77:0/4120326796 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec34011990 con 0x7fec4406b050 2023-07-24T05:47:55.331 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.324+0000 7fec3bfff700 1 -- 172.21.15.77:0/4120326796 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec34011d00 con 0x7fec4406b050 2023-07-24T05:47:55.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.324+0000 7fec4a427700 1 -- 172.21.15.77:0/4120326796 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec4406b050 msgr2=0x7fec440ca370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:55.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.324+0000 7fec4a427700 1 --2- 172.21.15.77:0/4120326796 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec4406b050 0x7fec440ca370 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fec34009880 tx=0x7fec34009b90 comp rx=0 tx=0).stop 2023-07-24T05:47:55.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.324+0000 7fec4a427700 1 -- 172.21.15.77:0/4120326796 shutdown_connections 2023-07-24T05:47:55.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.324+0000 7fec4a427700 1 --2- 172.21.15.77:0/4120326796 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec4406b050 0x7fec440ca370 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:55.332 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.324+0000 7fec4a427700 1 -- 172.21.15.77:0/4120326796 >> 172.21.15.77:0/4120326796 conn(0x7fec440cacc0 msgr2=0x7fec440cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:55.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.324+0000 7fec4a427700 1 -- 172.21.15.77:0/4120326796 shutdown_connections 2023-07-24T05:47:55.333 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.324+0000 7fec4a427700 1 -- 172.21.15.77:0/4120326796 wait complete. 2023-07-24T05:47:55.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.328+0000 7fec4a427700 1 Processor -- start 2023-07-24T05:47:55.335 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.328+0000 7fec4a427700 1 -- start start 2023-07-24T05:47:55.336 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.328+0000 7fec4a427700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec4406b050 0x7fec4414f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:55.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.328+0000 7fec4a427700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec440b1090 0x7fec440af770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:55.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.328+0000 7fec4a427700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec440c9f90 0x7fec4406cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:55.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.328+0000 7fec4a427700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec440c2a70 con 0x7fec4406b050 2023-07-24T05:47:55.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.328+0000 7fec4a427700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec440c1df0 con 0x7fec440b1090 2023-07-24T05:47:55.337 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.328+0000 7fec4a427700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec440c20d0 con 0x7fec440c9f90 2023-07-24T05:47:55.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.332+0000 7fec49425700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec4406b050 0x7fec4414f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:55.338 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.332+0000 7fec49425700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec4406b050 0x7fec4414f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41536/0 (socket says 172.21.15.77:41536) 2023-07-24T05:47:55.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.332+0000 7fec49425700 1 -- 172.21.15.77:0/323676886 learned_addr learned my addr 172.21.15.77:0/323676886 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:55.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.332+0000 7fec48c24700 1 --2- 172.21.15.77:0/323676886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec440b1090 0x7fec440af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:55.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.332+0000 7fec49c26700 1 --2- 172.21.15.77:0/323676886 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec440c9f90 0x7fec4406cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:55.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.332+0000 7fec49425700 1 -- 172.21.15.77:0/323676886 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec440c9f90 msgr2=0x7fec4406cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:55.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.332+0000 7fec49425700 1 --2- 172.21.15.77:0/323676886 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec440c9f90 0x7fec4406cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:55.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.332+0000 7fec49425700 1 -- 172.21.15.77:0/323676886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec440b1090 msgr2=0x7fec440af770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:55.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.332+0000 7fec49425700 1 --2- 172.21.15.77:0/323676886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec440b1090 0x7fec440af770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:55.339 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.332+0000 7fec49425700 1 -- 172.21.15.77:0/323676886 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec340094b0 con 0x7fec4406b050 2023-07-24T05:47:55.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.332+0000 7fec48c24700 1 --2- 172.21.15.77:0/323676886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec440b1090 0x7fec440af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:55.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.332+0000 7fec49425700 1 --2- 172.21.15.77:0/323676886 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec4406b050 0x7fec4414f0e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fec4000c500 tx=0x7fec4000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:55.340 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.332+0000 7fec39ffb700 1 -- 172.21.15.77:0/323676886 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec400052d0 con 0x7fec4406b050 2023-07-24T05:47:55.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.332+0000 7fec39ffb700 1 -- 172.21.15.77:0/323676886 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec40005450 con 0x7fec4406b050 2023-07-24T05:47:55.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.332+0000 7fec4a427700 1 -- 172.21.15.77:0/323676886 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec440c23b0 con 0x7fec4406b050 2023-07-24T05:47:55.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.332+0000 7fec39ffb700 1 -- 172.21.15.77:0/323676886 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec400038e0 con 0x7fec4406b050 2023-07-24T05:47:55.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.332+0000 7fec4a427700 1 -- 172.21.15.77:0/323676886 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec4415a300 con 0x7fec4406b050 2023-07-24T05:47:55.341 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.332+0000 7fec4a427700 1 -- 172.21.15.77:0/323676886 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec4415a490 con 0x7fec4406b050 2023-07-24T05:47:55.342 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.336+0000 7fec39ffb700 1 -- 172.21.15.77:0/323676886 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fec40003a40 con 0x7fec4406b050 2023-07-24T05:47:55.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.336+0000 7fec39ffb700 1 --2- 172.21.15.77:0/323676886 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fec280662f0 0x7fec280687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:55.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.336+0000 7fec39ffb700 1 -- 172.21.15.77:0/323676886 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fec400832e0 con 0x7fec4406b050 2023-07-24T05:47:55.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.336+0000 7fec48c24700 1 --2- 172.21.15.77:0/323676886 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fec280662f0 0x7fec280687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:55.345 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.340+0000 7fec48c24700 1 --2- 172.21.15.77:0/323676886 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fec280662f0 0x7fec280687b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fec340097d0 tx=0x7fec34010000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:55.350 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.344+0000 7fec39ffb700 1 -- 172.21.15.77:0/323676886 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fec40050610 con 0x7fec4406b050 2023-07-24T05:47:55.528 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.520+0000 7fec4a427700 1 -- 172.21.15.77:0/323676886 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec44160e80 con 0x7fec4406b050 2023-07-24T05:47:55.531 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.524+0000 7fec39ffb700 1 -- 172.21.15.77:0/323676886 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+18488 (secure 0 0 0) 0x7fec40053c30 con 0x7fec4406b050 2023-07-24T05:47:55.532 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:47:55.532 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":39,"fsid":"5aed5f7b-fb55-4d95-9c02-c6adbb1677b4","created":"2023-07-24T05:45:39.639731+0000","modified":"2023-07-24T05:47:52.584221+0000","last_up_change":"2023-07-24T05:45:52.319670+0000","last_in_change":"2023-07-24T05:45:43.643277+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-24T05:45:52.610430+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-24T05:45:52.773787+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-07-24T05:47:48.791472+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-07-24T05:47:50.021778+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ffa0d496-461a-4053-b764-0627d969521b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6812","nonce":825987196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6817","nonce":825987196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6831","nonce":825987196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":825987196},{"type":"v1","addr":"172.21.15.77:6824","nonce":825987196}]},"public_addr":"172.21.15.77:6812/825987196","cluster_addr":"172.21.15.77:6817/825987196","heartbeat_back_addr":"172.21.15.77:6831/825987196","heartbeat_front_addr":"172.21.15.77:6824/825987196","state":["exists","up"]},{"osd":1,"uuid":"9f595e5e-5c43-49bc-8ce4-ee70575c90da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6801","nonce":4133026815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6803","nonce":4133026815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6807","nonce":4133026815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":4133026815},{"type":"v1","addr":"172.21.15.77:6805","nonce":4133026815}]},"public_addr":"172.21.15.77:6801/4133026815","cluster_addr":"172.21.15.77:6803/4133026815","heartbeat_back_addr":"172.21.15.77:6807/4133026815","heartbeat_front_addr":"172.21.15.77:6805/4133026815","state":["exists","up"]},{"osd":2,"uuid":"2ac177aa-4d7d-4262-bd54-d2b9f29f4c3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6811","nonce":2394142159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6819","nonce":2394142159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6827","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6830","nonce":2394142159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2394142159},{"type":"v1","addr":"172.21.15.77:6825","nonce":2394142159}]},"public_addr":"172.21.15.77:6811/2394142159","cluster_addr":"172.21.15.77:6819/2394142159","heartbeat_back_addr":"172.21.15.77:6830/2394142159","heartbeat_front_addr":"172.21.15.77:6825/2394142159","state":["exists","up"]},{"osd":3,"uuid":"17d7a251-19e8-484c-8172-a578ab3da153","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6809","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6813","nonce":1492113982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6815","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6818","nonce":1492113982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6829","nonce":1492113982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6821","nonce":1492113982},{"type":"v1","addr":"172.21.15.77:6823","nonce":1492113982}]},"public_addr":"172.21.15.77:6813/1492113982","cluster_addr":"172.21.15.77:6818/1492113982","heartbeat_back_addr":"172.21.15.77:6829/1492113982","heartbeat_front_addr":"172.21.15.77:6823/1492113982","state":["exists","up"]},{"osd":4,"uuid":"bf63ca05-f06d-4e0f-ac44-2a416c70b919","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6825","nonce":1080481057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6827","nonce":1080481057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6831","nonce":1080481057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":1080481057},{"type":"v1","addr":"172.21.15.103:6829","nonce":1080481057}]},"public_addr":"172.21.15.103:6825/1080481057","cluster_addr":"172.21.15.103:6827/1080481057","heartbeat_back_addr":"172.21.15.103:6831/1080481057","heartbeat_front_addr":"172.21.15.103:6829/1080481057","state":["exists","up"]},{"osd":5,"uuid":"65a11a35-9e9f-4b3c-9fe3-b658d62b9318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6811","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6813","nonce":2756677504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6818","nonce":2756677504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6823","nonce":2756677504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":2756677504},{"type":"v1","addr":"172.21.15.103:6821","nonce":2756677504}]},"public_addr":"172.21.15.103:6813/2756677504","cluster_addr":"172.21.15.103:6818/2756677504","heartbeat_back_addr":"172.21.15.103:6823/2756677504","heartbeat_front_addr":"172.21.15.103:6821/2756677504","state":["exists","up"]},{"osd":6,"uuid":"750c1f87-686c-40b4-94a1-1a299dc78f3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6809","nonce":568977764}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6812","nonce":568977764}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6817","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6819","nonce":568977764}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":568977764},{"type":"v1","addr":"172.21.15.103:6815","nonce":568977764}]},"public_addr":"172.21.15.103:6809/568977764","cluster_addr":"172.21.15.103:6812/568977764","heartbeat_back_addr":"172.21.15.103:6819/568977764","heartbeat_front_addr":"172.21.15.103:6815/568977764","state":["exists","up"]},{"osd":7,"uuid":"d5fe4fb6-2e09-4158-885b-403803c85822","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6801","nonce":1074557176}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6803","nonce":1074557176}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6807","nonce":1074557176}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1074557176},{"type":"v1","addr":"172.21.15.103:6805","nonce":1074557176}]},"public_addr":"172.21.15.103:6801/1074557176","cluster_addr":"172.21.15.103:6803/1074557176","heartbeat_back_addr":"172.21.15.103:6807/1074557176","heartbeat_front_addr":"172.21.15.103:6805/1074557176","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.631032+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.154109+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.398587+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.679089+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.311218+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.353726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.314372+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-24T05:45:49.126212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-24T05:47:55.534 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.528+0000 7fec4a427700 1 -- 172.21.15.77:0/323676886 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fec280662f0 msgr2=0x7fec280687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:55.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.528+0000 7fec4a427700 1 --2- 172.21.15.77:0/323676886 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fec280662f0 0x7fec280687b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fec340097d0 tx=0x7fec34010000 comp rx=0 tx=0).stop 2023-07-24T05:47:55.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.528+0000 7fec4a427700 1 -- 172.21.15.77:0/323676886 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec4406b050 msgr2=0x7fec4414f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:55.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.528+0000 7fec4a427700 1 --2- 172.21.15.77:0/323676886 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec4406b050 0x7fec4414f0e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fec4000c500 tx=0x7fec4000c8c0 comp rx=0 tx=0).stop 2023-07-24T05:47:55.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.528+0000 7fec4a427700 1 -- 172.21.15.77:0/323676886 shutdown_connections 2023-07-24T05:47:55.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.528+0000 7fec4a427700 1 --2- 172.21.15.77:0/323676886 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fec280662f0 0x7fec280687b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:55.535 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.528+0000 7fec4a427700 1 --2- 172.21.15.77:0/323676886 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fec440c9f90 0x7fec4406cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:55.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.528+0000 7fec4a427700 1 --2- 172.21.15.77:0/323676886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec440b1090 0x7fec440af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:55.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.528+0000 7fec4a427700 1 --2- 172.21.15.77:0/323676886 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fec4406b050 0x7fec4414f0e0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:55.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.528+0000 7fec4a427700 1 -- 172.21.15.77:0/323676886 >> 172.21.15.77:0/323676886 conn(0x7fec440cacc0 msgr2=0x7fec4415fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:55.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.528+0000 7fec4a427700 1 -- 172.21.15.77:0/323676886 shutdown_connections 2023-07-24T05:47:55.536 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.528+0000 7fec4a427700 1 -- 172.21.15.77:0/323676886 wait complete. 2023-07-24T05:47:55.556 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-24T05:47:55.556 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-24T05:47:55.726 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.720+0000 7f027a81e700 1 Processor -- start 2023-07-24T05:47:55.727 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.720+0000 7f027a81e700 1 -- start start 2023-07-24T05:47:55.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.720+0000 7f027a81e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f027415dcb0 0x7f02740ad330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:55.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.724+0000 7f027a81e700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f027415e090 0x7f027415e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:55.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.724+0000 7f027a81e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f0274070000 0x7f02740704b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:55.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.724+0000 7f027a81e700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02740cefa0 con 0x7f027415e090 2023-07-24T05:47:55.729 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.724+0000 7f027a81e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02740cf280 con 0x7f0274070000 2023-07-24T05:47:55.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.724+0000 7f027a81e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02740cca00 con 0x7f027415dcb0 2023-07-24T05:47:55.730 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.724+0000 7f02737fe700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f027415e090 0x7f027415e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:55.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.724+0000 7f02737fe700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f027415e090 0x7f027415e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41538/0 (socket says 172.21.15.77:41538) 2023-07-24T05:47:55.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.724+0000 7f02737fe700 1 -- 172.21.15.77:0/3347173329 learned_addr learned my addr 172.21.15.77:0/3347173329 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:55.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.724+0000 7f0273fff700 1 --2- 172.21.15.77:0/3347173329 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f027415dcb0 0x7f02740ad330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:55.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.724+0000 7f0278dbb700 1 --2- 172.21.15.77:0/3347173329 >> v2:172.21.15.103:3300/0 conn(0x7f0274070000 0x7f02740704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:55.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.724+0000 7f02737fe700 1 -- 172.21.15.77:0/3347173329 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f027415dcb0 msgr2=0x7f02740ad330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:55.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.724+0000 7f02737fe700 1 --2- 172.21.15.77:0/3347173329 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f027415dcb0 0x7f02740ad330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:55.731 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.724+0000 7f02737fe700 1 -- 172.21.15.77:0/3347173329 >> v2:172.21.15.103:3300/0 conn(0x7f0274070000 msgr2=0x7f02740704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:55.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.724+0000 7f02737fe700 1 --2- 172.21.15.77:0/3347173329 >> v2:172.21.15.103:3300/0 conn(0x7f0274070000 0x7f02740704b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:55.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.724+0000 7f02737fe700 1 -- 172.21.15.77:0/3347173329 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02740ccce0 con 0x7f027415e090 2023-07-24T05:47:55.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.724+0000 7f0278dbb700 1 --2- 172.21.15.77:0/3347173329 >> v2:172.21.15.103:3300/0 conn(0x7f0274070000 0x7f02740704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:55.732 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.724+0000 7f02737fe700 1 --2- 172.21.15.77:0/3347173329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f027415e090 0x7f027415e4f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f02740c8630 tx=0x7f025c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=362b0ff4319d750a server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:55.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.724+0000 7f0272ffd700 1 -- 172.21.15.77:0/3347173329 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025c00b8a0 con 0x7f027415e090 2023-07-24T05:47:55.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.724+0000 7f0272ffd700 1 -- 172.21.15.77:0/3347173329 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025c00ba00 con 0x7f027415e090 2023-07-24T05:47:55.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.724+0000 7f0272ffd700 1 -- 172.21.15.77:0/3347173329 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025c00bd90 con 0x7f027415e090 2023-07-24T05:47:55.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.724+0000 7f027a81e700 1 -- 172.21.15.77:0/3347173329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f027415e090 msgr2=0x7f027415e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:55.733 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.724+0000 7f027a81e700 1 --2- 172.21.15.77:0/3347173329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f027415e090 0x7f027415e4f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f02740c8630 tx=0x7f025c009bf0 comp rx=0 tx=0).stop 2023-07-24T05:47:55.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.724+0000 7f027a81e700 1 -- 172.21.15.77:0/3347173329 shutdown_connections 2023-07-24T05:47:55.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.724+0000 7f027a81e700 1 --2- 172.21.15.77:0/3347173329 >> v2:172.21.15.103:3300/0 conn(0x7f0274070000 0x7f02740704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:55.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.724+0000 7f027a81e700 1 --2- 172.21.15.77:0/3347173329 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f027415e090 0x7f027415e4f0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:55.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.724+0000 7f027a81e700 1 --2- 172.21.15.77:0/3347173329 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f027415dcb0 0x7f02740ad330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:55.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.724+0000 7f027a81e700 1 -- 172.21.15.77:0/3347173329 >> 172.21.15.77:0/3347173329 conn(0x7f02740ce410 msgr2=0x7f02740ce7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:55.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.724+0000 7f027a81e700 1 -- 172.21.15.77:0/3347173329 shutdown_connections 2023-07-24T05:47:55.734 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.724+0000 7f027a81e700 1 -- 172.21.15.77:0/3347173329 wait complete. 2023-07-24T05:47:55.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.728+0000 7f027a81e700 1 Processor -- start 2023-07-24T05:47:55.735 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.728+0000 7f027a81e700 1 -- start start 2023-07-24T05:47:55.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.728+0000 7f027a81e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0274070000 0x7f02740c4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:55.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.728+0000 7f027a81e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f027415dcb0 0x7f0274157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:55.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.728+0000 7f027a81e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f027415e090 0x7f027406c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:55.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.728+0000 7f027a81e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027406a8e0 con 0x7f027415e090 2023-07-24T05:47:55.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.728+0000 7f027a81e700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027406a360 con 0x7f027415dcb0 2023-07-24T05:47:55.736 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.728+0000 7f027a81e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f027406a600 con 0x7f0274070000 2023-07-24T05:47:55.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.728+0000 7f0278dbb700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f027415e090 0x7f027406c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:55.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.728+0000 7f0278dbb700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f027415e090 0x7f027406c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41552/0 (socket says 172.21.15.77:41552) 2023-07-24T05:47:55.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.728+0000 7f0278dbb700 1 -- 172.21.15.77:0/3033169684 learned_addr learned my addr 172.21.15.77:0/3033169684 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:55.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.728+0000 7f0273fff700 1 --2- 172.21.15.77:0/3033169684 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0274070000 0x7f02740c4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:55.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.728+0000 7f02737fe700 1 --2- 172.21.15.77:0/3033169684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f027415dcb0 0x7f0274157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:55.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.728+0000 7f0278dbb700 1 -- 172.21.15.77:0/3033169684 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0274070000 msgr2=0x7f02740c4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:55.738 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.728+0000 7f0278dbb700 1 --2- 172.21.15.77:0/3033169684 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0274070000 0x7f02740c4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:55.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.728+0000 7f0278dbb700 1 -- 172.21.15.77:0/3033169684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f027415dcb0 msgr2=0x7f0274157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:55.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.728+0000 7f0278dbb700 1 --2- 172.21.15.77:0/3033169684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f027415dcb0 0x7f0274157100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:55.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.732+0000 7f0278dbb700 1 -- 172.21.15.77:0/3033169684 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025c009570 con 0x7f027415e090 2023-07-24T05:47:55.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.732+0000 7f0278dbb700 1 --2- 172.21.15.77:0/3033169684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f027415e090 0x7f027406c6a0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f026c007e10 tx=0x7f026c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:55.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.732+0000 7f0270ff9700 1 -- 172.21.15.77:0/3033169684 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026c00de90 con 0x7f027415e090 2023-07-24T05:47:55.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.732+0000 7f0270ff9700 1 -- 172.21.15.77:0/3033169684 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f026c00f040 con 0x7f027415e090 2023-07-24T05:47:55.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.732+0000 7f027a81e700 1 -- 172.21.15.77:0/3033169684 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02740c6020 con 0x7f027415e090 2023-07-24T05:47:55.739 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.732+0000 7f0270ff9700 1 -- 172.21.15.77:0/3033169684 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026c003c80 con 0x7f027415e090 2023-07-24T05:47:55.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.732+0000 7f027a81e700 1 -- 172.21.15.77:0/3033169684 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f027406cbe0 con 0x7f027415e090 2023-07-24T05:47:55.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.732+0000 7f027a81e700 1 -- 172.21.15.77:0/3033169684 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f027404df10 con 0x7f027415e090 2023-07-24T05:47:55.740 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.732+0000 7f0270ff9700 1 -- 172.21.15.77:0/3033169684 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f026c004030 con 0x7f027415e090 2023-07-24T05:47:55.741 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.736+0000 7f0270ff9700 1 --2- 172.21.15.77:0/3033169684 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f02540662f0 0x7f02540687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:55.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.736+0000 7f0270ff9700 1 -- 172.21.15.77:0/3033169684 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f026c083fe0 con 0x7f027415e090 2023-07-24T05:47:55.742 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.736+0000 7f0273fff700 1 --2- 172.21.15.77:0/3033169684 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f02540662f0 0x7f02540687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:55.743 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.736+0000 7f0273fff700 1 --2- 172.21.15.77:0/3033169684 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f02540662f0 0x7f02540687b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0264006fd0 tx=0x7f0264008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:55.747 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.740+0000 7f0270ff9700 1 -- 172.21.15.77:0/3033169684 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f026c051350 con 0x7f027415e090 2023-07-24T05:47:55.916 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.908+0000 7f027a81e700 1 -- 172.21.15.77:0/3033169684 --> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f02740709f0 con 0x7f02540662f0 2023-07-24T05:47:55.934 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.928+0000 7f0270ff9700 1 -- 172.21.15.77:0/3033169684 <== mgr.4108 v2:172.21.15.103:6832/1305366540 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309018 (secure 0 0 0) 0x7f0264009e10 con 0x7f02540662f0 2023-07-24T05:47:55.936 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:47:55.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.936+0000 7f027a81e700 1 -- 172.21.15.77:0/3033169684 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f02540662f0 msgr2=0x7f02540687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:55.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.936+0000 7f027a81e700 1 --2- 172.21.15.77:0/3033169684 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f02540662f0 0x7f02540687b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0264006fd0 tx=0x7f0264008040 comp rx=0 tx=0).stop 2023-07-24T05:47:55.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.936+0000 7f027a81e700 1 -- 172.21.15.77:0/3033169684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f027415e090 msgr2=0x7f027406c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:55.942 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.936+0000 7f027a81e700 1 --2- 172.21.15.77:0/3033169684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f027415e090 0x7f027406c6a0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f026c007e10 tx=0x7f026c00d3b0 comp rx=0 tx=0).stop 2023-07-24T05:47:55.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.936+0000 7f027a81e700 1 -- 172.21.15.77:0/3033169684 shutdown_connections 2023-07-24T05:47:55.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.936+0000 7f027a81e700 1 --2- 172.21.15.77:0/3033169684 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f027415e090 0x7f027406c6a0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:55.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.936+0000 7f027a81e700 1 --2- 172.21.15.77:0/3033169684 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f027415dcb0 0x7f0274157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:55.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.936+0000 7f027a81e700 1 --2- 172.21.15.77:0/3033169684 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f02540662f0 0x7f02540687b0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:55.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.936+0000 7f027a81e700 1 --2- 172.21.15.77:0/3033169684 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0274070000 0x7f02740c4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:55.943 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.936+0000 7f027a81e700 1 -- 172.21.15.77:0/3033169684 >> 172.21.15.77:0/3033169684 conn(0x7f02740ce410 msgr2=0x7f02740cbfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:55.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.936+0000 7f027a81e700 1 -- 172.21.15.77:0/3033169684 shutdown_connections 2023-07-24T05:47:55.944 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:55.936+0000 7f027a81e700 1 -- 172.21.15.77:0/3033169684 wait complete. 2023-07-24T05:47:55.945 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-07-24T05:47:55.965 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2023-07-24T05:47:54.567876+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":157,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":233060,"kb_used_data":4588,"kb_used_omap":13,"kb_used_meta":228338,"kb_avail":754741660,"statfs":{"total":773094113280,"available":772855459840,"internally_reserved":0,"allocated":4698112,"data_stored":2730647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":233818200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.020428"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.596203+0000","last_change":"2023-07-24T05:47:51.588261+0000","last_active":"2023-07-24T05:47:51.596203+0000","last_peered":"2023-07-24T05:47:51.596203+0000","last_clean":"2023-07-24T05:47:51.596203+0000","last_became_active":"2023-07-24T05:47:51.588006+0000","last_became_peered":"2023-07-24T05:47:51.588006+0000","last_unstale":"2023-07-24T05:47:51.596203+0000","last_undegraded":"2023-07-24T05:47:51.596203+0000","last_fullsized":"2023-07-24T05:47:51.596203+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:18:11.807824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.601272+0000","last_change":"2023-07-24T05:47:51.594121+0000","last_active":"2023-07-24T05:47:51.601272+0000","last_peered":"2023-07-24T05:47:51.601272+0000","last_clean":"2023-07-24T05:47:51.601272+0000","last_became_active":"2023-07-24T05:47:51.593856+0000","last_became_peered":"2023-07-24T05:47:51.593856+0000","last_unstale":"2023-07-24T05:47:51.601272+0000","last_undegraded":"2023-07-24T05:47:51.601272+0000","last_fullsized":"2023-07-24T05:47:51.601272+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:24:59.114141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.599531+0000","last_change":"2023-07-24T05:47:51.595829+0000","last_active":"2023-07-24T05:47:51.599531+0000","last_peered":"2023-07-24T05:47:51.599531+0000","last_clean":"2023-07-24T05:47:51.599531+0000","last_became_active":"2023-07-24T05:47:51.595507+0000","last_became_peered":"2023-07-24T05:47:51.595507+0000","last_unstale":"2023-07-24T05:47:51.599531+0000","last_undegraded":"2023-07-24T05:47:51.599531+0000","last_fullsized":"2023-07-24T05:47:51.599531+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:52:14.231919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.606622+0000","last_change":"2023-07-24T05:47:51.599981+0000","last_active":"2023-07-24T05:47:51.606622+0000","last_peered":"2023-07-24T05:47:51.606622+0000","last_clean":"2023-07-24T05:47:51.606622+0000","last_became_active":"2023-07-24T05:47:51.599674+0000","last_became_peered":"2023-07-24T05:47:51.599674+0000","last_unstale":"2023-07-24T05:47:51.606622+0000","last_undegraded":"2023-07-24T05:47:51.606622+0000","last_fullsized":"2023-07-24T05:47:51.606622+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:44:20.550615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.601730+0000","last_change":"2023-07-24T05:47:51.594206+0000","last_active":"2023-07-24T05:47:51.601730+0000","last_peered":"2023-07-24T05:47:51.601730+0000","last_clean":"2023-07-24T05:47:51.601730+0000","last_became_active":"2023-07-24T05:47:51.593886+0000","last_became_peered":"2023-07-24T05:47:51.593886+0000","last_unstale":"2023-07-24T05:47:51.601730+0000","last_undegraded":"2023-07-24T05:47:51.601730+0000","last_fullsized":"2023-07-24T05:47:51.601730+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:36:27.304506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.592807+0000","last_change":"2023-07-24T05:47:51.584585+0000","last_active":"2023-07-24T05:47:51.592807+0000","last_peered":"2023-07-24T05:47:51.592807+0000","last_clean":"2023-07-24T05:47:51.592807+0000","last_became_active":"2023-07-24T05:47:51.584305+0000","last_became_peered":"2023-07-24T05:47:51.584305+0000","last_unstale":"2023-07-24T05:47:51.592807+0000","last_undegraded":"2023-07-24T05:47:51.592807+0000","last_fullsized":"2023-07-24T05:47:51.592807+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:17:26.902880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.589403+0000","last_change":"2023-07-24T05:47:51.585471+0000","last_active":"2023-07-24T05:47:51.589403+0000","last_peered":"2023-07-24T05:47:51.589403+0000","last_clean":"2023-07-24T05:47:51.589403+0000","last_became_active":"2023-07-24T05:47:51.584926+0000","last_became_peered":"2023-07-24T05:47:51.584926+0000","last_unstale":"2023-07-24T05:47:51.589403+0000","last_undegraded":"2023-07-24T05:47:51.589403+0000","last_fullsized":"2023-07-24T05:47:51.589403+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:34:03.548571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.607964+0000","last_change":"2023-07-24T05:47:51.600582+0000","last_active":"2023-07-24T05:47:51.607964+0000","last_peered":"2023-07-24T05:47:51.607964+0000","last_clean":"2023-07-24T05:47:51.607964+0000","last_became_active":"2023-07-24T05:47:51.599808+0000","last_became_peered":"2023-07-24T05:47:51.599808+0000","last_unstale":"2023-07-24T05:47:51.607964+0000","last_undegraded":"2023-07-24T05:47:51.607964+0000","last_fullsized":"2023-07-24T05:47:51.607964+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:14:10.434404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.599015+0000","last_change":"2023-07-24T05:47:51.592312+0000","last_active":"2023-07-24T05:47:51.599015+0000","last_peered":"2023-07-24T05:47:51.599015+0000","last_clean":"2023-07-24T05:47:51.599015+0000","last_became_active":"2023-07-24T05:47:51.591662+0000","last_became_peered":"2023-07-24T05:47:51.591662+0000","last_unstale":"2023-07-24T05:47:51.599015+0000","last_undegraded":"2023-07-24T05:47:51.599015+0000","last_fullsized":"2023-07-24T05:47:51.599015+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:25:30.595015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.606686+0000","last_change":"2023-07-24T05:47:51.601418+0000","last_active":"2023-07-24T05:47:51.606686+0000","last_peered":"2023-07-24T05:47:51.606686+0000","last_clean":"2023-07-24T05:47:51.606686+0000","last_became_active":"2023-07-24T05:47:51.600405+0000","last_became_peered":"2023-07-24T05:47:51.600405+0000","last_unstale":"2023-07-24T05:47:51.606686+0000","last_undegraded":"2023-07-24T05:47:51.606686+0000","last_fullsized":"2023-07-24T05:47:51.606686+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:20:57.740398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.598925+0000","last_change":"2023-07-24T05:47:51.592551+0000","last_active":"2023-07-24T05:47:51.598925+0000","last_peered":"2023-07-24T05:47:51.598925+0000","last_clean":"2023-07-24T05:47:51.598925+0000","last_became_active":"2023-07-24T05:47:51.592226+0000","last_became_peered":"2023-07-24T05:47:51.592226+0000","last_unstale":"2023-07-24T05:47:51.598925+0000","last_undegraded":"2023-07-24T05:47:51.598925+0000","last_fullsized":"2023-07-24T05:47:51.598925+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:40:31.757869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.604556+0000","last_change":"2023-07-24T05:47:51.599950+0000","last_active":"2023-07-24T05:47:51.604556+0000","last_peered":"2023-07-24T05:47:51.604556+0000","last_clean":"2023-07-24T05:47:51.604556+0000","last_became_active":"2023-07-24T05:47:51.599684+0000","last_became_peered":"2023-07-24T05:47:51.599684+0000","last_unstale":"2023-07-24T05:47:51.604556+0000","last_undegraded":"2023-07-24T05:47:51.604556+0000","last_fullsized":"2023-07-24T05:47:51.604556+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:55:52.639522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.597287+0000","last_change":"2023-07-24T05:47:51.586230+0000","last_active":"2023-07-24T05:47:51.597287+0000","last_peered":"2023-07-24T05:47:51.597287+0000","last_clean":"2023-07-24T05:47:51.597287+0000","last_became_active":"2023-07-24T05:47:51.585351+0000","last_became_peered":"2023-07-24T05:47:51.585351+0000","last_unstale":"2023-07-24T05:47:51.597287+0000","last_undegraded":"2023-07-24T05:47:51.597287+0000","last_fullsized":"2023-07-24T05:47:51.597287+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:06:52.411384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.598877+0000","last_change":"2023-07-24T05:47:51.591504+0000","last_active":"2023-07-24T05:47:51.598877+0000","last_peered":"2023-07-24T05:47:51.598877+0000","last_clean":"2023-07-24T05:47:51.598877+0000","last_became_active":"2023-07-24T05:47:51.591191+0000","last_became_peered":"2023-07-24T05:47:51.591191+0000","last_unstale":"2023-07-24T05:47:51.598877+0000","last_undegraded":"2023-07-24T05:47:51.598877+0000","last_fullsized":"2023-07-24T05:47:51.598877+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:40:57.401239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.593297+0000","last_change":"2023-07-24T05:47:51.586630+0000","last_active":"2023-07-24T05:47:51.593297+0000","last_peered":"2023-07-24T05:47:51.593297+0000","last_clean":"2023-07-24T05:47:51.593297+0000","last_became_active":"2023-07-24T05:47:51.586241+0000","last_became_peered":"2023-07-24T05:47:51.586241+0000","last_unstale":"2023-07-24T05:47:51.593297+0000","last_undegraded":"2023-07-24T05:47:51.593297+0000","last_fullsized":"2023-07-24T05:47:51.593297+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:46:13.195434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.604461+0000","last_change":"2023-07-24T05:47:51.596516+0000","last_active":"2023-07-24T05:47:51.604461+0000","last_peered":"2023-07-24T05:47:51.604461+0000","last_clean":"2023-07-24T05:47:51.604461+0000","last_became_active":"2023-07-24T05:47:51.588054+0000","last_became_peered":"2023-07-24T05:47:51.588054+0000","last_unstale":"2023-07-24T05:47:51.604461+0000","last_undegraded":"2023-07-24T05:47:51.604461+0000","last_fullsized":"2023-07-24T05:47:51.604461+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:08:45.132266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.590818+0000","last_change":"2023-07-24T05:47:51.588100+0000","last_active":"2023-07-24T05:47:51.590818+0000","last_peered":"2023-07-24T05:47:51.590818+0000","last_clean":"2023-07-24T05:47:51.590818+0000","last_became_active":"2023-07-24T05:47:51.587843+0000","last_became_peered":"2023-07-24T05:47:51.587843+0000","last_unstale":"2023-07-24T05:47:51.590818+0000","last_undegraded":"2023-07-24T05:47:51.590818+0000","last_fullsized":"2023-07-24T05:47:51.590818+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:46:48.587048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.597444+0000","last_change":"2023-07-24T05:47:51.593535+0000","last_active":"2023-07-24T05:47:51.597444+0000","last_peered":"2023-07-24T05:47:51.597444+0000","last_clean":"2023-07-24T05:47:51.597444+0000","last_became_active":"2023-07-24T05:47:51.593263+0000","last_became_peered":"2023-07-24T05:47:51.593263+0000","last_unstale":"2023-07-24T05:47:51.597444+0000","last_undegraded":"2023-07-24T05:47:51.597444+0000","last_fullsized":"2023-07-24T05:47:51.597444+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:51:42.404101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.604497+0000","last_change":"2023-07-24T05:47:51.595066+0000","last_active":"2023-07-24T05:47:51.604497+0000","last_peered":"2023-07-24T05:47:51.604497+0000","last_clean":"2023-07-24T05:47:51.604497+0000","last_became_active":"2023-07-24T05:47:51.594740+0000","last_became_peered":"2023-07-24T05:47:51.594740+0000","last_unstale":"2023-07-24T05:47:51.604497+0000","last_undegraded":"2023-07-24T05:47:51.604497+0000","last_fullsized":"2023-07-24T05:47:51.604497+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:12:40.447549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.597482+0000","last_change":"2023-07-24T05:47:51.588119+0000","last_active":"2023-07-24T05:47:51.597482+0000","last_peered":"2023-07-24T05:47:51.597482+0000","last_clean":"2023-07-24T05:47:51.597482+0000","last_became_active":"2023-07-24T05:47:51.587837+0000","last_became_peered":"2023-07-24T05:47:51.587837+0000","last_unstale":"2023-07-24T05:47:51.597482+0000","last_undegraded":"2023-07-24T05:47:51.597482+0000","last_fullsized":"2023-07-24T05:47:51.597482+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T16:14:36.789555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.607079+0000","last_change":"2023-07-24T05:47:51.602398+0000","last_active":"2023-07-24T05:47:51.607079+0000","last_peered":"2023-07-24T05:47:51.607079+0000","last_clean":"2023-07-24T05:47:51.607079+0000","last_became_active":"2023-07-24T05:47:51.602022+0000","last_became_peered":"2023-07-24T05:47:51.602022+0000","last_unstale":"2023-07-24T05:47:51.607079+0000","last_undegraded":"2023-07-24T05:47:51.607079+0000","last_fullsized":"2023-07-24T05:47:51.607079+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:23:07.103895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.606733+0000","last_change":"2023-07-24T05:47:51.602473+0000","last_active":"2023-07-24T05:47:51.606733+0000","last_peered":"2023-07-24T05:47:51.606733+0000","last_clean":"2023-07-24T05:47:51.606733+0000","last_became_active":"2023-07-24T05:47:51.602149+0000","last_became_peered":"2023-07-24T05:47:51.602149+0000","last_unstale":"2023-07-24T05:47:51.606733+0000","last_undegraded":"2023-07-24T05:47:51.606733+0000","last_fullsized":"2023-07-24T05:47:51.606733+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:05:12.409583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.600789+0000","last_change":"2023-07-24T05:47:51.585191+0000","last_active":"2023-07-24T05:47:51.600789+0000","last_peered":"2023-07-24T05:47:51.600789+0000","last_clean":"2023-07-24T05:47:51.600789+0000","last_became_active":"2023-07-24T05:47:51.584826+0000","last_became_peered":"2023-07-24T05:47:51.584826+0000","last_unstale":"2023-07-24T05:47:51.600789+0000","last_undegraded":"2023-07-24T05:47:51.600789+0000","last_fullsized":"2023-07-24T05:47:51.600789+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:08:04.091964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.603777+0000","last_change":"2023-07-24T05:47:51.586369+0000","last_active":"2023-07-24T05:47:51.603777+0000","last_peered":"2023-07-24T05:47:51.603777+0000","last_clean":"2023-07-24T05:47:51.603777+0000","last_became_active":"2023-07-24T05:47:51.586095+0000","last_became_peered":"2023-07-24T05:47:51.586095+0000","last_unstale":"2023-07-24T05:47:51.603777+0000","last_undegraded":"2023-07-24T05:47:51.603777+0000","last_fullsized":"2023-07-24T05:47:51.603777+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:53:20.147093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.603915+0000","last_change":"2023-07-24T05:47:51.594160+0000","last_active":"2023-07-24T05:47:51.603915+0000","last_peered":"2023-07-24T05:47:51.603915+0000","last_clean":"2023-07-24T05:47:51.603915+0000","last_became_active":"2023-07-24T05:47:51.593894+0000","last_became_peered":"2023-07-24T05:47:51.593894+0000","last_unstale":"2023-07-24T05:47:51.603915+0000","last_undegraded":"2023-07-24T05:47:51.603915+0000","last_fullsized":"2023-07-24T05:47:51.603915+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:32:18.300646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.593480+0000","last_change":"2023-07-24T05:47:51.583289+0000","last_active":"2023-07-24T05:47:51.593480+0000","last_peered":"2023-07-24T05:47:51.593480+0000","last_clean":"2023-07-24T05:47:51.593480+0000","last_became_active":"2023-07-24T05:47:51.582965+0000","last_became_peered":"2023-07-24T05:47:51.582965+0000","last_unstale":"2023-07-24T05:47:51.593480+0000","last_undegraded":"2023-07-24T05:47:51.593480+0000","last_fullsized":"2023-07-24T05:47:51.593480+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:05:48.355600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.589189+0000","last_change":"2023-07-24T05:47:51.584997+0000","last_active":"2023-07-24T05:47:51.589189+0000","last_peered":"2023-07-24T05:47:51.589189+0000","last_clean":"2023-07-24T05:47:51.589189+0000","last_became_active":"2023-07-24T05:47:51.584723+0000","last_became_peered":"2023-07-24T05:47:51.584723+0000","last_unstale":"2023-07-24T05:47:51.589189+0000","last_undegraded":"2023-07-24T05:47:51.589189+0000","last_fullsized":"2023-07-24T05:47:51.589189+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:30:50.817095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.604537+0000","last_change":"2023-07-24T05:47:51.599892+0000","last_active":"2023-07-24T05:47:51.604537+0000","last_peered":"2023-07-24T05:47:51.604537+0000","last_clean":"2023-07-24T05:47:51.604537+0000","last_became_active":"2023-07-24T05:47:51.599586+0000","last_became_peered":"2023-07-24T05:47:51.599586+0000","last_unstale":"2023-07-24T05:47:51.604537+0000","last_undegraded":"2023-07-24T05:47:51.604537+0000","last_fullsized":"2023-07-24T05:47:51.604537+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:39:01.003716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.605157+0000","last_change":"2023-07-24T05:47:51.595197+0000","last_active":"2023-07-24T05:47:51.605157+0000","last_peered":"2023-07-24T05:47:51.605157+0000","last_clean":"2023-07-24T05:47:51.605157+0000","last_became_active":"2023-07-24T05:47:51.594896+0000","last_became_peered":"2023-07-24T05:47:51.594896+0000","last_unstale":"2023-07-24T05:47:51.605157+0000","last_undegraded":"2023-07-24T05:47:51.605157+0000","last_fullsized":"2023-07-24T05:47:51.605157+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:17:27.569460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.589257+0000","last_change":"2023-07-24T05:47:51.586638+0000","last_active":"2023-07-24T05:47:51.589257+0000","last_peered":"2023-07-24T05:47:51.589257+0000","last_clean":"2023-07-24T05:47:51.589257+0000","last_became_active":"2023-07-24T05:47:51.586375+0000","last_became_peered":"2023-07-24T05:47:51.586375+0000","last_unstale":"2023-07-24T05:47:51.589257+0000","last_undegraded":"2023-07-24T05:47:51.589257+0000","last_fullsized":"2023-07-24T05:47:51.589257+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:27:40.424486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.592708+0000","last_change":"2023-07-24T05:47:51.583267+0000","last_active":"2023-07-24T05:47:51.592708+0000","last_peered":"2023-07-24T05:47:51.592708+0000","last_clean":"2023-07-24T05:47:51.592708+0000","last_became_active":"2023-07-24T05:47:51.582953+0000","last_became_peered":"2023-07-24T05:47:51.582953+0000","last_unstale":"2023-07-24T05:47:51.592708+0000","last_undegraded":"2023-07-24T05:47:51.592708+0000","last_fullsized":"2023-07-24T05:47:51.592708+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:18:06.510996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.597309+0000","last_change":"2023-07-24T05:47:51.585906+0000","last_active":"2023-07-24T05:47:51.597309+0000","last_peered":"2023-07-24T05:47:51.597309+0000","last_clean":"2023-07-24T05:47:51.597309+0000","last_became_active":"2023-07-24T05:47:51.585631+0000","last_became_peered":"2023-07-24T05:47:51.585631+0000","last_unstale":"2023-07-24T05:47:51.597309+0000","last_undegraded":"2023-07-24T05:47:51.597309+0000","last_fullsized":"2023-07-24T05:47:51.597309+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:29:49.872609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.599423+0000","last_change":"2023-07-24T05:47:51.593786+0000","last_active":"2023-07-24T05:47:51.599423+0000","last_peered":"2023-07-24T05:47:51.599423+0000","last_clean":"2023-07-24T05:47:51.599423+0000","last_became_active":"2023-07-24T05:47:51.593518+0000","last_became_peered":"2023-07-24T05:47:51.593518+0000","last_unstale":"2023-07-24T05:47:51.599423+0000","last_undegraded":"2023-07-24T05:47:51.599423+0000","last_fullsized":"2023-07-24T05:47:51.599423+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:38:19.669163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"38'4","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.611834+0000","last_change":"2023-07-24T05:47:50.577431+0000","last_active":"2023-07-24T05:47:51.611834+0000","last_peered":"2023-07-24T05:47:51.611834+0000","last_clean":"2023-07-24T05:47:51.611834+0000","last_became_active":"2023-07-24T05:47:50.577117+0000","last_became_peered":"2023-07-24T05:47:50.577117+0000","last_unstale":"2023-07-24T05:47:51.611834+0000","last_undegraded":"2023-07-24T05:47:51.611834+0000","last_fullsized":"2023-07-24T05:47:51.611834+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:15:25.167039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.603633+0000","last_change":"2023-07-24T05:47:51.586693+0000","last_active":"2023-07-24T05:47:51.603633+0000","last_peered":"2023-07-24T05:47:51.603633+0000","last_clean":"2023-07-24T05:47:51.603633+0000","last_became_active":"2023-07-24T05:47:51.586382+0000","last_became_peered":"2023-07-24T05:47:51.586382+0000","last_unstale":"2023-07-24T05:47:51.603633+0000","last_undegraded":"2023-07-24T05:47:51.603633+0000","last_fullsized":"2023-07-24T05:47:51.603633+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:13:27.443554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.612402+0000","last_change":"2023-07-24T05:47:50.580407+0000","last_active":"2023-07-24T05:47:51.612402+0000","last_peered":"2023-07-24T05:47:51.612402+0000","last_clean":"2023-07-24T05:47:51.612402+0000","last_became_active":"2023-07-24T05:47:50.580018+0000","last_became_peered":"2023-07-24T05:47:50.580018+0000","last_unstale":"2023-07-24T05:47:51.612402+0000","last_undegraded":"2023-07-24T05:47:51.612402+0000","last_fullsized":"2023-07-24T05:47:51.612402+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:00:39.435428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.593684+0000","last_change":"2023-07-24T05:47:51.587299+0000","last_active":"2023-07-24T05:47:51.593684+0000","last_peered":"2023-07-24T05:47:51.593684+0000","last_clean":"2023-07-24T05:47:51.593684+0000","last_became_active":"2023-07-24T05:47:51.587036+0000","last_became_peered":"2023-07-24T05:47:51.587036+0000","last_unstale":"2023-07-24T05:47:51.593684+0000","last_undegraded":"2023-07-24T05:47:51.593684+0000","last_fullsized":"2023-07-24T05:47:51.593684+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:49:01.002220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.612635+0000","last_change":"2023-07-24T05:47:50.580453+0000","last_active":"2023-07-24T05:47:51.612635+0000","last_peered":"2023-07-24T05:47:51.612635+0000","last_clean":"2023-07-24T05:47:51.612635+0000","last_became_active":"2023-07-24T05:47:50.580119+0000","last_became_peered":"2023-07-24T05:47:50.580119+0000","last_unstale":"2023-07-24T05:47:51.612635+0000","last_undegraded":"2023-07-24T05:47:51.612635+0000","last_fullsized":"2023-07-24T05:47:51.612635+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:07:07.038286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.603500+0000","last_change":"2023-07-24T05:47:51.601668+0000","last_active":"2023-07-24T05:47:51.603500+0000","last_peered":"2023-07-24T05:47:51.603500+0000","last_clean":"2023-07-24T05:47:51.603500+0000","last_became_active":"2023-07-24T05:47:51.601381+0000","last_became_peered":"2023-07-24T05:47:51.601381+0000","last_unstale":"2023-07-24T05:47:51.603500+0000","last_undegraded":"2023-07-24T05:47:51.603500+0000","last_fullsized":"2023-07-24T05:47:51.603500+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:47:44.340903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.613734+0000","last_change":"2023-07-24T05:47:50.580139+0000","last_active":"2023-07-24T05:47:51.613734+0000","last_peered":"2023-07-24T05:47:51.613734+0000","last_clean":"2023-07-24T05:47:51.613734+0000","last_became_active":"2023-07-24T05:47:50.579854+0000","last_became_peered":"2023-07-24T05:47:50.579854+0000","last_unstale":"2023-07-24T05:47:51.613734+0000","last_undegraded":"2023-07-24T05:47:51.613734+0000","last_fullsized":"2023-07-24T05:47:51.613734+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:02:24.728623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.605996+0000","last_change":"2023-07-24T05:47:51.601501+0000","last_active":"2023-07-24T05:47:51.605996+0000","last_peered":"2023-07-24T05:47:51.605996+0000","last_clean":"2023-07-24T05:47:51.605996+0000","last_became_active":"2023-07-24T05:47:51.601178+0000","last_became_peered":"2023-07-24T05:47:51.601178+0000","last_unstale":"2023-07-24T05:47:51.605996+0000","last_undegraded":"2023-07-24T05:47:51.605996+0000","last_fullsized":"2023-07-24T05:47:51.605996+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:20:34.149258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.613917+0000","last_change":"2023-07-24T05:47:50.576327+0000","last_active":"2023-07-24T05:47:51.613917+0000","last_peered":"2023-07-24T05:47:51.613917+0000","last_clean":"2023-07-24T05:47:51.613917+0000","last_became_active":"2023-07-24T05:47:50.575861+0000","last_became_peered":"2023-07-24T05:47:50.575861+0000","last_unstale":"2023-07-24T05:47:51.613917+0000","last_undegraded":"2023-07-24T05:47:51.613917+0000","last_fullsized":"2023-07-24T05:47:51.613917+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:07:55.027634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.603416+0000","last_change":"2023-07-24T05:47:51.598249+0000","last_active":"2023-07-24T05:47:51.603416+0000","last_peered":"2023-07-24T05:47:51.603416+0000","last_clean":"2023-07-24T05:47:51.603416+0000","last_became_active":"2023-07-24T05:47:51.597872+0000","last_became_peered":"2023-07-24T05:47:51.597872+0000","last_unstale":"2023-07-24T05:47:51.603416+0000","last_undegraded":"2023-07-24T05:47:51.603416+0000","last_fullsized":"2023-07-24T05:47:51.603416+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:29:45.253895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.613459+0000","last_change":"2023-07-24T05:47:50.582153+0000","last_active":"2023-07-24T05:47:51.613459+0000","last_peered":"2023-07-24T05:47:51.613459+0000","last_clean":"2023-07-24T05:47:51.613459+0000","last_became_active":"2023-07-24T05:47:50.581801+0000","last_became_peered":"2023-07-24T05:47:50.581801+0000","last_unstale":"2023-07-24T05:47:51.613459+0000","last_undegraded":"2023-07-24T05:47:51.613459+0000","last_fullsized":"2023-07-24T05:47:51.613459+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:51:04.751797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.607987+0000","last_change":"2023-07-24T05:47:51.600765+0000","last_active":"2023-07-24T05:47:51.607987+0000","last_peered":"2023-07-24T05:47:51.607987+0000","last_clean":"2023-07-24T05:47:51.607987+0000","last_became_active":"2023-07-24T05:47:51.600228+0000","last_became_peered":"2023-07-24T05:47:51.600228+0000","last_unstale":"2023-07-24T05:47:51.607987+0000","last_undegraded":"2023-07-24T05:47:51.607987+0000","last_fullsized":"2023-07-24T05:47:51.607987+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T16:14:07.922744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.579662+0000","last_change":"2023-07-24T05:47:50.577821+0000","last_active":"2023-07-24T05:47:51.579662+0000","last_peered":"2023-07-24T05:47:51.579662+0000","last_clean":"2023-07-24T05:47:51.579662+0000","last_became_active":"2023-07-24T05:47:50.577557+0000","last_became_peered":"2023-07-24T05:47:50.577557+0000","last_unstale":"2023-07-24T05:47:51.579662+0000","last_undegraded":"2023-07-24T05:47:51.579662+0000","last_fullsized":"2023-07-24T05:47:51.579662+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:27:24.332325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.600808+0000","last_change":"2023-07-24T05:47:51.585653+0000","last_active":"2023-07-24T05:47:51.600808+0000","last_peered":"2023-07-24T05:47:51.600808+0000","last_clean":"2023-07-24T05:47:51.600808+0000","last_became_active":"2023-07-24T05:47:51.585364+0000","last_became_peered":"2023-07-24T05:47:51.585364+0000","last_unstale":"2023-07-24T05:47:51.600808+0000","last_undegraded":"2023-07-24T05:47:51.600808+0000","last_fullsized":"2023-07-24T05:47:51.600808+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:31:00.650267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.575027+0000","last_change":"2023-07-24T05:47:50.583513+0000","last_active":"2023-07-24T05:47:51.575027+0000","last_peered":"2023-07-24T05:47:51.575027+0000","last_clean":"2023-07-24T05:47:51.575027+0000","last_became_active":"2023-07-24T05:47:50.583246+0000","last_became_peered":"2023-07-24T05:47:50.583246+0000","last_unstale":"2023-07-24T05:47:51.575027+0000","last_undegraded":"2023-07-24T05:47:51.575027+0000","last_fullsized":"2023-07-24T05:47:51.575027+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:33:03.411036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.597425+0000","last_change":"2023-07-24T05:47:51.593170+0000","last_active":"2023-07-24T05:47:51.597425+0000","last_peered":"2023-07-24T05:47:51.597425+0000","last_clean":"2023-07-24T05:47:51.597425+0000","last_became_active":"2023-07-24T05:47:51.592921+0000","last_became_peered":"2023-07-24T05:47:51.592921+0000","last_unstale":"2023-07-24T05:47:51.597425+0000","last_undegraded":"2023-07-24T05:47:51.597425+0000","last_fullsized":"2023-07-24T05:47:51.597425+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:57:33.672718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.581231+0000","last_change":"2023-07-24T05:47:50.577427+0000","last_active":"2023-07-24T05:47:51.581231+0000","last_peered":"2023-07-24T05:47:51.581231+0000","last_clean":"2023-07-24T05:47:51.581231+0000","last_became_active":"2023-07-24T05:47:50.576898+0000","last_became_peered":"2023-07-24T05:47:50.576898+0000","last_unstale":"2023-07-24T05:47:51.581231+0000","last_undegraded":"2023-07-24T05:47:51.581231+0000","last_fullsized":"2023-07-24T05:47:51.581231+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:55:40.256829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.589382+0000","last_change":"2023-07-24T05:47:51.586124+0000","last_active":"2023-07-24T05:47:51.589382+0000","last_peered":"2023-07-24T05:47:51.589382+0000","last_clean":"2023-07-24T05:47:51.589382+0000","last_became_active":"2023-07-24T05:47:51.584348+0000","last_became_peered":"2023-07-24T05:47:51.584348+0000","last_unstale":"2023-07-24T05:47:51.589382+0000","last_undegraded":"2023-07-24T05:47:51.589382+0000","last_fullsized":"2023-07-24T05:47:51.589382+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:39:45.936856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.578952+0000","last_change":"2023-07-24T05:47:50.585942+0000","last_active":"2023-07-24T05:47:51.578952+0000","last_peered":"2023-07-24T05:47:51.578952+0000","last_clean":"2023-07-24T05:47:51.578952+0000","last_became_active":"2023-07-24T05:47:50.585706+0000","last_became_peered":"2023-07-24T05:47:50.585706+0000","last_unstale":"2023-07-24T05:47:51.578952+0000","last_undegraded":"2023-07-24T05:47:51.578952+0000","last_fullsized":"2023-07-24T05:47:51.578952+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T16:05:38.026572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.598445+0000","last_change":"2023-07-24T05:47:51.594973+0000","last_active":"2023-07-24T05:47:51.598445+0000","last_peered":"2023-07-24T05:47:51.598445+0000","last_clean":"2023-07-24T05:47:51.598445+0000","last_became_active":"2023-07-24T05:47:51.594663+0000","last_became_peered":"2023-07-24T05:47:51.594663+0000","last_unstale":"2023-07-24T05:47:51.598445+0000","last_undegraded":"2023-07-24T05:47:51.598445+0000","last_fullsized":"2023-07-24T05:47:51.598445+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:01:49.877147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"38'3","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.612725+0000","last_change":"2023-07-24T05:47:50.579602+0000","last_active":"2023-07-24T05:47:51.612725+0000","last_peered":"2023-07-24T05:47:51.612725+0000","last_clean":"2023-07-24T05:47:51.612725+0000","last_became_active":"2023-07-24T05:47:50.579321+0000","last_became_peered":"2023-07-24T05:47:50.579321+0000","last_unstale":"2023-07-24T05:47:51.612725+0000","last_undegraded":"2023-07-24T05:47:51.612725+0000","last_fullsized":"2023-07-24T05:47:51.612725+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:26:38.943328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.600155+0000","last_change":"2023-07-24T05:47:51.593310+0000","last_active":"2023-07-24T05:47:51.600155+0000","last_peered":"2023-07-24T05:47:51.600155+0000","last_clean":"2023-07-24T05:47:51.600155+0000","last_became_active":"2023-07-24T05:47:51.593021+0000","last_became_peered":"2023-07-24T05:47:51.593021+0000","last_unstale":"2023-07-24T05:47:51.600155+0000","last_undegraded":"2023-07-24T05:47:51.600155+0000","last_fullsized":"2023-07-24T05:47:51.600155+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:02:15.109934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"38'6","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.615680+0000","last_change":"2023-07-24T05:47:50.576672+0000","last_active":"2023-07-24T05:47:51.615680+0000","last_peered":"2023-07-24T05:47:51.615680+0000","last_clean":"2023-07-24T05:47:51.615680+0000","last_became_active":"2023-07-24T05:47:50.576352+0000","last_became_peered":"2023-07-24T05:47:50.576352+0000","last_unstale":"2023-07-24T05:47:51.615680+0000","last_undegraded":"2023-07-24T05:47:51.615680+0000","last_fullsized":"2023-07-24T05:47:51.615680+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:32:02.324284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.600755+0000","last_change":"2023-07-24T05:47:51.582147+0000","last_active":"2023-07-24T05:47:51.600755+0000","last_peered":"2023-07-24T05:47:51.600755+0000","last_clean":"2023-07-24T05:47:51.600755+0000","last_became_active":"2023-07-24T05:47:51.581875+0000","last_became_peered":"2023-07-24T05:47:51.581875+0000","last_unstale":"2023-07-24T05:47:51.600755+0000","last_undegraded":"2023-07-24T05:47:51.600755+0000","last_fullsized":"2023-07-24T05:47:51.600755+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:06:07.268812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.612308+0000","last_change":"2023-07-24T05:47:50.588278+0000","last_active":"2023-07-24T05:47:51.612308+0000","last_peered":"2023-07-24T05:47:51.612308+0000","last_clean":"2023-07-24T05:47:51.612308+0000","last_became_active":"2023-07-24T05:47:50.587983+0000","last_became_peered":"2023-07-24T05:47:50.587983+0000","last_unstale":"2023-07-24T05:47:51.612308+0000","last_undegraded":"2023-07-24T05:47:51.612308+0000","last_fullsized":"2023-07-24T05:47:51.612308+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:05:18.856965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.591990+0000","last_change":"2023-07-24T05:47:51.585004+0000","last_active":"2023-07-24T05:47:51.591990+0000","last_peered":"2023-07-24T05:47:51.591990+0000","last_clean":"2023-07-24T05:47:51.591990+0000","last_became_active":"2023-07-24T05:47:51.584738+0000","last_became_peered":"2023-07-24T05:47:51.584738+0000","last_unstale":"2023-07-24T05:47:51.591990+0000","last_undegraded":"2023-07-24T05:47:51.591990+0000","last_fullsized":"2023-07-24T05:47:51.591990+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:19:43.860556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.572463+0000","last_change":"2023-07-24T05:47:50.581538+0000","last_active":"2023-07-24T05:47:51.572463+0000","last_peered":"2023-07-24T05:47:51.572463+0000","last_clean":"2023-07-24T05:47:51.572463+0000","last_became_active":"2023-07-24T05:47:50.581281+0000","last_became_peered":"2023-07-24T05:47:50.581281+0000","last_unstale":"2023-07-24T05:47:51.572463+0000","last_undegraded":"2023-07-24T05:47:51.572463+0000","last_fullsized":"2023-07-24T05:47:51.572463+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:22:39.293540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.592944+0000","last_change":"2023-07-24T05:47:51.587516+0000","last_active":"2023-07-24T05:47:51.592944+0000","last_peered":"2023-07-24T05:47:51.592944+0000","last_clean":"2023-07-24T05:47:51.592944+0000","last_became_active":"2023-07-24T05:47:51.586715+0000","last_became_peered":"2023-07-24T05:47:51.586715+0000","last_unstale":"2023-07-24T05:47:51.592944+0000","last_undegraded":"2023-07-24T05:47:51.592944+0000","last_fullsized":"2023-07-24T05:47:51.592944+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T16:49:06.292192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.573296+0000","last_change":"2023-07-24T05:47:50.589972+0000","last_active":"2023-07-24T05:47:51.573296+0000","last_peered":"2023-07-24T05:47:51.573296+0000","last_clean":"2023-07-24T05:47:51.573296+0000","last_became_active":"2023-07-24T05:47:50.589711+0000","last_became_peered":"2023-07-24T05:47:50.589711+0000","last_unstale":"2023-07-24T05:47:51.573296+0000","last_undegraded":"2023-07-24T05:47:51.573296+0000","last_fullsized":"2023-07-24T05:47:51.573296+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:35:31.179438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.589418+0000","last_change":"2023-07-24T05:47:51.586070+0000","last_active":"2023-07-24T05:47:51.589418+0000","last_peered":"2023-07-24T05:47:51.589418+0000","last_clean":"2023-07-24T05:47:51.589418+0000","last_became_active":"2023-07-24T05:47:51.585813+0000","last_became_peered":"2023-07-24T05:47:51.585813+0000","last_unstale":"2023-07-24T05:47:51.589418+0000","last_undegraded":"2023-07-24T05:47:51.589418+0000","last_fullsized":"2023-07-24T05:47:51.589418+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:21:11.019118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"38'8","reported_seq":19,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.614535+0000","last_change":"2023-07-24T05:47:50.583366+0000","last_active":"2023-07-24T05:47:51.614535+0000","last_peered":"2023-07-24T05:47:51.614535+0000","last_clean":"2023-07-24T05:47:51.614535+0000","last_became_active":"2023-07-24T05:47:50.583037+0000","last_became_peered":"2023-07-24T05:47:50.583037+0000","last_unstale":"2023-07-24T05:47:51.614535+0000","last_undegraded":"2023-07-24T05:47:51.614535+0000","last_fullsized":"2023-07-24T05:47:51.614535+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:52:50.123352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.597375+0000","last_change":"2023-07-24T05:47:51.590311+0000","last_active":"2023-07-24T05:47:51.597375+0000","last_peered":"2023-07-24T05:47:51.597375+0000","last_clean":"2023-07-24T05:47:51.597375+0000","last_became_active":"2023-07-24T05:47:51.589978+0000","last_became_peered":"2023-07-24T05:47:51.589978+0000","last_unstale":"2023-07-24T05:47:51.597375+0000","last_undegraded":"2023-07-24T05:47:51.597375+0000","last_fullsized":"2023-07-24T05:47:51.597375+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:09:48.930487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.611394+0000","last_change":"2023-07-24T05:47:50.576579+0000","last_active":"2023-07-24T05:47:51.611394+0000","last_peered":"2023-07-24T05:47:51.611394+0000","last_clean":"2023-07-24T05:47:51.611394+0000","last_became_active":"2023-07-24T05:47:50.576116+0000","last_became_peered":"2023-07-24T05:47:50.576116+0000","last_unstale":"2023-07-24T05:47:51.611394+0000","last_undegraded":"2023-07-24T05:47:51.611394+0000","last_fullsized":"2023-07-24T05:47:51.611394+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T16:42:18.164629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.598996+0000","last_change":"2023-07-24T05:47:51.592078+0000","last_active":"2023-07-24T05:47:51.598996+0000","last_peered":"2023-07-24T05:47:51.598996+0000","last_clean":"2023-07-24T05:47:51.598996+0000","last_became_active":"2023-07-24T05:47:51.591256+0000","last_became_peered":"2023-07-24T05:47:51.591256+0000","last_unstale":"2023-07-24T05:47:51.598996+0000","last_undegraded":"2023-07-24T05:47:51.598996+0000","last_fullsized":"2023-07-24T05:47:51.598996+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:36:00.932269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.611030+0000","last_change":"2023-07-24T05:47:50.580248+0000","last_active":"2023-07-24T05:47:51.611030+0000","last_peered":"2023-07-24T05:47:51.611030+0000","last_clean":"2023-07-24T05:47:51.611030+0000","last_became_active":"2023-07-24T05:47:50.579738+0000","last_became_peered":"2023-07-24T05:47:50.579738+0000","last_unstale":"2023-07-24T05:47:51.611030+0000","last_undegraded":"2023-07-24T05:47:51.611030+0000","last_fullsized":"2023-07-24T05:47:51.611030+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:59:11.297736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.600682+0000","last_change":"2023-07-24T05:47:51.584499+0000","last_active":"2023-07-24T05:47:51.600682+0000","last_peered":"2023-07-24T05:47:51.600682+0000","last_clean":"2023-07-24T05:47:51.600682+0000","last_became_active":"2023-07-24T05:47:51.584222+0000","last_became_peered":"2023-07-24T05:47:51.584222+0000","last_unstale":"2023-07-24T05:47:51.600682+0000","last_undegraded":"2023-07-24T05:47:51.600682+0000","last_fullsized":"2023-07-24T05:47:51.600682+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:02:25.283944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.613065+0000","last_change":"2023-07-24T05:47:50.581681+0000","last_active":"2023-07-24T05:47:51.613065+0000","last_peered":"2023-07-24T05:47:51.613065+0000","last_clean":"2023-07-24T05:47:51.613065+0000","last_became_active":"2023-07-24T05:47:50.581434+0000","last_became_peered":"2023-07-24T05:47:50.581434+0000","last_unstale":"2023-07-24T05:47:51.613065+0000","last_undegraded":"2023-07-24T05:47:51.613065+0000","last_fullsized":"2023-07-24T05:47:51.613065+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:11:14.998636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.604478+0000","last_change":"2023-07-24T05:47:51.593763+0000","last_active":"2023-07-24T05:47:51.604478+0000","last_peered":"2023-07-24T05:47:51.604478+0000","last_clean":"2023-07-24T05:47:51.604478+0000","last_became_active":"2023-07-24T05:47:51.593421+0000","last_became_peered":"2023-07-24T05:47:51.593421+0000","last_unstale":"2023-07-24T05:47:51.604478+0000","last_undegraded":"2023-07-24T05:47:51.604478+0000","last_fullsized":"2023-07-24T05:47:51.604478+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:46:27.678439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.575314+0000","last_change":"2023-07-24T05:47:50.580193+0000","last_active":"2023-07-24T05:47:51.575314+0000","last_peered":"2023-07-24T05:47:51.575314+0000","last_clean":"2023-07-24T05:47:51.575314+0000","last_became_active":"2023-07-24T05:47:50.579903+0000","last_became_peered":"2023-07-24T05:47:50.579903+0000","last_unstale":"2023-07-24T05:47:51.575314+0000","last_undegraded":"2023-07-24T05:47:51.575314+0000","last_fullsized":"2023-07-24T05:47:51.575314+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T16:12:37.644111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.598520+0000","last_change":"2023-07-24T05:47:51.595666+0000","last_active":"2023-07-24T05:47:51.598520+0000","last_peered":"2023-07-24T05:47:51.598520+0000","last_clean":"2023-07-24T05:47:51.598520+0000","last_became_active":"2023-07-24T05:47:51.595343+0000","last_became_peered":"2023-07-24T05:47:51.595343+0000","last_unstale":"2023-07-24T05:47:51.598520+0000","last_undegraded":"2023-07-24T05:47:51.598520+0000","last_fullsized":"2023-07-24T05:47:51.598520+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:01:02.898420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.614001+0000","last_change":"2023-07-24T05:47:50.578792+0000","last_active":"2023-07-24T05:47:51.614001+0000","last_peered":"2023-07-24T05:47:51.614001+0000","last_clean":"2023-07-24T05:47:51.614001+0000","last_became_active":"2023-07-24T05:47:50.578501+0000","last_became_peered":"2023-07-24T05:47:50.578501+0000","last_unstale":"2023-07-24T05:47:51.614001+0000","last_undegraded":"2023-07-24T05:47:51.614001+0000","last_fullsized":"2023-07-24T05:47:51.614001+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:09:21.279371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.596691+0000","last_change":"2023-07-24T05:47:51.587438+0000","last_active":"2023-07-24T05:47:51.596691+0000","last_peered":"2023-07-24T05:47:51.596691+0000","last_clean":"2023-07-24T05:47:51.596691+0000","last_became_active":"2023-07-24T05:47:51.587095+0000","last_became_peered":"2023-07-24T05:47:51.587095+0000","last_unstale":"2023-07-24T05:47:51.596691+0000","last_undegraded":"2023-07-24T05:47:51.596691+0000","last_fullsized":"2023-07-24T05:47:51.596691+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:20:05.397749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.580575+0000","last_change":"2023-07-24T05:47:50.578490+0000","last_active":"2023-07-24T05:47:51.580575+0000","last_peered":"2023-07-24T05:47:51.580575+0000","last_clean":"2023-07-24T05:47:51.580575+0000","last_became_active":"2023-07-24T05:47:50.578217+0000","last_became_peered":"2023-07-24T05:47:50.578217+0000","last_unstale":"2023-07-24T05:47:51.580575+0000","last_undegraded":"2023-07-24T05:47:51.580575+0000","last_fullsized":"2023-07-24T05:47:51.580575+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:40:20.760178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.597585+0000","last_change":"2023-07-24T05:47:51.592009+0000","last_active":"2023-07-24T05:47:51.597585+0000","last_peered":"2023-07-24T05:47:51.597585+0000","last_clean":"2023-07-24T05:47:51.597585+0000","last_became_active":"2023-07-24T05:47:51.591496+0000","last_became_peered":"2023-07-24T05:47:51.591496+0000","last_unstale":"2023-07-24T05:47:51.597585+0000","last_undegraded":"2023-07-24T05:47:51.597585+0000","last_fullsized":"2023-07-24T05:47:51.597585+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:16:14.245040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.576200+0000","last_change":"2023-07-24T05:47:50.586464+0000","last_active":"2023-07-24T05:47:51.576200+0000","last_peered":"2023-07-24T05:47:51.576200+0000","last_clean":"2023-07-24T05:47:51.576200+0000","last_became_active":"2023-07-24T05:47:50.586194+0000","last_became_peered":"2023-07-24T05:47:50.586194+0000","last_unstale":"2023-07-24T05:47:51.576200+0000","last_undegraded":"2023-07-24T05:47:51.576200+0000","last_fullsized":"2023-07-24T05:47:51.576200+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:32:38.468754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.591179+0000","last_change":"2023-07-24T05:47:51.586487+0000","last_active":"2023-07-24T05:47:51.591179+0000","last_peered":"2023-07-24T05:47:51.591179+0000","last_clean":"2023-07-24T05:47:51.591179+0000","last_became_active":"2023-07-24T05:47:51.586165+0000","last_became_peered":"2023-07-24T05:47:51.586165+0000","last_unstale":"2023-07-24T05:47:51.591179+0000","last_undegraded":"2023-07-24T05:47:51.591179+0000","last_fullsized":"2023-07-24T05:47:51.591179+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:59:49.141483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.573784+0000","last_change":"2023-07-24T05:47:50.579729+0000","last_active":"2023-07-24T05:47:51.573784+0000","last_peered":"2023-07-24T05:47:51.573784+0000","last_clean":"2023-07-24T05:47:51.573784+0000","last_became_active":"2023-07-24T05:47:50.579404+0000","last_became_peered":"2023-07-24T05:47:50.579404+0000","last_unstale":"2023-07-24T05:47:51.573784+0000","last_undegraded":"2023-07-24T05:47:51.573784+0000","last_fullsized":"2023-07-24T05:47:51.573784+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:54:45.325118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.593069+0000","last_change":"2023-07-24T05:47:51.588112+0000","last_active":"2023-07-24T05:47:51.593069+0000","last_peered":"2023-07-24T05:47:51.593069+0000","last_clean":"2023-07-24T05:47:51.593069+0000","last_became_active":"2023-07-24T05:47:51.587745+0000","last_became_peered":"2023-07-24T05:47:51.587745+0000","last_unstale":"2023-07-24T05:47:51.593069+0000","last_undegraded":"2023-07-24T05:47:51.593069+0000","last_fullsized":"2023-07-24T05:47:51.593069+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:52:00.429345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.572646+0000","last_change":"2023-07-24T05:47:50.583129+0000","last_active":"2023-07-24T05:47:51.572646+0000","last_peered":"2023-07-24T05:47:51.572646+0000","last_clean":"2023-07-24T05:47:51.572646+0000","last_became_active":"2023-07-24T05:47:50.582878+0000","last_became_peered":"2023-07-24T05:47:50.582878+0000","last_unstale":"2023-07-24T05:47:51.572646+0000","last_undegraded":"2023-07-24T05:47:51.572646+0000","last_fullsized":"2023-07-24T05:47:51.572646+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:22:20.461821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":53,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.575036+0000","last_change":"2023-07-24T05:45:54.350738+0000","last_active":"2023-07-24T05:47:51.575036+0000","last_peered":"2023-07-24T05:47:51.575036+0000","last_clean":"2023-07-24T05:47:51.575036+0000","last_became_active":"2023-07-24T05:45:54.350347+0000","last_became_peered":"2023-07-24T05:45:54.350347+0000","last_unstale":"2023-07-24T05:47:51.575036+0000","last_undegraded":"2023-07-24T05:47:51.575036+0000","last_fullsized":"2023-07-24T05:47:51.575036+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:02:00.964812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.598489+0000","last_change":"2023-07-24T05:47:51.595560+0000","last_active":"2023-07-24T05:47:51.598489+0000","last_peered":"2023-07-24T05:47:51.598489+0000","last_clean":"2023-07-24T05:47:51.598489+0000","last_became_active":"2023-07-24T05:47:51.595279+0000","last_became_peered":"2023-07-24T05:47:51.595279+0000","last_unstale":"2023-07-24T05:47:51.598489+0000","last_undegraded":"2023-07-24T05:47:51.598489+0000","last_fullsized":"2023-07-24T05:47:51.598489+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:52:53.242465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.581073+0000","last_change":"2023-07-24T05:47:50.579107+0000","last_active":"2023-07-24T05:47:51.581073+0000","last_peered":"2023-07-24T05:47:51.581073+0000","last_clean":"2023-07-24T05:47:51.581073+0000","last_became_active":"2023-07-24T05:47:50.578852+0000","last_became_peered":"2023-07-24T05:47:50.578852+0000","last_unstale":"2023-07-24T05:47:51.581073+0000","last_undegraded":"2023-07-24T05:47:51.581073+0000","last_fullsized":"2023-07-24T05:47:51.581073+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T16:15:21.050446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.584853+0000","last_change":"2023-07-24T05:45:54.346766+0000","last_active":"2023-07-24T05:47:51.584853+0000","last_peered":"2023-07-24T05:47:51.584853+0000","last_clean":"2023-07-24T05:47:51.584853+0000","last_became_active":"2023-07-24T05:45:54.346404+0000","last_became_peered":"2023-07-24T05:45:54.346404+0000","last_unstale":"2023-07-24T05:47:51.584853+0000","last_undegraded":"2023-07-24T05:47:51.584853+0000","last_fullsized":"2023-07-24T05:47:51.584853+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T16:38:24.730210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.596420+0000","last_change":"2023-07-24T05:47:51.590438+0000","last_active":"2023-07-24T05:47:51.596420+0000","last_peered":"2023-07-24T05:47:51.596420+0000","last_clean":"2023-07-24T05:47:51.596420+0000","last_became_active":"2023-07-24T05:47:51.590136+0000","last_became_peered":"2023-07-24T05:47:51.590136+0000","last_unstale":"2023-07-24T05:47:51.596420+0000","last_undegraded":"2023-07-24T05:47:51.596420+0000","last_fullsized":"2023-07-24T05:47:51.596420+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:12:04.759700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.585408+0000","last_change":"2023-07-24T05:47:50.577084+0000","last_active":"2023-07-24T05:47:51.585408+0000","last_peered":"2023-07-24T05:47:51.585408+0000","last_clean":"2023-07-24T05:47:51.585408+0000","last_became_active":"2023-07-24T05:47:50.576739+0000","last_became_peered":"2023-07-24T05:47:50.576739+0000","last_unstale":"2023-07-24T05:47:51.585408+0000","last_undegraded":"2023-07-24T05:47:51.585408+0000","last_fullsized":"2023-07-24T05:47:51.585408+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:08:00.116854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.575429+0000","last_change":"2023-07-24T05:45:54.355858+0000","last_active":"2023-07-24T05:47:51.575429+0000","last_peered":"2023-07-24T05:47:51.575429+0000","last_clean":"2023-07-24T05:47:51.575429+0000","last_became_active":"2023-07-24T05:45:54.355598+0000","last_became_peered":"2023-07-24T05:45:54.355598+0000","last_unstale":"2023-07-24T05:47:51.575429+0000","last_undegraded":"2023-07-24T05:47:51.575429+0000","last_fullsized":"2023-07-24T05:47:51.575429+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:09:19.701801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.589219+0000","last_change":"2023-07-24T05:47:51.586308+0000","last_active":"2023-07-24T05:47:51.589219+0000","last_peered":"2023-07-24T05:47:51.589219+0000","last_clean":"2023-07-24T05:47:51.589219+0000","last_became_active":"2023-07-24T05:47:51.586023+0000","last_became_peered":"2023-07-24T05:47:51.586023+0000","last_unstale":"2023-07-24T05:47:51.589219+0000","last_undegraded":"2023-07-24T05:47:51.589219+0000","last_fullsized":"2023-07-24T05:47:51.589219+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:39:55.018564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.575275+0000","last_change":"2023-07-24T05:47:50.586892+0000","last_active":"2023-07-24T05:47:51.575275+0000","last_peered":"2023-07-24T05:47:51.575275+0000","last_clean":"2023-07-24T05:47:51.575275+0000","last_became_active":"2023-07-24T05:47:50.586478+0000","last_became_peered":"2023-07-24T05:47:50.586478+0000","last_unstale":"2023-07-24T05:47:51.575275+0000","last_undegraded":"2023-07-24T05:47:51.575275+0000","last_fullsized":"2023-07-24T05:47:51.575275+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:22:23.056937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.585175+0000","last_change":"2023-07-24T05:45:54.354128+0000","last_active":"2023-07-24T05:47:51.585175+0000","last_peered":"2023-07-24T05:47:51.585175+0000","last_clean":"2023-07-24T05:47:51.585175+0000","last_became_active":"2023-07-24T05:45:54.353816+0000","last_became_peered":"2023-07-24T05:45:54.353816+0000","last_unstale":"2023-07-24T05:47:51.585175+0000","last_undegraded":"2023-07-24T05:47:51.585175+0000","last_fullsized":"2023-07-24T05:47:51.585175+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:27:03.487363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.604441+0000","last_change":"2023-07-24T05:47:51.595446+0000","last_active":"2023-07-24T05:47:51.604441+0000","last_peered":"2023-07-24T05:47:51.604441+0000","last_clean":"2023-07-24T05:47:51.604441+0000","last_became_active":"2023-07-24T05:47:51.595199+0000","last_became_peered":"2023-07-24T05:47:51.595199+0000","last_unstale":"2023-07-24T05:47:51.604441+0000","last_undegraded":"2023-07-24T05:47:51.604441+0000","last_fullsized":"2023-07-24T05:47:51.604441+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:54:00.768438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.574522+0000","last_change":"2023-07-24T05:47:50.581787+0000","last_active":"2023-07-24T05:47:51.574522+0000","last_peered":"2023-07-24T05:47:51.574522+0000","last_clean":"2023-07-24T05:47:51.574522+0000","last_became_active":"2023-07-24T05:47:50.581493+0000","last_became_peered":"2023-07-24T05:47:50.581493+0000","last_unstale":"2023-07-24T05:47:51.574522+0000","last_undegraded":"2023-07-24T05:47:51.574522+0000","last_fullsized":"2023-07-24T05:47:51.574522+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:00:39.047623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.580621+0000","last_change":"2023-07-24T05:45:54.353232+0000","last_active":"2023-07-24T05:47:51.580621+0000","last_peered":"2023-07-24T05:47:51.580621+0000","last_clean":"2023-07-24T05:47:51.580621+0000","last_became_active":"2023-07-24T05:45:54.352983+0000","last_became_peered":"2023-07-24T05:45:54.352983+0000","last_unstale":"2023-07-24T05:47:51.580621+0000","last_undegraded":"2023-07-24T05:47:51.580621+0000","last_fullsized":"2023-07-24T05:47:51.580621+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:55:15.690169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.596000+0000","last_change":"2023-07-24T05:47:51.588834+0000","last_active":"2023-07-24T05:47:51.596000+0000","last_peered":"2023-07-24T05:47:51.596000+0000","last_clean":"2023-07-24T05:47:51.596000+0000","last_became_active":"2023-07-24T05:47:51.588548+0000","last_became_peered":"2023-07-24T05:47:51.588548+0000","last_unstale":"2023-07-24T05:47:51.596000+0000","last_undegraded":"2023-07-24T05:47:51.596000+0000","last_fullsized":"2023-07-24T05:47:51.596000+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:31:21.493546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.575688+0000","last_change":"2023-07-24T05:47:50.583320+0000","last_active":"2023-07-24T05:47:51.575688+0000","last_peered":"2023-07-24T05:47:51.575688+0000","last_clean":"2023-07-24T05:47:51.575688+0000","last_became_active":"2023-07-24T05:47:50.583018+0000","last_became_peered":"2023-07-24T05:47:50.583018+0000","last_unstale":"2023-07-24T05:47:51.575688+0000","last_undegraded":"2023-07-24T05:47:51.575688+0000","last_fullsized":"2023-07-24T05:47:51.575688+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:53:42.116230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.567262+0000","last_change":"2023-07-24T05:45:54.349000+0000","last_active":"2023-07-24T05:47:51.567262+0000","last_peered":"2023-07-24T05:47:51.567262+0000","last_clean":"2023-07-24T05:47:51.567262+0000","last_became_active":"2023-07-24T05:45:54.348646+0000","last_became_peered":"2023-07-24T05:45:54.348646+0000","last_unstale":"2023-07-24T05:47:51.567262+0000","last_undegraded":"2023-07-24T05:47:51.567262+0000","last_fullsized":"2023-07-24T05:47:51.567262+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:05:31.906433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.600174+0000","last_change":"2023-07-24T05:47:51.595587+0000","last_active":"2023-07-24T05:47:51.600174+0000","last_peered":"2023-07-24T05:47:51.600174+0000","last_clean":"2023-07-24T05:47:51.600174+0000","last_became_active":"2023-07-24T05:47:51.595327+0000","last_became_peered":"2023-07-24T05:47:51.595327+0000","last_unstale":"2023-07-24T05:47:51.600174+0000","last_undegraded":"2023-07-24T05:47:51.600174+0000","last_fullsized":"2023-07-24T05:47:51.600174+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:30:23.570890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.584806+0000","last_change":"2023-07-24T05:47:50.581068+0000","last_active":"2023-07-24T05:47:51.584806+0000","last_peered":"2023-07-24T05:47:51.584806+0000","last_clean":"2023-07-24T05:47:51.584806+0000","last_became_active":"2023-07-24T05:47:50.580303+0000","last_became_peered":"2023-07-24T05:47:50.580303+0000","last_unstale":"2023-07-24T05:47:51.584806+0000","last_undegraded":"2023-07-24T05:47:51.584806+0000","last_fullsized":"2023-07-24T05:47:51.584806+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:14:25.264935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.572328+0000","last_change":"2023-07-24T05:45:54.350803+0000","last_active":"2023-07-24T05:47:51.572328+0000","last_peered":"2023-07-24T05:47:51.572328+0000","last_clean":"2023-07-24T05:47:51.572328+0000","last_became_active":"2023-07-24T05:45:54.350427+0000","last_became_peered":"2023-07-24T05:45:54.350427+0000","last_unstale":"2023-07-24T05:47:51.572328+0000","last_undegraded":"2023-07-24T05:47:51.572328+0000","last_fullsized":"2023-07-24T05:47:51.572328+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:09:18.063653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.599011+0000","last_change":"2023-07-24T05:47:51.590933+0000","last_active":"2023-07-24T05:47:51.599011+0000","last_peered":"2023-07-24T05:47:51.599011+0000","last_clean":"2023-07-24T05:47:51.599011+0000","last_became_active":"2023-07-24T05:47:51.590603+0000","last_became_peered":"2023-07-24T05:47:51.590603+0000","last_unstale":"2023-07-24T05:47:51.599011+0000","last_undegraded":"2023-07-24T05:47:51.599011+0000","last_fullsized":"2023-07-24T05:47:51.599011+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:18:24.255030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.613167+0000","last_change":"2023-07-24T05:47:50.580775+0000","last_active":"2023-07-24T05:47:51.613167+0000","last_peered":"2023-07-24T05:47:51.613167+0000","last_clean":"2023-07-24T05:47:51.613167+0000","last_became_active":"2023-07-24T05:47:50.580560+0000","last_became_peered":"2023-07-24T05:47:50.580560+0000","last_unstale":"2023-07-24T05:47:51.613167+0000","last_undegraded":"2023-07-24T05:47:51.613167+0000","last_fullsized":"2023-07-24T05:47:51.613167+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:19:20.516228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.581245+0000","last_change":"2023-07-24T05:45:54.351103+0000","last_active":"2023-07-24T05:47:51.581245+0000","last_peered":"2023-07-24T05:47:51.581245+0000","last_clean":"2023-07-24T05:47:51.581245+0000","last_became_active":"2023-07-24T05:45:54.350628+0000","last_became_peered":"2023-07-24T05:45:54.350628+0000","last_unstale":"2023-07-24T05:47:51.581245+0000","last_undegraded":"2023-07-24T05:47:51.581245+0000","last_fullsized":"2023-07-24T05:47:51.581245+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:09:57.539415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":197,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.573867+0000","last_change":"2023-07-24T05:45:54.356765+0000","last_active":"2023-07-24T05:47:51.573867+0000","last_peered":"2023-07-24T05:47:51.573867+0000","last_clean":"2023-07-24T05:47:51.573867+0000","last_became_active":"2023-07-24T05:45:54.355687+0000","last_became_peered":"2023-07-24T05:45:54.355687+0000","last_unstale":"2023-07-24T05:47:51.573867+0000","last_undegraded":"2023-07-24T05:47:51.573867+0000","last_fullsized":"2023-07-24T05:47:51.573867+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T05:48:46.952271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542171,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32124,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":1028096,"data_stored":782954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jul 24 05:46:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":1.214}]},{"osd":1,"last update":"Mon Jul 24 05:46:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":1.5700000000000001}]},{"osd":2,"last update":"Mon Jul 24 05:46:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.278},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.736}]},{"osd":3,"last update":"Mon Jul 24 05:46:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":7.0110000000000001,"5min":7.0110000000000001,"15min":7.0110000000000001},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.462,"5min":1.462,"15min":1.462},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":7.1669999999999998,"5min":7.1669999999999998,"15min":7.1669999999999998},"last":1.413}]},{"osd":4,"last update":"Mon Jul 24 05:46:54 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":1.778},{"interface":"front","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.3640000000000001}]},{"osd":5,"last update":"Mon Jul 24 05:46:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.631},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":1.6890000000000001}]},{"osd":6,"last update":"Mon Jul 24 05:46:54 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":1.8240000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.8740000000000001},{"interface":"front","average":{"1min":1.349,"5min":1.349,"15min":1.349},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.847}]}]},{"osd":6,"up_from":14,"seq":60129542171,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":194529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jul 24 05:46:55 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":3.246,"5min":3.246,"15min":3.246},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":2.2850000000000001,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":0.95999999999999996}]},{"osd":1,"last update":"Mon Jul 24 05:46:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.891,"5min":1.891,"15min":1.891},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":2.843,"5min":2.843,"15min":2.843},"last":0.88200000000000001}]},{"osd":2,"last update":"Mon Jul 24 05:46:55 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":3.383,"5min":3.383,"15min":3.383},"last":1.534},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":1.016,"5min":1.016,"15min":1.016},"max":{"1min":2.6669999999999998,"5min":2.6669999999999998,"15min":2.6669999999999998},"last":1.181}]},{"osd":3,"last update":"Mon Jul 24 05:46:55 2023","interfaces":[{"interface":"back","average":{"1min":1.679,"5min":1.679,"15min":1.679},"min":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"max":{"1min":6.6379999999999999,"5min":6.6379999999999999,"15min":6.6379999999999999},"last":1.125},{"interface":"front","average":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":6.375,"5min":6.375,"15min":6.375},"last":1.3740000000000001}]},{"osd":4,"last update":"Mon Jul 24 05:46:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.8740000000000001,"5min":2.8740000000000001,"15min":2.8740000000000001},"last":1.579},{"interface":"front","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":3.3239999999999998,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":1.2290000000000001}]},{"osd":5,"last update":"Mon Jul 24 05:46:55 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":3.4830000000000001,"5min":3.4830000000000001,"15min":3.4830000000000001},"last":1.673},{"interface":"front","average":{"1min":1.52,"5min":1.52,"15min":1.52},"min":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"max":{"1min":2.7509999999999999,"5min":2.7509999999999999,"15min":2.7509999999999999},"last":1.7030000000000001}]},{"osd":7,"last update":"Mon Jul 24 05:46:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.5,"15min":1.5},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":3.0870000000000002,"5min":3.0870000000000002,"15min":3.0870000000000002},"last":1.488},{"interface":"front","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":3.5379999999999998,"5min":3.5379999999999998,"15min":3.5379999999999998},"last":1.6140000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542171,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":434176,"data_stored":192566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jul 24 05:46:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.873},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.2889999999999999}]},{"osd":1,"last update":"Mon Jul 24 05:46:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":1.012}]},{"osd":2,"last update":"Mon Jul 24 05:46:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":1.165}]},{"osd":3,"last update":"Mon Jul 24 05:46:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":1.25}]},{"osd":4,"last update":"Mon Jul 24 05:46:54 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":1.5229999999999999}]},{"osd":6,"last update":"Mon Jul 24 05:46:54 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.327,"15min":1.327},"min":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.49},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.2010000000000001}]},{"osd":7,"last update":"Mon Jul 24 05:46:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.5800000000000001},{"interface":"front","average":{"1min":1.446,"5min":1.446,"15min":1.446},"min":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":1.423}]}]},{"osd":4,"up_from":14,"seq":60129542170,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":446464,"data_stored":195421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jul 24 05:46:52 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":1.228}]},{"osd":1,"last update":"Mon Jul 24 05:46:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":2.0139999999999998,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":1.27},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":2.5089999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":1.0860000000000001}]},{"osd":2,"last update":"Mon Jul 24 05:46:52 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.1890000000000001}]},{"osd":3,"last update":"Mon Jul 24 05:46:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.22,"5min":1.22,"15min":1.22},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":1.403}]},{"osd":5,"last update":"Mon Jul 24 05:46:52 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.1259999999999999,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.292,"5min":1.292,"15min":1.292},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":1.026}]},{"osd":6,"last update":"Mon Jul 24 05:46:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.2149999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":0.999},{"interface":"front","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":2.3340000000000001,"5min":2.3340000000000001,"15min":2.3340000000000001},"last":1.4430000000000001}]},{"osd":7,"last update":"Mon Jul 24 05:46:52 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"min":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"max":{"1min":3.1240000000000001,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":1.5289999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542171,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31560,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":446464,"data_stored":194495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jul 24 05:46:53 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.876},{"interface":"front","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.84499999999999997}]},{"osd":1,"last update":"Mon Jul 24 05:46:53 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.98199999999999998}]},{"osd":2,"last update":"Mon Jul 24 05:46:53 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.64600000000000002},{"interface":"front","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.80200000000000005}]},{"osd":4,"last update":"Mon Jul 24 05:46:53 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":2.262,"5min":2.262,"15min":2.262},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.373,"5min":1.373,"15min":1.373},"min":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"max":{"1min":2.198,"5min":2.198,"15min":2.198},"last":1.1060000000000001}]},{"osd":5,"last update":"Mon Jul 24 05:46:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":2.0979999999999999,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.02},{"interface":"front","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"max":{"1min":2.2970000000000002,"5min":2.2970000000000002,"15min":2.2970000000000002},"last":0.93400000000000005}]},{"osd":6,"last update":"Mon Jul 24 05:46:53 2023","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.536,"15min":1.536},"min":{"1min":1.054,"5min":1.054,"15min":1.054},"max":{"1min":2.5089999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.462,"5min":1.462,"15min":1.462},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":2.339,"5min":2.339,"15min":2.339},"last":1.143}]},{"osd":7,"last update":"Mon Jul 24 05:46:53 2023","interfaces":[{"interface":"back","average":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":2.4729999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"min":{"1min":1.198,"5min":1.198,"15min":1.198},"max":{"1min":2.444,"5min":2.444,"15min":2.444},"last":1.1639999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542170,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":434176,"data_stored":193857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jul 24 05:46:54 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":1.883},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":3.544}]},{"osd":1,"last update":"Mon Jul 24 05:46:54 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.4350000000000001},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":1.948}]},{"osd":3,"last update":"Mon Jul 24 05:46:54 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.228},{"interface":"front","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":2.5459999999999998,"5min":2.5459999999999998,"15min":2.5459999999999998},"last":1.3700000000000001}]},{"osd":4,"last update":"Mon Jul 24 05:46:54 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.0489999999999999,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":3.2709999999999999,"5min":3.2709999999999999,"15min":3.2709999999999999},"last":1.71}]},{"osd":5,"last update":"Mon Jul 24 05:46:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.8330000000000002,"5min":2.8330000000000002,"15min":2.8330000000000002},"last":3.8660000000000001},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":2.3679999999999999,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":2.9289999999999998}]},{"osd":6,"last update":"Mon Jul 24 05:46:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.998,"5min":0.998,"15min":0.998},"max":{"1min":2.5979999999999999,"5min":2.5979999999999999,"15min":2.5979999999999999},"last":1.5229999999999999},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":2.7370000000000001,"5min":2.7370000000000001,"15min":2.7370000000000001},"last":4.0170000000000003}]},{"osd":7,"last update":"Mon Jul 24 05:46:54 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":2.4849999999999999,"5min":2.4849999999999999,"15min":2.4849999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":1.028,"5min":1.028,"15min":1.028},"max":{"1min":3.3660000000000001,"5min":3.3660000000000001,"15min":3.3660000000000001},"last":5.141}]}]},{"osd":1,"up_from":14,"seq":60129542171,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":438272,"data_stored":193927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jul 24 05:46:53 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":2.335,"5min":2.335,"15min":2.335},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.2930000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.59899999999999998}]},{"osd":2,"last update":"Mon Jul 24 05:46:53 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.9930000000000001,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.419,"5min":2.419,"15min":2.419},"last":0.80600000000000005}]},{"osd":3,"last update":"Mon Jul 24 05:46:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":2.4460000000000002,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":0.68700000000000006},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":2.266,"5min":2.266,"15min":2.266},"last":0.71699999999999997}]},{"osd":4,"last update":"Mon Jul 24 05:46:53 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.373,"15min":1.373},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":2.5920000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.365,"5min":1.365,"15min":1.365},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":2.3929999999999998,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":1.248}]},{"osd":5,"last update":"Mon Jul 24 05:46:53 2023","interfaces":[{"interface":"back","average":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"min":{"1min":0.995,"5min":0.995,"15min":0.995},"max":{"1min":2.746,"5min":2.746,"15min":2.746},"last":1.075},{"interface":"front","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.6509999999999998,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":1.2010000000000001}]},{"osd":6,"last update":"Mon Jul 24 05:46:53 2023","interfaces":[{"interface":"back","average":{"1min":1.623,"5min":1.623,"15min":1.623},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":4.0129999999999999,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":1.569},{"interface":"front","average":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"min":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"max":{"1min":4.0590000000000002,"5min":4.0590000000000002,"15min":4.0590000000000002},"last":1.5089999999999999}]},{"osd":7,"last update":"Mon Jul 24 05:46:53 2023","interfaces":[{"interface":"back","average":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"min":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"max":{"1min":2.8490000000000002,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":1.26},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":2.6909999999999998,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":1.4059999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542170,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":1028096,"data_stored":782898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jul 24 05:46:52 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.83699999999999997}]},{"osd":2,"last update":"Mon Jul 24 05:46:52 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":2.8029999999999999,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":0.90700000000000003}]},{"osd":3,"last update":"Mon Jul 24 05:46:52 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.119},{"interface":"front","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":0.94299999999999995}]},{"osd":4,"last update":"Mon Jul 24 05:46:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":2.097,"5min":2.097,"15min":2.097},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.292,"5min":1.292,"15min":1.292},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.8439999999999999,"5min":2.8439999999999999,"15min":2.8439999999999999},"last":1.2609999999999999}]},{"osd":5,"last update":"Mon Jul 24 05:46:52 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":3.4249999999999998,"5min":3.4249999999999998,"15min":3.4249999999999998},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.099}]},{"osd":6,"last update":"Mon Jul 24 05:46:52 2023","interfaces":[{"interface":"back","average":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":3.2519999999999998,"5min":3.2519999999999998,"15min":3.2519999999999998},"last":1.167},{"interface":"front","average":{"1min":1.542,"5min":1.542,"15min":1.542},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":2.6520000000000001,"5min":2.6520000000000001,"15min":2.6520000000000001},"last":1.286}]},{"osd":7,"last update":"Mon Jul 24 05:46:52 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":2.5790000000000002,"5min":2.5790000000000002,"15min":2.5790000000000002},"last":1.331},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":2.7090000000000001,"5min":2.7090000000000001,"15min":2.7090000000000001},"last":1.371}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-24T05:47:55.972 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-24T05:47:56.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.172+0000 7fe3f68f2700 1 Processor -- start 2023-07-24T05:47:56.180 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.172+0000 7fe3f68f2700 1 -- start start 2023-07-24T05:47:56.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.176+0000 7fe3f68f2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fe3f00b13c0 0x7fe3f006adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:56.182 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.176+0000 7fe3f68f2700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe3f0069b10 0x7fe3f0069fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:56.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.176+0000 7fe3f68f2700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3f00702f0 con 0x7fe3f00a4580 2023-07-24T05:47:56.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.176+0000 7fe3f68f2700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3f006a500 con 0x7fe3f0069b10 2023-07-24T05:47:56.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.176+0000 7fe3f68f2700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3f00adc40 con 0x7fe3f00b13c0 2023-07-24T05:47:56.183 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.176+0000 7fe3f60f1700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fe3f0069b10 0x7fe3f0069fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:56.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.176+0000 7fe3f50ef700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7fe3f00a4580 0x7fe3f006fbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:60984/0 (socket says 172.21.15.77:60984) 2023-07-24T05:47:56.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.176+0000 7fe3f50ef700 1 -- 172.21.15.77:0/26489441 learned_addr learned my addr 172.21.15.77:0/26489441 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:56.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.176+0000 7fe3f58f0700 1 --2- 172.21.15.77:0/26489441 >> v2:172.21.15.103:3300/0 conn(0x7fe3f00b13c0 0x7fe3f006adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:56.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.176+0000 7fe3f48ee700 1 -- 172.21.15.77:0/26489441 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497180550 0 0) 0x7fe3f00702f0 con 0x7fe3f00a4580 2023-07-24T05:47:56.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.176+0000 7fe3f48ee700 1 -- 172.21.15.77:0/26489441 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3dc0035d0 con 0x7fe3f00a4580 2023-07-24T05:47:56.184 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.176+0000 7fe3f60f1700 1 -- 172.21.15.77:0/26489441 >> v2:172.21.15.103:3300/0 conn(0x7fe3f00b13c0 msgr2=0x7fe3f006adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:56.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.176+0000 7fe3f60f1700 1 --2- 172.21.15.77:0/26489441 >> v2:172.21.15.103:3300/0 conn(0x7fe3f00b13c0 0x7fe3f006adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:56.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.176+0000 7fe3f60f1700 1 -- 172.21.15.77:0/26489441 >> v1:172.21.15.77:6789/0 conn(0x7fe3f00a4580 legacy=0x7fe3f006fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:56.185 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.176+0000 7fe3f60f1700 1 -- 172.21.15.77:0/26489441 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f006b330 con 0x7fe3f0069b10 2023-07-24T05:47:56.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.176+0000 7fe3f60f1700 1 --2- 172.21.15.77:0/26489441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3f0069b10 0x7fe3f0069fc0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fe3f006f1a0 tx=0x7fe3e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4d416c2ad08422 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:56.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.176+0000 7fe3f48ee700 1 -- 172.21.15.77:0/26489441 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e800e070 con 0x7fe3f0069b10 2023-07-24T05:47:56.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.176+0000 7fe3f48ee700 1 -- 172.21.15.77:0/26489441 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e800bb20 con 0x7fe3f0069b10 2023-07-24T05:47:56.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.176+0000 7fe3f48ee700 1 -- 172.21.15.77:0/26489441 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8012430 con 0x7fe3f0069b10 2023-07-24T05:47:56.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.180+0000 7fe3f68f2700 1 -- 172.21.15.77:0/26489441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3f0069b10 msgr2=0x7fe3f0069fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:56.186 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.180+0000 7fe3f68f2700 1 --2- 172.21.15.77:0/26489441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3f0069b10 0x7fe3f0069fc0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fe3f006f1a0 tx=0x7fe3e800b330 comp rx=0 tx=0).stop 2023-07-24T05:47:56.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.180+0000 7fe3f68f2700 1 -- 172.21.15.77:0/26489441 shutdown_connections 2023-07-24T05:47:56.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.180+0000 7fe3f68f2700 1 --2- 172.21.15.77:0/26489441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3f0069b10 0x7fe3f0069fc0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:56.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.180+0000 7fe3f68f2700 1 --2- 172.21.15.77:0/26489441 >> v2:172.21.15.103:3300/0 conn(0x7fe3f00b13c0 0x7fe3f006adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:56.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.180+0000 7fe3f68f2700 1 -- 172.21.15.77:0/26489441 >> 172.21.15.77:0/26489441 conn(0x7fe3f00cacc0 msgr2=0x7fe3f00cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:56.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.180+0000 7fe3f68f2700 1 -- 172.21.15.77:0/26489441 shutdown_connections 2023-07-24T05:47:56.187 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.180+0000 7fe3f68f2700 1 -- 172.21.15.77:0/26489441 wait complete. 2023-07-24T05:47:56.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.180+0000 7fe3f68f2700 1 Processor -- start 2023-07-24T05:47:56.188 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.180+0000 7fe3f68f2700 1 -- start start 2023-07-24T05:47:56.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.184+0000 7fe3f68f2700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3f0069b10 0x7fe3f015c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:56.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.184+0000 7fe3f68f2700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3f00a4580 0x7fe3f009a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:56.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.184+0000 7fe3f68f2700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3f00b13c0 0x7fe3f00c2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:56.189 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.184+0000 7fe3f68f2700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f009aba0 con 0x7fe3f00b13c0 2023-07-24T05:47:56.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.184+0000 7fe3f68f2700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f0099910 con 0x7fe3f00a4580 2023-07-24T05:47:56.190 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.184+0000 7fe3f68f2700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f00c2cc0 con 0x7fe3f0069b10 2023-07-24T05:47:56.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.184+0000 7fe3f60f1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3f00b13c0 0x7fe3f00c2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:56.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.184+0000 7fe3f60f1700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3f00b13c0 0x7fe3f00c2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41560/0 (socket says 172.21.15.77:41560) 2023-07-24T05:47:56.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.184+0000 7fe3f60f1700 1 -- 172.21.15.77:0/1672250101 learned_addr learned my addr 172.21.15.77:0/1672250101 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:56.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.184+0000 7fe3f50ef700 1 --2- 172.21.15.77:0/1672250101 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3f00a4580 0x7fe3f009a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:56.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.184+0000 7fe3f58f0700 1 --2- 172.21.15.77:0/1672250101 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3f0069b10 0x7fe3f015c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:56.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.184+0000 7fe3f60f1700 1 -- 172.21.15.77:0/1672250101 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3f0069b10 msgr2=0x7fe3f015c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:56.191 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.184+0000 7fe3f60f1700 1 --2- 172.21.15.77:0/1672250101 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3f0069b10 0x7fe3f015c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:56.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.184+0000 7fe3f60f1700 1 -- 172.21.15.77:0/1672250101 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3f00a4580 msgr2=0x7fe3f009a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:56.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.184+0000 7fe3f60f1700 1 --2- 172.21.15.77:0/1672250101 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3f00a4580 0x7fe3f009a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:56.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.184+0000 7fe3f60f1700 1 -- 172.21.15.77:0/1672250101 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e8009a70 con 0x7fe3f00b13c0 2023-07-24T05:47:56.192 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.184+0000 7fe3f60f1700 1 --2- 172.21.15.77:0/1672250101 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3f00b13c0 0x7fe3f00c2780 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fe3f009bc20 tx=0x7fe3e8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:56.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.184+0000 7fe3e67fc700 1 -- 172.21.15.77:0/1672250101 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8012430 con 0x7fe3f00b13c0 2023-07-24T05:47:56.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.184+0000 7fe3e67fc700 1 -- 172.21.15.77:0/1672250101 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e8020070 con 0x7fe3f00b13c0 2023-07-24T05:47:56.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.184+0000 7fe3f68f2700 1 -- 172.21.15.77:0/1672250101 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3f0099b80 con 0x7fe3f00b13c0 2023-07-24T05:47:56.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.184+0000 7fe3e67fc700 1 -- 172.21.15.77:0/1672250101 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8004280 con 0x7fe3f00b13c0 2023-07-24T05:47:56.193 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.184+0000 7fe3f68f2700 1 -- 172.21.15.77:0/1672250101 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f009a140 con 0x7fe3f00b13c0 2023-07-24T05:47:56.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.188+0000 7fe3f68f2700 1 -- 172.21.15.77:0/1672250101 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3f009a360 con 0x7fe3f00b13c0 2023-07-24T05:47:56.194 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.188+0000 7fe3e67fc700 1 -- 172.21.15.77:0/1672250101 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe3e80043e0 con 0x7fe3f00b13c0 2023-07-24T05:47:56.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.192+0000 7fe3e67fc700 1 --2- 172.21.15.77:0/1672250101 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe3d40662f0 0x7fe3d40687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:56.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.192+0000 7fe3e67fc700 1 -- 172.21.15.77:0/1672250101 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe3e8022070 con 0x7fe3f00b13c0 2023-07-24T05:47:56.197 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.192+0000 7fe3f58f0700 1 --2- 172.21.15.77:0/1672250101 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe3d40662f0 0x7fe3d40687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:56.198 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.192+0000 7fe3f58f0700 1 --2- 172.21.15.77:0/1672250101 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe3d40662f0 0x7fe3d40687b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec009b80 tx=0x7fe3ec008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:56.203 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.196+0000 7fe3e67fc700 1 -- 172.21.15.77:0/1672250101 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe3e80531f0 con 0x7fe3f00b13c0 2023-07-24T05:47:56.376 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.368+0000 7fe3f68f2700 1 -- 172.21.15.77:0/1672250101 --> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe3f00ae1c0 con 0x7fe3d40662f0 2023-07-24T05:47:56.391 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.384+0000 7fe3e67fc700 1 -- 172.21.15.77:0/1672250101 <== mgr.4108 v2:172.21.15.103:6832/1305366540 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309018 (secure 0 0 0) 0x7fe3ec0117b0 con 0x7fe3d40662f0 2023-07-24T05:47:56.394 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:47:56.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.392+0000 7fe3f68f2700 1 -- 172.21.15.77:0/1672250101 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe3d40662f0 msgr2=0x7fe3d40687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:56.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.392+0000 7fe3f68f2700 1 --2- 172.21.15.77:0/1672250101 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe3d40662f0 0x7fe3d40687b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec009b80 tx=0x7fe3ec008040 comp rx=0 tx=0).stop 2023-07-24T05:47:56.398 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.392+0000 7fe3f68f2700 1 -- 172.21.15.77:0/1672250101 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3f00b13c0 msgr2=0x7fe3f00c2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:56.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.392+0000 7fe3f68f2700 1 --2- 172.21.15.77:0/1672250101 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3f00b13c0 0x7fe3f00c2780 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fe3f009bc20 tx=0x7fe3e8004af0 comp rx=0 tx=0).stop 2023-07-24T05:47:56.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.392+0000 7fe3f68f2700 1 -- 172.21.15.77:0/1672250101 shutdown_connections 2023-07-24T05:47:56.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.392+0000 7fe3f68f2700 1 --2- 172.21.15.77:0/1672250101 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe3f00b13c0 0x7fe3f00c2780 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:56.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.392+0000 7fe3f68f2700 1 --2- 172.21.15.77:0/1672250101 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3f00a4580 0x7fe3f009a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:56.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.392+0000 7fe3f68f2700 1 --2- 172.21.15.77:0/1672250101 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fe3d40662f0 0x7fe3d40687b0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:56.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.392+0000 7fe3f68f2700 1 --2- 172.21.15.77:0/1672250101 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fe3f0069b10 0x7fe3f015c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:56.399 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.392+0000 7fe3f68f2700 1 -- 172.21.15.77:0/1672250101 >> 172.21.15.77:0/1672250101 conn(0x7fe3f00cacc0 msgr2=0x7fe3f006ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:56.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.392+0000 7fe3f68f2700 1 -- 172.21.15.77:0/1672250101 shutdown_connections 2023-07-24T05:47:56.400 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.392+0000 7fe3f68f2700 1 -- 172.21.15.77:0/1672250101 wait complete. 2023-07-24T05:47:56.400 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2023-07-24T05:47:56.420 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2023-07-24T05:47:54.567876+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":157,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":233060,"kb_used_data":4588,"kb_used_omap":13,"kb_used_meta":228338,"kb_avail":754741660,"statfs":{"total":773094113280,"available":772855459840,"internally_reserved":0,"allocated":4698112,"data_stored":2730647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":233818200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.020428"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.596203+0000","last_change":"2023-07-24T05:47:51.588261+0000","last_active":"2023-07-24T05:47:51.596203+0000","last_peered":"2023-07-24T05:47:51.596203+0000","last_clean":"2023-07-24T05:47:51.596203+0000","last_became_active":"2023-07-24T05:47:51.588006+0000","last_became_peered":"2023-07-24T05:47:51.588006+0000","last_unstale":"2023-07-24T05:47:51.596203+0000","last_undegraded":"2023-07-24T05:47:51.596203+0000","last_fullsized":"2023-07-24T05:47:51.596203+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:18:11.807824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.601272+0000","last_change":"2023-07-24T05:47:51.594121+0000","last_active":"2023-07-24T05:47:51.601272+0000","last_peered":"2023-07-24T05:47:51.601272+0000","last_clean":"2023-07-24T05:47:51.601272+0000","last_became_active":"2023-07-24T05:47:51.593856+0000","last_became_peered":"2023-07-24T05:47:51.593856+0000","last_unstale":"2023-07-24T05:47:51.601272+0000","last_undegraded":"2023-07-24T05:47:51.601272+0000","last_fullsized":"2023-07-24T05:47:51.601272+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:24:59.114141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.599531+0000","last_change":"2023-07-24T05:47:51.595829+0000","last_active":"2023-07-24T05:47:51.599531+0000","last_peered":"2023-07-24T05:47:51.599531+0000","last_clean":"2023-07-24T05:47:51.599531+0000","last_became_active":"2023-07-24T05:47:51.595507+0000","last_became_peered":"2023-07-24T05:47:51.595507+0000","last_unstale":"2023-07-24T05:47:51.599531+0000","last_undegraded":"2023-07-24T05:47:51.599531+0000","last_fullsized":"2023-07-24T05:47:51.599531+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:52:14.231919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.606622+0000","last_change":"2023-07-24T05:47:51.599981+0000","last_active":"2023-07-24T05:47:51.606622+0000","last_peered":"2023-07-24T05:47:51.606622+0000","last_clean":"2023-07-24T05:47:51.606622+0000","last_became_active":"2023-07-24T05:47:51.599674+0000","last_became_peered":"2023-07-24T05:47:51.599674+0000","last_unstale":"2023-07-24T05:47:51.606622+0000","last_undegraded":"2023-07-24T05:47:51.606622+0000","last_fullsized":"2023-07-24T05:47:51.606622+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:44:20.550615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.601730+0000","last_change":"2023-07-24T05:47:51.594206+0000","last_active":"2023-07-24T05:47:51.601730+0000","last_peered":"2023-07-24T05:47:51.601730+0000","last_clean":"2023-07-24T05:47:51.601730+0000","last_became_active":"2023-07-24T05:47:51.593886+0000","last_became_peered":"2023-07-24T05:47:51.593886+0000","last_unstale":"2023-07-24T05:47:51.601730+0000","last_undegraded":"2023-07-24T05:47:51.601730+0000","last_fullsized":"2023-07-24T05:47:51.601730+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:36:27.304506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.592807+0000","last_change":"2023-07-24T05:47:51.584585+0000","last_active":"2023-07-24T05:47:51.592807+0000","last_peered":"2023-07-24T05:47:51.592807+0000","last_clean":"2023-07-24T05:47:51.592807+0000","last_became_active":"2023-07-24T05:47:51.584305+0000","last_became_peered":"2023-07-24T05:47:51.584305+0000","last_unstale":"2023-07-24T05:47:51.592807+0000","last_undegraded":"2023-07-24T05:47:51.592807+0000","last_fullsized":"2023-07-24T05:47:51.592807+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:17:26.902880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.589403+0000","last_change":"2023-07-24T05:47:51.585471+0000","last_active":"2023-07-24T05:47:51.589403+0000","last_peered":"2023-07-24T05:47:51.589403+0000","last_clean":"2023-07-24T05:47:51.589403+0000","last_became_active":"2023-07-24T05:47:51.584926+0000","last_became_peered":"2023-07-24T05:47:51.584926+0000","last_unstale":"2023-07-24T05:47:51.589403+0000","last_undegraded":"2023-07-24T05:47:51.589403+0000","last_fullsized":"2023-07-24T05:47:51.589403+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:34:03.548571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.607964+0000","last_change":"2023-07-24T05:47:51.600582+0000","last_active":"2023-07-24T05:47:51.607964+0000","last_peered":"2023-07-24T05:47:51.607964+0000","last_clean":"2023-07-24T05:47:51.607964+0000","last_became_active":"2023-07-24T05:47:51.599808+0000","last_became_peered":"2023-07-24T05:47:51.599808+0000","last_unstale":"2023-07-24T05:47:51.607964+0000","last_undegraded":"2023-07-24T05:47:51.607964+0000","last_fullsized":"2023-07-24T05:47:51.607964+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:14:10.434404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.599015+0000","last_change":"2023-07-24T05:47:51.592312+0000","last_active":"2023-07-24T05:47:51.599015+0000","last_peered":"2023-07-24T05:47:51.599015+0000","last_clean":"2023-07-24T05:47:51.599015+0000","last_became_active":"2023-07-24T05:47:51.591662+0000","last_became_peered":"2023-07-24T05:47:51.591662+0000","last_unstale":"2023-07-24T05:47:51.599015+0000","last_undegraded":"2023-07-24T05:47:51.599015+0000","last_fullsized":"2023-07-24T05:47:51.599015+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:25:30.595015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.606686+0000","last_change":"2023-07-24T05:47:51.601418+0000","last_active":"2023-07-24T05:47:51.606686+0000","last_peered":"2023-07-24T05:47:51.606686+0000","last_clean":"2023-07-24T05:47:51.606686+0000","last_became_active":"2023-07-24T05:47:51.600405+0000","last_became_peered":"2023-07-24T05:47:51.600405+0000","last_unstale":"2023-07-24T05:47:51.606686+0000","last_undegraded":"2023-07-24T05:47:51.606686+0000","last_fullsized":"2023-07-24T05:47:51.606686+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:20:57.740398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.598925+0000","last_change":"2023-07-24T05:47:51.592551+0000","last_active":"2023-07-24T05:47:51.598925+0000","last_peered":"2023-07-24T05:47:51.598925+0000","last_clean":"2023-07-24T05:47:51.598925+0000","last_became_active":"2023-07-24T05:47:51.592226+0000","last_became_peered":"2023-07-24T05:47:51.592226+0000","last_unstale":"2023-07-24T05:47:51.598925+0000","last_undegraded":"2023-07-24T05:47:51.598925+0000","last_fullsized":"2023-07-24T05:47:51.598925+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:40:31.757869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.604556+0000","last_change":"2023-07-24T05:47:51.599950+0000","last_active":"2023-07-24T05:47:51.604556+0000","last_peered":"2023-07-24T05:47:51.604556+0000","last_clean":"2023-07-24T05:47:51.604556+0000","last_became_active":"2023-07-24T05:47:51.599684+0000","last_became_peered":"2023-07-24T05:47:51.599684+0000","last_unstale":"2023-07-24T05:47:51.604556+0000","last_undegraded":"2023-07-24T05:47:51.604556+0000","last_fullsized":"2023-07-24T05:47:51.604556+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:55:52.639522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.597287+0000","last_change":"2023-07-24T05:47:51.586230+0000","last_active":"2023-07-24T05:47:51.597287+0000","last_peered":"2023-07-24T05:47:51.597287+0000","last_clean":"2023-07-24T05:47:51.597287+0000","last_became_active":"2023-07-24T05:47:51.585351+0000","last_became_peered":"2023-07-24T05:47:51.585351+0000","last_unstale":"2023-07-24T05:47:51.597287+0000","last_undegraded":"2023-07-24T05:47:51.597287+0000","last_fullsized":"2023-07-24T05:47:51.597287+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:06:52.411384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.598877+0000","last_change":"2023-07-24T05:47:51.591504+0000","last_active":"2023-07-24T05:47:51.598877+0000","last_peered":"2023-07-24T05:47:51.598877+0000","last_clean":"2023-07-24T05:47:51.598877+0000","last_became_active":"2023-07-24T05:47:51.591191+0000","last_became_peered":"2023-07-24T05:47:51.591191+0000","last_unstale":"2023-07-24T05:47:51.598877+0000","last_undegraded":"2023-07-24T05:47:51.598877+0000","last_fullsized":"2023-07-24T05:47:51.598877+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:40:57.401239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.593297+0000","last_change":"2023-07-24T05:47:51.586630+0000","last_active":"2023-07-24T05:47:51.593297+0000","last_peered":"2023-07-24T05:47:51.593297+0000","last_clean":"2023-07-24T05:47:51.593297+0000","last_became_active":"2023-07-24T05:47:51.586241+0000","last_became_peered":"2023-07-24T05:47:51.586241+0000","last_unstale":"2023-07-24T05:47:51.593297+0000","last_undegraded":"2023-07-24T05:47:51.593297+0000","last_fullsized":"2023-07-24T05:47:51.593297+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:46:13.195434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.604461+0000","last_change":"2023-07-24T05:47:51.596516+0000","last_active":"2023-07-24T05:47:51.604461+0000","last_peered":"2023-07-24T05:47:51.604461+0000","last_clean":"2023-07-24T05:47:51.604461+0000","last_became_active":"2023-07-24T05:47:51.588054+0000","last_became_peered":"2023-07-24T05:47:51.588054+0000","last_unstale":"2023-07-24T05:47:51.604461+0000","last_undegraded":"2023-07-24T05:47:51.604461+0000","last_fullsized":"2023-07-24T05:47:51.604461+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:08:45.132266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.590818+0000","last_change":"2023-07-24T05:47:51.588100+0000","last_active":"2023-07-24T05:47:51.590818+0000","last_peered":"2023-07-24T05:47:51.590818+0000","last_clean":"2023-07-24T05:47:51.590818+0000","last_became_active":"2023-07-24T05:47:51.587843+0000","last_became_peered":"2023-07-24T05:47:51.587843+0000","last_unstale":"2023-07-24T05:47:51.590818+0000","last_undegraded":"2023-07-24T05:47:51.590818+0000","last_fullsized":"2023-07-24T05:47:51.590818+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:46:48.587048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.597444+0000","last_change":"2023-07-24T05:47:51.593535+0000","last_active":"2023-07-24T05:47:51.597444+0000","last_peered":"2023-07-24T05:47:51.597444+0000","last_clean":"2023-07-24T05:47:51.597444+0000","last_became_active":"2023-07-24T05:47:51.593263+0000","last_became_peered":"2023-07-24T05:47:51.593263+0000","last_unstale":"2023-07-24T05:47:51.597444+0000","last_undegraded":"2023-07-24T05:47:51.597444+0000","last_fullsized":"2023-07-24T05:47:51.597444+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:51:42.404101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.604497+0000","last_change":"2023-07-24T05:47:51.595066+0000","last_active":"2023-07-24T05:47:51.604497+0000","last_peered":"2023-07-24T05:47:51.604497+0000","last_clean":"2023-07-24T05:47:51.604497+0000","last_became_active":"2023-07-24T05:47:51.594740+0000","last_became_peered":"2023-07-24T05:47:51.594740+0000","last_unstale":"2023-07-24T05:47:51.604497+0000","last_undegraded":"2023-07-24T05:47:51.604497+0000","last_fullsized":"2023-07-24T05:47:51.604497+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:12:40.447549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.597482+0000","last_change":"2023-07-24T05:47:51.588119+0000","last_active":"2023-07-24T05:47:51.597482+0000","last_peered":"2023-07-24T05:47:51.597482+0000","last_clean":"2023-07-24T05:47:51.597482+0000","last_became_active":"2023-07-24T05:47:51.587837+0000","last_became_peered":"2023-07-24T05:47:51.587837+0000","last_unstale":"2023-07-24T05:47:51.597482+0000","last_undegraded":"2023-07-24T05:47:51.597482+0000","last_fullsized":"2023-07-24T05:47:51.597482+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T16:14:36.789555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.607079+0000","last_change":"2023-07-24T05:47:51.602398+0000","last_active":"2023-07-24T05:47:51.607079+0000","last_peered":"2023-07-24T05:47:51.607079+0000","last_clean":"2023-07-24T05:47:51.607079+0000","last_became_active":"2023-07-24T05:47:51.602022+0000","last_became_peered":"2023-07-24T05:47:51.602022+0000","last_unstale":"2023-07-24T05:47:51.607079+0000","last_undegraded":"2023-07-24T05:47:51.607079+0000","last_fullsized":"2023-07-24T05:47:51.607079+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:23:07.103895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.606733+0000","last_change":"2023-07-24T05:47:51.602473+0000","last_active":"2023-07-24T05:47:51.606733+0000","last_peered":"2023-07-24T05:47:51.606733+0000","last_clean":"2023-07-24T05:47:51.606733+0000","last_became_active":"2023-07-24T05:47:51.602149+0000","last_became_peered":"2023-07-24T05:47:51.602149+0000","last_unstale":"2023-07-24T05:47:51.606733+0000","last_undegraded":"2023-07-24T05:47:51.606733+0000","last_fullsized":"2023-07-24T05:47:51.606733+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:05:12.409583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.600789+0000","last_change":"2023-07-24T05:47:51.585191+0000","last_active":"2023-07-24T05:47:51.600789+0000","last_peered":"2023-07-24T05:47:51.600789+0000","last_clean":"2023-07-24T05:47:51.600789+0000","last_became_active":"2023-07-24T05:47:51.584826+0000","last_became_peered":"2023-07-24T05:47:51.584826+0000","last_unstale":"2023-07-24T05:47:51.600789+0000","last_undegraded":"2023-07-24T05:47:51.600789+0000","last_fullsized":"2023-07-24T05:47:51.600789+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:08:04.091964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.603777+0000","last_change":"2023-07-24T05:47:51.586369+0000","last_active":"2023-07-24T05:47:51.603777+0000","last_peered":"2023-07-24T05:47:51.603777+0000","last_clean":"2023-07-24T05:47:51.603777+0000","last_became_active":"2023-07-24T05:47:51.586095+0000","last_became_peered":"2023-07-24T05:47:51.586095+0000","last_unstale":"2023-07-24T05:47:51.603777+0000","last_undegraded":"2023-07-24T05:47:51.603777+0000","last_fullsized":"2023-07-24T05:47:51.603777+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:53:20.147093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.603915+0000","last_change":"2023-07-24T05:47:51.594160+0000","last_active":"2023-07-24T05:47:51.603915+0000","last_peered":"2023-07-24T05:47:51.603915+0000","last_clean":"2023-07-24T05:47:51.603915+0000","last_became_active":"2023-07-24T05:47:51.593894+0000","last_became_peered":"2023-07-24T05:47:51.593894+0000","last_unstale":"2023-07-24T05:47:51.603915+0000","last_undegraded":"2023-07-24T05:47:51.603915+0000","last_fullsized":"2023-07-24T05:47:51.603915+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:32:18.300646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.593480+0000","last_change":"2023-07-24T05:47:51.583289+0000","last_active":"2023-07-24T05:47:51.593480+0000","last_peered":"2023-07-24T05:47:51.593480+0000","last_clean":"2023-07-24T05:47:51.593480+0000","last_became_active":"2023-07-24T05:47:51.582965+0000","last_became_peered":"2023-07-24T05:47:51.582965+0000","last_unstale":"2023-07-24T05:47:51.593480+0000","last_undegraded":"2023-07-24T05:47:51.593480+0000","last_fullsized":"2023-07-24T05:47:51.593480+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:05:48.355600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.589189+0000","last_change":"2023-07-24T05:47:51.584997+0000","last_active":"2023-07-24T05:47:51.589189+0000","last_peered":"2023-07-24T05:47:51.589189+0000","last_clean":"2023-07-24T05:47:51.589189+0000","last_became_active":"2023-07-24T05:47:51.584723+0000","last_became_peered":"2023-07-24T05:47:51.584723+0000","last_unstale":"2023-07-24T05:47:51.589189+0000","last_undegraded":"2023-07-24T05:47:51.589189+0000","last_fullsized":"2023-07-24T05:47:51.589189+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:30:50.817095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.604537+0000","last_change":"2023-07-24T05:47:51.599892+0000","last_active":"2023-07-24T05:47:51.604537+0000","last_peered":"2023-07-24T05:47:51.604537+0000","last_clean":"2023-07-24T05:47:51.604537+0000","last_became_active":"2023-07-24T05:47:51.599586+0000","last_became_peered":"2023-07-24T05:47:51.599586+0000","last_unstale":"2023-07-24T05:47:51.604537+0000","last_undegraded":"2023-07-24T05:47:51.604537+0000","last_fullsized":"2023-07-24T05:47:51.604537+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:39:01.003716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.605157+0000","last_change":"2023-07-24T05:47:51.595197+0000","last_active":"2023-07-24T05:47:51.605157+0000","last_peered":"2023-07-24T05:47:51.605157+0000","last_clean":"2023-07-24T05:47:51.605157+0000","last_became_active":"2023-07-24T05:47:51.594896+0000","last_became_peered":"2023-07-24T05:47:51.594896+0000","last_unstale":"2023-07-24T05:47:51.605157+0000","last_undegraded":"2023-07-24T05:47:51.605157+0000","last_fullsized":"2023-07-24T05:47:51.605157+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:17:27.569460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.589257+0000","last_change":"2023-07-24T05:47:51.586638+0000","last_active":"2023-07-24T05:47:51.589257+0000","last_peered":"2023-07-24T05:47:51.589257+0000","last_clean":"2023-07-24T05:47:51.589257+0000","last_became_active":"2023-07-24T05:47:51.586375+0000","last_became_peered":"2023-07-24T05:47:51.586375+0000","last_unstale":"2023-07-24T05:47:51.589257+0000","last_undegraded":"2023-07-24T05:47:51.589257+0000","last_fullsized":"2023-07-24T05:47:51.589257+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:27:40.424486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.592708+0000","last_change":"2023-07-24T05:47:51.583267+0000","last_active":"2023-07-24T05:47:51.592708+0000","last_peered":"2023-07-24T05:47:51.592708+0000","last_clean":"2023-07-24T05:47:51.592708+0000","last_became_active":"2023-07-24T05:47:51.582953+0000","last_became_peered":"2023-07-24T05:47:51.582953+0000","last_unstale":"2023-07-24T05:47:51.592708+0000","last_undegraded":"2023-07-24T05:47:51.592708+0000","last_fullsized":"2023-07-24T05:47:51.592708+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:18:06.510996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.597309+0000","last_change":"2023-07-24T05:47:51.585906+0000","last_active":"2023-07-24T05:47:51.597309+0000","last_peered":"2023-07-24T05:47:51.597309+0000","last_clean":"2023-07-24T05:47:51.597309+0000","last_became_active":"2023-07-24T05:47:51.585631+0000","last_became_peered":"2023-07-24T05:47:51.585631+0000","last_unstale":"2023-07-24T05:47:51.597309+0000","last_undegraded":"2023-07-24T05:47:51.597309+0000","last_fullsized":"2023-07-24T05:47:51.597309+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:29:49.872609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.599423+0000","last_change":"2023-07-24T05:47:51.593786+0000","last_active":"2023-07-24T05:47:51.599423+0000","last_peered":"2023-07-24T05:47:51.599423+0000","last_clean":"2023-07-24T05:47:51.599423+0000","last_became_active":"2023-07-24T05:47:51.593518+0000","last_became_peered":"2023-07-24T05:47:51.593518+0000","last_unstale":"2023-07-24T05:47:51.599423+0000","last_undegraded":"2023-07-24T05:47:51.599423+0000","last_fullsized":"2023-07-24T05:47:51.599423+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:38:19.669163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"38'4","reported_seq":15,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.611834+0000","last_change":"2023-07-24T05:47:50.577431+0000","last_active":"2023-07-24T05:47:51.611834+0000","last_peered":"2023-07-24T05:47:51.611834+0000","last_clean":"2023-07-24T05:47:51.611834+0000","last_became_active":"2023-07-24T05:47:50.577117+0000","last_became_peered":"2023-07-24T05:47:50.577117+0000","last_unstale":"2023-07-24T05:47:51.611834+0000","last_undegraded":"2023-07-24T05:47:51.611834+0000","last_fullsized":"2023-07-24T05:47:51.611834+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:15:25.167039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.603633+0000","last_change":"2023-07-24T05:47:51.586693+0000","last_active":"2023-07-24T05:47:51.603633+0000","last_peered":"2023-07-24T05:47:51.603633+0000","last_clean":"2023-07-24T05:47:51.603633+0000","last_became_active":"2023-07-24T05:47:51.586382+0000","last_became_peered":"2023-07-24T05:47:51.586382+0000","last_unstale":"2023-07-24T05:47:51.603633+0000","last_undegraded":"2023-07-24T05:47:51.603633+0000","last_fullsized":"2023-07-24T05:47:51.603633+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:13:27.443554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.612402+0000","last_change":"2023-07-24T05:47:50.580407+0000","last_active":"2023-07-24T05:47:51.612402+0000","last_peered":"2023-07-24T05:47:51.612402+0000","last_clean":"2023-07-24T05:47:51.612402+0000","last_became_active":"2023-07-24T05:47:50.580018+0000","last_became_peered":"2023-07-24T05:47:50.580018+0000","last_unstale":"2023-07-24T05:47:51.612402+0000","last_undegraded":"2023-07-24T05:47:51.612402+0000","last_fullsized":"2023-07-24T05:47:51.612402+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:00:39.435428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.593684+0000","last_change":"2023-07-24T05:47:51.587299+0000","last_active":"2023-07-24T05:47:51.593684+0000","last_peered":"2023-07-24T05:47:51.593684+0000","last_clean":"2023-07-24T05:47:51.593684+0000","last_became_active":"2023-07-24T05:47:51.587036+0000","last_became_peered":"2023-07-24T05:47:51.587036+0000","last_unstale":"2023-07-24T05:47:51.593684+0000","last_undegraded":"2023-07-24T05:47:51.593684+0000","last_fullsized":"2023-07-24T05:47:51.593684+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:49:01.002220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.612635+0000","last_change":"2023-07-24T05:47:50.580453+0000","last_active":"2023-07-24T05:47:51.612635+0000","last_peered":"2023-07-24T05:47:51.612635+0000","last_clean":"2023-07-24T05:47:51.612635+0000","last_became_active":"2023-07-24T05:47:50.580119+0000","last_became_peered":"2023-07-24T05:47:50.580119+0000","last_unstale":"2023-07-24T05:47:51.612635+0000","last_undegraded":"2023-07-24T05:47:51.612635+0000","last_fullsized":"2023-07-24T05:47:51.612635+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:07:07.038286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.603500+0000","last_change":"2023-07-24T05:47:51.601668+0000","last_active":"2023-07-24T05:47:51.603500+0000","last_peered":"2023-07-24T05:47:51.603500+0000","last_clean":"2023-07-24T05:47:51.603500+0000","last_became_active":"2023-07-24T05:47:51.601381+0000","last_became_peered":"2023-07-24T05:47:51.601381+0000","last_unstale":"2023-07-24T05:47:51.603500+0000","last_undegraded":"2023-07-24T05:47:51.603500+0000","last_fullsized":"2023-07-24T05:47:51.603500+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:47:44.340903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.613734+0000","last_change":"2023-07-24T05:47:50.580139+0000","last_active":"2023-07-24T05:47:51.613734+0000","last_peered":"2023-07-24T05:47:51.613734+0000","last_clean":"2023-07-24T05:47:51.613734+0000","last_became_active":"2023-07-24T05:47:50.579854+0000","last_became_peered":"2023-07-24T05:47:50.579854+0000","last_unstale":"2023-07-24T05:47:51.613734+0000","last_undegraded":"2023-07-24T05:47:51.613734+0000","last_fullsized":"2023-07-24T05:47:51.613734+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:02:24.728623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.605996+0000","last_change":"2023-07-24T05:47:51.601501+0000","last_active":"2023-07-24T05:47:51.605996+0000","last_peered":"2023-07-24T05:47:51.605996+0000","last_clean":"2023-07-24T05:47:51.605996+0000","last_became_active":"2023-07-24T05:47:51.601178+0000","last_became_peered":"2023-07-24T05:47:51.601178+0000","last_unstale":"2023-07-24T05:47:51.605996+0000","last_undegraded":"2023-07-24T05:47:51.605996+0000","last_fullsized":"2023-07-24T05:47:51.605996+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:20:34.149258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.613917+0000","last_change":"2023-07-24T05:47:50.576327+0000","last_active":"2023-07-24T05:47:51.613917+0000","last_peered":"2023-07-24T05:47:51.613917+0000","last_clean":"2023-07-24T05:47:51.613917+0000","last_became_active":"2023-07-24T05:47:50.575861+0000","last_became_peered":"2023-07-24T05:47:50.575861+0000","last_unstale":"2023-07-24T05:47:51.613917+0000","last_undegraded":"2023-07-24T05:47:51.613917+0000","last_fullsized":"2023-07-24T05:47:51.613917+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:07:55.027634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.603416+0000","last_change":"2023-07-24T05:47:51.598249+0000","last_active":"2023-07-24T05:47:51.603416+0000","last_peered":"2023-07-24T05:47:51.603416+0000","last_clean":"2023-07-24T05:47:51.603416+0000","last_became_active":"2023-07-24T05:47:51.597872+0000","last_became_peered":"2023-07-24T05:47:51.597872+0000","last_unstale":"2023-07-24T05:47:51.603416+0000","last_undegraded":"2023-07-24T05:47:51.603416+0000","last_fullsized":"2023-07-24T05:47:51.603416+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:29:45.253895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.613459+0000","last_change":"2023-07-24T05:47:50.582153+0000","last_active":"2023-07-24T05:47:51.613459+0000","last_peered":"2023-07-24T05:47:51.613459+0000","last_clean":"2023-07-24T05:47:51.613459+0000","last_became_active":"2023-07-24T05:47:50.581801+0000","last_became_peered":"2023-07-24T05:47:50.581801+0000","last_unstale":"2023-07-24T05:47:51.613459+0000","last_undegraded":"2023-07-24T05:47:51.613459+0000","last_fullsized":"2023-07-24T05:47:51.613459+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:51:04.751797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.607987+0000","last_change":"2023-07-24T05:47:51.600765+0000","last_active":"2023-07-24T05:47:51.607987+0000","last_peered":"2023-07-24T05:47:51.607987+0000","last_clean":"2023-07-24T05:47:51.607987+0000","last_became_active":"2023-07-24T05:47:51.600228+0000","last_became_peered":"2023-07-24T05:47:51.600228+0000","last_unstale":"2023-07-24T05:47:51.607987+0000","last_undegraded":"2023-07-24T05:47:51.607987+0000","last_fullsized":"2023-07-24T05:47:51.607987+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T16:14:07.922744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.579662+0000","last_change":"2023-07-24T05:47:50.577821+0000","last_active":"2023-07-24T05:47:51.579662+0000","last_peered":"2023-07-24T05:47:51.579662+0000","last_clean":"2023-07-24T05:47:51.579662+0000","last_became_active":"2023-07-24T05:47:50.577557+0000","last_became_peered":"2023-07-24T05:47:50.577557+0000","last_unstale":"2023-07-24T05:47:51.579662+0000","last_undegraded":"2023-07-24T05:47:51.579662+0000","last_fullsized":"2023-07-24T05:47:51.579662+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:27:24.332325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.600808+0000","last_change":"2023-07-24T05:47:51.585653+0000","last_active":"2023-07-24T05:47:51.600808+0000","last_peered":"2023-07-24T05:47:51.600808+0000","last_clean":"2023-07-24T05:47:51.600808+0000","last_became_active":"2023-07-24T05:47:51.585364+0000","last_became_peered":"2023-07-24T05:47:51.585364+0000","last_unstale":"2023-07-24T05:47:51.600808+0000","last_undegraded":"2023-07-24T05:47:51.600808+0000","last_fullsized":"2023-07-24T05:47:51.600808+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:31:00.650267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.575027+0000","last_change":"2023-07-24T05:47:50.583513+0000","last_active":"2023-07-24T05:47:51.575027+0000","last_peered":"2023-07-24T05:47:51.575027+0000","last_clean":"2023-07-24T05:47:51.575027+0000","last_became_active":"2023-07-24T05:47:50.583246+0000","last_became_peered":"2023-07-24T05:47:50.583246+0000","last_unstale":"2023-07-24T05:47:51.575027+0000","last_undegraded":"2023-07-24T05:47:51.575027+0000","last_fullsized":"2023-07-24T05:47:51.575027+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:33:03.411036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.597425+0000","last_change":"2023-07-24T05:47:51.593170+0000","last_active":"2023-07-24T05:47:51.597425+0000","last_peered":"2023-07-24T05:47:51.597425+0000","last_clean":"2023-07-24T05:47:51.597425+0000","last_became_active":"2023-07-24T05:47:51.592921+0000","last_became_peered":"2023-07-24T05:47:51.592921+0000","last_unstale":"2023-07-24T05:47:51.597425+0000","last_undegraded":"2023-07-24T05:47:51.597425+0000","last_fullsized":"2023-07-24T05:47:51.597425+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:57:33.672718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.581231+0000","last_change":"2023-07-24T05:47:50.577427+0000","last_active":"2023-07-24T05:47:51.581231+0000","last_peered":"2023-07-24T05:47:51.581231+0000","last_clean":"2023-07-24T05:47:51.581231+0000","last_became_active":"2023-07-24T05:47:50.576898+0000","last_became_peered":"2023-07-24T05:47:50.576898+0000","last_unstale":"2023-07-24T05:47:51.581231+0000","last_undegraded":"2023-07-24T05:47:51.581231+0000","last_fullsized":"2023-07-24T05:47:51.581231+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:55:40.256829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.589382+0000","last_change":"2023-07-24T05:47:51.586124+0000","last_active":"2023-07-24T05:47:51.589382+0000","last_peered":"2023-07-24T05:47:51.589382+0000","last_clean":"2023-07-24T05:47:51.589382+0000","last_became_active":"2023-07-24T05:47:51.584348+0000","last_became_peered":"2023-07-24T05:47:51.584348+0000","last_unstale":"2023-07-24T05:47:51.589382+0000","last_undegraded":"2023-07-24T05:47:51.589382+0000","last_fullsized":"2023-07-24T05:47:51.589382+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:39:45.936856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.578952+0000","last_change":"2023-07-24T05:47:50.585942+0000","last_active":"2023-07-24T05:47:51.578952+0000","last_peered":"2023-07-24T05:47:51.578952+0000","last_clean":"2023-07-24T05:47:51.578952+0000","last_became_active":"2023-07-24T05:47:50.585706+0000","last_became_peered":"2023-07-24T05:47:50.585706+0000","last_unstale":"2023-07-24T05:47:51.578952+0000","last_undegraded":"2023-07-24T05:47:51.578952+0000","last_fullsized":"2023-07-24T05:47:51.578952+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T16:05:38.026572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.598445+0000","last_change":"2023-07-24T05:47:51.594973+0000","last_active":"2023-07-24T05:47:51.598445+0000","last_peered":"2023-07-24T05:47:51.598445+0000","last_clean":"2023-07-24T05:47:51.598445+0000","last_became_active":"2023-07-24T05:47:51.594663+0000","last_became_peered":"2023-07-24T05:47:51.594663+0000","last_unstale":"2023-07-24T05:47:51.598445+0000","last_undegraded":"2023-07-24T05:47:51.598445+0000","last_fullsized":"2023-07-24T05:47:51.598445+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:01:49.877147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"38'3","reported_seq":14,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.612725+0000","last_change":"2023-07-24T05:47:50.579602+0000","last_active":"2023-07-24T05:47:51.612725+0000","last_peered":"2023-07-24T05:47:51.612725+0000","last_clean":"2023-07-24T05:47:51.612725+0000","last_became_active":"2023-07-24T05:47:50.579321+0000","last_became_peered":"2023-07-24T05:47:50.579321+0000","last_unstale":"2023-07-24T05:47:51.612725+0000","last_undegraded":"2023-07-24T05:47:51.612725+0000","last_fullsized":"2023-07-24T05:47:51.612725+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:26:38.943328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.600155+0000","last_change":"2023-07-24T05:47:51.593310+0000","last_active":"2023-07-24T05:47:51.600155+0000","last_peered":"2023-07-24T05:47:51.600155+0000","last_clean":"2023-07-24T05:47:51.600155+0000","last_became_active":"2023-07-24T05:47:51.593021+0000","last_became_peered":"2023-07-24T05:47:51.593021+0000","last_unstale":"2023-07-24T05:47:51.600155+0000","last_undegraded":"2023-07-24T05:47:51.600155+0000","last_fullsized":"2023-07-24T05:47:51.600155+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:02:15.109934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"38'6","reported_seq":17,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.615680+0000","last_change":"2023-07-24T05:47:50.576672+0000","last_active":"2023-07-24T05:47:51.615680+0000","last_peered":"2023-07-24T05:47:51.615680+0000","last_clean":"2023-07-24T05:47:51.615680+0000","last_became_active":"2023-07-24T05:47:50.576352+0000","last_became_peered":"2023-07-24T05:47:50.576352+0000","last_unstale":"2023-07-24T05:47:51.615680+0000","last_undegraded":"2023-07-24T05:47:51.615680+0000","last_fullsized":"2023-07-24T05:47:51.615680+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:32:02.324284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.600755+0000","last_change":"2023-07-24T05:47:51.582147+0000","last_active":"2023-07-24T05:47:51.600755+0000","last_peered":"2023-07-24T05:47:51.600755+0000","last_clean":"2023-07-24T05:47:51.600755+0000","last_became_active":"2023-07-24T05:47:51.581875+0000","last_became_peered":"2023-07-24T05:47:51.581875+0000","last_unstale":"2023-07-24T05:47:51.600755+0000","last_undegraded":"2023-07-24T05:47:51.600755+0000","last_fullsized":"2023-07-24T05:47:51.600755+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:06:07.268812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.612308+0000","last_change":"2023-07-24T05:47:50.588278+0000","last_active":"2023-07-24T05:47:51.612308+0000","last_peered":"2023-07-24T05:47:51.612308+0000","last_clean":"2023-07-24T05:47:51.612308+0000","last_became_active":"2023-07-24T05:47:50.587983+0000","last_became_peered":"2023-07-24T05:47:50.587983+0000","last_unstale":"2023-07-24T05:47:51.612308+0000","last_undegraded":"2023-07-24T05:47:51.612308+0000","last_fullsized":"2023-07-24T05:47:51.612308+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T08:05:18.856965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.591990+0000","last_change":"2023-07-24T05:47:51.585004+0000","last_active":"2023-07-24T05:47:51.591990+0000","last_peered":"2023-07-24T05:47:51.591990+0000","last_clean":"2023-07-24T05:47:51.591990+0000","last_became_active":"2023-07-24T05:47:51.584738+0000","last_became_peered":"2023-07-24T05:47:51.584738+0000","last_unstale":"2023-07-24T05:47:51.591990+0000","last_undegraded":"2023-07-24T05:47:51.591990+0000","last_fullsized":"2023-07-24T05:47:51.591990+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:19:43.860556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.572463+0000","last_change":"2023-07-24T05:47:50.581538+0000","last_active":"2023-07-24T05:47:51.572463+0000","last_peered":"2023-07-24T05:47:51.572463+0000","last_clean":"2023-07-24T05:47:51.572463+0000","last_became_active":"2023-07-24T05:47:50.581281+0000","last_became_peered":"2023-07-24T05:47:50.581281+0000","last_unstale":"2023-07-24T05:47:51.572463+0000","last_undegraded":"2023-07-24T05:47:51.572463+0000","last_fullsized":"2023-07-24T05:47:51.572463+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:22:39.293540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.592944+0000","last_change":"2023-07-24T05:47:51.587516+0000","last_active":"2023-07-24T05:47:51.592944+0000","last_peered":"2023-07-24T05:47:51.592944+0000","last_clean":"2023-07-24T05:47:51.592944+0000","last_became_active":"2023-07-24T05:47:51.586715+0000","last_became_peered":"2023-07-24T05:47:51.586715+0000","last_unstale":"2023-07-24T05:47:51.592944+0000","last_undegraded":"2023-07-24T05:47:51.592944+0000","last_fullsized":"2023-07-24T05:47:51.592944+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T16:49:06.292192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.573296+0000","last_change":"2023-07-24T05:47:50.589972+0000","last_active":"2023-07-24T05:47:51.573296+0000","last_peered":"2023-07-24T05:47:51.573296+0000","last_clean":"2023-07-24T05:47:51.573296+0000","last_became_active":"2023-07-24T05:47:50.589711+0000","last_became_peered":"2023-07-24T05:47:50.589711+0000","last_unstale":"2023-07-24T05:47:51.573296+0000","last_undegraded":"2023-07-24T05:47:51.573296+0000","last_fullsized":"2023-07-24T05:47:51.573296+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:35:31.179438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.589418+0000","last_change":"2023-07-24T05:47:51.586070+0000","last_active":"2023-07-24T05:47:51.589418+0000","last_peered":"2023-07-24T05:47:51.589418+0000","last_clean":"2023-07-24T05:47:51.589418+0000","last_became_active":"2023-07-24T05:47:51.585813+0000","last_became_peered":"2023-07-24T05:47:51.585813+0000","last_unstale":"2023-07-24T05:47:51.589418+0000","last_undegraded":"2023-07-24T05:47:51.589418+0000","last_fullsized":"2023-07-24T05:47:51.589418+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:21:11.019118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"38'8","reported_seq":19,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.614535+0000","last_change":"2023-07-24T05:47:50.583366+0000","last_active":"2023-07-24T05:47:51.614535+0000","last_peered":"2023-07-24T05:47:51.614535+0000","last_clean":"2023-07-24T05:47:51.614535+0000","last_became_active":"2023-07-24T05:47:50.583037+0000","last_became_peered":"2023-07-24T05:47:50.583037+0000","last_unstale":"2023-07-24T05:47:51.614535+0000","last_undegraded":"2023-07-24T05:47:51.614535+0000","last_fullsized":"2023-07-24T05:47:51.614535+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:52:50.123352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.597375+0000","last_change":"2023-07-24T05:47:51.590311+0000","last_active":"2023-07-24T05:47:51.597375+0000","last_peered":"2023-07-24T05:47:51.597375+0000","last_clean":"2023-07-24T05:47:51.597375+0000","last_became_active":"2023-07-24T05:47:51.589978+0000","last_became_peered":"2023-07-24T05:47:51.589978+0000","last_unstale":"2023-07-24T05:47:51.597375+0000","last_undegraded":"2023-07-24T05:47:51.597375+0000","last_fullsized":"2023-07-24T05:47:51.597375+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:09:48.930487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.611394+0000","last_change":"2023-07-24T05:47:50.576579+0000","last_active":"2023-07-24T05:47:51.611394+0000","last_peered":"2023-07-24T05:47:51.611394+0000","last_clean":"2023-07-24T05:47:51.611394+0000","last_became_active":"2023-07-24T05:47:50.576116+0000","last_became_peered":"2023-07-24T05:47:50.576116+0000","last_unstale":"2023-07-24T05:47:51.611394+0000","last_undegraded":"2023-07-24T05:47:51.611394+0000","last_fullsized":"2023-07-24T05:47:51.611394+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T16:42:18.164629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.598996+0000","last_change":"2023-07-24T05:47:51.592078+0000","last_active":"2023-07-24T05:47:51.598996+0000","last_peered":"2023-07-24T05:47:51.598996+0000","last_clean":"2023-07-24T05:47:51.598996+0000","last_became_active":"2023-07-24T05:47:51.591256+0000","last_became_peered":"2023-07-24T05:47:51.591256+0000","last_unstale":"2023-07-24T05:47:51.598996+0000","last_undegraded":"2023-07-24T05:47:51.598996+0000","last_fullsized":"2023-07-24T05:47:51.598996+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:36:00.932269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.611030+0000","last_change":"2023-07-24T05:47:50.580248+0000","last_active":"2023-07-24T05:47:51.611030+0000","last_peered":"2023-07-24T05:47:51.611030+0000","last_clean":"2023-07-24T05:47:51.611030+0000","last_became_active":"2023-07-24T05:47:50.579738+0000","last_became_peered":"2023-07-24T05:47:50.579738+0000","last_unstale":"2023-07-24T05:47:51.611030+0000","last_undegraded":"2023-07-24T05:47:51.611030+0000","last_fullsized":"2023-07-24T05:47:51.611030+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:59:11.297736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.600682+0000","last_change":"2023-07-24T05:47:51.584499+0000","last_active":"2023-07-24T05:47:51.600682+0000","last_peered":"2023-07-24T05:47:51.600682+0000","last_clean":"2023-07-24T05:47:51.600682+0000","last_became_active":"2023-07-24T05:47:51.584222+0000","last_became_peered":"2023-07-24T05:47:51.584222+0000","last_unstale":"2023-07-24T05:47:51.600682+0000","last_undegraded":"2023-07-24T05:47:51.600682+0000","last_fullsized":"2023-07-24T05:47:51.600682+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:02:25.283944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.613065+0000","last_change":"2023-07-24T05:47:50.581681+0000","last_active":"2023-07-24T05:47:51.613065+0000","last_peered":"2023-07-24T05:47:51.613065+0000","last_clean":"2023-07-24T05:47:51.613065+0000","last_became_active":"2023-07-24T05:47:50.581434+0000","last_became_peered":"2023-07-24T05:47:50.581434+0000","last_unstale":"2023-07-24T05:47:51.613065+0000","last_undegraded":"2023-07-24T05:47:51.613065+0000","last_fullsized":"2023-07-24T05:47:51.613065+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:11:14.998636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.604478+0000","last_change":"2023-07-24T05:47:51.593763+0000","last_active":"2023-07-24T05:47:51.604478+0000","last_peered":"2023-07-24T05:47:51.604478+0000","last_clean":"2023-07-24T05:47:51.604478+0000","last_became_active":"2023-07-24T05:47:51.593421+0000","last_became_peered":"2023-07-24T05:47:51.593421+0000","last_unstale":"2023-07-24T05:47:51.604478+0000","last_undegraded":"2023-07-24T05:47:51.604478+0000","last_fullsized":"2023-07-24T05:47:51.604478+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:46:27.678439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.575314+0000","last_change":"2023-07-24T05:47:50.580193+0000","last_active":"2023-07-24T05:47:51.575314+0000","last_peered":"2023-07-24T05:47:51.575314+0000","last_clean":"2023-07-24T05:47:51.575314+0000","last_became_active":"2023-07-24T05:47:50.579903+0000","last_became_peered":"2023-07-24T05:47:50.579903+0000","last_unstale":"2023-07-24T05:47:51.575314+0000","last_undegraded":"2023-07-24T05:47:51.575314+0000","last_fullsized":"2023-07-24T05:47:51.575314+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T16:12:37.644111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.598520+0000","last_change":"2023-07-24T05:47:51.595666+0000","last_active":"2023-07-24T05:47:51.598520+0000","last_peered":"2023-07-24T05:47:51.598520+0000","last_clean":"2023-07-24T05:47:51.598520+0000","last_became_active":"2023-07-24T05:47:51.595343+0000","last_became_peered":"2023-07-24T05:47:51.595343+0000","last_unstale":"2023-07-24T05:47:51.598520+0000","last_undegraded":"2023-07-24T05:47:51.598520+0000","last_fullsized":"2023-07-24T05:47:51.598520+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:01:02.898420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.614001+0000","last_change":"2023-07-24T05:47:50.578792+0000","last_active":"2023-07-24T05:47:51.614001+0000","last_peered":"2023-07-24T05:47:51.614001+0000","last_clean":"2023-07-24T05:47:51.614001+0000","last_became_active":"2023-07-24T05:47:50.578501+0000","last_became_peered":"2023-07-24T05:47:50.578501+0000","last_unstale":"2023-07-24T05:47:51.614001+0000","last_undegraded":"2023-07-24T05:47:51.614001+0000","last_fullsized":"2023-07-24T05:47:51.614001+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:09:21.279371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.596691+0000","last_change":"2023-07-24T05:47:51.587438+0000","last_active":"2023-07-24T05:47:51.596691+0000","last_peered":"2023-07-24T05:47:51.596691+0000","last_clean":"2023-07-24T05:47:51.596691+0000","last_became_active":"2023-07-24T05:47:51.587095+0000","last_became_peered":"2023-07-24T05:47:51.587095+0000","last_unstale":"2023-07-24T05:47:51.596691+0000","last_undegraded":"2023-07-24T05:47:51.596691+0000","last_fullsized":"2023-07-24T05:47:51.596691+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:20:05.397749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.580575+0000","last_change":"2023-07-24T05:47:50.578490+0000","last_active":"2023-07-24T05:47:51.580575+0000","last_peered":"2023-07-24T05:47:51.580575+0000","last_clean":"2023-07-24T05:47:51.580575+0000","last_became_active":"2023-07-24T05:47:50.578217+0000","last_became_peered":"2023-07-24T05:47:50.578217+0000","last_unstale":"2023-07-24T05:47:51.580575+0000","last_undegraded":"2023-07-24T05:47:51.580575+0000","last_fullsized":"2023-07-24T05:47:51.580575+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:40:20.760178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.597585+0000","last_change":"2023-07-24T05:47:51.592009+0000","last_active":"2023-07-24T05:47:51.597585+0000","last_peered":"2023-07-24T05:47:51.597585+0000","last_clean":"2023-07-24T05:47:51.597585+0000","last_became_active":"2023-07-24T05:47:51.591496+0000","last_became_peered":"2023-07-24T05:47:51.591496+0000","last_unstale":"2023-07-24T05:47:51.597585+0000","last_undegraded":"2023-07-24T05:47:51.597585+0000","last_fullsized":"2023-07-24T05:47:51.597585+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:16:14.245040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.576200+0000","last_change":"2023-07-24T05:47:50.586464+0000","last_active":"2023-07-24T05:47:51.576200+0000","last_peered":"2023-07-24T05:47:51.576200+0000","last_clean":"2023-07-24T05:47:51.576200+0000","last_became_active":"2023-07-24T05:47:50.586194+0000","last_became_peered":"2023-07-24T05:47:50.586194+0000","last_unstale":"2023-07-24T05:47:51.576200+0000","last_undegraded":"2023-07-24T05:47:51.576200+0000","last_fullsized":"2023-07-24T05:47:51.576200+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T13:32:38.468754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.591179+0000","last_change":"2023-07-24T05:47:51.586487+0000","last_active":"2023-07-24T05:47:51.591179+0000","last_peered":"2023-07-24T05:47:51.591179+0000","last_clean":"2023-07-24T05:47:51.591179+0000","last_became_active":"2023-07-24T05:47:51.586165+0000","last_became_peered":"2023-07-24T05:47:51.586165+0000","last_unstale":"2023-07-24T05:47:51.591179+0000","last_undegraded":"2023-07-24T05:47:51.591179+0000","last_fullsized":"2023-07-24T05:47:51.591179+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:59:49.141483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.573784+0000","last_change":"2023-07-24T05:47:50.579729+0000","last_active":"2023-07-24T05:47:51.573784+0000","last_peered":"2023-07-24T05:47:51.573784+0000","last_clean":"2023-07-24T05:47:51.573784+0000","last_became_active":"2023-07-24T05:47:50.579404+0000","last_became_peered":"2023-07-24T05:47:50.579404+0000","last_unstale":"2023-07-24T05:47:51.573784+0000","last_undegraded":"2023-07-24T05:47:51.573784+0000","last_fullsized":"2023-07-24T05:47:51.573784+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:54:45.325118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.593069+0000","last_change":"2023-07-24T05:47:51.588112+0000","last_active":"2023-07-24T05:47:51.593069+0000","last_peered":"2023-07-24T05:47:51.593069+0000","last_clean":"2023-07-24T05:47:51.593069+0000","last_became_active":"2023-07-24T05:47:51.587745+0000","last_became_peered":"2023-07-24T05:47:51.587745+0000","last_unstale":"2023-07-24T05:47:51.593069+0000","last_undegraded":"2023-07-24T05:47:51.593069+0000","last_fullsized":"2023-07-24T05:47:51.593069+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:52:00.429345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.572646+0000","last_change":"2023-07-24T05:47:50.583129+0000","last_active":"2023-07-24T05:47:51.572646+0000","last_peered":"2023-07-24T05:47:51.572646+0000","last_clean":"2023-07-24T05:47:51.572646+0000","last_became_active":"2023-07-24T05:47:50.582878+0000","last_became_peered":"2023-07-24T05:47:50.582878+0000","last_unstale":"2023-07-24T05:47:51.572646+0000","last_undegraded":"2023-07-24T05:47:51.572646+0000","last_fullsized":"2023-07-24T05:47:51.572646+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:22:20.461821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":53,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.575036+0000","last_change":"2023-07-24T05:45:54.350738+0000","last_active":"2023-07-24T05:47:51.575036+0000","last_peered":"2023-07-24T05:47:51.575036+0000","last_clean":"2023-07-24T05:47:51.575036+0000","last_became_active":"2023-07-24T05:45:54.350347+0000","last_became_peered":"2023-07-24T05:45:54.350347+0000","last_unstale":"2023-07-24T05:47:51.575036+0000","last_undegraded":"2023-07-24T05:47:51.575036+0000","last_fullsized":"2023-07-24T05:47:51.575036+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:02:00.964812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.598489+0000","last_change":"2023-07-24T05:47:51.595560+0000","last_active":"2023-07-24T05:47:51.598489+0000","last_peered":"2023-07-24T05:47:51.598489+0000","last_clean":"2023-07-24T05:47:51.598489+0000","last_became_active":"2023-07-24T05:47:51.595279+0000","last_became_peered":"2023-07-24T05:47:51.595279+0000","last_unstale":"2023-07-24T05:47:51.598489+0000","last_undegraded":"2023-07-24T05:47:51.598489+0000","last_fullsized":"2023-07-24T05:47:51.598489+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:52:53.242465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.581073+0000","last_change":"2023-07-24T05:47:50.579107+0000","last_active":"2023-07-24T05:47:51.581073+0000","last_peered":"2023-07-24T05:47:51.581073+0000","last_clean":"2023-07-24T05:47:51.581073+0000","last_became_active":"2023-07-24T05:47:50.578852+0000","last_became_peered":"2023-07-24T05:47:50.578852+0000","last_unstale":"2023-07-24T05:47:51.581073+0000","last_undegraded":"2023-07-24T05:47:51.581073+0000","last_fullsized":"2023-07-24T05:47:51.581073+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T16:15:21.050446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.584853+0000","last_change":"2023-07-24T05:45:54.346766+0000","last_active":"2023-07-24T05:47:51.584853+0000","last_peered":"2023-07-24T05:47:51.584853+0000","last_clean":"2023-07-24T05:47:51.584853+0000","last_became_active":"2023-07-24T05:45:54.346404+0000","last_became_peered":"2023-07-24T05:45:54.346404+0000","last_unstale":"2023-07-24T05:47:51.584853+0000","last_undegraded":"2023-07-24T05:47:51.584853+0000","last_fullsized":"2023-07-24T05:47:51.584853+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T16:38:24.730210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.596420+0000","last_change":"2023-07-24T05:47:51.590438+0000","last_active":"2023-07-24T05:47:51.596420+0000","last_peered":"2023-07-24T05:47:51.596420+0000","last_clean":"2023-07-24T05:47:51.596420+0000","last_became_active":"2023-07-24T05:47:51.590136+0000","last_became_peered":"2023-07-24T05:47:51.590136+0000","last_unstale":"2023-07-24T05:47:51.596420+0000","last_undegraded":"2023-07-24T05:47:51.596420+0000","last_fullsized":"2023-07-24T05:47:51.596420+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T11:12:04.759700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.585408+0000","last_change":"2023-07-24T05:47:50.577084+0000","last_active":"2023-07-24T05:47:51.585408+0000","last_peered":"2023-07-24T05:47:51.585408+0000","last_clean":"2023-07-24T05:47:51.585408+0000","last_became_active":"2023-07-24T05:47:50.576739+0000","last_became_peered":"2023-07-24T05:47:50.576739+0000","last_unstale":"2023-07-24T05:47:51.585408+0000","last_undegraded":"2023-07-24T05:47:51.585408+0000","last_fullsized":"2023-07-24T05:47:51.585408+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:08:00.116854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.575429+0000","last_change":"2023-07-24T05:45:54.355858+0000","last_active":"2023-07-24T05:47:51.575429+0000","last_peered":"2023-07-24T05:47:51.575429+0000","last_clean":"2023-07-24T05:47:51.575429+0000","last_became_active":"2023-07-24T05:45:54.355598+0000","last_became_peered":"2023-07-24T05:45:54.355598+0000","last_unstale":"2023-07-24T05:47:51.575429+0000","last_undegraded":"2023-07-24T05:47:51.575429+0000","last_fullsized":"2023-07-24T05:47:51.575429+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:09:19.701801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.589219+0000","last_change":"2023-07-24T05:47:51.586308+0000","last_active":"2023-07-24T05:47:51.589219+0000","last_peered":"2023-07-24T05:47:51.589219+0000","last_clean":"2023-07-24T05:47:51.589219+0000","last_became_active":"2023-07-24T05:47:51.586023+0000","last_became_peered":"2023-07-24T05:47:51.586023+0000","last_unstale":"2023-07-24T05:47:51.589219+0000","last_undegraded":"2023-07-24T05:47:51.589219+0000","last_fullsized":"2023-07-24T05:47:51.589219+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:39:55.018564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.575275+0000","last_change":"2023-07-24T05:47:50.586892+0000","last_active":"2023-07-24T05:47:51.575275+0000","last_peered":"2023-07-24T05:47:51.575275+0000","last_clean":"2023-07-24T05:47:51.575275+0000","last_became_active":"2023-07-24T05:47:50.586478+0000","last_became_peered":"2023-07-24T05:47:50.586478+0000","last_unstale":"2023-07-24T05:47:51.575275+0000","last_undegraded":"2023-07-24T05:47:51.575275+0000","last_fullsized":"2023-07-24T05:47:51.575275+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:22:23.056937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.585175+0000","last_change":"2023-07-24T05:45:54.354128+0000","last_active":"2023-07-24T05:47:51.585175+0000","last_peered":"2023-07-24T05:47:51.585175+0000","last_clean":"2023-07-24T05:47:51.585175+0000","last_became_active":"2023-07-24T05:45:54.353816+0000","last_became_peered":"2023-07-24T05:45:54.353816+0000","last_unstale":"2023-07-24T05:47:51.585175+0000","last_undegraded":"2023-07-24T05:47:51.585175+0000","last_fullsized":"2023-07-24T05:47:51.585175+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:27:03.487363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.604441+0000","last_change":"2023-07-24T05:47:51.595446+0000","last_active":"2023-07-24T05:47:51.604441+0000","last_peered":"2023-07-24T05:47:51.604441+0000","last_clean":"2023-07-24T05:47:51.604441+0000","last_became_active":"2023-07-24T05:47:51.595199+0000","last_became_peered":"2023-07-24T05:47:51.595199+0000","last_unstale":"2023-07-24T05:47:51.604441+0000","last_undegraded":"2023-07-24T05:47:51.604441+0000","last_fullsized":"2023-07-24T05:47:51.604441+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:54:00.768438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.574522+0000","last_change":"2023-07-24T05:47:50.581787+0000","last_active":"2023-07-24T05:47:51.574522+0000","last_peered":"2023-07-24T05:47:51.574522+0000","last_clean":"2023-07-24T05:47:51.574522+0000","last_became_active":"2023-07-24T05:47:50.581493+0000","last_became_peered":"2023-07-24T05:47:50.581493+0000","last_unstale":"2023-07-24T05:47:51.574522+0000","last_undegraded":"2023-07-24T05:47:51.574522+0000","last_fullsized":"2023-07-24T05:47:51.574522+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T06:00:39.047623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.580621+0000","last_change":"2023-07-24T05:45:54.353232+0000","last_active":"2023-07-24T05:47:51.580621+0000","last_peered":"2023-07-24T05:47:51.580621+0000","last_clean":"2023-07-24T05:47:51.580621+0000","last_became_active":"2023-07-24T05:45:54.352983+0000","last_became_peered":"2023-07-24T05:45:54.352983+0000","last_unstale":"2023-07-24T05:47:51.580621+0000","last_undegraded":"2023-07-24T05:47:51.580621+0000","last_fullsized":"2023-07-24T05:47:51.580621+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:55:15.690169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.596000+0000","last_change":"2023-07-24T05:47:51.588834+0000","last_active":"2023-07-24T05:47:51.596000+0000","last_peered":"2023-07-24T05:47:51.596000+0000","last_clean":"2023-07-24T05:47:51.596000+0000","last_became_active":"2023-07-24T05:47:51.588548+0000","last_became_peered":"2023-07-24T05:47:51.588548+0000","last_unstale":"2023-07-24T05:47:51.596000+0000","last_undegraded":"2023-07-24T05:47:51.596000+0000","last_fullsized":"2023-07-24T05:47:51.596000+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T07:31:21.493546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.575688+0000","last_change":"2023-07-24T05:47:50.583320+0000","last_active":"2023-07-24T05:47:51.575688+0000","last_peered":"2023-07-24T05:47:51.575688+0000","last_clean":"2023-07-24T05:47:51.575688+0000","last_became_active":"2023-07-24T05:47:50.583018+0000","last_became_peered":"2023-07-24T05:47:50.583018+0000","last_unstale":"2023-07-24T05:47:51.575688+0000","last_undegraded":"2023-07-24T05:47:51.575688+0000","last_fullsized":"2023-07-24T05:47:51.575688+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T10:53:42.116230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":45,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.567262+0000","last_change":"2023-07-24T05:45:54.349000+0000","last_active":"2023-07-24T05:47:51.567262+0000","last_peered":"2023-07-24T05:47:51.567262+0000","last_clean":"2023-07-24T05:47:51.567262+0000","last_became_active":"2023-07-24T05:45:54.348646+0000","last_became_peered":"2023-07-24T05:45:54.348646+0000","last_unstale":"2023-07-24T05:47:51.567262+0000","last_undegraded":"2023-07-24T05:47:51.567262+0000","last_fullsized":"2023-07-24T05:47:51.567262+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:05:31.906433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.600174+0000","last_change":"2023-07-24T05:47:51.595587+0000","last_active":"2023-07-24T05:47:51.600174+0000","last_peered":"2023-07-24T05:47:51.600174+0000","last_clean":"2023-07-24T05:47:51.600174+0000","last_became_active":"2023-07-24T05:47:51.595327+0000","last_became_peered":"2023-07-24T05:47:51.595327+0000","last_unstale":"2023-07-24T05:47:51.600174+0000","last_undegraded":"2023-07-24T05:47:51.600174+0000","last_fullsized":"2023-07-24T05:47:51.600174+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T17:30:23.570890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.584806+0000","last_change":"2023-07-24T05:47:50.581068+0000","last_active":"2023-07-24T05:47:51.584806+0000","last_peered":"2023-07-24T05:47:51.584806+0000","last_clean":"2023-07-24T05:47:51.584806+0000","last_became_active":"2023-07-24T05:47:50.580303+0000","last_became_peered":"2023-07-24T05:47:50.580303+0000","last_unstale":"2023-07-24T05:47:51.584806+0000","last_undegraded":"2023-07-24T05:47:51.584806+0000","last_fullsized":"2023-07-24T05:47:51.584806+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T14:14:25.264935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.572328+0000","last_change":"2023-07-24T05:45:54.350803+0000","last_active":"2023-07-24T05:47:51.572328+0000","last_peered":"2023-07-24T05:47:51.572328+0000","last_clean":"2023-07-24T05:47:51.572328+0000","last_became_active":"2023-07-24T05:45:54.350427+0000","last_became_peered":"2023-07-24T05:45:54.350427+0000","last_unstale":"2023-07-24T05:47:51.572328+0000","last_undegraded":"2023-07-24T05:47:51.572328+0000","last_fullsized":"2023-07-24T05:47:51.572328+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:09:18.063653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.599011+0000","last_change":"2023-07-24T05:47:51.590933+0000","last_active":"2023-07-24T05:47:51.599011+0000","last_peered":"2023-07-24T05:47:51.599011+0000","last_clean":"2023-07-24T05:47:51.599011+0000","last_became_active":"2023-07-24T05:47:51.590603+0000","last_became_peered":"2023-07-24T05:47:51.590603+0000","last_unstale":"2023-07-24T05:47:51.599011+0000","last_undegraded":"2023-07-24T05:47:51.599011+0000","last_fullsized":"2023-07-24T05:47:51.599011+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:50.544995+0000","last_clean_scrub_stamp":"2023-07-24T05:47:50.544995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T09:18:24.255030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.613167+0000","last_change":"2023-07-24T05:47:50.580775+0000","last_active":"2023-07-24T05:47:51.613167+0000","last_peered":"2023-07-24T05:47:51.613167+0000","last_clean":"2023-07-24T05:47:51.613167+0000","last_became_active":"2023-07-24T05:47:50.580560+0000","last_became_peered":"2023-07-24T05:47:50.580560+0000","last_unstale":"2023-07-24T05:47:51.613167+0000","last_undegraded":"2023-07-24T05:47:51.613167+0000","last_fullsized":"2023-07-24T05:47:51.613167+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:47:49.530452+0000","last_clean_scrub_stamp":"2023-07-24T05:47:49.530452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T15:19:20.516228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.581245+0000","last_change":"2023-07-24T05:45:54.351103+0000","last_active":"2023-07-24T05:47:51.581245+0000","last_peered":"2023-07-24T05:47:51.581245+0000","last_clean":"2023-07-24T05:47:51.581245+0000","last_became_active":"2023-07-24T05:45:54.350628+0000","last_became_peered":"2023-07-24T05:45:54.350628+0000","last_unstale":"2023-07-24T05:47:51.581245+0000","last_undegraded":"2023-07-24T05:47:51.581245+0000","last_fullsized":"2023-07-24T05:47:51.581245+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T12:09:57.539415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":197,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-07-24T05:47:51.573867+0000","last_change":"2023-07-24T05:45:54.356765+0000","last_active":"2023-07-24T05:47:51.573867+0000","last_peered":"2023-07-24T05:47:51.573867+0000","last_clean":"2023-07-24T05:47:51.573867+0000","last_became_active":"2023-07-24T05:45:54.355687+0000","last_became_peered":"2023-07-24T05:45:54.355687+0000","last_unstale":"2023-07-24T05:47:51.573867+0000","last_undegraded":"2023-07-24T05:47:51.573867+0000","last_fullsized":"2023-07-24T05:47:51.573867+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-24T05:45:53.324184+0000","last_clean_scrub_stamp":"2023-07-24T05:45:53.324184+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-25T05:48:46.952271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542171,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32124,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339716,"statfs":{"total":96636764160,"available":96603869184,"internally_reserved":0,"allocated":1028096,"data_stored":782954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jul 24 05:46:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":1.214}]},{"osd":1,"last update":"Mon Jul 24 05:46:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":2.1560000000000001,"5min":2.1560000000000001,"15min":2.1560000000000001},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":1.5700000000000001}]},{"osd":2,"last update":"Mon Jul 24 05:46:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.6639999999999999,"5min":1.6639999999999999,"15min":1.6639999999999999},"last":1.278},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.736}]},{"osd":3,"last update":"Mon Jul 24 05:46:54 2023","interfaces":[{"interface":"back","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":7.0110000000000001,"5min":7.0110000000000001,"15min":7.0110000000000001},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.462,"5min":1.462,"15min":1.462},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":7.1669999999999998,"5min":7.1669999999999998,"15min":7.1669999999999998},"last":1.413}]},{"osd":4,"last update":"Mon Jul 24 05:46:54 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.629,"5min":1.629,"15min":1.629},"last":1.778},{"interface":"front","average":{"1min":1.165,"5min":1.165,"15min":1.165},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.3640000000000001}]},{"osd":5,"last update":"Mon Jul 24 05:46:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.631},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":1.6890000000000001}]},{"osd":6,"last update":"Mon Jul 24 05:46:54 2023","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":1.8240000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.8740000000000001},{"interface":"front","average":{"1min":1.349,"5min":1.349,"15min":1.349},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":1.847}]}]},{"osd":6,"up_from":14,"seq":60129542171,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":194529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jul 24 05:46:55 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.151,"15min":1.151},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":3.246,"5min":3.246,"15min":3.246},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":2.2850000000000001,"5min":2.2850000000000001,"15min":2.2850000000000001},"last":0.95999999999999996}]},{"osd":1,"last update":"Mon Jul 24 05:46:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.891,"5min":1.891,"15min":1.891},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":2.843,"5min":2.843,"15min":2.843},"last":0.88200000000000001}]},{"osd":2,"last update":"Mon Jul 24 05:46:55 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":3.383,"5min":3.383,"15min":3.383},"last":1.534},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":1.016,"5min":1.016,"15min":1.016},"max":{"1min":2.6669999999999998,"5min":2.6669999999999998,"15min":2.6669999999999998},"last":1.181}]},{"osd":3,"last update":"Mon Jul 24 05:46:55 2023","interfaces":[{"interface":"back","average":{"1min":1.679,"5min":1.679,"15min":1.679},"min":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"max":{"1min":6.6379999999999999,"5min":6.6379999999999999,"15min":6.6379999999999999},"last":1.125},{"interface":"front","average":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":6.375,"5min":6.375,"15min":6.375},"last":1.3740000000000001}]},{"osd":4,"last update":"Mon Jul 24 05:46:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":2.8740000000000001,"5min":2.8740000000000001,"15min":2.8740000000000001},"last":1.579},{"interface":"front","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":3.3239999999999998,"5min":3.3239999999999998,"15min":3.3239999999999998},"last":1.2290000000000001}]},{"osd":5,"last update":"Mon Jul 24 05:46:55 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":3.4830000000000001,"5min":3.4830000000000001,"15min":3.4830000000000001},"last":1.673},{"interface":"front","average":{"1min":1.52,"5min":1.52,"15min":1.52},"min":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"max":{"1min":2.7509999999999999,"5min":2.7509999999999999,"15min":2.7509999999999999},"last":1.7030000000000001}]},{"osd":7,"last update":"Mon Jul 24 05:46:55 2023","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.5,"15min":1.5},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":3.0870000000000002,"5min":3.0870000000000002,"15min":3.0870000000000002},"last":1.488},{"interface":"front","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":3.5379999999999998,"5min":3.5379999999999998,"15min":3.5379999999999998},"last":1.6140000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542171,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":434176,"data_stored":192566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jul 24 05:46:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.873},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.2889999999999999}]},{"osd":1,"last update":"Mon Jul 24 05:46:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.46,"5min":1.46,"15min":1.46},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":1.012}]},{"osd":2,"last update":"Mon Jul 24 05:46:54 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":1.165}]},{"osd":3,"last update":"Mon Jul 24 05:46:54 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":1.25}]},{"osd":4,"last update":"Mon Jul 24 05:46:54 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.708,"5min":1.708,"15min":1.708},"last":1.5229999999999999}]},{"osd":6,"last update":"Mon Jul 24 05:46:54 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.327,"15min":1.327},"min":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.49},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.2010000000000001}]},{"osd":7,"last update":"Mon Jul 24 05:46:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.8859999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.5800000000000001},{"interface":"front","average":{"1min":1.446,"5min":1.446,"15min":1.446},"min":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":1.423}]}]},{"osd":4,"up_from":14,"seq":60129542170,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":446464,"data_stored":195421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jul 24 05:46:52 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.236,"15min":1.236},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.8160000000000001,"5min":1.8160000000000001,"15min":1.8160000000000001},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.772,"5min":1.772,"15min":1.772},"last":1.228}]},{"osd":1,"last update":"Mon Jul 24 05:46:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":2.0139999999999998,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":1.27},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":2.5089999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":1.0860000000000001}]},{"osd":2,"last update":"Mon Jul 24 05:46:52 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":1.1890000000000001}]},{"osd":3,"last update":"Mon Jul 24 05:46:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.4810000000000001,"5min":1.4810000000000001,"15min":1.4810000000000001},"last":0.93600000000000005},{"interface":"front","average":{"1min":1.22,"5min":1.22,"15min":1.22},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":1.403}]},{"osd":5,"last update":"Mon Jul 24 05:46:52 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.1259999999999999,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.292,"5min":1.292,"15min":1.292},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":1.026}]},{"osd":6,"last update":"Mon Jul 24 05:46:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.2149999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":0.999},{"interface":"front","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":2.3340000000000001,"5min":2.3340000000000001,"15min":2.3340000000000001},"last":1.4430000000000001}]},{"osd":7,"last update":"Mon Jul 24 05:46:52 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"min":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"max":{"1min":3.1240000000000001,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":1.5289999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542171,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31560,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340280,"statfs":{"total":96636764160,"available":96604446720,"internally_reserved":0,"allocated":446464,"data_stored":194495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jul 24 05:46:53 2023","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.876},{"interface":"front","average":{"1min":1.028,"5min":1.028,"15min":1.028},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.84499999999999997}]},{"osd":1,"last update":"Mon Jul 24 05:46:53 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.98199999999999998}]},{"osd":2,"last update":"Mon Jul 24 05:46:53 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.64600000000000002},{"interface":"front","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.80200000000000005}]},{"osd":4,"last update":"Mon Jul 24 05:46:53 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":2.262,"5min":2.262,"15min":2.262},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.373,"5min":1.373,"15min":1.373},"min":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"max":{"1min":2.198,"5min":2.198,"15min":2.198},"last":1.1060000000000001}]},{"osd":5,"last update":"Mon Jul 24 05:46:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":2.0979999999999999,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.02},{"interface":"front","average":{"1min":1.458,"5min":1.458,"15min":1.458},"min":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"max":{"1min":2.2970000000000002,"5min":2.2970000000000002,"15min":2.2970000000000002},"last":0.93400000000000005}]},{"osd":6,"last update":"Mon Jul 24 05:46:53 2023","interfaces":[{"interface":"back","average":{"1min":1.536,"5min":1.536,"15min":1.536},"min":{"1min":1.054,"5min":1.054,"15min":1.054},"max":{"1min":2.5089999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.462,"5min":1.462,"15min":1.462},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":2.339,"5min":2.339,"15min":2.339},"last":1.143}]},{"osd":7,"last update":"Mon Jul 24 05:46:53 2023","interfaces":[{"interface":"back","average":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":2.4729999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"min":{"1min":1.198,"5min":1.198,"15min":1.198},"max":{"1min":2.444,"5min":2.444,"15min":2.444},"last":1.1639999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542170,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":434176,"data_stored":193857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jul 24 05:46:54 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":1.883},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":3.544}]},{"osd":1,"last update":"Mon Jul 24 05:46:54 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.4350000000000001},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":1.948}]},{"osd":3,"last update":"Mon Jul 24 05:46:54 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1.228},{"interface":"front","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":2.5459999999999998,"5min":2.5459999999999998,"15min":2.5459999999999998},"last":1.3700000000000001}]},{"osd":4,"last update":"Mon Jul 24 05:46:54 2023","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.202,"15min":1.202},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.0489999999999999,"5min":2.0489999999999999,"15min":2.0489999999999999},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"max":{"1min":3.2709999999999999,"5min":3.2709999999999999,"15min":3.2709999999999999},"last":1.71}]},{"osd":5,"last update":"Mon Jul 24 05:46:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.8330000000000002,"5min":2.8330000000000002,"15min":2.8330000000000002},"last":3.8660000000000001},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":2.3679999999999999,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":2.9289999999999998}]},{"osd":6,"last update":"Mon Jul 24 05:46:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"min":{"1min":0.998,"5min":0.998,"15min":0.998},"max":{"1min":2.5979999999999999,"5min":2.5979999999999999,"15min":2.5979999999999999},"last":1.5229999999999999},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":2.7370000000000001,"5min":2.7370000000000001,"15min":2.7370000000000001},"last":4.0170000000000003}]},{"osd":7,"last update":"Mon Jul 24 05:46:54 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":2.4849999999999999,"5min":2.4849999999999999,"15min":2.4849999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":1.028,"5min":1.028,"15min":1.028},"max":{"1min":3.3660000000000001,"5min":3.3660000000000001,"15min":3.3660000000000001},"last":5.141}]}]},{"osd":1,"up_from":14,"seq":60129542171,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":438272,"data_stored":193927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jul 24 05:46:53 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":2.335,"5min":2.335,"15min":2.335},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.2930000000000001,"5min":2.2930000000000001,"15min":2.2930000000000001},"last":0.59899999999999998}]},{"osd":2,"last update":"Mon Jul 24 05:46:53 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.9930000000000001,"5min":1.9930000000000001,"15min":1.9930000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.419,"5min":2.419,"15min":2.419},"last":0.80600000000000005}]},{"osd":3,"last update":"Mon Jul 24 05:46:53 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":2.4460000000000002,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":0.68700000000000006},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":2.266,"5min":2.266,"15min":2.266},"last":0.71699999999999997}]},{"osd":4,"last update":"Mon Jul 24 05:46:53 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.373,"15min":1.373},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":2.5920000000000001,"5min":2.5920000000000001,"15min":2.5920000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.365,"5min":1.365,"15min":1.365},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":2.3929999999999998,"5min":2.3929999999999998,"15min":2.3929999999999998},"last":1.248}]},{"osd":5,"last update":"Mon Jul 24 05:46:53 2023","interfaces":[{"interface":"back","average":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"min":{"1min":0.995,"5min":0.995,"15min":0.995},"max":{"1min":2.746,"5min":2.746,"15min":2.746},"last":1.075},{"interface":"front","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.6509999999999998,"5min":2.6509999999999998,"15min":2.6509999999999998},"last":1.2010000000000001}]},{"osd":6,"last update":"Mon Jul 24 05:46:53 2023","interfaces":[{"interface":"back","average":{"1min":1.623,"5min":1.623,"15min":1.623},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":4.0129999999999999,"5min":4.0129999999999999,"15min":4.0129999999999999},"last":1.569},{"interface":"front","average":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"min":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"max":{"1min":4.0590000000000002,"5min":4.0590000000000002,"15min":4.0590000000000002},"last":1.5089999999999999}]},{"osd":7,"last update":"Mon Jul 24 05:46:53 2023","interfaces":[{"interface":"back","average":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"min":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"max":{"1min":2.8490000000000002,"5min":2.8490000000000002,"15min":2.8490000000000002},"last":1.26},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":2.6909999999999998,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":1.4059999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542170,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":1028096,"data_stored":782898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jul 24 05:46:52 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.83699999999999997}]},{"osd":2,"last update":"Mon Jul 24 05:46:52 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":2.8029999999999999,"5min":2.8029999999999999,"15min":2.8029999999999999},"last":0.90700000000000003}]},{"osd":3,"last update":"Mon Jul 24 05:46:52 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":1.119},{"interface":"front","average":{"1min":1.228,"5min":1.228,"15min":1.228},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.752,"5min":1.752,"15min":1.752},"last":0.94299999999999995}]},{"osd":4,"last update":"Mon Jul 24 05:46:52 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":2.097,"5min":2.097,"15min":2.097},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.292,"5min":1.292,"15min":1.292},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":2.8439999999999999,"5min":2.8439999999999999,"15min":2.8439999999999999},"last":1.2609999999999999}]},{"osd":5,"last update":"Mon Jul 24 05:46:52 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"min":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"max":{"1min":3.4249999999999998,"5min":3.4249999999999998,"15min":3.4249999999999998},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.431,"5min":1.431,"15min":1.431},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":2.2610000000000001,"5min":2.2610000000000001,"15min":2.2610000000000001},"last":1.099}]},{"osd":6,"last update":"Mon Jul 24 05:46:52 2023","interfaces":[{"interface":"back","average":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":3.2519999999999998,"5min":3.2519999999999998,"15min":3.2519999999999998},"last":1.167},{"interface":"front","average":{"1min":1.542,"5min":1.542,"15min":1.542},"min":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"max":{"1min":2.6520000000000001,"5min":2.6520000000000001,"15min":2.6520000000000001},"last":1.286}]},{"osd":7,"last update":"Mon Jul 24 05:46:52 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":2.5790000000000002,"5min":2.5790000000000002,"15min":2.5790000000000002},"last":1.331},{"interface":"front","average":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"min":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"max":{"1min":2.7090000000000001,"5min":2.7090000000000001,"15min":2.7090000000000001},"last":1.371}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-24T05:47:56.427 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-24T05:47:56.427 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-24T05:47:56.639 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.632+0000 7f0db421e700 1 Processor -- start 2023-07-24T05:47:56.640 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.632+0000 7f0db421e700 1 -- start start 2023-07-24T05:47:56.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.636+0000 7f0db421e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0dac06b9f0 0x7f0dac06bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:56.642 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.636+0000 7f0db421e700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dac06d450 con 0x7f0dac0ccf20 2023-07-24T05:47:56.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.636+0000 7f0db421e700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dac0ad710 con 0x7f0dac0ada10 2023-07-24T05:47:56.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.636+0000 7f0db421e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac071570 con 0x7f0dac06b9f0 2023-07-24T05:47:56.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.636+0000 7f0db17b9700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f0dac0ccf20 0x7f0dac06ac20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:60996/0 (socket says 172.21.15.77:60996) 2023-07-24T05:47:56.643 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.636+0000 7f0db17b9700 1 -- 172.21.15.77:0/1892868986 learned_addr learned my addr 172.21.15.77:0/1892868986 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:56.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.636+0000 7f0db1fba700 1 --2- 172.21.15.77:0/1892868986 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0dac06b9f0 0x7f0dac06bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:56.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.636+0000 7f0db1fba700 1 -- 172.21.15.77:0/1892868986 >> v1:172.21.15.103:6789/0 conn(0x7f0dac0ada10 legacy=0x7f0dac06fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:56.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.636+0000 7f0db1fba700 1 -- 172.21.15.77:0/1892868986 >> v1:172.21.15.77:6789/0 conn(0x7f0dac0ccf20 legacy=0x7f0dac06ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:56.644 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.636+0000 7f0db1fba700 1 -- 172.21.15.77:0/1892868986 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dac0cca20 con 0x7f0dac06b9f0 2023-07-24T05:47:56.645 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.636+0000 7f0db1fba700 1 --2- 172.21.15.77:0/1892868986 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0dac06b9f0 0x7f0dac06bdd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0da8009870 tx=0x7f0da8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=720fa67efabadaf4 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:56.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.640+0000 7f0db0fb8700 1 -- 172.21.15.77:0/1892868986 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da8005e50 con 0x7f0dac06b9f0 2023-07-24T05:47:56.647 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.640+0000 7f0db0fb8700 1 -- 172.21.15.77:0/1892868986 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da8006030 con 0x7f0dac06b9f0 2023-07-24T05:47:56.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.640+0000 7f0db0fb8700 1 -- 172.21.15.77:0/1892868986 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da80063c0 con 0x7f0dac06b9f0 2023-07-24T05:47:56.648 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.640+0000 7f0db421e700 1 -- 172.21.15.77:0/1892868986 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0dac06b9f0 msgr2=0x7f0dac06bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:56.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.640+0000 7f0db421e700 1 --2- 172.21.15.77:0/1892868986 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0dac06b9f0 0x7f0dac06bdd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0da8009870 tx=0x7f0da8009b80 comp rx=0 tx=0).stop 2023-07-24T05:47:56.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.640+0000 7f0db421e700 1 -- 172.21.15.77:0/1892868986 shutdown_connections 2023-07-24T05:47:56.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.640+0000 7f0db421e700 1 --2- 172.21.15.77:0/1892868986 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0dac06b9f0 0x7f0dac06bdd0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:56.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.640+0000 7f0db421e700 1 -- 172.21.15.77:0/1892868986 >> 172.21.15.77:0/1892868986 conn(0x7f0dac0ce440 msgr2=0x7f0dac0ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:56.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.640+0000 7f0db421e700 1 -- 172.21.15.77:0/1892868986 shutdown_connections 2023-07-24T05:47:56.649 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.640+0000 7f0db421e700 1 -- 172.21.15.77:0/1892868986 wait complete. 2023-07-24T05:47:56.650 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.644+0000 7f0db421e700 1 Processor -- start 2023-07-24T05:47:56.651 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.644+0000 7f0db421e700 1 -- start start 2023-07-24T05:47:56.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.644+0000 7f0db421e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0dac06b9f0 0x7f0dac0c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:56.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.644+0000 7f0db421e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0dac0ada10 0x7f0dac0c45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:56.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.644+0000 7f0db421e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0dac0ccf20 0x7f0dac1e0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:56.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.644+0000 7f0db421e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac0c3550 con 0x7f0dac0ada10 2023-07-24T05:47:56.652 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.644+0000 7f0db421e700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac0c3830 con 0x7f0dac0ccf20 2023-07-24T05:47:56.653 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.644+0000 7f0db421e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac0c3b10 con 0x7f0dac06b9f0 2023-07-24T05:47:56.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.644+0000 7f0db17b9700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0dac0ada10 0x7f0dac0c45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:56.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.644+0000 7f0db1fba700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0dac06b9f0 0x7f0dac0c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:56.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.644+0000 7f0db17b9700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0dac0ada10 0x7f0dac0c45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41568/0 (socket says 172.21.15.77:41568) 2023-07-24T05:47:56.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.644+0000 7f0db1fba700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0dac06b9f0 0x7f0dac0c9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3301/0 says I am v2:172.21.15.77:48652/0 (socket says 172.21.15.77:48652) 2023-07-24T05:47:56.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.644+0000 7f0db17b9700 1 -- 172.21.15.77:0/3758694651 learned_addr learned my addr 172.21.15.77:0/3758694651 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:56.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.644+0000 7f0db27bb700 1 --2- 172.21.15.77:0/3758694651 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0dac0ccf20 0x7f0dac1e0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:56.654 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.648+0000 7f0db1fba700 1 -- 172.21.15.77:0/3758694651 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0dac0ccf20 msgr2=0x7f0dac1e0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:56.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.648+0000 7f0db1fba700 1 --2- 172.21.15.77:0/3758694651 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0dac0ccf20 0x7f0dac1e0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:56.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.648+0000 7f0db1fba700 1 -- 172.21.15.77:0/3758694651 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0dac0ada10 msgr2=0x7f0dac0c45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:56.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.648+0000 7f0db1fba700 1 --2- 172.21.15.77:0/3758694651 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0dac0ada10 0x7f0dac0c45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:56.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.648+0000 7f0db1fba700 1 -- 172.21.15.77:0/3758694651 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da8009450 con 0x7f0dac06b9f0 2023-07-24T05:47:56.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.648+0000 7f0db1fba700 1 --2- 172.21.15.77:0/3758694651 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0dac06b9f0 0x7f0dac0c9e50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0da8015000 tx=0x7f0da8004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:56.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.648+0000 7f0da27fc700 1 -- 172.21.15.77:0/3758694651 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da8004050 con 0x7f0dac06b9f0 2023-07-24T05:47:56.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.648+0000 7f0da27fc700 1 -- 172.21.15.77:0/3758694651 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da8020070 con 0x7f0dac06b9f0 2023-07-24T05:47:56.655 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.648+0000 7f0db421e700 1 -- 172.21.15.77:0/3758694651 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dac0c3df0 con 0x7f0dac06b9f0 2023-07-24T05:47:56.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.648+0000 7f0da27fc700 1 -- 172.21.15.77:0/3758694651 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da80043f0 con 0x7f0dac06b9f0 2023-07-24T05:47:56.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.648+0000 7f0db421e700 1 -- 172.21.15.77:0/3758694651 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dac0ca390 con 0x7f0dac06b9f0 2023-07-24T05:47:56.656 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.648+0000 7f0db421e700 1 -- 172.21.15.77:0/3758694651 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dac0c4310 con 0x7f0dac06b9f0 2023-07-24T05:47:56.658 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.652+0000 7f0da27fc700 1 -- 172.21.15.77:0/3758694651 <== mon.2 v2:172.21.15.103:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0da80036c0 con 0x7f0dac06b9f0 2023-07-24T05:47:56.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.652+0000 7f0da27fc700 1 --2- 172.21.15.77:0/3758694651 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f0d900662f0 0x7f0d900687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:56.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.652+0000 7f0da27fc700 1 -- 172.21.15.77:0/3758694651 <== mon.2 v2:172.21.15.103:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f0da8085290 con 0x7f0dac06b9f0 2023-07-24T05:47:56.660 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.652+0000 7f0db17b9700 1 --2- 172.21.15.77:0/3758694651 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f0d900662f0 0x7f0d900687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:56.662 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.656+0000 7f0db17b9700 1 --2- 172.21.15.77:0/3758694651 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f0d900662f0 0x7f0d900687b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0dac09c3a0 tx=0x7f0d9c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:56.670 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.664+0000 7f0da27fc700 1 -- 172.21.15.77:0/3758694651 <== mon.2 v2:172.21.15.103:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0da8052790 con 0x7f0dac06b9f0 2023-07-24T05:47:56.905 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.900+0000 7f0db421e700 1 -- 172.21.15.77:0/3758694651 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f0dac04df10 con 0x7f0dac06b9f0 2023-07-24T05:47:56.917 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.912+0000 7f0da27fc700 1 -- 172.21.15.77:0/3758694651 <== mon.2 v2:172.21.15.103:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) v1 ==== 190+0+147 (secure 0 0 0) 0x7f0da8055db0 con 0x7f0dac06b9f0 2023-07-24T05:47:56.918 INFO:teuthology.orchestra.run.smithi077.stdout:[client.0] 2023-07-24T05:47:56.918 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDaD75kFKS1BxAA0KR0wkYow59oiBtAVGaXrQ== 2023-07-24T05:47:56.918 INFO:teuthology.orchestra.run.smithi077.stdout: caps mds = "allow" 2023-07-24T05:47:56.918 INFO:teuthology.orchestra.run.smithi077.stdout: caps mon = "allow r" 2023-07-24T05:47:56.918 INFO:teuthology.orchestra.run.smithi077.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-24T05:47:56.920 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.912+0000 7f0db421e700 1 -- 172.21.15.77:0/3758694651 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f0d900662f0 msgr2=0x7f0d900687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:56.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.912+0000 7f0db421e700 1 --2- 172.21.15.77:0/3758694651 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f0d900662f0 0x7f0d900687b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0dac09c3a0 tx=0x7f0d9c009040 comp rx=0 tx=0).stop 2023-07-24T05:47:56.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.912+0000 7f0db421e700 1 -- 172.21.15.77:0/3758694651 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0dac06b9f0 msgr2=0x7f0dac0c9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:56.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.912+0000 7f0db421e700 1 --2- 172.21.15.77:0/3758694651 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0dac06b9f0 0x7f0dac0c9e50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0da8015000 tx=0x7f0da8004770 comp rx=0 tx=0).stop 2023-07-24T05:47:56.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.912+0000 7f0db421e700 1 -- 172.21.15.77:0/3758694651 shutdown_connections 2023-07-24T05:47:56.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.912+0000 7f0db421e700 1 --2- 172.21.15.77:0/3758694651 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0dac0ccf20 0x7f0dac1e0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:56.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.912+0000 7f0db421e700 1 --2- 172.21.15.77:0/3758694651 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0dac0ada10 0x7f0dac0c45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:56.921 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.912+0000 7f0db421e700 1 --2- 172.21.15.77:0/3758694651 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f0d900662f0 0x7f0d900687b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:56.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.912+0000 7f0db421e700 1 --2- 172.21.15.77:0/3758694651 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f0dac06b9f0 0x7f0dac0c9e50 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:56.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.912+0000 7f0db421e700 1 -- 172.21.15.77:0/3758694651 >> 172.21.15.77:0/3758694651 conn(0x7f0dac0ce440 msgr2=0x7f0dac1e1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:56.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.916+0000 7f0db421e700 1 -- 172.21.15.77:0/3758694651 shutdown_connections 2023-07-24T05:47:56.922 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:56.916+0000 7f0db421e700 1 -- 172.21.15.77:0/3758694651 wait complete. 2023-07-24T05:47:56.923 INFO:teuthology.orchestra.run.smithi077.stderr:updated caps for client.0 2023-07-24T05:47:56.943 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-24T05:47:57.116 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.108+0000 7f02c4fa0700 1 Processor -- start 2023-07-24T05:47:57.117 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.112+0000 7f02c4fa0700 1 -- start start 2023-07-24T05:47:57.118 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.112+0000 7f02c4fa0700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f02c00c1b50 0x7f02c00cd730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:57.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.112+0000 7f02c4fa0700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02c006ae00 con 0x7f02c00cba10 2023-07-24T05:47:57.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.112+0000 7f02c4fa0700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02c006bd50 con 0x7f02c0160f70 2023-07-24T05:47:57.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.112+0000 7f02c4fa0700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02c00cdc70 con 0x7f02c00c1b50 2023-07-24T05:47:57.119 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.112+0000 7f02b7fff700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f02c00cba10 0x7f02c00c1440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:32776/0 (socket says 172.21.15.77:32776) 2023-07-24T05:47:57.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.112+0000 7f02b7fff700 1 -- 172.21.15.77:0/1504521374 learned_addr learned my addr 172.21.15.77:0/1504521374 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:57.120 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.112+0000 7f02bed9d700 1 --2- 172.21.15.77:0/1504521374 >> v2:172.21.15.77:3300/0 conn(0x7f02c00c1b50 0x7f02c00cd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:57.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.112+0000 7f02bdd9b700 1 -- 172.21.15.77:0/1504521374 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1543781157 0 0) 0x7f02c006ae00 con 0x7f02c00cba10 2023-07-24T05:47:57.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.112+0000 7f02bdd9b700 1 -- 172.21.15.77:0/1504521374 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02ac0035d0 con 0x7f02c00cba10 2023-07-24T05:47:57.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.112+0000 7f02bdd9b700 1 -- 172.21.15.77:0/1504521374 <== mon.1 v1:172.21.15.103:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 716357650 0 0) 0x7f02c006bd50 con 0x7f02c0160f70 2023-07-24T05:47:57.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.112+0000 7f02bdd9b700 1 -- 172.21.15.77:0/1504521374 --> v1:172.21.15.103:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02c006ae00 con 0x7f02c0160f70 2023-07-24T05:47:57.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.112+0000 7f02bed9d700 1 -- 172.21.15.77:0/1504521374 >> v1:172.21.15.103:6789/0 conn(0x7f02c0160f70 legacy=0x7f02c0069be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:57.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.112+0000 7f02bed9d700 1 -- 172.21.15.77:0/1504521374 >> v1:172.21.15.77:6789/0 conn(0x7f02c00cba10 legacy=0x7f02c00c1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:57.121 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.112+0000 7f02bed9d700 1 -- 172.21.15.77:0/1504521374 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c006a2f0 con 0x7f02c00c1b50 2023-07-24T05:47:57.122 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.116+0000 7f02bed9d700 1 --2- 172.21.15.77:0/1504521374 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02c00c1b50 0x7f02c00cd730 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f02b8009d90 tx=0x7f02b800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a8504a0fbd278dd server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:57.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.116+0000 7f02bdd9b700 1 -- 172.21.15.77:0/1504521374 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b800e070 con 0x7f02c00c1b50 2023-07-24T05:47:57.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.116+0000 7f02bdd9b700 1 -- 172.21.15.77:0/1504521374 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b800bb20 con 0x7f02c00c1b50 2023-07-24T05:47:57.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.116+0000 7f02bdd9b700 1 -- 172.21.15.77:0/1504521374 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b8012430 con 0x7f02c00c1b50 2023-07-24T05:47:57.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.116+0000 7f02c4fa0700 1 -- 172.21.15.77:0/1504521374 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02c00c1b50 msgr2=0x7f02c00cd730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:57.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.116+0000 7f02c4fa0700 1 --2- 172.21.15.77:0/1504521374 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02c00c1b50 0x7f02c00cd730 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f02b8009d90 tx=0x7f02b800b330 comp rx=0 tx=0).stop 2023-07-24T05:47:57.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.116+0000 7f02c4fa0700 1 -- 172.21.15.77:0/1504521374 shutdown_connections 2023-07-24T05:47:57.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.116+0000 7f02c4fa0700 1 --2- 172.21.15.77:0/1504521374 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02c00c1b50 0x7f02c00cd730 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:57.123 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.116+0000 7f02c4fa0700 1 -- 172.21.15.77:0/1504521374 >> 172.21.15.77:0/1504521374 conn(0x7f02c00b3450 msgr2=0x7f02c00b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:57.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.116+0000 7f02c4fa0700 1 -- 172.21.15.77:0/1504521374 shutdown_connections 2023-07-24T05:47:57.124 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.116+0000 7f02c4fa0700 1 -- 172.21.15.77:0/1504521374 wait complete. 2023-07-24T05:47:57.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.120+0000 7f02c4fa0700 1 Processor -- start 2023-07-24T05:47:57.125 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.120+0000 7f02c4fa0700 1 -- start start 2023-07-24T05:47:57.126 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.120+0000 7f02c4fa0700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02c00c1b50 0x7f02c01620d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:57.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.120+0000 7f02c4fa0700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f02c00cba10 0x7f02c00cc720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:57.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.120+0000 7f02c4fa0700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02c0160f70 0x7f02c00ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:57.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.120+0000 7f02c4fa0700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c01613e0 con 0x7f02c0160f70 2023-07-24T05:47:57.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.120+0000 7f02c4fa0700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02c01f7250 con 0x7f02c00c1b50 2023-07-24T05:47:57.127 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.120+0000 7f02c4fa0700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02c01615f0 con 0x7f02c00cba10 2023-07-24T05:47:57.128 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.120+0000 7f02bed9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02c0160f70 0x7f02c00ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:57.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.120+0000 7f02bed9d700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02c0160f70 0x7f02c00ccc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41584/0 (socket says 172.21.15.77:41584) 2023-07-24T05:47:57.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.120+0000 7f02bed9d700 1 -- 172.21.15.77:0/2612423006 learned_addr learned my addr 172.21.15.77:0/2612423006 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:57.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.120+0000 7f02be59c700 1 --2- 172.21.15.77:0/2612423006 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02c00c1b50 0x7f02c01620d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:57.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.120+0000 7f02b7fff700 1 --2- 172.21.15.77:0/2612423006 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f02c00cba10 0x7f02c00cc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:57.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.120+0000 7f02bed9d700 1 -- 172.21.15.77:0/2612423006 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f02c00cba10 msgr2=0x7f02c00cc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:57.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.120+0000 7f02bed9d700 1 --2- 172.21.15.77:0/2612423006 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f02c00cba10 0x7f02c00cc720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:57.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.120+0000 7f02bed9d700 1 -- 172.21.15.77:0/2612423006 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02c00c1b50 msgr2=0x7f02c01620d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:57.129 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.120+0000 7f02bed9d700 1 --2- 172.21.15.77:0/2612423006 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02c00c1b50 0x7f02c01620d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:57.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.120+0000 7f02bed9d700 1 -- 172.21.15.77:0/2612423006 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b8009a70 con 0x7f02c0160f70 2023-07-24T05:47:57.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.120+0000 7f02b7fff700 1 --2- 172.21.15.77:0/2612423006 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f02c00cba10 0x7f02c00cc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-24T05:47:57.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.120+0000 7f02bed9d700 1 --2- 172.21.15.77:0/2612423006 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02c0160f70 0x7f02c00ccc60 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f02b8013000 tx=0x7f02b8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:57.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.120+0000 7f02b6ffd700 1 -- 172.21.15.77:0/2612423006 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b801b810 con 0x7f02c0160f70 2023-07-24T05:47:57.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.120+0000 7f02b6ffd700 1 -- 172.21.15.77:0/2612423006 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02b8020070 con 0x7f02c0160f70 2023-07-24T05:47:57.130 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.120+0000 7f02c4fa0700 1 -- 172.21.15.77:0/2612423006 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02c01618d0 con 0x7f02c0160f70 2023-07-24T05:47:57.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.120+0000 7f02b6ffd700 1 -- 172.21.15.77:0/2612423006 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02b801bbb0 con 0x7f02c0160f70 2023-07-24T05:47:57.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.120+0000 7f02c4fa0700 1 -- 172.21.15.77:0/2612423006 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02c00c2ff0 con 0x7f02c0160f70 2023-07-24T05:47:57.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.124+0000 7f02c4fa0700 1 -- 172.21.15.77:0/2612423006 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02c0161df0 con 0x7f02c0160f70 2023-07-24T05:47:57.131 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.124+0000 7f02b6ffd700 1 -- 172.21.15.77:0/2612423006 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f02b801bd10 con 0x7f02c0160f70 2023-07-24T05:47:57.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.124+0000 7f02b6ffd700 1 --2- 172.21.15.77:0/2612423006 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f02a00662f0 0x7f02a00687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:57.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.128+0000 7f02b6ffd700 1 -- 172.21.15.77:0/2612423006 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f02b8022070 con 0x7f02c0160f70 2023-07-24T05:47:57.133 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.128+0000 7f02be59c700 1 --2- 172.21.15.77:0/2612423006 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f02a00662f0 0x7f02a00687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:57.134 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.128+0000 7f02be59c700 1 --2- 172.21.15.77:0/2612423006 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f02a00662f0 0x7f02a00687b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f02b00011e0 tx=0x7f02b0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:57.140 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.132+0000 7f02b6ffd700 1 -- 172.21.15.77:0/2612423006 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f02b80b6700 con 0x7f02c0160f70 2023-07-24T05:47:57.343 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.336+0000 7f02c4fa0700 1 -- 172.21.15.77:0/2612423006 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f02c004df10 con 0x7f02c0160f70 2023-07-24T05:47:57.344 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.336+0000 7f02b6ffd700 1 -- 172.21.15.77:0/2612423006 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4671 (secure 0 0 0) 0x7f02c0161df0 con 0x7f02c0160f70 2023-07-24T05:47:57.345 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:47:57.345 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5596,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/3507550644","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6833","nonce":3507550644},{"type":"v1","addr":"172.21.15.77:6835","nonce":3507550644}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5599,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6836/93827363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":93827363},{"type":"v1","addr":"172.21.15.103:6836","nonce":93827363}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5673,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6834/1812124332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1812124332},{"type":"v1","addr":"172.21.15.77:6834","nonce":1812124332}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-24T05:47:51.010765+0000","modified":"2023-07-24T05:47:54.611783+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5685},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5685":{"gid":5685,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.103:6837/3210395971","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6835","nonce":3210395971},{"type":"v1","addr":"172.21.15.103:6837","nonce":3210395971}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-24T05:47:57.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.340+0000 7f02c4fa0700 1 -- 172.21.15.77:0/2612423006 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f02a00662f0 msgr2=0x7f02a00687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:57.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.340+0000 7f02c4fa0700 1 --2- 172.21.15.77:0/2612423006 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f02a00662f0 0x7f02a00687b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f02b00011e0 tx=0x7f02b0009040 comp rx=0 tx=0).stop 2023-07-24T05:47:57.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.340+0000 7f02c4fa0700 1 -- 172.21.15.77:0/2612423006 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02c0160f70 msgr2=0x7f02c00ccc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:57.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.340+0000 7f02c4fa0700 1 --2- 172.21.15.77:0/2612423006 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02c0160f70 0x7f02c00ccc60 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f02b8013000 tx=0x7f02b8004af0 comp rx=0 tx=0).stop 2023-07-24T05:47:57.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.340+0000 7f02c4fa0700 1 -- 172.21.15.77:0/2612423006 shutdown_connections 2023-07-24T05:47:57.347 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.340+0000 7f02c4fa0700 1 --2- 172.21.15.77:0/2612423006 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f02c0160f70 0x7f02c00ccc60 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:57.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.340+0000 7f02c4fa0700 1 --2- 172.21.15.77:0/2612423006 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f02a00662f0 0x7f02a00687b0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:57.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.340+0000 7f02c4fa0700 1 --2- 172.21.15.77:0/2612423006 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f02c00cba10 0x7f02c00cc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:57.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.340+0000 7f02c4fa0700 1 --2- 172.21.15.77:0/2612423006 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f02c00c1b50 0x7f02c01620d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:57.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.340+0000 7f02c4fa0700 1 -- 172.21.15.77:0/2612423006 >> 172.21.15.77:0/2612423006 conn(0x7f02c00b3450 msgr2=0x7f02c00b08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:57.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.340+0000 7f02c4fa0700 1 -- 172.21.15.77:0/2612423006 shutdown_connections 2023-07-24T05:47:57.348 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.340+0000 7f02c4fa0700 1 -- 172.21.15.77:0/2612423006 wait complete. 2023-07-24T05:47:57.349 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 18 2023-07-24T05:47:57.769 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-24T05:47:51.010765+0000', 'modified': '2023-07-24T05:47:54.611783+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5685}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5685': {'gid': 5685, 'name': 'd', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.103:6837/3210395971', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.103:6835', 'nonce': 3210395971}, {'type': 'v1', 'addr': '172.21.15.103:6837', 'nonce': 3210395971}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-24T05:47:57.770 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-24T05:47:57.770 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-07-24T05:47:57.947 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.940+0000 7f307a89e700 1 Processor -- start 2023-07-24T05:47:57.948 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.940+0000 7f307a89e700 1 -- start start 2023-07-24T05:47:57.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.944+0000 7f307a89e700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f307415ca90 0x7f30740b8280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:57.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.944+0000 7f307a89e700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f30740d1f00 0x7f30740b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:57.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.944+0000 7f307a89e700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30740b5a00 con 0x7f30740b4420 2023-07-24T05:47:57.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.944+0000 7f307a89e700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30740b4df0 con 0x7f30740d1f00 2023-07-24T05:47:57.950 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.944+0000 7f307a89e700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f307406a8a0 con 0x7f307415ca90 2023-07-24T05:47:57.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.944+0000 7f306b7fe700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f30740b4420 0x7f3074160770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:32778/0 (socket says 172.21.15.77:32778) 2023-07-24T05:47:57.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.944+0000 7f3078e3b700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f30740d1f00 0x7f30740b48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:57.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.944+0000 7f306b7fe700 1 -- 172.21.15.77:0/2159632033 learned_addr learned my addr 172.21.15.77:0/2159632033 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:47:57.951 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.944+0000 7f3073fff700 1 --2- 172.21.15.77:0/2159632033 >> v2:172.21.15.103:3300/0 conn(0x7f307415ca90 0x7f30740b8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:57.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.944+0000 7f3078e3b700 1 -- 172.21.15.77:0/2159632033 >> v2:172.21.15.103:3300/0 conn(0x7f307415ca90 msgr2=0x7f30740b8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:57.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.944+0000 7f3078e3b700 1 --2- 172.21.15.77:0/2159632033 >> v2:172.21.15.103:3300/0 conn(0x7f307415ca90 0x7f30740b8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:57.952 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.944+0000 7f3078e3b700 1 -- 172.21.15.77:0/2159632033 >> v1:172.21.15.77:6789/0 conn(0x7f30740b4420 legacy=0x7f3074160770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:57.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.944+0000 7f3078e3b700 1 -- 172.21.15.77:0/2159632033 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3074069c90 con 0x7f30740d1f00 2023-07-24T05:47:57.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.944+0000 7f30737fe700 1 -- 172.21.15.77:0/2159632033 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2651428562 0 0) 0x7f30740b5a00 con 0x7f30740b4420 2023-07-24T05:47:57.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.944+0000 7f3078e3b700 1 --2- 172.21.15.77:0/2159632033 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30740d1f00 0x7f30740b48b0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f30740b5340 tx=0x7f306c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bbef6b03d71053a server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:57.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.944+0000 7f30737fe700 1 -- 172.21.15.77:0/2159632033 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306c00e070 con 0x7f30740d1f00 2023-07-24T05:47:57.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.944+0000 7f30737fe700 1 -- 172.21.15.77:0/2159632033 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306c00bb20 con 0x7f30740d1f00 2023-07-24T05:47:57.953 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.944+0000 7f30737fe700 1 -- 172.21.15.77:0/2159632033 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306c012430 con 0x7f30740d1f00 2023-07-24T05:47:57.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.948+0000 7f307a89e700 1 -- 172.21.15.77:0/2159632033 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30740d1f00 msgr2=0x7f30740b48b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:57.954 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.948+0000 7f307a89e700 1 --2- 172.21.15.77:0/2159632033 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30740d1f00 0x7f30740b48b0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f30740b5340 tx=0x7f306c00b330 comp rx=0 tx=0).stop 2023-07-24T05:47:57.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.948+0000 7f307a89e700 1 -- 172.21.15.77:0/2159632033 shutdown_connections 2023-07-24T05:47:57.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.948+0000 7f307a89e700 1 --2- 172.21.15.77:0/2159632033 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30740d1f00 0x7f30740b48b0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:57.955 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.948+0000 7f307a89e700 1 --2- 172.21.15.77:0/2159632033 >> v2:172.21.15.103:3300/0 conn(0x7f307415ca90 0x7f30740b8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:57.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.948+0000 7f307a89e700 1 -- 172.21.15.77:0/2159632033 >> 172.21.15.77:0/2159632033 conn(0x7f30740cf420 msgr2=0x7f30740cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:57.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.948+0000 7f307a89e700 1 -- 172.21.15.77:0/2159632033 shutdown_connections 2023-07-24T05:47:57.956 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.948+0000 7f307a89e700 1 -- 172.21.15.77:0/2159632033 wait complete. 2023-07-24T05:47:57.957 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.952+0000 7f307a89e700 1 Processor -- start 2023-07-24T05:47:57.958 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.952+0000 7f307a89e700 1 -- start start 2023-07-24T05:47:57.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.952+0000 7f307a89e700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30740b4420 0x7f307415a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:57.960 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.952+0000 7f307a89e700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f30740d1f00 0x7f307415e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:57.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.952+0000 7f307a89e700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f307415ca90 0x7f30740cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:57.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.952+0000 7f307a89e700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30740cbd30 con 0x7f30740b4420 2023-07-24T05:47:57.961 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.952+0000 7f307a89e700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30741f57f0 con 0x7f307415ca90 2023-07-24T05:47:57.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.952+0000 7f307a89e700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30740cbf60 con 0x7f30740d1f00 2023-07-24T05:47:57.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.952+0000 7f3073fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30740b4420 0x7f307415a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:57.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.952+0000 7f3073fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30740b4420 0x7f307415a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41608/0 (socket says 172.21.15.77:41608) 2023-07-24T05:47:57.962 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.952+0000 7f3073fff700 1 -- 172.21.15.77:0/1302382237 learned_addr learned my addr 172.21.15.77:0/1302382237 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:57.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.952+0000 7f3078e3b700 1 --2- 172.21.15.77:0/1302382237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f307415ca90 0x7f30740cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:57.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.952+0000 7f306b7fe700 1 --2- 172.21.15.77:0/1302382237 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f30740d1f00 0x7f307415e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:57.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.952+0000 7f3073fff700 1 -- 172.21.15.77:0/1302382237 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f30740d1f00 msgr2=0x7f307415e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:57.963 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.952+0000 7f3073fff700 1 --2- 172.21.15.77:0/1302382237 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f30740d1f00 0x7f307415e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:57.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.952+0000 7f3073fff700 1 -- 172.21.15.77:0/1302382237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f307415ca90 msgr2=0x7f30740cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:57.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.952+0000 7f3073fff700 1 --2- 172.21.15.77:0/1302382237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f307415ca90 0x7f30740cb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:57.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.952+0000 7f3073fff700 1 -- 172.21.15.77:0/1302382237 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f306c009a70 con 0x7f30740b4420 2023-07-24T05:47:57.964 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.952+0000 7f306b7fe700 1 --2- 172.21.15.77:0/1302382237 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f30740d1f00 0x7f307415e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:57.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.952+0000 7f3073fff700 1 --2- 172.21.15.77:0/1302382237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30740b4420 0x7f307415a2b0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f306400e840 tx=0x7f306400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:57.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.956+0000 7f30717fa700 1 -- 172.21.15.77:0/1302382237 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30640095a0 con 0x7f30740b4420 2023-07-24T05:47:57.966 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.956+0000 7f30717fa700 1 -- 172.21.15.77:0/1302382237 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3064013680 con 0x7f30740b4420 2023-07-24T05:47:57.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.956+0000 7f307a89e700 1 -- 172.21.15.77:0/1302382237 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30740cc240 con 0x7f30740b4420 2023-07-24T05:47:57.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.956+0000 7f30717fa700 1 -- 172.21.15.77:0/1302382237 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30640139f0 con 0x7f30740b4420 2023-07-24T05:47:57.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.956+0000 7f307a89e700 1 -- 172.21.15.77:0/1302382237 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30741f5a40 con 0x7f30740b4420 2023-07-24T05:47:57.967 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.956+0000 7f30717fa700 1 -- 172.21.15.77:0/1302382237 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3064013b50 con 0x7f30740b4420 2023-07-24T05:47:57.970 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.960+0000 7f30717fa700 1 --2- 172.21.15.77:0/1302382237 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f30580662f0 0x7f30580687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:57.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.960+0000 7f30717fa700 1 -- 172.21.15.77:0/1302382237 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3064083dc0 con 0x7f30740b4420 2023-07-24T05:47:57.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.960+0000 7f307db32740 1 Processor -- start 2023-07-24T05:47:57.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.960+0000 7f307db32740 1 -- start start 2023-07-24T05:47:57.971 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.960+0000 7f306b7fe700 1 --2- 172.21.15.77:0/1302382237 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f30580662f0 0x7f30580687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:57.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.960+0000 7f307db32740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x23b1b80 0x23b1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:57.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.960+0000 7f307db32740 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x23b24a0 0x2366dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:57.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.960+0000 7f307db32740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2367310 0x23676f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:57.972 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.960+0000 7f307db32740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x22d8ef0 con 0x2367310 2023-07-24T05:47:57.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.960+0000 7f307db32740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x22d65e0 con 0x23b1b80 2023-07-24T05:47:57.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.960+0000 7f307db32740 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x22d1ed0 con 0x23b24a0 2023-07-24T05:47:57.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.960+0000 7f306b7fe700 1 --2- 172.21.15.77:0/1302382237 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f30580662f0 0x7f30580687b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f305c000f60 tx=0x7f305c007ce0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:57.973 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.964+0000 7f3078e3b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2367310 0x23676f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:57.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.964+0000 7f306b7fe700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x23b24a0 0x2366dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:57.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.964+0000 7f3073fff700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x23b1b80 0x23b1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:57.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.964+0000 7f3078e3b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2367310 0x23676f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41624/0 (socket says 172.21.15.77:41624) 2023-07-24T05:47:57.974 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.964+0000 7f3078e3b700 1 -- 172.21.15.77:0/3717201489 learned_addr learned my addr 172.21.15.77:0/3717201489 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:57.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.964+0000 7f3078e3b700 1 -- 172.21.15.77:0/3717201489 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x23b24a0 msgr2=0x2366dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:57.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.964+0000 7f3078e3b700 1 --2- 172.21.15.77:0/3717201489 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x23b24a0 0x2366dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:57.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.964+0000 7f3078e3b700 1 -- 172.21.15.77:0/3717201489 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x23b1b80 msgr2=0x23b1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:57.975 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.964+0000 7f3078e3b700 1 --2- 172.21.15.77:0/3717201489 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x23b1b80 0x23b1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:57.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.964+0000 7f3078e3b700 1 -- 172.21.15.77:0/3717201489 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2283580 con 0x2367310 2023-07-24T05:47:57.976 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.964+0000 7f3078e3b700 1 --2- 172.21.15.77:0/3717201489 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2367310 0x23676f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f306c009fd0 tx=0x7f306c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b307725b0fae6422 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:57.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.964+0000 7f3069ffb700 1 -- 172.21.15.77:0/3717201489 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306c003a40 con 0x2367310 2023-07-24T05:47:57.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.964+0000 7f3069ffb700 1 -- 172.21.15.77:0/3717201489 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306c003bc0 con 0x2367310 2023-07-24T05:47:57.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.964+0000 7f3069ffb700 1 -- 172.21.15.77:0/3717201489 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306c0125e0 con 0x2367310 2023-07-24T05:47:57.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.964+0000 7f307db32740 1 -- 172.21.15.77:0/3717201489 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2367310 msgr2=0x23676f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:57.979 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.964+0000 7f307db32740 1 --2- 172.21.15.77:0/3717201489 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2367310 0x23676f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f306c009fd0 tx=0x7f306c010000 comp rx=0 tx=0).stop 2023-07-24T05:47:57.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.964+0000 7f307db32740 1 -- 172.21.15.77:0/3717201489 shutdown_connections 2023-07-24T05:47:57.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.964+0000 7f307db32740 1 --2- 172.21.15.77:0/3717201489 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2367310 0x23676f0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:57.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.964+0000 7f307db32740 1 --2- 172.21.15.77:0/3717201489 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x23b24a0 0x2366dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:57.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.964+0000 7f307db32740 1 --2- 172.21.15.77:0/3717201489 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x23b1b80 0x23b1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:57.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.964+0000 7f307db32740 1 -- 172.21.15.77:0/3717201489 >> 172.21.15.77:0/3717201489 conn(0x20f9550 msgr2=0x236d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:57.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.964+0000 7f307db32740 1 -- 172.21.15.77:0/3717201489 shutdown_connections 2023-07-24T05:47:57.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.964+0000 7f307db32740 1 -- 172.21.15.77:0/3717201489 wait complete. 2023-07-24T05:47:57.980 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.968+0000 7f307db32740 1 -- start start 2023-07-24T05:47:57.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.968+0000 7f307db32740 1 Processor -- start 2023-07-24T05:47:57.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.968+0000 7f307db32740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2367310 0x2396790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:57.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.968+0000 7f307db32740 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x23b1b80 0x23973c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:57.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.968+0000 7f307db32740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x23b24a0 0x2397900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:57.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.968+0000 7f307db32740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x2293b00 con 0x23b24a0 2023-07-24T05:47:57.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.968+0000 7f307db32740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x2292470 con 0x2367310 2023-07-24T05:47:57.981 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.968+0000 7f307db32740 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x217db20 con 0x23b1b80 2023-07-24T05:47:57.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.968+0000 7f307db32740 10 client.0 _ll_register_callbacks cb 0x2324bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-24T05:47:57.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.968+0000 7f3078e3b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x23b24a0 0x2397900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:57.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.968+0000 7f3078e3b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x23b24a0 0x2397900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41626/0 (socket says 172.21.15.77:41626) 2023-07-24T05:47:57.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.968+0000 7f3078e3b700 1 -- 172.21.15.77:0/914017216 learned_addr learned my addr 172.21.15.77:0/914017216 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:57.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.968+0000 7f306b7fe700 1 --2- 172.21.15.77:0/914017216 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x23b1b80 0x23973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:57.982 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.968+0000 7f3073fff700 1 --2- 172.21.15.77:0/914017216 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2367310 0x2396790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:57.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.968+0000 7f3078e3b700 1 -- 172.21.15.77:0/914017216 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x23b1b80 msgr2=0x23973c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:57.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.968+0000 7f3078e3b700 1 --2- 172.21.15.77:0/914017216 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x23b1b80 0x23973c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:57.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.968+0000 7f3078e3b700 1 -- 172.21.15.77:0/914017216 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2367310 msgr2=0x2396790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:57.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.968+0000 7f3078e3b700 1 --2- 172.21.15.77:0/914017216 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2367310 0x2396790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:57.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.968+0000 7f3078e3b700 1 -- 172.21.15.77:0/914017216 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3074069c90 con 0x23b24a0 2023-07-24T05:47:57.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.968+0000 7f306b7fe700 1 --2- 172.21.15.77:0/914017216 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x23b1b80 0x23973c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-24T05:47:57.983 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.972+0000 7f3078e3b700 1 --2- 172.21.15.77:0/914017216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x23b24a0 0x2397900 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f306c00b680 tx=0x7f306c004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6ed2b607dc45858 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:57.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.972+0000 7f3062ffd700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-07-24T05:47:57.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.972+0000 7f3062ffd700 1 -- 172.21.15.77:0/914017216 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306c003a40 con 0x23b24a0 2023-07-24T05:47:57.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.972+0000 7f307db32740 1 -- 172.21.15.77:0/914017216 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x22c9be0 con 0x23b24a0 2023-07-24T05:47:57.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.972+0000 7f3062ffd700 1 -- 172.21.15.77:0/914017216 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f306c025620 con 0x23b24a0 2023-07-24T05:47:57.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.972+0000 7f3062ffd700 1 -- 172.21.15.77:0/914017216 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f306c0257e0 con 0x23b24a0 2023-07-24T05:47:57.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.972+0000 7f307db32740 10 client.5859 fetch_fsmap learned FSMap version 18 2023-07-24T05:47:57.984 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.972+0000 7f307db32740 1 -- 172.21.15.77:0/914017216 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x21449e0 con 0x23b24a0 2023-07-24T05:47:57.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.972+0000 7f3062ffd700 1 -- 172.21.15.77:0/914017216 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x22c9be0 con 0x23b24a0 2023-07-24T05:47:57.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.972+0000 7f3062ffd700 1 -- 172.21.15.77:0/914017216 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 18) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f306c025940 con 0x23b24a0 2023-07-24T05:47:57.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.972+0000 7f307db32740 10 client.5859 fetch_fsmap finished waiting for FSMap version 18 2023-07-24T05:47:57.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.972+0000 7f307db32740 10 client.5859 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-24T05:47:57.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.972+0000 7f307db32740 20 client.5859 populate_metadata read hostname 'smithi077' 2023-07-24T05:47:57.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.972+0000 7f307db32740 1 --2- 172.21.15.77:0/914017216 >> [v2:172.21.15.103:6835/3210395971,v1:172.21.15.103:6837/3210395971] conn(0x236bf20 0x236c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:57.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.972+0000 7f307db32740 4 client.5859 mds_command: new command op to 5685 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-24T05:47:57.985 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.972+0000 7f307db32740 1 -- 172.21.15.77:0/914017216 --> [v2:172.21.15.103:6835/3210395971,v1:172.21.15.103:6837/3210395971] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x22caeb0 con 0x236bf20 2023-07-24T05:47:57.986 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.972+0000 7f3073fff700 1 --2- 172.21.15.77:0/914017216 >> [v2:172.21.15.103:6835/3210395971,v1:172.21.15.103:6837/3210395971] conn(0x236bf20 0x236c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:57.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.972+0000 7f3073fff700 1 --2- 172.21.15.77:0/914017216 >> [v2:172.21.15.103:6835/3210395971,v1:172.21.15.103:6837/3210395971] conn(0x236bf20 0x236c300 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a21be609a2ca0eb8 server_cookie=eceb3b875b7950d3 in_seq=0 out_seq=0 2023-07-24T05:47:57.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.972+0000 7f3062ffd700 10 client.5859 ms_handle_connect on v2:172.21.15.103:6835/3210395971 2023-07-24T05:47:57.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.976+0000 7f3062ffd700 1 -- 172.21.15.77:0/914017216 <== mds.0 v2:172.21.15.103:6835/3210395971 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x22caeb0 con 0x236bf20 2023-07-24T05:47:57.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.976+0000 7f3062ffd700 10 client.5859 handle_command_reply: tid=0 2023-07-24T05:47:57.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.976+0000 7f307db32740 1 client.5859 shutdown 2023-07-24T05:47:57.987 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.976+0000 7f307db32740 1 -- 172.21.15.77:0/914017216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x23b24a0 msgr2=0x2397900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:57.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.976+0000 7f307db32740 1 --2- 172.21.15.77:0/914017216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x23b24a0 0x2397900 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f306c00b680 tx=0x7f306c004b60 comp rx=0 tx=0).stop 2023-07-24T05:47:57.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.976+0000 7f307db32740 1 -- 172.21.15.77:0/914017216 shutdown_connections 2023-07-24T05:47:57.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.976+0000 7f307db32740 1 --2- 172.21.15.77:0/914017216 >> [v2:172.21.15.103:6835/3210395971,v1:172.21.15.103:6837/3210395971] conn(0x236bf20 0x236c300 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:57.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.976+0000 7f307db32740 1 --2- 172.21.15.77:0/914017216 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x23b24a0 0x2397900 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:57.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.976+0000 7f307db32740 1 --2- 172.21.15.77:0/914017216 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x23b1b80 0x23973c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:57.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.976+0000 7f3062ffd700 0 client.5859 ms_handle_reset on v2:172.21.15.103:6835/3210395971 2023-07-24T05:47:57.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.976+0000 7f307db32740 1 --2- 172.21.15.77:0/914017216 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2367310 0x2396790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:57.988 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.976+0000 7f307db32740 1 -- 172.21.15.77:0/914017216 >> 172.21.15.77:0/914017216 conn(0x20f9550 msgr2=0x2367f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:57.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.976+0000 7f307db32740 1 -- 172.21.15.77:0/914017216 shutdown_connections 2023-07-24T05:47:57.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.976+0000 7f307db32740 1 -- 172.21.15.77:0/914017216 wait complete. 2023-07-24T05:47:57.989 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.976+0000 7f307db32740 20 client.5859 trim_cache size 0 max 16384 2023-07-24T05:47:58.002 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.996+0000 7f307db32740 1 Processor -- start 2023-07-24T05:47:58.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.996+0000 7f307db32740 1 -- start start 2023-07-24T05:47:58.003 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.996+0000 7f307db32740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2367310 0x236abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:58.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.996+0000 7f307db32740 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x23b1b80 0x236b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:58.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.996+0000 7f307db32740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x23b24a0 0x23b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:58.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.996+0000 7f307db32740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x22a0d50 con 0x2367310 2023-07-24T05:47:58.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.996+0000 7f307db32740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x22cf6e0 con 0x23b24a0 2023-07-24T05:47:58.004 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.996+0000 7f307db32740 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x22cf2d0 con 0x23b1b80 2023-07-24T05:47:58.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.996+0000 7f3073fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2367310 0x236abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:58.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.996+0000 7f3073fff700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2367310 0x236abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41638/0 (socket says 172.21.15.77:41638) 2023-07-24T05:47:58.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.996+0000 7f3073fff700 1 -- 172.21.15.77:0/2554448708 learned_addr learned my addr 172.21.15.77:0/2554448708 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:58.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.996+0000 7f3078e3b700 1 --2- 172.21.15.77:0/2554448708 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x23b24a0 0x23b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:58.005 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:57.996+0000 7f306b7fe700 1 --2- 172.21.15.77:0/2554448708 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x23b1b80 0x236b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:58.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.000+0000 7f3073fff700 1 -- 172.21.15.77:0/2554448708 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x23b1b80 msgr2=0x236b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:58.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.000+0000 7f3073fff700 1 --2- 172.21.15.77:0/2554448708 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x23b1b80 0x236b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:58.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.000+0000 7f3073fff700 1 -- 172.21.15.77:0/2554448708 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x23b24a0 msgr2=0x23b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:58.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.000+0000 7f3073fff700 1 --2- 172.21.15.77:0/2554448708 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x23b24a0 0x23b03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:58.006 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.000+0000 7f3073fff700 1 -- 172.21.15.77:0/2554448708 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f307415b340 con 0x2367310 2023-07-24T05:47:58.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.000+0000 7f3073fff700 1 --2- 172.21.15.77:0/2554448708 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2367310 0x236abb0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f3064009fd0 tx=0x7f3064081f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e50c05755da6be server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:58.007 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.000+0000 7f306a7fc700 1 -- 172.21.15.77:0/2554448708 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3064058040 con 0x2367310 2023-07-24T05:47:58.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.000+0000 7f306a7fc700 1 -- 172.21.15.77:0/2554448708 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3064082180 con 0x2367310 2023-07-24T05:47:58.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.000+0000 7f306a7fc700 1 -- 172.21.15.77:0/2554448708 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3064052e70 con 0x2367310 2023-07-24T05:47:58.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.000+0000 7f307db32740 1 -- 172.21.15.77:0/2554448708 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2367310 msgr2=0x236abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:58.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.000+0000 7f307db32740 1 --2- 172.21.15.77:0/2554448708 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2367310 0x236abb0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f3064009fd0 tx=0x7f3064081f10 comp rx=0 tx=0).stop 2023-07-24T05:47:58.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.000+0000 7f307db32740 1 -- 172.21.15.77:0/2554448708 shutdown_connections 2023-07-24T05:47:58.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.000+0000 7f307db32740 1 --2- 172.21.15.77:0/2554448708 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x23b24a0 0x23b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:58.008 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.000+0000 7f307db32740 1 --2- 172.21.15.77:0/2554448708 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x23b1b80 0x236b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:58.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.000+0000 7f307db32740 1 --2- 172.21.15.77:0/2554448708 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x2367310 0x236abb0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:58.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.000+0000 7f307db32740 1 -- 172.21.15.77:0/2554448708 >> 172.21.15.77:0/2554448708 conn(0x20f9550 msgr2=0x2394180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:58.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.000+0000 7f307db32740 1 -- 172.21.15.77:0/2554448708 shutdown_connections 2023-07-24T05:47:58.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.000+0000 7f307db32740 1 -- 172.21.15.77:0/2554448708 wait complete. 2023-07-24T05:47:58.009 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.000+0000 7f307db32740 1 -- start start 2023-07-24T05:47:58.010 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.004+0000 7f307db32740 1 Processor -- start 2023-07-24T05:47:58.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.004+0000 7f307db32740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2367310 0x23fa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:58.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.004+0000 7f307db32740 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x23b1b80 0x23c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:58.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.004+0000 7f307db32740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x23b24a0 0x2410fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:58.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.004+0000 7f307db32740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x22a1510 con 0x23b24a0 2023-07-24T05:47:58.012 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.004+0000 7f307db32740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x22d57b0 con 0x2367310 2023-07-24T05:47:58.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.004+0000 7f307db32740 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x23ce4e0 con 0x23b1b80 2023-07-24T05:47:58.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.004+0000 7f307db32740 10 client.0 _ll_register_callbacks cb 0x2289800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-24T05:47:58.013 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.004+0000 7f3078e3b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x23b24a0 0x2410fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:58.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.004+0000 7f3078e3b700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x23b24a0 0x2410fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41648/0 (socket says 172.21.15.77:41648) 2023-07-24T05:47:58.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.004+0000 7f3078e3b700 1 -- 172.21.15.77:0/1562010486 learned_addr learned my addr 172.21.15.77:0/1562010486 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:58.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.004+0000 7f3073fff700 1 --2- 172.21.15.77:0/1562010486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2367310 0x23fa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:58.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.004+0000 7f306b7fe700 1 --2- 172.21.15.77:0/1562010486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x23b1b80 0x23c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:58.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.008+0000 7f3078e3b700 1 -- 172.21.15.77:0/1562010486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x23b1b80 msgr2=0x23c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:58.014 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.008+0000 7f3078e3b700 1 --2- 172.21.15.77:0/1562010486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x23b1b80 0x23c19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:58.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.008+0000 7f3078e3b700 1 -- 172.21.15.77:0/1562010486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2367310 msgr2=0x23fa4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:58.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.008+0000 7f3078e3b700 1 --2- 172.21.15.77:0/1562010486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2367310 0x23fa4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:58.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.008+0000 7f3078e3b700 1 -- 172.21.15.77:0/1562010486 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30741f5a40 con 0x23b24a0 2023-07-24T05:47:58.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.008+0000 7f3073fff700 1 --2- 172.21.15.77:0/1562010486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2367310 0x23fa4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:47:58.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.008+0000 7f3078e3b700 1 --2- 172.21.15.77:0/1562010486 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x23b24a0 0x2410fa0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f306c030e70 tx=0x7f306c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67622cd29f525ea3 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:58.015 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.008+0000 7f3062ffd700 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2023-07-24T05:47:58.016 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.008+0000 7f3062ffd700 1 -- 172.21.15.77:0/1562010486 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306c00e040 con 0x23b24a0 2023-07-24T05:47:58.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.008+0000 7f3062ffd700 1 -- 172.21.15.77:0/1562010486 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f306c03fd90 con 0x23b24a0 2023-07-24T05:47:58.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.008+0000 7f307db32740 1 -- 172.21.15.77:0/1562010486 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f306c003bc0 con 0x23b24a0 2023-07-24T05:47:58.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.008+0000 7f3062ffd700 1 -- 172.21.15.77:0/1562010486 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f306c003a40 con 0x23b24a0 2023-07-24T05:47:58.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.008+0000 7f307db32740 10 client.5865 fetch_fsmap learned FSMap version 18 2023-07-24T05:47:58.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.008+0000 7f307db32740 1 -- 172.21.15.77:0/1562010486 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x2297250 con 0x23b24a0 2023-07-24T05:47:58.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.008+0000 7f3062ffd700 1 -- 172.21.15.77:0/1562010486 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f306c003bc0 con 0x23b24a0 2023-07-24T05:47:58.017 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.008+0000 7f3062ffd700 1 -- 172.21.15.77:0/1562010486 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 18) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f306c025620 con 0x23b24a0 2023-07-24T05:47:58.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.008+0000 7f307db32740 10 client.5865 fetch_fsmap finished waiting for FSMap version 18 2023-07-24T05:47:58.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.008+0000 7f307db32740 10 client.5865 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-24T05:47:58.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.008+0000 7f307db32740 20 client.5865 populate_metadata read hostname 'smithi077' 2023-07-24T05:47:58.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.008+0000 7f307db32740 1 --2- 172.21.15.77:0/1562010486 >> [v2:172.21.15.103:6835/3210395971,v1:172.21.15.103:6837/3210395971] conn(0x23b7350 0x23b7730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:58.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.008+0000 7f307db32740 4 client.5865 mds_command: new command op to 5685 tid=0[{"prefix": "status"}] 2023-07-24T05:47:58.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.008+0000 7f307db32740 1 -- 172.21.15.77:0/1562010486 --> [v2:172.21.15.103:6835/3210395971,v1:172.21.15.103:6837/3210395971] -- command(tid 0: {"prefix": "status"}) v1 -- 0x22cabd0 con 0x23b7350 2023-07-24T05:47:58.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.008+0000 7f3073fff700 1 --2- 172.21.15.77:0/1562010486 >> [v2:172.21.15.103:6835/3210395971,v1:172.21.15.103:6837/3210395971] conn(0x23b7350 0x23b7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:58.018 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.008+0000 7f3062ffd700 10 client.5865 ms_handle_connect on v2:172.21.15.103:6835/3210395971 2023-07-24T05:47:58.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.008+0000 7f3073fff700 1 --2- 172.21.15.77:0/1562010486 >> [v2:172.21.15.103:6835/3210395971,v1:172.21.15.103:6837/3210395971] conn(0x23b7350 0x23b7730 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43bb619cf71eda75 server_cookie=4379b6cac9bb8d7 in_seq=0 out_seq=0 2023-07-24T05:47:58.019 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.012+0000 7f3062ffd700 1 -- 172.21.15.77:0/1562010486 <== mds.0 v2:172.21.15.103:6835/3210395971 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x22cabd0 con 0x23b7350 2023-07-24T05:47:58.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.012+0000 7f3062ffd700 10 client.5865 handle_command_reply: tid=0 2023-07-24T05:47:58.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.012+0000 7f307db32740 1 client.5865 shutdown 2023-07-24T05:47:58.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.012+0000 7f307db32740 1 -- 172.21.15.77:0/1562010486 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x23b24a0 msgr2=0x2410fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:58.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.012+0000 7f307db32740 1 --2- 172.21.15.77:0/1562010486 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x23b24a0 0x2410fa0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f306c030e70 tx=0x7f306c010000 comp rx=0 tx=0).stop 2023-07-24T05:47:58.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.012+0000 7f307db32740 1 -- 172.21.15.77:0/1562010486 shutdown_connections 2023-07-24T05:47:58.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.012+0000 7f307db32740 1 --2- 172.21.15.77:0/1562010486 >> [v2:172.21.15.103:6835/3210395971,v1:172.21.15.103:6837/3210395971] conn(0x23b7350 0x23b7730 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:58.020 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.012+0000 7f307db32740 1 --2- 172.21.15.77:0/1562010486 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x23b24a0 0x2410fa0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:58.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.012+0000 7f307db32740 1 --2- 172.21.15.77:0/1562010486 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x23b1b80 0x23c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:58.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.012+0000 7f307db32740 1 --2- 172.21.15.77:0/1562010486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x2367310 0x23fa4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:58.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.012+0000 7f3062ffd700 0 client.5865 ms_handle_reset on v2:172.21.15.103:6835/3210395971 2023-07-24T05:47:58.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.012+0000 7f307db32740 1 -- 172.21.15.77:0/1562010486 >> 172.21.15.77:0/1562010486 conn(0x20f9550 msgr2=0x23c12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:58.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.012+0000 7f307db32740 1 -- 172.21.15.77:0/1562010486 shutdown_connections 2023-07-24T05:47:58.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.012+0000 7f307db32740 1 -- 172.21.15.77:0/1562010486 wait complete. 2023-07-24T05:47:58.021 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.012+0000 7f307db32740 20 client.5865 trim_cache size 0 max 16384 2023-07-24T05:47:58.022 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-07-24T05:47:58.022 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "5aed5f7b-fb55-4d95-9c02-c6adbb1677b4", 2023-07-24T05:47:58.022 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 0, 2023-07-24T05:47:58.022 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 5685, 2023-07-24T05:47:58.022 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2023-07-24T05:47:58.022 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2023-07-24T05:47:58.023 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs", 2023-07-24T05:47:58.023 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 6.4268302869999996, 2023-07-24T05:47:58.023 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 18, 2023-07-24T05:47:58.023 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 39, 2023-07-24T05:47:58.023 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 39, 2023-07-24T05:47:58.023 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 15.312514473 2023-07-24T05:47:58.023 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-07-24T05:47:58.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.012+0000 7f307a89e700 1 -- 172.21.15.77:0/1302382237 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f30580662f0 msgr2=0x7f30580687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:58.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.012+0000 7f307a89e700 1 --2- 172.21.15.77:0/1302382237 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f30580662f0 0x7f30580687b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f305c000f60 tx=0x7f305c007ce0 comp rx=0 tx=0).stop 2023-07-24T05:47:58.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.012+0000 7f307a89e700 1 -- 172.21.15.77:0/1302382237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30740b4420 msgr2=0x7f307415a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:58.024 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.012+0000 7f307a89e700 1 --2- 172.21.15.77:0/1302382237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30740b4420 0x7f307415a2b0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f306400e840 tx=0x7f306400eb50 comp rx=0 tx=0).stop 2023-07-24T05:47:58.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.012+0000 7f307a89e700 1 -- 172.21.15.77:0/1302382237 shutdown_connections 2023-07-24T05:47:58.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.012+0000 7f307a89e700 1 --2- 172.21.15.77:0/1302382237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f307415ca90 0x7f30740cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:58.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.012+0000 7f307a89e700 1 --2- 172.21.15.77:0/1302382237 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f30580662f0 0x7f30580687b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:58.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.012+0000 7f307a89e700 1 --2- 172.21.15.77:0/1302382237 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f30740d1f00 0x7f307415e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:58.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.012+0000 7f307a89e700 1 --2- 172.21.15.77:0/1302382237 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f30740b4420 0x7f307415a2b0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:58.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.012+0000 7f307a89e700 1 -- 172.21.15.77:0/1302382237 >> 172.21.15.77:0/1302382237 conn(0x7f30740cf420 msgr2=0x7f30740b5990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:58.025 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.012+0000 7f307a89e700 1 -- 172.21.15.77:0/1302382237 shutdown_connections 2023-07-24T05:47:58.026 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.012+0000 7f307a89e700 1 -- 172.21.15.77:0/1302382237 wait complete. 2023-07-24T05:47:58.039 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-24T05:47:58.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.204+0000 7fde11dae700 1 Processor -- start 2023-07-24T05:47:58.213 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.208+0000 7fde11dae700 1 -- start start 2023-07-24T05:47:58.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.208+0000 7fde11dae700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fde0c0c1af0 0x7fde0c06bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:58.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.208+0000 7fde11dae700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7fde0c069ef0 0x7fde0c06c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:58.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.208+0000 7fde11dae700 1 -- --> v1:172.21.15.103:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde0c06b810 con 0x7fde0c161030 2023-07-24T05:47:58.216 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.208+0000 7fde11dae700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde0c0cb230 con 0x7fde0c0c1af0 2023-07-24T05:47:58.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.208+0000 7fde11dae700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde0c0cb510 con 0x7fde0c069ef0 2023-07-24T05:47:58.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.208+0000 7fde03fff700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fde0c0c1af0 0x7fde0c06bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:58.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.212+0000 7fde03fff700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7fde0c0c1af0 0x7fde0c06bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41650/0 (socket says 172.21.15.77:41650) 2023-07-24T05:47:58.217 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.212+0000 7fde03fff700 1 -- 172.21.15.77:0/2431386767 learned_addr learned my addr 172.21.15.77:0/2431386767 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:58.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.212+0000 7fde0bfff700 1 --2- 172.21.15.77:0/2431386767 >> v2:172.21.15.103:3300/0 conn(0x7fde0c069ef0 0x7fde0c06c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:58.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.212+0000 7fde03fff700 1 -- 172.21.15.77:0/2431386767 >> v2:172.21.15.103:3300/0 conn(0x7fde0c069ef0 msgr2=0x7fde0c06c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:47:58.218 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.212+0000 7fde03fff700 1 --2- 172.21.15.77:0/2431386767 >> v2:172.21.15.103:3300/0 conn(0x7fde0c069ef0 0x7fde0c06c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:58.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.212+0000 7fde03fff700 1 -- 172.21.15.77:0/2431386767 >> v1:172.21.15.103:6789/0 conn(0x7fde0c161030 legacy=0x7fde0c0c13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:58.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.212+0000 7fde03fff700 1 -- 172.21.15.77:0/2431386767 --> v2:172.21.15.77:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde0c0cb7f0 con 0x7fde0c0c1af0 2023-07-24T05:47:58.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.212+0000 7fde03fff700 1 --2- 172.21.15.77:0/2431386767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde0c0c1af0 0x7fde0c06bca0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fde0c06d930 tx=0x7fddf4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bff32629e8d35839 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:58.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.212+0000 7fde0affd700 1 -- 172.21.15.77:0/2431386767 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf4011830 con 0x7fde0c0c1af0 2023-07-24T05:47:58.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.212+0000 7fde0affd700 1 -- 172.21.15.77:0/2431386767 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf4011990 con 0x7fde0c0c1af0 2023-07-24T05:47:58.219 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.212+0000 7fde0affd700 1 -- 172.21.15.77:0/2431386767 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf4011d20 con 0x7fde0c0c1af0 2023-07-24T05:47:58.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.212+0000 7fde11dae700 1 -- 172.21.15.77:0/2431386767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde0c0c1af0 msgr2=0x7fde0c06bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:58.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.212+0000 7fde11dae700 1 --2- 172.21.15.77:0/2431386767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde0c0c1af0 0x7fde0c06bca0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fde0c06d930 tx=0x7fddf4009bf0 comp rx=0 tx=0).stop 2023-07-24T05:47:58.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.212+0000 7fde11dae700 1 -- 172.21.15.77:0/2431386767 shutdown_connections 2023-07-24T05:47:58.220 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.212+0000 7fde11dae700 1 --2- 172.21.15.77:0/2431386767 >> v2:172.21.15.103:3300/0 conn(0x7fde0c069ef0 0x7fde0c06c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:58.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.212+0000 7fde11dae700 1 --2- 172.21.15.77:0/2431386767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde0c0c1af0 0x7fde0c06bca0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:58.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.212+0000 7fde11dae700 1 -- 172.21.15.77:0/2431386767 >> 172.21.15.77:0/2431386767 conn(0x7fde0c0ce410 msgr2=0x7fde0c0ce7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:58.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.212+0000 7fde11dae700 1 -- 172.21.15.77:0/2431386767 shutdown_connections 2023-07-24T05:47:58.221 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.212+0000 7fde11dae700 1 -- 172.21.15.77:0/2431386767 wait complete. 2023-07-24T05:47:58.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.216+0000 7fde11dae700 1 Processor -- start 2023-07-24T05:47:58.222 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.216+0000 7fde11dae700 1 -- start start 2023-07-24T05:47:58.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.216+0000 7fde11dae700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde0c069ef0 0x7fde0c0c4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:58.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.216+0000 7fde11dae700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde0c0c1af0 0x7fde0c150120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:58.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.216+0000 7fde11dae700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fde0c161030 0x7fde0c0c2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:58.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.216+0000 7fde11dae700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0c0ae2b0 con 0x7fde0c069ef0 2023-07-24T05:47:58.224 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.216+0000 7fde11dae700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0c0c43f0 con 0x7fde0c0c1af0 2023-07-24T05:47:58.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.216+0000 7fde11dae700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde0c0c4d50 con 0x7fde0c161030 2023-07-24T05:47:58.225 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.216+0000 7fde0b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde0c069ef0 0x7fde0c0c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:58.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.216+0000 7fde0b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde0c069ef0 0x7fde0c0c4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41660/0 (socket says 172.21.15.77:41660) 2023-07-24T05:47:58.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.216+0000 7fde0b7fe700 1 -- 172.21.15.77:0/366227413 learned_addr learned my addr 172.21.15.77:0/366227413 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:47:58.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.216+0000 7fde0bfff700 1 --2- 172.21.15.77:0/366227413 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fde0c161030 0x7fde0c0c2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:58.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.216+0000 7fde03fff700 1 --2- 172.21.15.77:0/366227413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde0c0c1af0 0x7fde0c150120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:58.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.216+0000 7fde0b7fe700 1 -- 172.21.15.77:0/366227413 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fde0c161030 msgr2=0x7fde0c0c2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:58.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.216+0000 7fde0b7fe700 1 --2- 172.21.15.77:0/366227413 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fde0c161030 0x7fde0c0c2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:58.226 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.216+0000 7fde0b7fe700 1 -- 172.21.15.77:0/366227413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde0c0c1af0 msgr2=0x7fde0c150120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:58.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.216+0000 7fde0b7fe700 1 --2- 172.21.15.77:0/366227413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde0c0c1af0 0x7fde0c150120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:58.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.220+0000 7fde0b7fe700 1 -- 172.21.15.77:0/366227413 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf4009570 con 0x7fde0c069ef0 2023-07-24T05:47:58.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.220+0000 7fde0b7fe700 1 --2- 172.21.15.77:0/366227413 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde0c069ef0 0x7fde0c0c4810 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fddfc00c480 tx=0x7fddfc00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:58.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.220+0000 7fde08ff9700 1 -- 172.21.15.77:0/366227413 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddfc0052d0 con 0x7fde0c069ef0 2023-07-24T05:47:58.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.220+0000 7fde08ff9700 1 -- 172.21.15.77:0/366227413 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddfc005430 con 0x7fde0c069ef0 2023-07-24T05:47:58.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.220+0000 7fde11dae700 1 -- 172.21.15.77:0/366227413 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde0c150660 con 0x7fde0c069ef0 2023-07-24T05:47:58.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.220+0000 7fde08ff9700 1 -- 172.21.15.77:0/366227413 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddfc003930 con 0x7fde0c069ef0 2023-07-24T05:47:58.227 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.220+0000 7fde11dae700 1 -- 172.21.15.77:0/366227413 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde0c0c3a50 con 0x7fde0c069ef0 2023-07-24T05:47:58.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.220+0000 7fde11dae700 1 -- 172.21.15.77:0/366227413 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde0c04df10 con 0x7fde0c069ef0 2023-07-24T05:47:58.228 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.220+0000 7fde08ff9700 1 -- 172.21.15.77:0/366227413 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fddfc003a90 con 0x7fde0c069ef0 2023-07-24T05:47:58.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.224+0000 7fde08ff9700 1 --2- 172.21.15.77:0/366227413 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fddec066320 0x7fddec0687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:47:58.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.224+0000 7fde08ff9700 1 -- 172.21.15.77:0/366227413 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fddfc083390 con 0x7fde0c069ef0 2023-07-24T05:47:58.230 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.224+0000 7fde03fff700 1 --2- 172.21.15.77:0/366227413 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fddec066320 0x7fddec0687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:47:58.231 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.224+0000 7fde03fff700 1 --2- 172.21.15.77:0/366227413 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fddec066320 0x7fddec0687e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fde0c06d930 tx=0x7fddf4008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:47:58.236 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.228+0000 7fde08ff9700 1 -- 172.21.15.77:0/366227413 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fddfc050630 con 0x7fde0c069ef0 2023-07-24T05:47:58.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.436+0000 7fde11dae700 1 -- 172.21.15.77:0/366227413 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fde0c160950 con 0x7fde0c069ef0 2023-07-24T05:47:58.444 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.436+0000 7fde08ff9700 1 -- 172.21.15.77:0/366227413 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+73 (secure 0 0 0) 0x7fddfc053c50 con 0x7fde0c069ef0 2023-07-24T05:47:58.445 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-24T05:47:58.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.440+0000 7fde11dae700 1 -- 172.21.15.77:0/366227413 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fddec066320 msgr2=0x7fddec0687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:58.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.440+0000 7fde11dae700 1 --2- 172.21.15.77:0/366227413 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fddec066320 0x7fddec0687e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fde0c06d930 tx=0x7fddf4008030 comp rx=0 tx=0).stop 2023-07-24T05:47:58.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.440+0000 7fde11dae700 1 -- 172.21.15.77:0/366227413 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde0c069ef0 msgr2=0x7fde0c0c4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:47:58.447 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.440+0000 7fde11dae700 1 --2- 172.21.15.77:0/366227413 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde0c069ef0 0x7fde0c0c4810 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fddfc00c480 tx=0x7fddfc00c840 comp rx=0 tx=0).stop 2023-07-24T05:47:58.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.440+0000 7fde11dae700 1 -- 172.21.15.77:0/366227413 shutdown_connections 2023-07-24T05:47:58.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.440+0000 7fde11dae700 1 --2- 172.21.15.77:0/366227413 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7fddec066320 0x7fddec0687e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:58.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.440+0000 7fde11dae700 1 --2- 172.21.15.77:0/366227413 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7fde0c161030 0x7fde0c0c2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:58.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.440+0000 7fde11dae700 1 --2- 172.21.15.77:0/366227413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde0c0c1af0 0x7fde0c150120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:58.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.440+0000 7fde11dae700 1 --2- 172.21.15.77:0/366227413 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde0c069ef0 0x7fde0c0c4810 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:47:58.448 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.440+0000 7fde11dae700 1 -- 172.21.15.77:0/366227413 >> 172.21.15.77:0/366227413 conn(0x7fde0c0ce410 msgr2=0x7fde0c0acff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:47:58.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.440+0000 7fde11dae700 1 -- 172.21.15.77:0/366227413 shutdown_connections 2023-07-24T05:47:58.449 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:47:58.440+0000 7fde11dae700 1 -- 172.21.15.77:0/366227413 wait complete. 2023-07-24T05:47:58.470 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-24T05:47:58.470 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-24T05:47:58.470 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi077.front.sepia.ceph.com 2023-07-24T05:47:58.471 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-24T05:47:58.471 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-24T05:47:58.471 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-24T05:47:58.471 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-24T05:47:58.472 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-24T05:47:58.472 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-24T05:47:58.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:47:58.473 DEBUG:teuthology.orchestra.run.smithi077:> ip addr 2023-07-24T05:47:58.490 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-24T05:47:58.490 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-24T05:47:58.490 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2023-07-24T05:47:58.491 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:47:58.491 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2023-07-24T05:47:58.491 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:47:58.491 INFO:teuthology.orchestra.run.smithi077.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-24T05:47:58.491 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d8 brd ff:ff:ff:ff:ff:ff 2023-07-24T05:47:58.491 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f0 2023-07-24T05:47:58.492 INFO:teuthology.orchestra.run.smithi077.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-24T05:47:58.492 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d9 brd ff:ff:ff:ff:ff:ff 2023-07-24T05:47:58.492 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f1 2023-07-24T05:47:58.492 INFO:teuthology.orchestra.run.smithi077.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-24T05:47:58.492 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d2 brd ff:ff:ff:ff:ff:ff 2023-07-24T05:47:58.492 INFO:teuthology.orchestra.run.smithi077.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-24T05:47:58.492 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d3 brd ff:ff:ff:ff:ff:ff 2023-07-24T05:47:58.492 INFO:teuthology.orchestra.run.smithi077.stdout: inet 172.21.15.77/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-24T05:47:58.493 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft 42291sec preferred_lft 42291sec 2023-07-24T05:47:58.493 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::ec4:7aff:fe8f:d3d3/64 scope link 2023-07-24T05:47:58.493 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:47:58.493 INFO:teuthology.orchestra.run.smithi077.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-24T05:47:58.493 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 02:42:ca:23:89:0f brd ff:ff:ff:ff:ff:ff 2023-07-24T05:47:58.493 INFO:teuthology.orchestra.run.smithi077.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-24T05:47:58.493 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:47:58.494 INFO:teuthology.orchestra.run.smithi077.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-24T05:47:58.494 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 2a:4e:35:3d:0d:9f brd ff:ff:ff:ff:ff:ff 2023-07-24T05:47:58.494 INFO:teuthology.orchestra.run.smithi077.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-24T05:47:58.494 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:47:58.494 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::38d3:54ff:fe8d:401a/64 scope link 2023-07-24T05:47:58.494 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:47:58.494 INFO:teuthology.orchestra.run.smithi077.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-24T05:47:58.494 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 7a:8b:65:ea:da:cc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-24T05:47:58.495 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::788b:65ff:feea:dacc/64 scope link 2023-07-24T05:47:58.495 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:47:58.495 INFO:teuthology.orchestra.run.smithi077.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-24T05:47:58.495 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 2a:4e:35:3d:0d:9f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-24T05:47:58.495 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::284e:35ff:fe3d:d9f/64 scope link 2023-07-24T05:47:58.495 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2023-07-24T05:47:58.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:47:58.496 DEBUG:teuthology.orchestra.run.smithi077:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-24T05:47:58.571 INFO:teuthology.orchestra.run.smithi077.stdout:1 2023-07-24T05:47:58.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:47:58.575 DEBUG:teuthology.orchestra.run.smithi077:> route 2023-07-24T05:47:58.639 INFO:teuthology.orchestra.run.smithi077.stdout:Kernel IP routing table 2023-07-24T05:47:58.639 INFO:teuthology.orchestra.run.smithi077.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-24T05:47:58.639 INFO:teuthology.orchestra.run.smithi077.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-24T05:47:58.640 INFO:teuthology.orchestra.run.smithi077.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-24T05:47:58.640 INFO:teuthology.orchestra.run.smithi077.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-24T05:47:58.640 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-07-24T05:47:58.640 INFO:teuthology.orchestra.run.smithi077.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-24T05:47:58.641 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-24T05:47:58.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:47:58.643 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec bash -c ' 2023-07-24T05:47:58.643 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2023-07-24T05:47:58.644 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-24T05:47:58.644 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-24T05:47:58.645 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-24T05:47:58.645 DEBUG:teuthology.orchestra.run.smithi077:> ') 2023-07-24T05:47:58.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:47:58.778 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2023-07-24T05:47:58.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-24T05:47:58.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-24T05:47:58.795 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-24T05:47:58.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:47:58.796 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set brx.0 up 2023-07-24T05:47:58.871 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-07-24T05:47:58.872 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-24T05:47:58.872 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-24T05:47:58.933 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-24T05:47:58.933 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-24T05:47:58.934 DEBUG:teuthology.orchestra.run.smithi077:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-24T05:47:58.996 DEBUG:teuthology.orchestra.run.smithi077:> sudo modprobe fuse 2023-07-24T05:47:59.078 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-24T05:47:59.078 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-24T05:47:59.154 INFO:teuthology.orchestra.run.smithi077.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-24T05:47:59.156 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-24T05:47:59.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:47:59.157 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-07-24T05:47:59.218 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-24T05:47:59.219 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-07-24T05:47:59.266 DEBUG:teuthology.orchestra.run.smithi077:> sudo modprobe fuse 2023-07-24T05:47:59.300 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-24T05:47:59.300 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-24T05:47:59.372 INFO:teuthology.orchestra.run.smithi077.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-24T05:47:59.374 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-24T05:47:59.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:47:59.375 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-07-24T05:47:59.414 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:2023-07-24T05:47:59.408+0000 7fb39e76f640 -1 init, newargv = 0x564e06fb9c00 newargc=15 2023-07-24T05:47:59.414 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:ceph-fuse[46155]: starting ceph client 2023-07-24T05:47:59.427 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:ceph-fuse[46155]: starting fuse 2023-07-24T05:48:00.528 DEBUG:teuthology.orchestra.run.smithi077:> sudo modprobe fuse 2023-07-24T05:48:00.566 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-24T05:48:00.566 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-24T05:48:00.642 INFO:teuthology.orchestra.run.smithi077.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-24T05:48:00.645 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-24T05:48:00.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:48:00.646 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2023-07-24T05:48:00.706 INFO:teuthology.orchestra.run.smithi077.stdout:49 2023-07-24T05:48:00.707 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-07-24T05:48:00.707 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-24T05:48:00.708 DEBUG:teuthology.orchestra.run.smithi077:> import glob 2023-07-24T05:48:00.708 DEBUG:teuthology.orchestra.run.smithi077:> import re 2023-07-24T05:48:00.708 DEBUG:teuthology.orchestra.run.smithi077:> import os 2023-07-24T05:48:00.709 DEBUG:teuthology.orchestra.run.smithi077:> import subprocess 2023-07-24T05:48:00.709 DEBUG:teuthology.orchestra.run.smithi077:> 2023-07-24T05:48:00.709 DEBUG:teuthology.orchestra.run.smithi077:> def _find_admin_socket(client_name): 2023-07-24T05:48:00.709 DEBUG:teuthology.orchestra.run.smithi077:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-07-24T05:48:00.710 DEBUG:teuthology.orchestra.run.smithi077:> files = glob.glob(asok_path) 2023-07-24T05:48:00.710 DEBUG:teuthology.orchestra.run.smithi077:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-07-24T05:48:00.710 DEBUG:teuthology.orchestra.run.smithi077:> 2023-07-24T05:48:00.711 DEBUG:teuthology.orchestra.run.smithi077:> # Given a non-glob path, it better be there 2023-07-24T05:48:00.711 DEBUG:teuthology.orchestra.run.smithi077:> if "*" not in asok_path: 2023-07-24T05:48:00.711 DEBUG:teuthology.orchestra.run.smithi077:> assert(len(files) == 1) 2023-07-24T05:48:00.712 DEBUG:teuthology.orchestra.run.smithi077:> return files[0] 2023-07-24T05:48:00.712 DEBUG:teuthology.orchestra.run.smithi077:> 2023-07-24T05:48:00.712 DEBUG:teuthology.orchestra.run.smithi077:> for f in files: 2023-07-24T05:48:00.713 DEBUG:teuthology.orchestra.run.smithi077:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-24T05:48:00.713 DEBUG:teuthology.orchestra.run.smithi077:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-24T05:48:00.713 DEBUG:teuthology.orchestra.run.smithi077:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-24T05:48:00.714 DEBUG:teuthology.orchestra.run.smithi077:> contents = proc_f.read() 2023-07-24T05:48:00.714 DEBUG:teuthology.orchestra.run.smithi077:> if mountpoint in contents: 2023-07-24T05:48:00.714 DEBUG:teuthology.orchestra.run.smithi077:> return f 2023-07-24T05:48:00.714 DEBUG:teuthology.orchestra.run.smithi077:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-24T05:48:00.715 DEBUG:teuthology.orchestra.run.smithi077:> 2023-07-24T05:48:00.715 DEBUG:teuthology.orchestra.run.smithi077:> print(_find_admin_socket("client.0")) 2023-07-24T05:48:00.715 DEBUG:teuthology.orchestra.run.smithi077:> ' 2023-07-24T05:48:00.871 INFO:teuthology.orchestra.run.smithi077.stdout:/var/run/ceph/ceph-client.0.46155.asok 2023-07-24T05:48:01.056 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.46155.asok 2023-07-24T05:48:01.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:48:01.057 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.46155.asok status 2023-07-24T05:48:01.253 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2023-07-24T05:48:01.254 INFO:teuthology.orchestra.run.smithi077.stdout: "metadata": { 2023-07-24T05:48:01.254 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_sha1": "e2c50893bf78471cc8ee960317cc10390300dfd5", 2023-07-24T05:48:01.254 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_version": "ceph version 18.0.0-5042-ge2c50893 (e2c50893bf78471cc8ee960317cc10390300dfd5) reef (dev)", 2023-07-24T05:48:01.254 INFO:teuthology.orchestra.run.smithi077.stdout: "entity_id": "0", 2023-07-24T05:48:01.254 INFO:teuthology.orchestra.run.smithi077.stdout: "hostname": "smithi077", 2023-07-24T05:48:01.254 INFO:teuthology.orchestra.run.smithi077.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-07-24T05:48:01.254 INFO:teuthology.orchestra.run.smithi077.stdout: "pid": "46155", 2023-07-24T05:48:01.255 INFO:teuthology.orchestra.run.smithi077.stdout: "root": "/" 2023-07-24T05:48:01.255 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-07-24T05:48:01.255 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_count": 0, 2023-07-24T05:48:01.255 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_pinned_count": 0, 2023-07-24T05:48:01.255 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 5877, 2023-07-24T05:48:01.255 INFO:teuthology.orchestra.run.smithi077.stdout: "inst": { 2023-07-24T05:48:01.255 INFO:teuthology.orchestra.run.smithi077.stdout: "name": { 2023-07-24T05:48:01.256 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "client", 2023-07-24T05:48:01.256 INFO:teuthology.orchestra.run.smithi077.stdout: "num": 5877 2023-07-24T05:48:01.256 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-07-24T05:48:01.256 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2023-07-24T05:48:01.256 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2023-07-24T05:48:01.256 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.1:0", 2023-07-24T05:48:01.256 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2424740587 2023-07-24T05:48:01.257 INFO:teuthology.orchestra.run.smithi077.stdout: } 2023-07-24T05:48:01.257 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-07-24T05:48:01.257 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2023-07-24T05:48:01.257 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2023-07-24T05:48:01.257 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.1:0", 2023-07-24T05:48:01.257 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2424740587 2023-07-24T05:48:01.257 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2023-07-24T05:48:01.258 INFO:teuthology.orchestra.run.smithi077.stdout: "inst_str": "client.5877 192.168.0.1:0/2424740587", 2023-07-24T05:48:01.258 INFO:teuthology.orchestra.run.smithi077.stdout: "addr_str": "192.168.0.1:0/2424740587", 2023-07-24T05:48:01.258 INFO:teuthology.orchestra.run.smithi077.stdout: "inode_count": 1, 2023-07-24T05:48:01.258 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_epoch": 18, 2023-07-24T05:48:01.258 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch": 39, 2023-07-24T05:48:01.258 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch_barrier": 0, 2023-07-24T05:48:01.258 INFO:teuthology.orchestra.run.smithi077.stdout: "blocklisted": false, 2023-07-24T05:48:01.258 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs" 2023-07-24T05:48:01.259 INFO:teuthology.orchestra.run.smithi077.stdout:} 2023-07-24T05:48:01.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:48:01.268 DEBUG:teuthology.orchestra.run.smithi077:> stat --file-system '--printf=%T 2023-07-24T05:48:01.268 DEBUG:teuthology.orchestra.run.smithi077:> ' -- /home/ubuntu/cephtest/mnt.0 2023-07-24T05:48:01.286 INFO:teuthology.orchestra.run.smithi077.stdout:fuseblk 2023-07-24T05:48:01.287 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-07-24T05:48:01.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:48:01.287 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-24T05:48:01.364 DEBUG:teuthology.orchestra.run.smithi077:> mktemp -d --suffix=xfstests-dev 2023-07-24T05:48:01.422 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/tmp.l0Q1kOBHMTxfstests-dev 2023-07-24T05:48:01.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:48:01.423 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.l0Q1kOBHMTxfstests-dev) 2023-07-24T05:48:01.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:48:01.504 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.l0Q1kOBHMTxfstests-dev) 2023-07-24T05:48:01.579 INFO:teuthology.orchestra.run.smithi077.stderr:Cloning into '/tmp/tmp.l0Q1kOBHMTxfstests-dev'... 2023-07-24T05:48:02.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:48:02.540 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-07-24T05:48:02.621 DEBUG:teuthology.orchestra.run.smithi077:> mktemp -d --suffix=test 2023-07-24T05:48:02.682 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/tmp.OIBegeaH9ytest 2023-07-24T05:48:02.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:48:02.683 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-07-24T05:48:02.752 DEBUG:teuthology.orchestra.run.smithi077:> mktemp -d --suffix=scratch 2023-07-24T05:48:02.810 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/tmp.o5Xv2LeDrtscratch 2023-07-24T05:48:02.811 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "ubuntu" and "20.04". 2023-07-24T05:48:02.811 DEBUG:teuthology.orchestra.run.smithi077:> sudo apt-get install -y xfslibs-dev uuid-dev libtool-bin e2fsprogs automake gcc libuuid1 quota attr libattr1-dev make libacl1-dev libaio-dev xfsprogs libgdbm-dev gawk fio dbench uuid-runtime python2 sqlite3 2023-07-24T05:48:02.977 INFO:teuthology.orchestra.run.smithi077.stdout:Reading package lists... 2023-07-24T05:48:03.175 INFO:teuthology.orchestra.run.smithi077.stdout:Building dependency tree... 2023-07-24T05:48:03.176 INFO:teuthology.orchestra.run.smithi077.stdout:Reading state information... 2023-07-24T05:48:03.357 INFO:teuthology.orchestra.run.smithi077.stdout:attr is already the newest version (1:2.4.48-5). 2023-07-24T05:48:03.357 INFO:teuthology.orchestra.run.smithi077.stdout:automake is already the newest version (1:1.16.1-4ubuntu6). 2023-07-24T05:48:03.357 INFO:teuthology.orchestra.run.smithi077.stdout:gawk is already the newest version (1:5.0.1+dfsg-1). 2023-07-24T05:48:03.357 INFO:teuthology.orchestra.run.smithi077.stdout:gcc is already the newest version (4:9.3.0-1ubuntu2). 2023-07-24T05:48:03.357 INFO:teuthology.orchestra.run.smithi077.stdout:gcc set to manually installed. 2023-07-24T05:48:03.358 INFO:teuthology.orchestra.run.smithi077.stdout:libacl1-dev is already the newest version (2.2.53-6). 2023-07-24T05:48:03.358 INFO:teuthology.orchestra.run.smithi077.stdout:libaio-dev is already the newest version (0.3.112-5). 2023-07-24T05:48:03.358 INFO:teuthology.orchestra.run.smithi077.stdout:libattr1-dev is already the newest version (1:2.4.48-5). 2023-07-24T05:48:03.358 INFO:teuthology.orchestra.run.smithi077.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-07-24T05:48:03.358 INFO:teuthology.orchestra.run.smithi077.stdout:make is already the newest version (4.2.1-1.2). 2023-07-24T05:48:03.358 INFO:teuthology.orchestra.run.smithi077.stdout:make set to manually installed. 2023-07-24T05:48:03.358 INFO:teuthology.orchestra.run.smithi077.stdout:quota is already the newest version (4.05-1). 2023-07-24T05:48:03.358 INFO:teuthology.orchestra.run.smithi077.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-07-24T05:48:03.359 INFO:teuthology.orchestra.run.smithi077.stdout:xfsprogs is already the newest version (5.3.0-1ubuntu2). 2023-07-24T05:48:03.359 INFO:teuthology.orchestra.run.smithi077.stdout:dbench is already the newest version (4.0-2build1). 2023-07-24T05:48:03.359 INFO:teuthology.orchestra.run.smithi077.stdout:python2 is already the newest version (2.7.17-2ubuntu4). 2023-07-24T05:48:03.359 INFO:teuthology.orchestra.run.smithi077.stdout:python2 set to manually installed. 2023-07-24T05:48:03.359 INFO:teuthology.orchestra.run.smithi077.stdout:e2fsprogs is already the newest version (1.45.5-2ubuntu1.1). 2023-07-24T05:48:03.359 INFO:teuthology.orchestra.run.smithi077.stdout:libuuid1 is already the newest version (2.34-0.1ubuntu9.4). 2023-07-24T05:48:03.359 INFO:teuthology.orchestra.run.smithi077.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.4). 2023-07-24T05:48:03.360 INFO:teuthology.orchestra.run.smithi077.stdout:The following packages were automatically installed and are no longer required: 2023-07-24T05:48:03.360 INFO:teuthology.orchestra.run.smithi077.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-07-24T05:48:03.360 INFO:teuthology.orchestra.run.smithi077.stdout:Use 'sudo apt autoremove' to remove them. 2023-07-24T05:48:03.360 INFO:teuthology.orchestra.run.smithi077.stdout:The following additional packages will be installed: 2023-07-24T05:48:03.361 INFO:teuthology.orchestra.run.smithi077.stdout: libgfapi0 libgfrpc0 libgfxdr0 libglusterfs0 libsqlite3-0 2023-07-24T05:48:03.361 INFO:teuthology.orchestra.run.smithi077.stdout:Suggested packages: 2023-07-24T05:48:03.361 INFO:teuthology.orchestra.run.smithi077.stdout: gnuplot gfio python-scipy sqlite3-doc 2023-07-24T05:48:03.425 INFO:teuthology.orchestra.run.smithi077.stdout:The following NEW packages will be installed: 2023-07-24T05:48:03.426 INFO:teuthology.orchestra.run.smithi077.stdout: fio libgdbm-dev libgfapi0 libgfrpc0 libgfxdr0 libglusterfs0 sqlite3 2023-07-24T05:48:03.427 INFO:teuthology.orchestra.run.smithi077.stdout:The following packages will be upgraded: 2023-07-24T05:48:03.428 INFO:teuthology.orchestra.run.smithi077.stdout: libsqlite3-0 uuid-runtime 2023-07-24T05:48:03.601 INFO:teuthology.orchestra.run.smithi077.stdout:2 upgraded, 7 newly installed, 0 to remove and 204 not upgraded. 2023-07-24T05:48:03.601 INFO:teuthology.orchestra.run.smithi077.stdout:Need to get 2,464 kB of archives. 2023-07-24T05:48:03.602 INFO:teuthology.orchestra.run.smithi077.stdout:After this operation, 7,043 kB of additional disk space will be used. 2023-07-24T05:48:03.602 INFO:teuthology.orchestra.run.smithi077.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-runtime amd64 2.34-0.1ubuntu9.4 [35.4 kB] 2023-07-24T05:48:03.732 INFO:teuthology.orchestra.run.smithi077.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libsqlite3-0 amd64 3.31.1-4ubuntu0.5 [549 kB] 2023-07-24T05:48:03.944 INFO:teuthology.orchestra.run.smithi077.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/universe amd64 libglusterfs0 amd64 7.2-2build1 [286 kB] 2023-07-24T05:48:03.972 INFO:teuthology.orchestra.run.smithi077.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/universe amd64 libgfxdr0 amd64 7.2-2build1 [24.2 kB] 2023-07-24T05:48:03.973 INFO:teuthology.orchestra.run.smithi077.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 libgfrpc0 amd64 7.2-2build1 [46.1 kB] 2023-07-24T05:48:03.977 INFO:teuthology.orchestra.run.smithi077.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 libgfapi0 amd64 7.2-2build1 [72.6 kB] 2023-07-24T05:48:03.982 INFO:teuthology.orchestra.run.smithi077.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/universe amd64 fio amd64 3.16-1 [507 kB] 2023-07-24T05:48:04.016 INFO:teuthology.orchestra.run.smithi077.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libgdbm-dev amd64 1.18.1-5 [83.4 kB] 2023-07-24T05:48:04.023 INFO:teuthology.orchestra.run.smithi077.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 sqlite3 amd64 3.31.1-4ubuntu0.5 [860 kB] 2023-07-24T05:48:04.379 INFO:teuthology.orchestra.run.smithi077.stderr:debconf: unable to initialize frontend: Dialog 2023-07-24T05:48:04.379 INFO:teuthology.orchestra.run.smithi077.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2023-07-24T05:48:04.379 INFO:teuthology.orchestra.run.smithi077.stderr:debconf: falling back to frontend: Readline 2023-07-24T05:48:04.411 INFO:teuthology.orchestra.run.smithi077.stderr:debconf: unable to initialize frontend: Readline 2023-07-24T05:48:04.411 INFO:teuthology.orchestra.run.smithi077.stderr:debconf: (This frontend requires a controlling tty.) 2023-07-24T05:48:04.411 INFO:teuthology.orchestra.run.smithi077.stderr:debconf: falling back to frontend: Teletype 2023-07-24T05:48:04.428 INFO:teuthology.orchestra.run.smithi077.stderr:dpkg-preconfigure: unable to re-open stdin: 2023-07-24T05:48:04.511 INFO:teuthology.orchestra.run.smithi077.stdout:Fetched 2,464 kB in 1s (3,860 kB/s) 2023-07-24T05:48:05.038 INFO:teuthology.orchestra.run.smithi077.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 121317 files and directories currently installed.) 2023-07-24T05:48:05.041 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../0-uuid-runtime_2.34-0.1ubuntu9.4_amd64.deb ... 2023-07-24T05:48:05.221 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking uuid-runtime (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-07-24T05:48:05.800 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../1-libsqlite3-0_3.31.1-4ubuntu0.5_amd64.deb ... 2023-07-24T05:48:05.970 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libsqlite3-0:amd64 (3.31.1-4ubuntu0.5) over (3.31.1-4ubuntu0.3) ... 2023-07-24T05:48:06.458 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libglusterfs0:amd64. 2023-07-24T05:48:06.478 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../2-libglusterfs0_7.2-2build1_amd64.deb ... 2023-07-24T05:48:06.516 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libglusterfs0:amd64 (7.2-2build1) ... 2023-07-24T05:48:06.911 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libgfxdr0:amd64. 2023-07-24T05:48:06.931 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../3-libgfxdr0_7.2-2build1_amd64.deb ... 2023-07-24T05:48:06.969 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libgfxdr0:amd64 (7.2-2build1) ... 2023-07-24T05:48:07.339 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libgfrpc0:amd64. 2023-07-24T05:48:07.359 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../4-libgfrpc0_7.2-2build1_amd64.deb ... 2023-07-24T05:48:07.397 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libgfrpc0:amd64 (7.2-2build1) ... 2023-07-24T05:48:07.784 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libgfapi0:amd64. 2023-07-24T05:48:07.805 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../5-libgfapi0_7.2-2build1_amd64.deb ... 2023-07-24T05:48:07.842 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libgfapi0:amd64 (7.2-2build1) ... 2023-07-24T05:48:08.263 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package fio. 2023-07-24T05:48:08.284 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../6-fio_3.16-1_amd64.deb ... 2023-07-24T05:48:08.329 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking fio (3.16-1) ... 2023-07-24T05:48:08.742 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package libgdbm-dev:amd64. 2023-07-24T05:48:08.760 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../7-libgdbm-dev_1.18.1-5_amd64.deb ... 2023-07-24T05:48:08.799 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking libgdbm-dev:amd64 (1.18.1-5) ... 2023-07-24T05:48:09.170 INFO:teuthology.orchestra.run.smithi077.stdout:Selecting previously unselected package sqlite3. 2023-07-24T05:48:09.191 INFO:teuthology.orchestra.run.smithi077.stdout:Preparing to unpack .../8-sqlite3_3.31.1-4ubuntu0.5_amd64.deb ... 2023-07-24T05:48:09.236 INFO:teuthology.orchestra.run.smithi077.stdout:Unpacking sqlite3 (3.31.1-4ubuntu0.5) ... 2023-07-24T05:48:09.654 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libsqlite3-0:amd64 (3.31.1-4ubuntu0.5) ... 2023-07-24T05:48:10.033 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libglusterfs0:amd64 (7.2-2build1) ... 2023-07-24T05:48:10.184 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up uuid-runtime (2.34-0.1ubuntu9.4) ... 2023-07-24T05:48:11.611 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libgdbm-dev:amd64 (1.18.1-5) ... 2023-07-24T05:48:11.737 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up sqlite3 (3.31.1-4ubuntu0.5) ... 2023-07-24T05:48:11.863 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libgfxdr0:amd64 (7.2-2build1) ... 2023-07-24T05:48:12.023 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libgfrpc0:amd64 (7.2-2build1) ... 2023-07-24T05:48:12.149 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up libgfapi0:amd64 (7.2-2build1) ... 2023-07-24T05:48:12.276 INFO:teuthology.orchestra.run.smithi077.stdout:Setting up fio (3.16-1) ... 2023-07-24T05:48:12.561 INFO:teuthology.orchestra.run.smithi077.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-07-24T05:48:12.722 INFO:teuthology.orchestra.run.smithi077.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-07-24T05:48:13.230 INFO:teuthology.orchestra.run.smithi077.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-07-24T05:48:16.408 INFO:teuthology.orchestra.run.smithi077.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-07-24T05:48:17.338 DEBUG:teuthology.orchestra.run.smithi077:> sudo useradd -m fsgqa 2023-07-24T05:48:17.370 INFO:teuthology.orchestra.run.smithi077.stderr:useradd: user 'fsgqa' already exists 2023-07-24T05:48:17.374 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-07-24T05:48:17.375 DEBUG:teuthology.orchestra.run.smithi077:> sudo groupadd fsgqa 2023-07-24T05:48:17.452 INFO:teuthology.orchestra.run.smithi077.stderr:groupadd: group 'fsgqa' already exists 2023-07-24T05:48:17.454 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-07-24T05:48:17.454 DEBUG:teuthology.orchestra.run.smithi077:> sudo useradd fsgqa2 2023-07-24T05:48:17.960 DEBUG:teuthology.orchestra.run.smithi077:> sudo useradd 123456-fsgqa 2023-07-24T05:48:18.400 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-07-24T05:48:18.572 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.564+0000 7f3e515d2700 1 Processor -- start 2023-07-24T05:48:18.573 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.564+0000 7f3e515d2700 1 -- start start 2023-07-24T05:48:18.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.568+0000 7f3e515d2700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f3e4c15c960 0x7f3e4c06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:48:18.574 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.568+0000 7f3e515d2700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3e4c06ab20 0x7f3e4c0d2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:48:18.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.568+0000 7f3e515d2700 1 -- --> v1:172.21.15.77:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e4c0cfd40 con 0x7f3e4c0d25f0 2023-07-24T05:48:18.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.568+0000 7f3e515d2700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e4c0ceee0 con 0x7f3e4c15c960 2023-07-24T05:48:18.575 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.568+0000 7f3e515d2700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c0cf130 con 0x7f3e4c06ab20 2023-07-24T05:48:18.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.568+0000 7f3e4b7fe700 1 --1- >> v1:172.21.15.77:6789/0 conn(0x7f3e4c0d25f0 0x7f3e4c0b40e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.77:6789/0 says I am v1:172.21.15.77:56952/0 (socket says 172.21.15.77:56952) 2023-07-24T05:48:18.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.568+0000 7f3e4b7fe700 1 -- 172.21.15.77:0/4092409359 learned_addr learned my addr 172.21.15.77:0/4092409359 (peer_addr_for_me v1:172.21.15.77:0/0) 2023-07-24T05:48:18.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.568+0000 7f3e4bfff700 1 --2- 172.21.15.77:0/4092409359 >> v2:172.21.15.103:3300/0 conn(0x7f3e4c15c960 0x7f3e4c06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:48:18.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.568+0000 7f3e50dd1700 1 --2- 172.21.15.77:0/4092409359 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3e4c06ab20 0x7f3e4c0d2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:48:18.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.568+0000 7f3e4affd700 1 -- 172.21.15.77:0/4092409359 <== mon.0 v1:172.21.15.77:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 15724853 0 0) 0x7f3e4c0cfd40 con 0x7f3e4c0d25f0 2023-07-24T05:48:18.576 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.568+0000 7f3e4affd700 1 -- 172.21.15.77:0/4092409359 --> v1:172.21.15.77:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e340035d0 con 0x7f3e4c0d25f0 2023-07-24T05:48:18.577 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.568+0000 7f3e4affd700 1 -- 172.21.15.77:0/4092409359 <== mon.0 v1:172.21.15.77:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1157074551 0 0) 0x7f3e340035d0 con 0x7f3e4c0d25f0 2023-07-24T05:48:18.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.568+0000 7f3e4affd700 1 -- 172.21.15.77:0/4092409359 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3e4c06ab20 msgr2=0x7f3e4c0d2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:48:18.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.568+0000 7f3e4affd700 1 --2- 172.21.15.77:0/4092409359 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3e4c06ab20 0x7f3e4c0d2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:48:18.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.568+0000 7f3e4affd700 1 -- 172.21.15.77:0/4092409359 >> v2:172.21.15.103:3300/0 conn(0x7f3e4c15c960 msgr2=0x7f3e4c06d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:48:18.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.568+0000 7f3e4affd700 1 --2- 172.21.15.77:0/4092409359 >> v2:172.21.15.103:3300/0 conn(0x7f3e4c15c960 0x7f3e4c06d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:48:18.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.568+0000 7f3e4affd700 1 -- 172.21.15.77:0/4092409359 --> v1:172.21.15.77:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e4c0d2f90 con 0x7f3e4c0d25f0 2023-07-24T05:48:18.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.568+0000 7f3e4affd700 1 -- 172.21.15.77:0/4092409359 <== mon.0 v1:172.21.15.77:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 4109865209 0 0) 0x7f3e40001670 con 0x7f3e4c0d25f0 2023-07-24T05:48:18.578 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.568+0000 7f3e4affd700 1 -- 172.21.15.77:0/4092409359 >> v1:172.21.15.77:6789/0 conn(0x7f3e4c0d25f0 legacy=0x7f3e4c0b40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:48:18.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.568+0000 7f3e4affd700 1 --2- 172.21.15.77:0/4092409359 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3e4c06ab20 0x7f3e34003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:48:18.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.568+0000 7f3e4affd700 1 --2- 172.21.15.77:0/4092409359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e34003ff0 0x7f3e34004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:48:18.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.568+0000 7f3e4affd700 1 --2- 172.21.15.77:0/4092409359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e34004db0 0x7f3e34005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:48:18.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.568+0000 7f3e4affd700 1 -- 172.21.15.77:0/4092409359 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c0ceee0 con 0x7f3e34004db0 2023-07-24T05:48:18.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.568+0000 7f3e4affd700 1 -- 172.21.15.77:0/4092409359 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c0cf130 con 0x7f3e34003ff0 2023-07-24T05:48:18.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.568+0000 7f3e4affd700 1 -- 172.21.15.77:0/4092409359 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3400ba30 con 0x7f3e4c06ab20 2023-07-24T05:48:18.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.572+0000 7f3e4b7fe700 1 --2- 172.21.15.77:0/4092409359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e34003ff0 0x7f3e34004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:48:18.579 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.572+0000 7f3e4bfff700 1 --2- 172.21.15.77:0/4092409359 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3e4c06ab20 0x7f3e34003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:48:18.580 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.572+0000 7f3e50dd1700 1 --2- 172.21.15.77:0/4092409359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e34004db0 0x7f3e34005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:48:18.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.572+0000 7f3e4bfff700 1 -- 172.21.15.77:0/4092409359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e34003ff0 msgr2=0x7f3e34004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:48:18.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.572+0000 7f3e4bfff700 1 --2- 172.21.15.77:0/4092409359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e34003ff0 0x7f3e34004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:48:18.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.572+0000 7f3e4bfff700 1 -- 172.21.15.77:0/4092409359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e34004db0 msgr2=0x7f3e34005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:48:18.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.572+0000 7f3e4bfff700 1 --2- 172.21.15.77:0/4092409359 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e34004db0 0x7f3e34005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:48:18.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.572+0000 7f3e4bfff700 1 -- 172.21.15.77:0/4092409359 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e340035d0 con 0x7f3e4c06ab20 2023-07-24T05:48:18.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.572+0000 7f3e4bfff700 1 --2- 172.21.15.77:0/4092409359 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3e4c06ab20 0x7f3e34003a20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c00e170 tx=0x7f3e340058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2095c7a19073fde8 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:48:18.581 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.572+0000 7f3e4affd700 1 -- 172.21.15.77:0/4092409359 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c00ec90 con 0x7f3e4c06ab20 2023-07-24T05:48:18.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.572+0000 7f3e4affd700 1 -- 172.21.15.77:0/4092409359 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3c00f040 con 0x7f3e4c06ab20 2023-07-24T05:48:18.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.572+0000 7f3e4affd700 1 -- 172.21.15.77:0/4092409359 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c014480 con 0x7f3e4c06ab20 2023-07-24T05:48:18.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.572+0000 7f3e515d2700 1 -- 172.21.15.77:0/4092409359 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3e4c06ab20 msgr2=0x7f3e34003a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:48:18.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.572+0000 7f3e515d2700 1 --2- 172.21.15.77:0/4092409359 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3e4c06ab20 0x7f3e34003a20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c00e170 tx=0x7f3e340058a0 comp rx=0 tx=0).stop 2023-07-24T05:48:18.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.572+0000 7f3e50dd1700 1 -- 172.21.15.77:0/4092409359 reap_dead start 2023-07-24T05:48:18.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.572+0000 7f3e515d2700 1 -- 172.21.15.77:0/4092409359 shutdown_connections 2023-07-24T05:48:18.582 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.572+0000 7f3e515d2700 1 -- 172.21.15.77:0/4092409359 >> 172.21.15.77:0/4092409359 conn(0x7f3e4c0b7600 msgr2=0x7f3e4c0b79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:48:18.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.572+0000 7f3e515d2700 1 -- 172.21.15.77:0/4092409359 shutdown_connections 2023-07-24T05:48:18.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.572+0000 7f3e515d2700 1 -- 172.21.15.77:0/4092409359 wait complete. 2023-07-24T05:48:18.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.576+0000 7f3e515d2700 1 Processor -- start 2023-07-24T05:48:18.583 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.576+0000 7f3e515d2700 1 -- start start 2023-07-24T05:48:18.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.580+0000 7f3e515d2700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e4c06ab20 0x7f3e4c0c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:48:18.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.580+0000 7f3e515d2700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e4c0b4540 0x7f3e4c1560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:48:18.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.580+0000 7f3e515d2700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3e4c157150 0x7f3e4c0c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:48:18.585 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.580+0000 7f3e515d2700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c0b4d20 con 0x7f3e4c0b4540 2023-07-24T05:48:18.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.580+0000 7f3e515d2700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c0b28a0 con 0x7f3e4c06ab20 2023-07-24T05:48:18.586 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.580+0000 7f3e515d2700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4c156610 con 0x7f3e4c157150 2023-07-24T05:48:18.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.580+0000 7f3e4b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e4c0b4540 0x7f3e4c1560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:48:18.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.580+0000 7f3e4b7fe700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e4c0b4540 0x7f3e4c1560d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54988/0 (socket says 172.21.15.77:54988) 2023-07-24T05:48:18.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.580+0000 7f3e4b7fe700 1 -- 172.21.15.77:0/512696945 learned_addr learned my addr 172.21.15.77:0/512696945 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:48:18.587 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.580+0000 7f3e4bfff700 1 --2- 172.21.15.77:0/512696945 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e4c06ab20 0x7f3e4c0c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:48:18.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.580+0000 7f3e50dd1700 1 --2- 172.21.15.77:0/512696945 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3e4c157150 0x7f3e4c0c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:48:18.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.580+0000 7f3e4b7fe700 1 -- 172.21.15.77:0/512696945 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3e4c157150 msgr2=0x7f3e4c0c7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:48:18.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.580+0000 7f3e4b7fe700 1 --2- 172.21.15.77:0/512696945 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3e4c157150 0x7f3e4c0c7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:48:18.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.580+0000 7f3e4b7fe700 1 -- 172.21.15.77:0/512696945 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e4c06ab20 msgr2=0x7f3e4c0c6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:48:18.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.580+0000 7f3e4b7fe700 1 --2- 172.21.15.77:0/512696945 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e4c06ab20 0x7f3e4c0c6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:48:18.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.580+0000 7f3e4b7fe700 1 -- 172.21.15.77:0/512696945 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e4c0b1f70 con 0x7f3e4c0b4540 2023-07-24T05:48:18.588 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.580+0000 7f3e4b7fe700 1 --2- 172.21.15.77:0/512696945 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e4c0b4540 0x7f3e4c1560d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f3e40007370 tx=0x7f3e40007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:48:18.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.580+0000 7f3e48ff9700 1 -- 172.21.15.77:0/512696945 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e40007c60 con 0x7f3e4c0b4540 2023-07-24T05:48:18.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.580+0000 7f3e48ff9700 1 -- 172.21.15.77:0/512696945 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4000f660 con 0x7f3e4c0b4540 2023-07-24T05:48:18.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.580+0000 7f3e515d2700 1 -- 172.21.15.77:0/512696945 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e4c0b2250 con 0x7f3e4c0b4540 2023-07-24T05:48:18.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.580+0000 7f3e48ff9700 1 -- 172.21.15.77:0/512696945 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4000f9f0 con 0x7f3e4c0b4540 2023-07-24T05:48:18.589 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.580+0000 7f3e515d2700 1 -- 172.21.15.77:0/512696945 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e4c0b49c0 con 0x7f3e4c0b4540 2023-07-24T05:48:18.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.580+0000 7f3e515d2700 1 -- 172.21.15.77:0/512696945 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e4c072490 con 0x7f3e4c0b4540 2023-07-24T05:48:18.590 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.584+0000 7f3e48ff9700 1 -- 172.21.15.77:0/512696945 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3e4000fb50 con 0x7f3e4c0b4540 2023-07-24T05:48:18.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.584+0000 7f3e48ff9700 1 --2- 172.21.15.77:0/512696945 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3e38066320 0x7f3e380687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:48:18.591 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.584+0000 7f3e48ff9700 1 -- 172.21.15.77:0/512696945 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3e400836d0 con 0x7f3e4c0b4540 2023-07-24T05:48:18.592 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.584+0000 7f3e4bfff700 1 --2- 172.21.15.77:0/512696945 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3e38066320 0x7f3e380687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:48:18.593 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.588+0000 7f3e4bfff700 1 --2- 172.21.15.77:0/512696945 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3e38066320 0x7f3e380687e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c017040 tx=0x7f3e3c020040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:48:18.599 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.592+0000 7f3e48ff9700 1 -- 172.21.15.77:0/512696945 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3e40050aa0 con 0x7f3e4c0b4540 2023-07-24T05:48:18.830 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.824+0000 7f3e515d2700 1 -- 172.21.15.77:0/512696945 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f3e4c0d32d0 con 0x7f3e4c0b4540 2023-07-24T05:48:18.831 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.824+0000 7f3e48ff9700 1 -- 172.21.15.77:0/512696945 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1276 (secure 0 0 0) 0x7f3e400540c0 con 0x7f3e4c0b4540 2023-07-24T05:48:18.831 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:48:18.832 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":1,"fsid":"5aed5f7b-fb55-4d95-9c02-c6adbb1677b4","modified":"2023-07-24T05:44:56.546685Z","created":"2023-07-24T05:44:56.546685Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:3300","nonce":0},{"type":"v1","addr":"172.21.15.77:6789","nonce":0}]},"addr":"172.21.15.77:6789/0","public_addr":"172.21.15.77:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3301","nonce":0},{"type":"v1","addr":"172.21.15.103:6790","nonce":0}]},"addr":"172.21.15.103:6790/0","public_addr":"172.21.15.103:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-07-24T05:48:18.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.828+0000 7f3e515d2700 1 -- 172.21.15.77:0/512696945 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3e38066320 msgr2=0x7f3e380687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:48:18.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.828+0000 7f3e515d2700 1 --2- 172.21.15.77:0/512696945 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3e38066320 0x7f3e380687e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c017040 tx=0x7f3e3c020040 comp rx=0 tx=0).stop 2023-07-24T05:48:18.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.828+0000 7f3e515d2700 1 -- 172.21.15.77:0/512696945 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e4c0b4540 msgr2=0x7f3e4c1560d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:48:18.834 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.828+0000 7f3e515d2700 1 --2- 172.21.15.77:0/512696945 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e4c0b4540 0x7f3e4c1560d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f3e40007370 tx=0x7f3e40007680 comp rx=0 tx=0).stop 2023-07-24T05:48:18.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.828+0000 7f3e515d2700 1 -- 172.21.15.77:0/512696945 shutdown_connections 2023-07-24T05:48:18.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.828+0000 7f3e515d2700 1 --2- 172.21.15.77:0/512696945 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f3e38066320 0x7f3e380687e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:48:18.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.828+0000 7f3e515d2700 1 --2- 172.21.15.77:0/512696945 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f3e4c157150 0x7f3e4c0c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:48:18.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.828+0000 7f3e515d2700 1 --2- 172.21.15.77:0/512696945 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3e4c0b4540 0x7f3e4c1560d0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:48:18.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.828+0000 7f3e515d2700 1 --2- 172.21.15.77:0/512696945 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3e4c06ab20 0x7f3e4c0c6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:48:18.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.828+0000 7f3e515d2700 1 -- 172.21.15.77:0/512696945 >> 172.21.15.77:0/512696945 conn(0x7f3e4c0b7600 msgr2=0x7f3e4c0b55b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:48:18.835 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.828+0000 7f3e515d2700 1 -- 172.21.15.77:0/512696945 shutdown_connections 2023-07-24T05:48:18.836 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:18.828+0000 7f3e515d2700 1 -- 172.21.15.77:0/512696945 wait complete. 2023-07-24T05:48:18.836 INFO:teuthology.orchestra.run.smithi077.stderr:dumped monmap epoch 1 2023-07-24T05:48:18.853 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.admin 2023-07-24T05:48:19.029 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.023+0000 7f5816ad8700 1 Processor -- start 2023-07-24T05:48:19.030 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.023+0000 7f5816ad8700 1 -- start start 2023-07-24T05:48:19.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.023+0000 7f5816ad8700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5810160d20 0x7f58100adba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:48:19.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.023+0000 7f5816ad8700 1 --2- >> v2:172.21.15.103:3300/0 conn(0x7f58100ae0e0 0x7f58100b1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:48:19.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.023+0000 7f5816ad8700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5810161100 0x7f58100b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:48:19.031 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.023+0000 7f5816ad8700 1 -- --> v2:172.21.15.77:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58100af170 con 0x7f5810161100 2023-07-24T05:48:19.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.023+0000 7f5816ad8700 1 -- --> v2:172.21.15.103:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58100ae5f0 con 0x7f58100ae0e0 2023-07-24T05:48:19.032 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.023+0000 7f5816ad8700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58100ae8d0 con 0x7f5810160d20 2023-07-24T05:48:19.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.023+0000 7f58162d7700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5810161100 0x7f58100b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:48:19.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.023+0000 7f5815ad6700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5810160d20 0x7f58100adba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:48:19.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.023+0000 7f58162d7700 1 --2- >> v2:172.21.15.77:3300/0 conn(0x7f5810161100 0x7f58100b15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55004/0 (socket says 172.21.15.77:55004) 2023-07-24T05:48:19.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.023+0000 7f58162d7700 1 -- 172.21.15.77:0/1619911395 learned_addr learned my addr 172.21.15.77:0/1619911395 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:48:19.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.023+0000 7f58152d5700 1 --2- 172.21.15.77:0/1619911395 >> v2:172.21.15.103:3300/0 conn(0x7f58100ae0e0 0x7f58100b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:48:19.033 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.023+0000 7f5815ad6700 1 -- 172.21.15.77:0/1619911395 >> v2:172.21.15.103:3300/0 conn(0x7f58100ae0e0 msgr2=0x7f58100b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:48:19.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.023+0000 7f5815ad6700 1 --2- 172.21.15.77:0/1619911395 >> v2:172.21.15.103:3300/0 conn(0x7f58100ae0e0 0x7f58100b1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:48:19.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.023+0000 7f5815ad6700 1 -- 172.21.15.77:0/1619911395 >> v2:172.21.15.77:3300/0 conn(0x7f5810161100 msgr2=0x7f58100b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-24T05:48:19.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.023+0000 7f5815ad6700 1 --2- 172.21.15.77:0/1619911395 >> v2:172.21.15.77:3300/0 conn(0x7f5810161100 0x7f58100b15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:48:19.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.023+0000 7f5815ad6700 1 -- 172.21.15.77:0/1619911395 --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58100aebb0 con 0x7f5810160d20 2023-07-24T05:48:19.034 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.023+0000 7f58162d7700 1 --2- 172.21.15.77:0/1619911395 >> v2:172.21.15.77:3300/0 conn(0x7f5810161100 0x7f58100b15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-24T05:48:19.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.027+0000 7f5815ad6700 1 --2- 172.21.15.77:0/1619911395 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5810160d20 0x7f58100adba0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f581006deb0 tx=0x7f580c009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0cb706a35577f2d server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:48:19.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.027+0000 7f5814ad4700 1 -- 172.21.15.77:0/1619911395 <== mon.2 v2:172.21.15.103:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580c011830 con 0x7f5810160d20 2023-07-24T05:48:19.035 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.027+0000 7f5814ad4700 1 -- 172.21.15.77:0/1619911395 <== mon.2 v2:172.21.15.103:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f580c011990 con 0x7f5810160d20 2023-07-24T05:48:19.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.027+0000 7f5814ad4700 1 -- 172.21.15.77:0/1619911395 <== mon.2 v2:172.21.15.103:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580c011d20 con 0x7f5810160d20 2023-07-24T05:48:19.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.027+0000 7f5816ad8700 1 -- 172.21.15.77:0/1619911395 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5810160d20 msgr2=0x7f58100adba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:48:19.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.027+0000 7f5816ad8700 1 --2- 172.21.15.77:0/1619911395 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5810160d20 0x7f58100adba0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f581006deb0 tx=0x7f580c009b30 comp rx=0 tx=0).stop 2023-07-24T05:48:19.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.027+0000 7f5816ad8700 1 -- 172.21.15.77:0/1619911395 shutdown_connections 2023-07-24T05:48:19.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.027+0000 7f5816ad8700 1 --2- 172.21.15.77:0/1619911395 >> v2:172.21.15.77:3300/0 conn(0x7f5810161100 0x7f58100b15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:48:19.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.027+0000 7f5816ad8700 1 --2- 172.21.15.77:0/1619911395 >> v2:172.21.15.103:3300/0 conn(0x7f58100ae0e0 0x7f58100b1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:48:19.036 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.027+0000 7f5816ad8700 1 --2- 172.21.15.77:0/1619911395 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f5810160d20 0x7f58100adba0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:48:19.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.027+0000 7f5816ad8700 1 -- 172.21.15.77:0/1619911395 >> 172.21.15.77:0/1619911395 conn(0x7f58100cacc0 msgr2=0x7f58100cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:48:19.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.027+0000 7f5816ad8700 1 -- 172.21.15.77:0/1619911395 shutdown_connections 2023-07-24T05:48:19.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.027+0000 7f5816ad8700 1 -- 172.21.15.77:0/1619911395 wait complete. 2023-07-24T05:48:19.037 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.031+0000 7f5816ad8700 1 Processor -- start 2023-07-24T05:48:19.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.031+0000 7f5816ad8700 1 -- start start 2023-07-24T05:48:19.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.031+0000 7f5816ad8700 1 --2- >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f58100ae0e0 0x7f58100c4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:48:19.038 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.031+0000 7f5816ad8700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5810160d20 0x7f581015cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:48:19.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.031+0000 7f5816ad8700 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5810161100 0x7f581015ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:48:19.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.031+0000 7f5816ad8700 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5810162880 con 0x7f5810160d20 2023-07-24T05:48:19.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.031+0000 7f5816ad8700 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581015d4d0 con 0x7f5810161100 2023-07-24T05:48:19.039 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.031+0000 7f5816ad8700 1 -- --> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5810161bc0 con 0x7f58100ae0e0 2023-07-24T05:48:19.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.031+0000 7f58152d5700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5810160d20 0x7f581015cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:48:19.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.031+0000 7f58152d5700 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5810160d20 0x7f581015cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55012/0 (socket says 172.21.15.77:55012) 2023-07-24T05:48:19.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.031+0000 7f58152d5700 1 -- 172.21.15.77:0/2651545726 learned_addr learned my addr 172.21.15.77:0/2651545726 (peer_addr_for_me v2:172.21.15.77:0/0) 2023-07-24T05:48:19.040 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.031+0000 7f58162d7700 1 --2- 172.21.15.77:0/2651545726 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5810161100 0x7f581015ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:48:19.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.031+0000 7f5815ad6700 1 --2- 172.21.15.77:0/2651545726 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f58100ae0e0 0x7f58100c4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:48:19.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.031+0000 7f58152d5700 1 -- 172.21.15.77:0/2651545726 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f58100ae0e0 msgr2=0x7f58100c4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:48:19.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.031+0000 7f58152d5700 1 --2- 172.21.15.77:0/2651545726 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f58100ae0e0 0x7f58100c4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:48:19.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.031+0000 7f58152d5700 1 -- 172.21.15.77:0/2651545726 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5810161100 msgr2=0x7f581015ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:48:19.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.031+0000 7f58152d5700 1 --2- 172.21.15.77:0/2651545726 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5810161100 0x7f581015ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:48:19.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.031+0000 7f58152d5700 1 -- 172.21.15.77:0/2651545726 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5808009b30 con 0x7f5810160d20 2023-07-24T05:48:19.041 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.031+0000 7f58152d5700 1 --2- 172.21.15.77:0/2651545726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5810160d20 0x7f581015cf90 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f580000e900 tx=0x7f580000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:48:19.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.031+0000 7f58067fc700 1 -- 172.21.15.77:0/2651545726 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5800013680 con 0x7f5810160d20 2023-07-24T05:48:19.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.031+0000 7f58067fc700 1 -- 172.21.15.77:0/2651545726 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58000137e0 con 0x7f5810160d20 2023-07-24T05:48:19.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.031+0000 7f5816ad8700 1 -- 172.21.15.77:0/2651545726 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f580c0094b0 con 0x7f5810160d20 2023-07-24T05:48:19.042 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.031+0000 7f58067fc700 1 -- 172.21.15.77:0/2651545726 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5800013b70 con 0x7f5810160d20 2023-07-24T05:48:19.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.031+0000 7f5816ad8700 1 -- 172.21.15.77:0/2651545726 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5810162180 con 0x7f5810160d20 2023-07-24T05:48:19.043 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.035+0000 7f5816ad8700 1 -- 172.21.15.77:0/2651545726 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58101629c0 con 0x7f5810160d20 2023-07-24T05:48:19.044 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.035+0000 7f58067fc700 1 -- 172.21.15.77:0/2651545726 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5800013cd0 con 0x7f5810160d20 2023-07-24T05:48:19.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.039+0000 7f58067fc700 1 --2- 172.21.15.77:0/2651545726 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f57f40662f0 0x7f57f40687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-24T05:48:19.045 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.039+0000 7f58067fc700 1 -- 172.21.15.77:0/2651545726 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f5800083e50 con 0x7f5810160d20 2023-07-24T05:48:19.046 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.039+0000 7f5815ad6700 1 --2- 172.21.15.77:0/2651545726 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f57f40662f0 0x7f57f40687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-24T05:48:19.047 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.039+0000 7f5815ad6700 1 --2- 172.21.15.77:0/2651545726 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f57f40662f0 0x7f57f40687b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f580c000c00 tx=0x7f580c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-24T05:48:19.052 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.043+0000 7f58067fc700 1 -- 172.21.15.77:0/2651545726 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f58101629c0 con 0x7f5810160d20 2023-07-24T05:48:19.280 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.271+0000 7f5816ad8700 1 -- 172.21.15.77:0/2651545726 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.admin"} v 0) v1 -- 0x7f58101629c0 con 0x7f5810160d20 2023-07-24T05:48:19.281 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.275+0000 7f58067fc700 1 -- 172.21.15.77:0/2651545726 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.admin"}]=0 v9) v1 ==== 82+0+151 (secure 0 0 0) 0x7f58101629c0 con 0x7f5810160d20 2023-07-24T05:48:19.282 INFO:teuthology.orchestra.run.smithi077.stdout:[client.admin] 2023-07-24T05:48:19.282 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQDYD75kh1t9MBAAExO6qebNSWQP3et+p9GmvA== 2023-07-24T05:48:19.282 INFO:teuthology.orchestra.run.smithi077.stdout: caps mds = "allow *" 2023-07-24T05:48:19.282 INFO:teuthology.orchestra.run.smithi077.stdout: caps mgr = "allow *" 2023-07-24T05:48:19.282 INFO:teuthology.orchestra.run.smithi077.stdout: caps mon = "allow *" 2023-07-24T05:48:19.282 INFO:teuthology.orchestra.run.smithi077.stdout: caps osd = "allow *" 2023-07-24T05:48:19.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.279+0000 7f5816ad8700 1 -- 172.21.15.77:0/2651545726 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f57f40662f0 msgr2=0x7f57f40687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:48:19.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.279+0000 7f5816ad8700 1 --2- 172.21.15.77:0/2651545726 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f57f40662f0 0x7f57f40687b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f580c000c00 tx=0x7f580c008030 comp rx=0 tx=0).stop 2023-07-24T05:48:19.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.279+0000 7f5816ad8700 1 -- 172.21.15.77:0/2651545726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5810160d20 msgr2=0x7f581015cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-24T05:48:19.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.279+0000 7f5816ad8700 1 --2- 172.21.15.77:0/2651545726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5810160d20 0x7f581015cf90 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f580000e900 tx=0x7f580000ec10 comp rx=0 tx=0).stop 2023-07-24T05:48:19.287 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.279+0000 7f5816ad8700 1 -- 172.21.15.77:0/2651545726 shutdown_connections 2023-07-24T05:48:19.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.279+0000 7f5816ad8700 1 --2- 172.21.15.77:0/2651545726 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5810161100 0x7f581015ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:48:19.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.279+0000 7f5816ad8700 1 --2- 172.21.15.77:0/2651545726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5810160d20 0x7f581015cf90 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:48:19.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.279+0000 7f5816ad8700 1 --2- 172.21.15.77:0/2651545726 >> [v2:172.21.15.103:6832/1305366540,v1:172.21.15.103:6833/1305366540] conn(0x7f57f40662f0 0x7f57f40687b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:48:19.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.279+0000 7f5816ad8700 1 --2- 172.21.15.77:0/2651545726 >> [v2:172.21.15.103:3301/0,v1:172.21.15.103:6790/0] conn(0x7f58100ae0e0 0x7f58100c4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-24T05:48:19.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.279+0000 7f5816ad8700 1 -- 172.21.15.77:0/2651545726 >> 172.21.15.77:0/2651545726 conn(0x7f58100cacc0 msgr2=0x7f58100cb0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-24T05:48:19.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.279+0000 7f5816ad8700 1 -- 172.21.15.77:0/2651545726 shutdown_connections 2023-07-24T05:48:19.288 INFO:teuthology.orchestra.run.smithi077.stderr:2023-07-24T05:48:19.279+0000 7f5816ad8700 1 -- 172.21.15.77:0/2651545726 wait complete. 2023-07-24T05:48:19.308 DEBUG:teuthology.orchestra.run.smithi077:> mktemp 2023-07-24T05:48:19.326 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/tmp.8mZscV7kLW 2023-07-24T05:48:19.326 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-07-24T05:48:19.326 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/tmp/tmp.8mZscV7kLW 2023-07-24T05:48:19.384 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-07-24T05:48:19.385 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/tmp/tmp.l0Q1kOBHMTxfstests-dev/local.config 2023-07-24T05:48:19.457 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph-fuse export CEPH_FUSE_BIN_PATH=ceph-fuse export TEST_DEV=ceph-fuse # without this tests won't get started export TEST_DIR=/tmp/tmp.OIBegeaH9ytest export SCRATCH_DEV= export SCRATCH_MNT=/tmp/tmp.o5Xv2LeDrtscratch export CEPHFS_MOUNT_OPTIONS="-m 172.21.15.77:6789 -k /tmp/tmp.8mZscV7kLW --client_mountpoint /test" 2023-07-24T05:48:19.457 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2023-07-24T05:48:19.458 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/tmp/tmp.l0Q1kOBHMTxfstests-dev/ceph.exclude 2023-07-24T05:48:19.532 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo make) 2023-07-24T05:48:19.640 INFO:teuthology.orchestra.run.smithi077.stdout:libtoolize -cfi 2023-07-24T05:48:20.330 INFO:teuthology.orchestra.run.smithi077.stdout:libtoolize: putting auxiliary files in '.'. 2023-07-24T05:48:20.330 INFO:teuthology.orchestra.run.smithi077.stdout:libtoolize: copying file './config.guess' 2023-07-24T05:48:20.356 INFO:teuthology.orchestra.run.smithi077.stdout:libtoolize: copying file './config.sub' 2023-07-24T05:48:20.411 INFO:teuthology.orchestra.run.smithi077.stdout:libtoolize: copying file './install-sh' 2023-07-24T05:48:20.440 INFO:teuthology.orchestra.run.smithi077.stdout:libtoolize: copying file './ltmain.sh' 2023-07-24T05:48:20.559 INFO:teuthology.orchestra.run.smithi077.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-07-24T05:48:20.559 INFO:teuthology.orchestra.run.smithi077.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-07-24T05:48:20.594 INFO:teuthology.orchestra.run.smithi077.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-07-24T05:48:20.619 INFO:teuthology.orchestra.run.smithi077.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-07-24T05:48:20.647 INFO:teuthology.orchestra.run.smithi077.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-07-24T05:48:20.674 INFO:teuthology.orchestra.run.smithi077.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-07-24T05:48:20.697 INFO:teuthology.orchestra.run.smithi077.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-07-24T05:48:20.703 INFO:teuthology.orchestra.run.smithi077.stdout:cp include/install-sh . 2023-07-24T05:48:20.707 INFO:teuthology.orchestra.run.smithi077.stdout:aclocal -I m4 2023-07-24T05:48:22.277 INFO:teuthology.orchestra.run.smithi077.stdout:autoheader 2023-07-24T05:48:22.718 INFO:teuthology.orchestra.run.smithi077.stdout:autoconf 2023-07-24T05:48:23.045 INFO:teuthology.orchestra.run.smithi077.stdout:./configure \ 2023-07-24T05:48:23.045 INFO:teuthology.orchestra.run.smithi077.stdout: --libexecdir=/usr/lib \ 2023-07-24T05:48:23.045 INFO:teuthology.orchestra.run.smithi077.stdout: --exec_prefix=/var/lib 2023-07-24T05:48:24.119 INFO:teuthology.orchestra.run.smithi077.stdout:checking build system type... x86_64-pc-linux-gnu 2023-07-24T05:48:24.119 INFO:teuthology.orchestra.run.smithi077.stdout:checking host system type... x86_64-pc-linux-gnu 2023-07-24T05:48:24.182 INFO:teuthology.orchestra.run.smithi077.stdout:checking how to print strings... printf 2023-07-24T05:48:24.183 INFO:teuthology.orchestra.run.smithi077.stdout:checking for gcc... gcc 2023-07-24T05:48:24.483 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether the C compiler works... yes 2023-07-24T05:48:24.484 INFO:teuthology.orchestra.run.smithi077.stdout:checking for C compiler default output file name... a.out 2023-07-24T05:48:24.564 INFO:teuthology.orchestra.run.smithi077.stdout:checking for suffix of executables... 2023-07-24T05:48:24.706 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether we are cross compiling... no 2023-07-24T05:48:24.769 INFO:teuthology.orchestra.run.smithi077.stdout:checking for suffix of object files... o 2023-07-24T05:48:24.823 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether we are using the GNU C compiler... yes 2023-07-24T05:48:24.879 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether gcc accepts -g... yes 2023-07-24T05:48:25.016 INFO:teuthology.orchestra.run.smithi077.stdout:checking for gcc option to accept ISO C89... none needed 2023-07-24T05:48:25.033 INFO:teuthology.orchestra.run.smithi077.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2023-07-24T05:48:25.044 INFO:teuthology.orchestra.run.smithi077.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2023-07-24T05:48:25.050 INFO:teuthology.orchestra.run.smithi077.stdout:checking for egrep... /usr/bin/grep -E 2023-07-24T05:48:25.057 INFO:teuthology.orchestra.run.smithi077.stdout:checking for fgrep... /usr/bin/grep -F 2023-07-24T05:48:25.072 INFO:teuthology.orchestra.run.smithi077.stdout:checking for ld used by gcc... /usr/bin/ld 2023-07-24T05:48:25.081 INFO:teuthology.orchestra.run.smithi077.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2023-07-24T05:48:25.093 INFO:teuthology.orchestra.run.smithi077.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2023-07-24T05:48:25.119 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:48:25.126 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:48:25.167 INFO:teuthology.orchestra.run.smithi077.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2023-07-24T05:48:25.167 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether ln -s works... yes 2023-07-24T05:48:25.203 INFO:teuthology.orchestra.run.smithi077.stdout:checking the maximum length of command line arguments... 1572864 2023-07-24T05:48:25.216 INFO:teuthology.orchestra.run.smithi077.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-07-24T05:48:25.216 INFO:teuthology.orchestra.run.smithi077.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-07-24T05:48:25.217 INFO:teuthology.orchestra.run.smithi077.stdout:checking for /usr/bin/ld option to reload object files... -r 2023-07-24T05:48:25.218 INFO:teuthology.orchestra.run.smithi077.stdout:checking for objdump... objdump 2023-07-24T05:48:25.219 INFO:teuthology.orchestra.run.smithi077.stdout:checking how to recognize dependent libraries... pass_all 2023-07-24T05:48:25.221 INFO:teuthology.orchestra.run.smithi077.stdout:checking for dlltool... no 2023-07-24T05:48:25.221 INFO:teuthology.orchestra.run.smithi077.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-07-24T05:48:25.223 INFO:teuthology.orchestra.run.smithi077.stdout:checking for ar... ar 2023-07-24T05:48:25.309 INFO:teuthology.orchestra.run.smithi077.stdout:checking for archiver @FILE support... @ 2023-07-24T05:48:25.310 INFO:teuthology.orchestra.run.smithi077.stdout:checking for strip... strip 2023-07-24T05:48:25.312 INFO:teuthology.orchestra.run.smithi077.stdout:checking for ranlib... ranlib 2023-07-24T05:48:25.313 INFO:teuthology.orchestra.run.smithi077.stdout:checking for gawk... gawk 2023-07-24T05:48:25.535 INFO:teuthology.orchestra.run.smithi077.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2023-07-24T05:48:25.542 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sysroot... no 2023-07-24T05:48:25.557 INFO:teuthology.orchestra.run.smithi077.stdout:checking for a working dd... /usr/bin/dd 2023-07-24T05:48:25.571 INFO:teuthology.orchestra.run.smithi077.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2023-07-24T05:48:25.625 INFO:teuthology.orchestra.run.smithi077.stdout:checking for mt... mt 2023-07-24T05:48:25.652 INFO:teuthology.orchestra.run.smithi077.stdout:checking if mt is a manifest tool... no 2023-07-24T05:48:25.764 INFO:teuthology.orchestra.run.smithi077.stdout:checking how to run the C preprocessor... gcc -E 2023-07-24T05:48:26.151 INFO:teuthology.orchestra.run.smithi077.stdout:checking for ANSI C header files... yes 2023-07-24T05:48:26.227 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/types.h... yes 2023-07-24T05:48:26.325 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/stat.h... yes 2023-07-24T05:48:26.417 INFO:teuthology.orchestra.run.smithi077.stdout:checking for stdlib.h... yes 2023-07-24T05:48:26.516 INFO:teuthology.orchestra.run.smithi077.stdout:checking for string.h... yes 2023-07-24T05:48:26.619 INFO:teuthology.orchestra.run.smithi077.stdout:checking for memory.h... yes 2023-07-24T05:48:26.713 INFO:teuthology.orchestra.run.smithi077.stdout:checking for strings.h... yes 2023-07-24T05:48:26.814 INFO:teuthology.orchestra.run.smithi077.stdout:checking for inttypes.h... yes 2023-07-24T05:48:26.913 INFO:teuthology.orchestra.run.smithi077.stdout:checking for stdint.h... yes 2023-07-24T05:48:27.020 INFO:teuthology.orchestra.run.smithi077.stdout:checking for unistd.h... yes 2023-07-24T05:48:27.125 INFO:teuthology.orchestra.run.smithi077.stdout:checking for dlfcn.h... yes 2023-07-24T05:48:27.142 INFO:teuthology.orchestra.run.smithi077.stdout:checking for objdir... .libs 2023-07-24T05:48:27.390 INFO:teuthology.orchestra.run.smithi077.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-07-24T05:48:27.391 INFO:teuthology.orchestra.run.smithi077.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-07-24T05:48:27.462 INFO:teuthology.orchestra.run.smithi077.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-07-24T05:48:27.687 INFO:teuthology.orchestra.run.smithi077.stdout:checking if gcc static flag -static works... yes 2023-07-24T05:48:27.790 INFO:teuthology.orchestra.run.smithi077.stdout:checking if gcc supports -c -o file.o... yes 2023-07-24T05:48:27.790 INFO:teuthology.orchestra.run.smithi077.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-07-24T05:48:27.826 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-07-24T05:48:27.905 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether -lc should be explicitly linked in... no 2023-07-24T05:48:28.069 INFO:teuthology.orchestra.run.smithi077.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-07-24T05:48:28.070 INFO:teuthology.orchestra.run.smithi077.stdout:checking how to hardcode library paths into programs... immediate 2023-07-24T05:48:28.082 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether stripping libraries is possible... yes 2023-07-24T05:48:28.082 INFO:teuthology.orchestra.run.smithi077.stdout:checking if libtool supports shared libraries... yes 2023-07-24T05:48:28.083 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether to build shared libraries... yes 2023-07-24T05:48:28.083 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether to build static libraries... yes 2023-07-24T05:48:28.114 INFO:teuthology.orchestra.run.smithi077.stdout:checking for gcc... (cached) gcc 2023-07-24T05:48:28.191 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-07-24T05:48:28.192 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether gcc accepts -g... (cached) yes 2023-07-24T05:48:28.193 INFO:teuthology.orchestra.run.smithi077.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-07-24T05:48:28.194 INFO:teuthology.orchestra.run.smithi077.stdout:checking for gmake... no 2023-07-24T05:48:28.195 INFO:teuthology.orchestra.run.smithi077.stdout:checking for make... /usr/bin/make 2023-07-24T05:48:28.195 INFO:teuthology.orchestra.run.smithi077.stderr:./configure: line 8824: test: $(SHELL): binary operator expected 2023-07-24T05:48:28.196 INFO:teuthology.orchestra.run.smithi077.stdout:checking for tar... /bin/tar 2023-07-24T05:48:28.197 INFO:teuthology.orchestra.run.smithi077.stdout:checking for gzip... /bin/gzip 2023-07-24T05:48:28.223 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether gcc -MM is supported... yes 2023-07-24T05:48:28.224 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sort... /bin/sort 2023-07-24T05:48:28.225 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether ln -s works... yes 2023-07-24T05:48:28.226 INFO:teuthology.orchestra.run.smithi077.stdout:checking for rpm... no 2023-07-24T05:48:28.317 INFO:teuthology.orchestra.run.smithi077.stdout:checking assert.h usability... yes 2023-07-24T05:48:28.345 INFO:teuthology.orchestra.run.smithi077.stdout:checking assert.h presence... yes 2023-07-24T05:48:28.346 INFO:teuthology.orchestra.run.smithi077.stdout:checking for assert.h... yes 2023-07-24T05:48:28.451 INFO:teuthology.orchestra.run.smithi077.stdout:checking bstring.h usability... no 2023-07-24T05:48:28.502 INFO:teuthology.orchestra.run.smithi077.stdout:checking bstring.h presence... no 2023-07-24T05:48:28.502 INFO:teuthology.orchestra.run.smithi077.stdout:checking for bstring.h... no 2023-07-24T05:48:28.591 INFO:teuthology.orchestra.run.smithi077.stdout:checking libgen.h usability... yes 2023-07-24T05:48:28.622 INFO:teuthology.orchestra.run.smithi077.stdout:checking libgen.h presence... yes 2023-07-24T05:48:28.622 INFO:teuthology.orchestra.run.smithi077.stdout:checking for libgen.h... yes 2023-07-24T05:48:28.734 INFO:teuthology.orchestra.run.smithi077.stdout:checking dirent.h usability... yes 2023-07-24T05:48:28.762 INFO:teuthology.orchestra.run.smithi077.stdout:checking dirent.h presence... yes 2023-07-24T05:48:28.763 INFO:teuthology.orchestra.run.smithi077.stdout:checking for dirent.h... yes 2023-07-24T05:48:28.899 INFO:teuthology.orchestra.run.smithi077.stdout:checking errno.h usability... yes 2023-07-24T05:48:28.931 INFO:teuthology.orchestra.run.smithi077.stdout:checking errno.h presence... yes 2023-07-24T05:48:28.932 INFO:teuthology.orchestra.run.smithi077.stdout:checking for errno.h... yes 2023-07-24T05:48:29.037 INFO:teuthology.orchestra.run.smithi077.stdout:checking malloc.h usability... yes 2023-07-24T05:48:29.074 INFO:teuthology.orchestra.run.smithi077.stdout:checking malloc.h presence... yes 2023-07-24T05:48:29.074 INFO:teuthology.orchestra.run.smithi077.stdout:checking for malloc.h... yes 2023-07-24T05:48:29.176 INFO:teuthology.orchestra.run.smithi077.stdout:checking uuid.h usability... no 2023-07-24T05:48:29.228 INFO:teuthology.orchestra.run.smithi077.stdout:checking uuid.h presence... no 2023-07-24T05:48:29.228 INFO:teuthology.orchestra.run.smithi077.stdout:checking for uuid.h... no 2023-07-24T05:48:29.335 INFO:teuthology.orchestra.run.smithi077.stdout:checking uuid/uuid.h usability... yes 2023-07-24T05:48:29.366 INFO:teuthology.orchestra.run.smithi077.stdout:checking uuid/uuid.h presence... yes 2023-07-24T05:48:29.366 INFO:teuthology.orchestra.run.smithi077.stdout:checking for uuid/uuid.h... yes 2023-07-24T05:48:29.479 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/uuid.h usability... no 2023-07-24T05:48:29.531 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/uuid.h presence... no 2023-07-24T05:48:29.531 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/uuid.h... no 2023-07-24T05:48:29.624 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/file.h usability... yes 2023-07-24T05:48:29.655 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/file.h presence... yes 2023-07-24T05:48:29.655 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/file.h... yes 2023-07-24T05:48:29.758 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/fcntl.h usability... yes 2023-07-24T05:48:29.793 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/fcntl.h presence... yes 2023-07-24T05:48:29.793 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/fcntl.h... yes 2023-07-24T05:48:29.903 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/syssgi.h usability... no 2023-07-24T05:48:29.952 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/syssgi.h presence... no 2023-07-24T05:48:29.952 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/syssgi.h... no 2023-07-24T05:48:30.069 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/param.h usability... yes 2023-07-24T05:48:30.106 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/param.h presence... yes 2023-07-24T05:48:30.107 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/param.h... yes 2023-07-24T05:48:30.137 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/stat.h... (cached) yes 2023-07-24T05:48:30.243 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/statvfs.h usability... yes 2023-07-24T05:48:30.276 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/statvfs.h presence... yes 2023-07-24T05:48:30.277 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/statvfs.h... yes 2023-07-24T05:48:30.382 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/time.h usability... yes 2023-07-24T05:48:30.414 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/time.h presence... yes 2023-07-24T05:48:30.415 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/time.h... yes 2023-07-24T05:48:30.526 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/ioctl.h usability... yes 2023-07-24T05:48:30.559 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/ioctl.h presence... yes 2023-07-24T05:48:30.560 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/ioctl.h... yes 2023-07-24T05:48:30.670 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/wait.h usability... yes 2023-07-24T05:48:30.702 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/wait.h presence... yes 2023-07-24T05:48:30.703 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/wait.h... yes 2023-07-24T05:48:30.729 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/types.h... (cached) yes 2023-07-24T05:48:30.755 INFO:teuthology.orchestra.run.smithi077.stdout:checking for strings.h... (cached) yes 2023-07-24T05:48:30.862 INFO:teuthology.orchestra.run.smithi077.stdout:checking err.h usability... yes 2023-07-24T05:48:30.894 INFO:teuthology.orchestra.run.smithi077.stdout:checking err.h presence... yes 2023-07-24T05:48:30.894 INFO:teuthology.orchestra.run.smithi077.stdout:checking for err.h... yes 2023-07-24T05:48:30.999 INFO:teuthology.orchestra.run.smithi077.stdout:checking linux/falloc.h usability... yes 2023-07-24T05:48:31.029 INFO:teuthology.orchestra.run.smithi077.stdout:checking linux/falloc.h presence... yes 2023-07-24T05:48:31.030 INFO:teuthology.orchestra.run.smithi077.stdout:checking for linux/falloc.h... yes 2023-07-24T05:48:31.136 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-07-24T05:48:31.187 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-07-24T05:48:31.188 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/fs/xfs_fsops.h... no 2023-07-24T05:48:31.280 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/fs/xfs_itable.h usability... no 2023-07-24T05:48:31.329 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/fs/xfs_itable.h presence... no 2023-07-24T05:48:31.330 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/fs/xfs_itable.h... no 2023-07-24T05:48:31.432 INFO:teuthology.orchestra.run.smithi077.stdout:checking xfs/platform_defs.h usability... no 2023-07-24T05:48:31.480 INFO:teuthology.orchestra.run.smithi077.stdout:checking xfs/platform_defs.h presence... no 2023-07-24T05:48:31.481 INFO:teuthology.orchestra.run.smithi077.stdout:checking for xfs/platform_defs.h... no 2023-07-24T05:48:31.577 INFO:teuthology.orchestra.run.smithi077.stdout:checking btrfs/ioctl.h usability... no 2023-07-24T05:48:31.621 INFO:teuthology.orchestra.run.smithi077.stdout:checking btrfs/ioctl.h presence... no 2023-07-24T05:48:31.621 INFO:teuthology.orchestra.run.smithi077.stdout:checking for btrfs/ioctl.h... no 2023-07-24T05:48:31.710 INFO:teuthology.orchestra.run.smithi077.stdout:checking cifs/ioctl.h usability... no 2023-07-24T05:48:31.761 INFO:teuthology.orchestra.run.smithi077.stdout:checking cifs/ioctl.h presence... no 2023-07-24T05:48:31.761 INFO:teuthology.orchestra.run.smithi077.stdout:checking for cifs/ioctl.h... no 2023-07-24T05:48:31.851 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/mman.h usability... yes 2023-07-24T05:48:31.886 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/mman.h presence... yes 2023-07-24T05:48:31.886 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/mman.h... yes 2023-07-24T05:48:31.961 INFO:teuthology.orchestra.run.smithi077.stdout:checking for xfs/xfs_log_format.h... no 2023-07-24T05:48:32.092 INFO:teuthology.orchestra.run.smithi077.stdout:checking for uuid_compare... no 2023-07-24T05:48:32.187 INFO:teuthology.orchestra.run.smithi077.stdout:checking for uuid_compare in -luuid... yes 2023-07-24T05:48:32.344 INFO:teuthology.orchestra.run.smithi077.stdout:checking for xfs/xfs.h... yes 2023-07-24T05:48:32.411 INFO:teuthology.orchestra.run.smithi077.stdout:checking for xfs/libxfs.h... no 2023-07-24T05:48:32.487 INFO:teuthology.orchestra.run.smithi077.stdout:checking whether xlog_assign_lsn is declared... no 2023-07-24T05:48:32.573 INFO:teuthology.orchestra.run.smithi077.stdout:checking for xfs/xqm.h... yes 2023-07-24T05:48:32.693 INFO:teuthology.orchestra.run.smithi077.stdout:checking xfsctl from xfs/xfs.h... ok 2023-07-24T05:48:32.769 INFO:teuthology.orchestra.run.smithi077.stdout:checking xfs/handle.h usability... yes 2023-07-24T05:48:32.798 INFO:teuthology.orchestra.run.smithi077.stdout:checking xfs/handle.h presence... yes 2023-07-24T05:48:32.798 INFO:teuthology.orchestra.run.smithi077.stdout:checking for xfs/handle.h... yes 2023-07-24T05:48:32.908 INFO:teuthology.orchestra.run.smithi077.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-07-24T05:48:33.002 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/acl.h usability... yes 2023-07-24T05:48:33.037 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/acl.h presence... yes 2023-07-24T05:48:33.037 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/acl.h... yes 2023-07-24T05:48:33.122 INFO:teuthology.orchestra.run.smithi077.stdout:checking acl/libacl.h usability... yes 2023-07-24T05:48:33.156 INFO:teuthology.orchestra.run.smithi077.stdout:checking acl/libacl.h presence... yes 2023-07-24T05:48:33.156 INFO:teuthology.orchestra.run.smithi077.stdout:checking for acl/libacl.h... yes 2023-07-24T05:48:33.260 INFO:teuthology.orchestra.run.smithi077.stdout:checking for acl_init in -lacl... yes 2023-07-24T05:48:33.341 INFO:teuthology.orchestra.run.smithi077.stdout:checking gdbm-ndbm.h usability... no 2023-07-24T05:48:33.386 INFO:teuthology.orchestra.run.smithi077.stdout:checking gdbm-ndbm.h presence... no 2023-07-24T05:48:33.386 INFO:teuthology.orchestra.run.smithi077.stdout:checking for gdbm-ndbm.h... no 2023-07-24T05:48:33.468 INFO:teuthology.orchestra.run.smithi077.stdout:checking gdbm/ndbm.h usability... no 2023-07-24T05:48:33.512 INFO:teuthology.orchestra.run.smithi077.stdout:checking gdbm/ndbm.h presence... no 2023-07-24T05:48:33.513 INFO:teuthology.orchestra.run.smithi077.stdout:checking for gdbm/ndbm.h... no 2023-07-24T05:48:33.590 INFO:teuthology.orchestra.run.smithi077.stdout:checking ndbm.h usability... no 2023-07-24T05:48:33.641 INFO:teuthology.orchestra.run.smithi077.stdout:checking ndbm.h presence... no 2023-07-24T05:48:33.642 INFO:teuthology.orchestra.run.smithi077.stdout:checking for ndbm.h... no 2023-07-24T05:48:33.732 INFO:teuthology.orchestra.run.smithi077.stdout:checking libaio.h usability... yes 2023-07-24T05:48:33.768 INFO:teuthology.orchestra.run.smithi077.stdout:checking libaio.h presence... yes 2023-07-24T05:48:33.768 INFO:teuthology.orchestra.run.smithi077.stdout:checking for libaio.h... yes 2023-07-24T05:48:33.852 INFO:teuthology.orchestra.run.smithi077.stdout:checking liburing.h usability... no 2023-07-24T05:48:33.900 INFO:teuthology.orchestra.run.smithi077.stdout:checking liburing.h presence... no 2023-07-24T05:48:33.901 INFO:teuthology.orchestra.run.smithi077.stdout:checking for liburing.h... no 2023-07-24T05:48:33.979 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/capability.h usability... no 2023-07-24T05:48:34.029 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/capability.h presence... no 2023-07-24T05:48:34.030 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/capability.h... no 2023-07-24T05:48:34.105 INFO:teuthology.orchestra.run.smithi077.stdout:checking linux/fiemap.h usability... yes 2023-07-24T05:48:34.140 INFO:teuthology.orchestra.run.smithi077.stdout:checking linux/fiemap.h presence... yes 2023-07-24T05:48:34.140 INFO:teuthology.orchestra.run.smithi077.stdout:checking for linux/fiemap.h... yes 2023-07-24T05:48:34.243 INFO:teuthology.orchestra.run.smithi077.stdout:checking for fallocate... yes 2023-07-24T05:48:34.346 INFO:teuthology.orchestra.run.smithi077.stdout:checking for open_by_handle_at... yes 2023-07-24T05:48:34.426 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/prctl.h usability... yes 2023-07-24T05:48:34.458 INFO:teuthology.orchestra.run.smithi077.stdout:checking sys/prctl.h presence... yes 2023-07-24T05:48:34.459 INFO:teuthology.orchestra.run.smithi077.stdout:checking for sys/prctl.h... yes 2023-07-24T05:48:34.548 INFO:teuthology.orchestra.run.smithi077.stdout:checking linux/fs.h usability... yes 2023-07-24T05:48:34.579 INFO:teuthology.orchestra.run.smithi077.stdout:checking linux/fs.h presence... yes 2023-07-24T05:48:34.580 INFO:teuthology.orchestra.run.smithi077.stdout:checking for linux/fs.h... yes 2023-07-24T05:48:34.658 INFO:teuthology.orchestra.run.smithi077.stdout:checking btrfsutil.h usability... no 2023-07-24T05:48:34.702 INFO:teuthology.orchestra.run.smithi077.stdout:checking btrfsutil.h presence... no 2023-07-24T05:48:34.702 INFO:teuthology.orchestra.run.smithi077.stdout:checking for btrfsutil.h... no 2023-07-24T05:48:34.806 INFO:teuthology.orchestra.run.smithi077.stdout:checking for copy_file_range... yes 2023-07-24T05:48:34.909 INFO:teuthology.orchestra.run.smithi077.stdout:checking for SEEK_DATA... yes 2023-07-24T05:48:35.026 INFO:teuthology.orchestra.run.smithi077.stdout:checking for BMV_OF_SHARED... yes 2023-07-24T05:48:35.131 INFO:teuthology.orchestra.run.smithi077.stdout:checking for nftw... yes 2023-07-24T05:48:35.260 INFO:teuthology.orchestra.run.smithi077.stdout:checking for RLIMIT_NOFILE... yes 2023-07-24T05:48:35.336 INFO:teuthology.orchestra.run.smithi077.stdout:checking for FIEXCHANGE_RANGE... no 2023-07-24T05:48:35.430 INFO:teuthology.orchestra.run.smithi077.stdout:checking for renameat2... yes 2023-07-24T05:48:35.519 INFO:teuthology.orchestra.run.smithi077.stdout:checking for reallocarray... yes 2023-07-24T05:48:35.583 INFO:teuthology.orchestra.run.smithi077.stdout:checking for struct mount_attr... no 2023-07-24T05:48:35.714 INFO:teuthology.orchestra.run.smithi077.stdout:checking for struct btrfs_qgroup_limit... yes 2023-07-24T05:48:35.844 INFO:teuthology.orchestra.run.smithi077.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-07-24T05:48:35.974 INFO:teuthology.orchestra.run.smithi077.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-07-24T05:48:36.106 INFO:teuthology.orchestra.run.smithi077.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-07-24T05:48:36.237 INFO:teuthology.orchestra.run.smithi077.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-07-24T05:48:36.375 INFO:teuthology.orchestra.run.smithi077.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-07-24T05:48:36.505 INFO:teuthology.orchestra.run.smithi077.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-07-24T05:48:36.602 INFO:teuthology.orchestra.run.smithi077.stdout:checking linux/btrfs.h usability... yes 2023-07-24T05:48:36.638 INFO:teuthology.orchestra.run.smithi077.stdout:checking linux/btrfs.h presence... yes 2023-07-24T05:48:36.639 INFO:teuthology.orchestra.run.smithi077.stdout:checking for linux/btrfs.h... yes 2023-07-24T05:48:36.750 INFO:teuthology.orchestra.run.smithi077.stdout:checking linux/btrfs_tree.h usability... yes 2023-07-24T05:48:36.781 INFO:teuthology.orchestra.run.smithi077.stdout:checking linux/btrfs_tree.h presence... yes 2023-07-24T05:48:36.782 INFO:teuthology.orchestra.run.smithi077.stdout:checking for linux/btrfs_tree.h... yes 2023-07-24T05:48:36.915 INFO:teuthology.orchestra.run.smithi077.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-07-24T05:48:36.966 INFO:teuthology.orchestra.run.smithi077.stdout:configure: creating ./config.status 2023-07-24T05:48:38.880 INFO:teuthology.orchestra.run.smithi077.stdout:config.status: creating include/builddefs 2023-07-24T05:48:38.939 INFO:teuthology.orchestra.run.smithi077.stdout:config.status: creating include/config.h 2023-07-24T05:48:38.989 INFO:teuthology.orchestra.run.smithi077.stdout:config.status: executing libtool commands 2023-07-24T05:48:39.154 INFO:teuthology.orchestra.run.smithi077.stdout:Building include 2023-07-24T05:48:39.168 INFO:teuthology.orchestra.run.smithi077.stdout:Building lib 2023-07-24T05:48:39.183 INFO:teuthology.orchestra.run.smithi077.stdout: [LTDEP] 2023-07-24T05:48:39.483 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] dataascii.lo 2023-07-24T05:48:39.777 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] databin.lo 2023-07-24T05:48:40.106 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] datapid.lo 2023-07-24T05:48:40.369 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] file_lock.lo 2023-07-24T05:48:40.706 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] forker.lo 2023-07-24T05:48:41.014 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] pattern.lo 2023-07-24T05:48:41.313 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] open_flags.lo 2023-07-24T05:48:41.638 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] random_range.lo 2023-07-24T05:48:42.070 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] string_to_tokens.lo 2023-07-24T05:48:42.340 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] str_to_bytes.lo 2023-07-24T05:48:42.650 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] tlibio.lo 2023-07-24T05:48:43.085 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] write_log.lo 2023-07-24T05:48:43.267 INFO:teuthology.orchestra.run.smithi077.stderr:write_log.c: In function 'wlog_record_write': 2023-07-24T05:48:43.267 INFO:teuthology.orchestra.run.smithi077.stderr:write_log.c:205:6: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:48:43.267 INFO:teuthology.orchestra.run.smithi077.stderr: 205 | write(wfile->w_afd, wbuf, reclen); 2023-07-24T05:48:43.267 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:48:43.267 INFO:teuthology.orchestra.run.smithi077.stderr:write_log.c:209:6: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:48:43.267 INFO:teuthology.orchestra.run.smithi077.stderr: 209 | write(wfile->w_rfd, wbuf, reclen); 2023-07-24T05:48:43.268 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:48:43.513 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] random.lo 2023-07-24T05:48:43.784 INFO:teuthology.orchestra.run.smithi077.stdout: [LD] 2023-07-24T05:48:44.020 INFO:teuthology.orchestra.run.smithi077.stdout:Building ltp 2023-07-24T05:48:44.036 INFO:teuthology.orchestra.run.smithi077.stdout: [DEP] 2023-07-24T05:48:44.374 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] doio 2023-07-24T05:48:45.381 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] fsstress 2023-07-24T05:48:47.125 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] fsx 2023-07-24T05:48:48.364 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] growfiles 2023-07-24T05:48:49.208 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] iogen 2023-07-24T05:48:49.549 INFO:teuthology.orchestra.run.smithi077.stderr:iogen.c: In function 'main': 2023-07-24T05:48:49.549 INFO:teuthology.orchestra.run.smithi077.stderr:iogen.c:280:2: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:48:49.549 INFO:teuthology.orchestra.run.smithi077.stderr: 280 | write(outfd, (char *)&req, sizeof(req)); 2023-07-24T05:48:49.550 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:48:49.555 INFO:teuthology.orchestra.run.smithi077.stderr:iogen.c: In function 'parse_cmdline': 2023-07-24T05:48:49.555 INFO:teuthology.orchestra.run.smithi077.stderr:iogen.c:1535:10: warning: ignoring return value of 'getcwd', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:48:49.556 INFO:teuthology.orchestra.run.smithi077.stderr: 1535 | getcwd(fptr->f_path, 2023-07-24T05:48:49.556 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:48:49.556 INFO:teuthology.orchestra.run.smithi077.stderr: 1536 | sizeof(fptr->f_path)-1); 2023-07-24T05:48:49.556 INFO:teuthology.orchestra.run.smithi077.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:48:49.867 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-stress 2023-07-24T05:48:50.203 INFO:teuthology.orchestra.run.smithi077.stderr:aio-stress.c: In function 'setup_shared_mem': 2023-07-24T05:48:50.203 INFO:teuthology.orchestra.run.smithi077.stderr:aio-stress.c:1013:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:48:50.203 INFO:teuthology.orchestra.run.smithi077.stderr: 1013 | ftruncate(fd, total_ram); 2023-07-24T05:48:50.204 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:48:50.591 INFO:teuthology.orchestra.run.smithi077.stdout:Building src 2023-07-24T05:48:50.608 INFO:teuthology.orchestra.run.smithi077.stdout: [DEP] 2023-07-24T05:48:54.178 INFO:teuthology.orchestra.run.smithi077.stdout: [DEP] 2023-07-24T05:48:54.255 INFO:teuthology.orchestra.run.smithi077.stdout: [DEP] 2023-07-24T05:48:54.287 INFO:teuthology.orchestra.run.smithi077.stdout: [DEP] 2023-07-24T05:48:54.762 INFO:teuthology.orchestra.run.smithi077.stdout: [DEP] 2023-07-24T05:48:54.851 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] dirstress 2023-07-24T05:48:55.216 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:48:55.223 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:48:55.387 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] fill 2023-07-24T05:48:55.779 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] fill2 2023-07-24T05:48:56.260 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] getpagesize 2023-07-24T05:48:56.629 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] holes 2023-07-24T05:48:57.076 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] lstat64 2023-07-24T05:48:57.495 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] nametest 2023-07-24T05:48:57.841 INFO:teuthology.orchestra.run.smithi077.stderr:nametest.c: In function 'main': 2023-07-24T05:48:57.841 INFO:teuthology.orchestra.run.smithi077.stderr:nametest.c:236:5: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:48:57.842 INFO:teuthology.orchestra.run.smithi077.stderr: 236 | write(1, "\n", 1); 2023-07-24T05:48:57.842 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~ 2023-07-24T05:48:57.842 INFO:teuthology.orchestra.run.smithi077.stderr:nametest.c:238:4: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:48:57.842 INFO:teuthology.orchestra.run.smithi077.stderr: 238 | write(1, ".", 1); 2023-07-24T05:48:57.842 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~ 2023-07-24T05:48:57.842 INFO:teuthology.orchestra.run.smithi077.stderr:nametest.c:288:5: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:48:57.842 INFO:teuthology.orchestra.run.smithi077.stderr: 288 | write(1, ".", 1); 2023-07-24T05:48:57.842 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~ 2023-07-24T05:48:58.007 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] permname 2023-07-24T05:48:58.454 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] randholes 2023-07-24T05:48:58.970 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] runas 2023-07-24T05:48:59.386 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] truncfile 2023-07-24T05:48:59.824 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] usemem 2023-07-24T05:49:00.209 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] mmapcat 2023-07-24T05:49:00.510 INFO:teuthology.orchestra.run.smithi077.stderr:mmapcat.c: In function 'main': 2023-07-24T05:49:00.510 INFO:teuthology.orchestra.run.smithi077.stderr:mmapcat.c:29:2: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:00.510 INFO:teuthology.orchestra.run.smithi077.stderr: 29 | write(1,ptr2,ptr - ptr2); 2023-07-24T05:49:00.510 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:00.583 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] append_reader 2023-07-24T05:49:00.981 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] append_writer 2023-07-24T05:49:01.367 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] dirperf 2023-07-24T05:49:01.843 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] metaperf 2023-07-24T05:49:02.163 INFO:teuthology.orchestra.run.smithi077.stderr:metaperf.c: In function 'crfiles': 2023-07-24T05:49:02.163 INFO:teuthology.orchestra.run.smithi077.stderr:metaperf.c:166:4: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:02.163 INFO:teuthology.orchestra.run.smithi077.stderr: 166 | write(fd, buf, fsize); 2023-07-24T05:49:02.164 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:02.164 INFO:teuthology.orchestra.run.smithi077.stderr:metaperf.c: In function 't_linkun': 2023-07-24T05:49:02.164 INFO:teuthology.orchestra.run.smithi077.stderr:metaperf.c:454:4: warning: ignoring return value of 'link', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:02.165 INFO:teuthology.orchestra.run.smithi077.stderr: 454 | link("a", *fnp); 2023-07-24T05:49:02.165 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~ 2023-07-24T05:49:02.165 INFO:teuthology.orchestra.run.smithi077.stderr:metaperf.c: In function 't_chown': 2023-07-24T05:49:02.165 INFO:teuthology.orchestra.run.smithi077.stderr:metaperf.c:404:5: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:02.165 INFO:teuthology.orchestra.run.smithi077.stderr: 404 | chown(*fnp, 2, -1); 2023-07-24T05:49:02.165 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:02.165 INFO:teuthology.orchestra.run.smithi077.stderr:metaperf.c:406:5: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:02.165 INFO:teuthology.orchestra.run.smithi077.stderr: 406 | chown(*fnp, 1, -1); 2023-07-24T05:49:02.166 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:02.166 INFO:teuthology.orchestra.run.smithi077.stderr:metaperf.c: In function 'i_chown': 2023-07-24T05:49:02.166 INFO:teuthology.orchestra.run.smithi077.stderr:metaperf.c:291:3: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:02.166 INFO:teuthology.orchestra.run.smithi077.stderr: 291 | chown(*fnp, 1, -1); 2023-07-24T05:49:02.166 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:02.166 INFO:teuthology.orchestra.run.smithi077.stderr:metaperf.c: In function 'main': 2023-07-24T05:49:02.166 INFO:teuthology.orchestra.run.smithi077.stderr:metaperf.c:152:2: warning: ignoring return value of 'chdir', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:02.167 INFO:teuthology.orchestra.run.smithi077.stderr: 152 | chdir(".."); 2023-07-24T05:49:02.167 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~ 2023-07-24T05:49:02.352 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] devzero 2023-07-24T05:49:02.770 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] feature 2023-07-24T05:49:03.233 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] alloc 2023-07-24T05:49:03.576 INFO:teuthology.orchestra.run.smithi077.stderr:alloc.c: In function 'main': 2023-07-24T05:49:03.577 INFO:teuthology.orchestra.run.smithi077.stderr:alloc.c:247:3: warning: ignoring return value of 'mkstemp', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:03.577 INFO:teuthology.orchestra.run.smithi077.stderr: 247 | mkstemp(tmpfile); 2023-07-24T05:49:03.577 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~ 2023-07-24T05:49:03.718 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] fault 2023-07-24T05:49:04.119 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] fstest 2023-07-24T05:49:04.630 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_access_root 2023-07-24T05:49:04.944 INFO:teuthology.orchestra.run.smithi077.stderr:t_access_root.c: In function 'main': 2023-07-24T05:49:04.944 INFO:teuthology.orchestra.run.smithi077.stderr:t_access_root.c:55:5: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:04.945 INFO:teuthology.orchestra.run.smithi077.stderr: 55 | system(cmd); 2023-07-24T05:49:04.945 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~ 2023-07-24T05:49:05.035 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] godown 2023-07-24T05:49:05.436 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] resvtest 2023-07-24T05:49:05.879 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] writemod 2023-07-24T05:49:06.268 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] writev_on_pagefault 2023-07-24T05:49:06.663 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] makeextents 2023-07-24T05:49:07.086 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] itrash 2023-07-24T05:49:07.468 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] rename 2023-07-24T05:49:07.836 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] multi_open_unlink 2023-07-24T05:49:08.255 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] unwritten_sync 2023-07-24T05:49:08.688 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] genhashnames 2023-07-24T05:49:09.117 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_holes 2023-07-24T05:49:09.505 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_mmap_writev 2023-07-24T05:49:09.893 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_truncate_cmtime 2023-07-24T05:49:10.302 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] dirhash_collide 2023-07-24T05:49:10.735 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_rename_overwrite 2023-07-24T05:49:11.110 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] holetest 2023-07-24T05:49:11.431 INFO:teuthology.orchestra.run.smithi077.stderr:holetest.c: In function 'pt_write_marker': 2023-07-24T05:49:11.431 INFO:teuthology.orchestra.run.smithi077.stderr:holetest.c:140:3: warning: ignoring return value of 'pwrite', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:11.431 INFO:teuthology.orchestra.run.smithi077.stderr: 140 | pwrite(fd, &tid, sizeof(tid), i * page_size + pgoff); 2023-07-24T05:49:11.431 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:11.579 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_truncate_self 2023-07-24T05:49:11.961 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] af_unix 2023-07-24T05:49:12.354 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_mmap_stale_pmd 2023-07-24T05:49:12.652 INFO:teuthology.orchestra.run.smithi077.stderr:t_mmap_stale_pmd.c: In function 'main': 2023-07-24T05:49:12.652 INFO:teuthology.orchestra.run.smithi077.stderr:t_mmap_stale_pmd.c:42:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:12.652 INFO:teuthology.orchestra.run.smithi077.stderr: 42 | ftruncate(fd, 0); 2023-07-24T05:49:12.652 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~ 2023-07-24T05:49:12.653 INFO:teuthology.orchestra.run.smithi077.stderr:t_mmap_stale_pmd.c:43:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:12.653 INFO:teuthology.orchestra.run.smithi077.stderr: 43 | ftruncate(fd, MiB(4)); 2023-07-24T05:49:12.653 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:12.653 INFO:teuthology.orchestra.run.smithi077.stderr:t_mmap_stale_pmd.c:55:2: warning: ignoring return value of 'pwrite', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:12.653 INFO:teuthology.orchestra.run.smithi077.stderr: 55 | pwrite(fd, buffer, strlen(buffer), MiB(2)); 2023-07-24T05:49:12.653 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:12.721 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_mmap_cow_race 2023-07-24T05:49:13.041 INFO:teuthology.orchestra.run.smithi077.stderr:t_mmap_cow_race.c: In function 'main': 2023-07-24T05:49:13.042 INFO:teuthology.orchestra.run.smithi077.stderr:t_mmap_cow_race.c:61:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:13.042 INFO:teuthology.orchestra.run.smithi077.stderr: 61 | ftruncate(fd, 0); 2023-07-24T05:49:13.042 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~ 2023-07-24T05:49:13.042 INFO:teuthology.orchestra.run.smithi077.stderr:t_mmap_cow_race.c:62:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:13.042 INFO:teuthology.orchestra.run.smithi077.stderr: 62 | ftruncate(fd, MiB(2)); 2023-07-24T05:49:13.042 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:13.123 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_mmap_fallocate 2023-07-24T05:49:13.514 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] fsync-err 2023-07-24T05:49:13.964 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_mmap_write_ro 2023-07-24T05:49:14.359 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_ext4_dax_journal_corruption 2023-07-24T05:49:14.679 INFO:teuthology.orchestra.run.smithi077.stderr:t_ext4_dax_journal_corruption.c: In function 'main': 2023-07-24T05:49:14.680 INFO:teuthology.orchestra.run.smithi077.stderr:t_ext4_dax_journal_corruption.c:61:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:14.680 INFO:teuthology.orchestra.run.smithi077.stderr: 61 | ftruncate(fd, 0); 2023-07-24T05:49:14.680 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~ 2023-07-24T05:49:14.765 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_ext4_dax_inline_corruption 2023-07-24T05:49:15.173 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_ofd_locks 2023-07-24T05:49:15.632 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_mmap_collision 2023-07-24T05:49:16.083 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] mmap-write-concurrent 2023-07-24T05:49:16.490 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_get_file_time 2023-07-24T05:49:16.876 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_create_short_dirs 2023-07-24T05:49:17.296 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_create_long_dirs 2023-07-24T05:49:17.705 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_enospc 2023-07-24T05:49:18.147 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_mmap_writev_overlap 2023-07-24T05:49:18.559 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] checkpoint_journal 2023-07-24T05:49:18.961 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] mmap-rw-fault 2023-07-24T05:49:19.395 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] allocstale 2023-07-24T05:49:19.811 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_mmap_cow_memory_failure 2023-07-24T05:49:20.247 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] fake-dump-rootino 2023-07-24T05:49:20.636 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] dio-buf-fault 2023-07-24T05:49:21.026 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] xfsctl 2023-07-24T05:49:21.473 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] bstat 2023-07-24T05:49:21.922 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_mtab 2023-07-24T05:49:22.257 INFO:teuthology.orchestra.run.smithi077.stderr:t_mtab.c: In function 'update_mtab': 2023-07-24T05:49:22.257 INFO:teuthology.orchestra.run.smithi077.stderr:t_mtab.c:256:3: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:22.257 INFO:teuthology.orchestra.run.smithi077.stderr: 256 | chown (mounted_temp, sbuf.st_uid, sbuf.st_gid); 2023-07-24T05:49:22.257 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:22.370 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] getdevicesize 2023-07-24T05:49:22.742 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] preallo_rw_pattern_reader 2023-07-24T05:49:23.073 INFO:teuthology.orchestra.run.smithi077.stderr:In file included from preallo_rw_pattern_reader.c:2: 2023-07-24T05:49:23.073 INFO:teuthology.orchestra.run.smithi077.stderr:iopat.c: In function 'main': 2023-07-24T05:49:23.074 INFO:teuthology.orchestra.run.smithi077.stderr:iopat.c:38:4: warning: ignoring return value of 'read', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:23.074 INFO:teuthology.orchestra.run.smithi077.stderr: 38 | read(fd, &x, 1048576); 2023-07-24T05:49:23.074 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:23.145 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] preallo_rw_pattern_writer 2023-07-24T05:49:23.480 INFO:teuthology.orchestra.run.smithi077.stderr:In file included from preallo_rw_pattern_writer.c:2: 2023-07-24T05:49:23.480 INFO:teuthology.orchestra.run.smithi077.stderr:iopat.c: In function 'main': 2023-07-24T05:49:23.480 INFO:teuthology.orchestra.run.smithi077.stderr:iopat.c:34:4: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:23.480 INFO:teuthology.orchestra.run.smithi077.stderr: 34 | write(fd, &x, 1048576); 2023-07-24T05:49:23.480 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:23.555 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] ftrunc 2023-07-24T05:49:23.950 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] trunc 2023-07-24T05:49:24.356 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] fs_perms 2023-07-24T05:49:24.658 INFO:teuthology.orchestra.run.smithi077.stderr:fs_perms.c: In function 'main': 2023-07-24T05:49:24.658 INFO:teuthology.orchestra.run.smithi077.stderr:fs_perms.c:54:4: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:24.658 INFO:teuthology.orchestra.run.smithi077.stderr: 54 | system("rm -f test.file"); 2023-07-24T05:49:24.658 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:24.658 INFO:teuthology.orchestra.run.smithi077.stderr:fs_perms.c: In function 'testsetup': 2023-07-24T05:49:24.658 INFO:teuthology.orchestra.run.smithi077.stderr:fs_perms.c:67:4: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:24.659 INFO:teuthology.orchestra.run.smithi077.stderr: 67 | system("cp testx.file test.file"); 2023-07-24T05:49:24.659 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:24.659 INFO:teuthology.orchestra.run.smithi077.stderr:fs_perms.c:69:4: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:24.659 INFO:teuthology.orchestra.run.smithi077.stderr: 69 | chown("test.file",cuserId,cgroupId); 2023-07-24T05:49:24.659 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:24.659 INFO:teuthology.orchestra.run.smithi077.stderr:fs_perms.c: In function 'testfperm': 2023-07-24T05:49:24.660 INFO:teuthology.orchestra.run.smithi077.stderr:fs_perms.c:123:5: warning: ignoring return value of 'seteuid', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:24.660 INFO:teuthology.orchestra.run.smithi077.stderr: 123 | seteuid(0); 2023-07-24T05:49:24.660 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~ 2023-07-24T05:49:24.660 INFO:teuthology.orchestra.run.smithi077.stderr:fs_perms.c:124:5: warning: ignoring return value of 'setegid', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:24.660 INFO:teuthology.orchestra.run.smithi077.stderr: 124 | setegid(0); 2023-07-24T05:49:24.660 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~ 2023-07-24T05:49:24.742 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] testx 2023-07-24T05:49:25.087 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] looptest 2023-07-24T05:49:25.316 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:49:25.321 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:49:25.527 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] locktest 2023-07-24T05:49:26.124 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] unwritten_mmap 2023-07-24T05:49:26.532 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] bulkstat_unlink_test 2023-07-24T05:49:26.863 INFO:teuthology.orchestra.run.smithi077.stderr:bulkstat_unlink_test.c: In function 'main': 2023-07-24T05:49:26.864 INFO:teuthology.orchestra.run.smithi077.stderr:bulkstat_unlink_test.c:106:4: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:26.864 INFO:teuthology.orchestra.run.smithi077.stderr: 106 | write(fd[i], fname, sizeof(fname)); 2023-07-24T05:49:26.864 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:26.864 INFO:teuthology.orchestra.run.smithi077.stderr:bulkstat_unlink_test.c:178:3: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:26.864 INFO:teuthology.orchestra.run.smithi077.stderr: 178 | system(fname); 2023-07-24T05:49:26.864 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~ 2023-07-24T05:49:26.989 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] deduperace 2023-07-24T05:49:27.438 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] bulkstat_unlink_test_modified 2023-07-24T05:49:27.765 INFO:teuthology.orchestra.run.smithi077.stderr:bulkstat_unlink_test_modified.c: In function 'main': 2023-07-24T05:49:27.766 INFO:teuthology.orchestra.run.smithi077.stderr:bulkstat_unlink_test_modified.c:83:6: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:27.766 INFO:teuthology.orchestra.run.smithi077.stderr: 83 | write(fd, fname, sizeof(fname)); 2023-07-24T05:49:27.766 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:27.766 INFO:teuthology.orchestra.run.smithi077.stderr:bulkstat_unlink_test_modified.c:139:6: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:27.766 INFO:teuthology.orchestra.run.smithi077.stderr: 139 | write(fd, fname, sizeof(fname)); 2023-07-24T05:49:27.766 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:27.766 INFO:teuthology.orchestra.run.smithi077.stderr:bulkstat_unlink_test_modified.c:185:2: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:27.767 INFO:teuthology.orchestra.run.smithi077.stderr: 185 | system(fname); 2023-07-24T05:49:27.767 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~ 2023-07-24T05:49:27.884 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_dir_offset 2023-07-24T05:49:28.272 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_futimens 2023-07-24T05:49:28.617 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_immutable 2023-07-24T05:49:28.969 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c: In function 'create_test_area': 2023-07-24T05:49:28.970 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:2061:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.970 INFO:teuthology.orchestra.run.smithi077.stderr: 2061 | asprintf(&path, "%s/immutable.d", dir); 2023-07-24T05:49:28.970 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.970 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:2096:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.970 INFO:teuthology.orchestra.run.smithi077.stderr: 2096 | asprintf(&path, "%s/append-only.d", dir); 2023-07-24T05:49:28.970 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.971 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c: In function 'remove_test_area': 2023-07-24T05:49:28.972 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:2152:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.972 INFO:teuthology.orchestra.run.smithi077.stderr: 2152 | asprintf(&path, "%s/immutable.d", dir); 2023-07-24T05:49:28.972 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.972 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:2163:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.972 INFO:teuthology.orchestra.run.smithi077.stderr: 2163 | asprintf(&path, "%s/empty-immutable.d", dir); 2023-07-24T05:49:28.972 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.973 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:2175:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.973 INFO:teuthology.orchestra.run.smithi077.stderr: 2175 | asprintf(&path, "%s/append-only.d", dir); 2023-07-24T05:49:28.973 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.973 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:2186:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.973 INFO:teuthology.orchestra.run.smithi077.stderr: 2186 | asprintf(&path, "%s/empty-append-only.d", dir); 2023-07-24T05:49:28.973 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.973 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:2197:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.973 INFO:teuthology.orchestra.run.smithi077.stderr: 2197 | asprintf(&path, "%s/append-only.f", dir); 2023-07-24T05:49:28.974 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.974 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:2209:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.974 INFO:teuthology.orchestra.run.smithi077.stderr: 2209 | asprintf(&path, "%s/immutable.f", dir); 2023-07-24T05:49:28.974 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.974 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c: In function 'check_test_area': 2023-07-24T05:49:28.974 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:1788:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.974 INFO:teuthology.orchestra.run.smithi077.stderr: 1788 | asprintf(&path, "%s/", dir); 2023-07-24T05:49:28.975 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.975 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:1800:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.975 INFO:teuthology.orchestra.run.smithi077.stderr: 1800 | asprintf(&path, "%s/immutable.f", dir); 2023-07-24T05:49:28.975 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.975 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:1812:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.975 INFO:teuthology.orchestra.run.smithi077.stderr: 1812 | asprintf(&path, "%s/append-only.f", dir); 2023-07-24T05:49:28.975 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.975 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:1824:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.976 INFO:teuthology.orchestra.run.smithi077.stderr: 1824 | asprintf(&path, "%s/immutable.d", dir); 2023-07-24T05:49:28.976 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.976 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:1837:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.976 INFO:teuthology.orchestra.run.smithi077.stderr: 1837 | asprintf(&path, "%s/append-only.d", dir); 2023-07-24T05:49:28.976 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.976 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:1850:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.976 INFO:teuthology.orchestra.run.smithi077.stderr: 1850 | asprintf(&path, "%s/immutable.d/file", dir); 2023-07-24T05:49:28.976 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.977 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:1862:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.977 INFO:teuthology.orchestra.run.smithi077.stderr: 1862 | asprintf(&path, "%s/append-only.d/file", dir); 2023-07-24T05:49:28.977 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.977 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:1874:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.977 INFO:teuthology.orchestra.run.smithi077.stderr: 1874 | asprintf(&path, "%s/immutable.d/dir", dir); 2023-07-24T05:49:28.977 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.977 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:1887:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.977 INFO:teuthology.orchestra.run.smithi077.stderr: 1887 | asprintf(&path, "%s/append-only.d/dir", dir); 2023-07-24T05:49:28.978 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.978 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c: In function 'test_immutable': 2023-07-24T05:49:28.978 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:151:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.978 INFO:teuthology.orchestra.run.smithi077.stderr: 151 | asprintf(&path, "%s/immutable.f", dir); 2023-07-24T05:49:28.979 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.979 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:381:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.979 INFO:teuthology.orchestra.run.smithi077.stderr: 381 | asprintf(&linkpath, "%s/immutable.f.hardlink", dir); 2023-07-24T05:49:28.979 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.979 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:408:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.979 INFO:teuthology.orchestra.run.smithi077.stderr: 408 | chown(path, 0, 0); 2023-07-24T05:49:28.979 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.980 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:485:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.980 INFO:teuthology.orchestra.run.smithi077.stderr: 485 | asprintf(&linkpath, "%s/immutable.f.newname", dir); 2023-07-24T05:49:28.980 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.980 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:532:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.980 INFO:teuthology.orchestra.run.smithi077.stderr: 532 | asprintf(&path, "%s/immutable.d/file", dir); 2023-07-24T05:49:28.980 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.980 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:553:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.980 INFO:teuthology.orchestra.run.smithi077.stderr: 553 | chown(path, 0, 0); 2023-07-24T05:49:28.981 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.981 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:556:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.981 INFO:teuthology.orchestra.run.smithi077.stderr: 556 | asprintf(&linkpath, "%s/immutable.d/file.link", dir); 2023-07-24T05:49:28.981 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.981 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:575:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.981 INFO:teuthology.orchestra.run.smithi077.stderr: 575 | asprintf(&linkpath, "%s/immutable.d/file.newname", dir); 2023-07-24T05:49:28.981 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.981 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:595:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.982 INFO:teuthology.orchestra.run.smithi077.stderr: 595 | asprintf(&path, "%s/immutable.d/newfile", dir); 2023-07-24T05:49:28.982 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.982 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:619:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.982 INFO:teuthology.orchestra.run.smithi077.stderr: 619 | asprintf(&path, "%s/immutable.d/newdir", dir); 2023-07-24T05:49:28.982 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.982 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:631:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.982 INFO:teuthology.orchestra.run.smithi077.stderr: 631 | asprintf(&path, "%s/immutable.d/dir/newfile-%d", dir, getuid()); 2023-07-24T05:49:28.983 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.983 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:653:16: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.983 INFO:teuthology.orchestra.run.smithi077.stderr: 653 | chown(path, 0, 0); 2023-07-24T05:49:28.983 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.983 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:657:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.983 INFO:teuthology.orchestra.run.smithi077.stderr: 657 | asprintf(&path, "%s/immutable.d/dir", dir); 2023-07-24T05:49:28.983 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.983 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:668:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.984 INFO:teuthology.orchestra.run.smithi077.stderr: 668 | asprintf(&path, "%s/immutable.d", dir); 2023-07-24T05:49:28.984 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.984 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:705:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.984 INFO:teuthology.orchestra.run.smithi077.stderr: 705 | chown(path, 0, 0); 2023-07-24T05:49:28.984 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.984 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:782:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.984 INFO:teuthology.orchestra.run.smithi077.stderr: 782 | asprintf(&path, "%s/empty-immutable.d", dir); 2023-07-24T05:49:28.984 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.986 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c: In function 'test_append': 2023-07-24T05:49:28.986 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:822:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.986 INFO:teuthology.orchestra.run.smithi077.stderr: 822 | asprintf(&path, "%s/append-only.f", dir); 2023-07-24T05:49:28.986 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.986 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:1024:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.986 INFO:teuthology.orchestra.run.smithi077.stderr: 1024 | asprintf(&linkpath, "%s/append-only.f.hardlink", dir); 2023-07-24T05:49:28.986 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.987 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:1051:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.987 INFO:teuthology.orchestra.run.smithi077.stderr: 1051 | chown(path, 0, 0); 2023-07-24T05:49:28.987 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.987 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:1126:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.987 INFO:teuthology.orchestra.run.smithi077.stderr: 1126 | asprintf(&linkpath, "%s/append-only.f.newname", dir); 2023-07-24T05:49:28.987 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.987 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:1495:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.987 INFO:teuthology.orchestra.run.smithi077.stderr: 1495 | asprintf(&path, "%s/append-only.d/file", dir); 2023-07-24T05:49:28.988 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.988 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:1516:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.988 INFO:teuthology.orchestra.run.smithi077.stderr: 1516 | chown(path, 0, 0); 2023-07-24T05:49:28.988 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.988 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:1519:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.988 INFO:teuthology.orchestra.run.smithi077.stderr: 1519 | asprintf(&linkpath, "%s/append-only.d/file.link-%d", dir, getuid()); 2023-07-24T05:49:28.988 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.989 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:1529:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.989 INFO:teuthology.orchestra.run.smithi077.stderr: 1529 | asprintf(&linkpath, "%s/append-only.d/file.symlink-%d", dir, getuid()); 2023-07-24T05:49:28.989 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.989 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:1539:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.989 INFO:teuthology.orchestra.run.smithi077.stderr: 1539 | asprintf(&linkpath, "%s/append-only.d/file.newname", dir); 2023-07-24T05:49:28.989 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.989 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:1559:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.989 INFO:teuthology.orchestra.run.smithi077.stderr: 1559 | asprintf(&path, "%s/append-only.d/newfile-%d", dir, getuid()); 2023-07-24T05:49:28.990 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.990 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:1573:4: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.990 INFO:teuthology.orchestra.run.smithi077.stderr: 1573 | asprintf(&path, "%s/append-only.d/newdev-%d", dir, getuid()); 2023-07-24T05:49:28.990 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.990 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:1586:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.990 INFO:teuthology.orchestra.run.smithi077.stderr: 1586 | asprintf(&path, "%s/append-only.d/newdir-%d", dir, getuid()); 2023-07-24T05:49:28.990 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.990 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:1596:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.991 INFO:teuthology.orchestra.run.smithi077.stderr: 1596 | asprintf(&path, "%s/append-only.d/newdir-%d/newfile-%d", dir, getuid(), getuid()); 2023-07-24T05:49:28.991 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.991 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:1618:16: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.991 INFO:teuthology.orchestra.run.smithi077.stderr: 1618 | chown(path, 0, 0); 2023-07-24T05:49:28.991 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.991 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:1622:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.991 INFO:teuthology.orchestra.run.smithi077.stderr: 1622 | asprintf(&path, "%s/append-only.d/dir/newfile-%d", dir, getuid()); 2023-07-24T05:49:28.991 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.992 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:1644:16: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.992 INFO:teuthology.orchestra.run.smithi077.stderr: 1644 | chown(path, 0, 0); 2023-07-24T05:49:28.992 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.992 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:1648:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.992 INFO:teuthology.orchestra.run.smithi077.stderr: 1648 | asprintf(&path, "%s/append-only.d/dir", dir); 2023-07-24T05:49:28.992 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.992 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:1659:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.992 INFO:teuthology.orchestra.run.smithi077.stderr: 1659 | asprintf(&path, "%s/append-only.d", dir); 2023-07-24T05:49:28.993 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.993 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:1692:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.993 INFO:teuthology.orchestra.run.smithi077.stderr: 1692 | chown(path, 0, 0); 2023-07-24T05:49:28.993 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~ 2023-07-24T05:49:28.993 INFO:teuthology.orchestra.run.smithi077.stderr:t_immutable.c:1769:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:28.993 INFO:teuthology.orchestra.run.smithi077.stderr: 1769 | asprintf(&path, "%s/empty-append-only.d", dir); 2023-07-24T05:49:28.993 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:29.635 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] stale_handle 2023-07-24T05:49:29.961 INFO:teuthology.orchestra.run.smithi077.stderr:stale_handle.c: In function 'main': 2023-07-24T05:49:29.962 INFO:teuthology.orchestra.run.smithi077.stderr:stale_handle.c:102:2: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:29.962 INFO:teuthology.orchestra.run.smithi077.stderr: 102 | system("echo 3 > /proc/sys/vm/drop_caches"); 2023-07-24T05:49:29.962 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:30.055 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] pwrite_mmap_blocked 2023-07-24T05:49:30.454 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_dir_offset2 2023-07-24T05:49:30.905 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] seek_sanity_test 2023-07-24T05:49:31.239 INFO:teuthology.orchestra.run.smithi077.stderr:seek_sanity_test.c: In function 'test18': 2023-07-24T05:49:31.239 INFO:teuthology.orchestra.run.smithi077.stderr:seek_sanity_test.c:460:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:31.240 INFO:teuthology.orchestra.run.smithi077.stderr: 460 | ftruncate(fd, 0); 2023-07-24T05:49:31.240 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~ 2023-07-24T05:49:31.242 INFO:teuthology.orchestra.run.smithi077.stderr:seek_sanity_test.c: In function 'test_basic_support': 2023-07-24T05:49:31.243 INFO:teuthology.orchestra.run.smithi077.stderr:seek_sanity_test.c:1207:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:31.243 INFO:teuthology.orchestra.run.smithi077.stderr: 1207 | ftruncate(fd, 0); 2023-07-24T05:49:31.243 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~ 2023-07-24T05:49:31.243 INFO:teuthology.orchestra.run.smithi077.stderr:seek_sanity_test.c:1256:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:31.243 INFO:teuthology.orchestra.run.smithi077.stderr: 1256 | ftruncate(fd, 0); 2023-07-24T05:49:31.243 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~ 2023-07-24T05:49:31.244 INFO:teuthology.orchestra.run.smithi077.stderr:seek_sanity_test.c: In function 'get_io_sizes': 2023-07-24T05:49:31.244 INFO:teuthology.orchestra.run.smithi077.stderr:seek_sanity_test.c:88:3: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:31.244 INFO:teuthology.orchestra.run.smithi077.stderr: 88 | ftruncate(fd, 0); 2023-07-24T05:49:31.244 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~ 2023-07-24T05:49:31.244 INFO:teuthology.orchestra.run.smithi077.stderr:seek_sanity_test.c:89:3: warning: ignoring return value of 'pwrite', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:31.244 INFO:teuthology.orchestra.run.smithi077.stderr: 89 | pwrite(fd, "a", 1, offset); 2023-07-24T05:49:31.245 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:31.245 INFO:teuthology.orchestra.run.smithi077.stderr:seek_sanity_test.c:98:3: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:31.245 INFO:teuthology.orchestra.run.smithi077.stderr: 98 | ftruncate(fd, 0); 2023-07-24T05:49:31.245 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~ 2023-07-24T05:49:31.245 INFO:teuthology.orchestra.run.smithi077.stderr:seek_sanity_test.c:99:3: warning: ignoring return value of 'pwrite', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:31.245 INFO:teuthology.orchestra.run.smithi077.stderr: 99 | pwrite(fd, "a", 1, offset); 2023-07-24T05:49:31.245 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:31.615 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] seek_copy_test 2023-07-24T05:49:32.047 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_readdir_1 2023-07-24T05:49:32.371 INFO:teuthology.orchestra.run.smithi077.stderr:t_readdir_1.c: In function 'main': 2023-07-24T05:49:32.371 INFO:teuthology.orchestra.run.smithi077.stderr:t_readdir_1.c:30:25: warning: ignoring return value of 'read', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:32.371 INFO:teuthology.orchestra.run.smithi077.stderr: 30 | read(fd, buf, 100); 2023-07-24T05:49:32.371 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:32.442 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_readdir_2 2023-07-24T05:49:32.841 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] fsync-tester 2023-07-24T05:49:33.165 INFO:teuthology.orchestra.run.smithi077.stderr:fsync-tester.c: In function 'main': 2023-07-24T05:49:33.165 INFO:teuthology.orchestra.run.smithi077.stderr:fsync-tester.c:391:3: warning: ignoring return value of 'read', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:33.165 INFO:teuthology.orchestra.run.smithi077.stderr: 391 | read(fd, &seed, sizeof(seed)); 2023-07-24T05:49:33.166 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:33.166 INFO:teuthology.orchestra.run.smithi077.stderr:fsync-tester.c:541:3: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:33.166 INFO:teuthology.orchestra.run.smithi077.stderr: 541 | system("reboot -fn"); 2023-07-24T05:49:33.166 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:33.166 INFO:teuthology.orchestra.run.smithi077.stderr:fsync-tester.c: In function 'drop_all_caches': 2023-07-24T05:49:33.166 INFO:teuthology.orchestra.run.smithi077.stderr:fsync-tester.c:90:2: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:33.167 INFO:teuthology.orchestra.run.smithi077.stderr: 90 | write(fd, value, sizeof(value)-1); 2023-07-24T05:49:33.167 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:33.362 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] nsexec 2023-07-24T05:49:33.781 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] cloner 2023-07-24T05:49:34.226 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] renameat2 2023-07-24T05:49:34.637 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_getcwd 2023-07-24T05:49:34.951 INFO:teuthology.orchestra.run.smithi077.stderr:t_getcwd.c: In function 'test_getcwd': 2023-07-24T05:49:34.951 INFO:teuthology.orchestra.run.smithi077.stderr:t_getcwd.c:21:3: warning: ignoring return value of 'getcwd', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:34.951 INFO:teuthology.orchestra.run.smithi077.stderr: 21 | getcwd(cur_cwd, BUF_SIZE); 2023-07-24T05:49:34.952 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:35.037 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] e4compact 2023-07-24T05:49:35.508 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] test-nextquota 2023-07-24T05:49:35.931 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] punch-alternating 2023-07-24T05:49:36.354 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] attr-list-by-handle-cursor-test 2023-07-24T05:49:36.771 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] listxattr 2023-07-24T05:49:37.159 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] dio-interleaved 2023-07-24T05:49:37.562 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_dir_type 2023-07-24T05:49:37.956 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] dio-invalidate-cache 2023-07-24T05:49:38.284 INFO:teuthology.orchestra.run.smithi077.stderr:dio-invalidate-cache.c: In function 'main': 2023-07-24T05:49:38.284 INFO:teuthology.orchestra.run.smithi077.stderr:dio-invalidate-cache.c:286:3: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:38.284 INFO:teuthology.orchestra.run.smithi077.stderr: 286 | write(fd, buf, blksz * nr_child); 2023-07-24T05:49:38.285 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:38.422 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] stat_test 2023-07-24T05:49:38.994 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_encrypted_d_revalidate 2023-07-24T05:49:39.414 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] attr_replace_test 2023-07-24T05:49:39.836 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] swapon 2023-07-24T05:49:40.252 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] mkswap 2023-07-24T05:49:40.627 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_attr_corruption 2023-07-24T05:49:41.020 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_open_tmpfiles 2023-07-24T05:49:41.455 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] fscrypt-crypt-util 2023-07-24T05:49:42.428 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] bulkstat_null_ocount 2023-07-24T05:49:42.835 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] splice-test 2023-07-24T05:49:43.258 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] chprojid_fail 2023-07-24T05:49:43.664 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] detached_mounts_propagation 2023-07-24T05:49:44.103 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] ext4_resize 2023-07-24T05:49:44.482 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_readdir_3 2023-07-24T05:49:44.914 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] splice2pipe 2023-07-24T05:49:45.232 INFO:teuthology.orchestra.run.smithi077.stderr:splice2pipe.c: In function 'prepare_pipe': 2023-07-24T05:49:45.232 INFO:teuthology.orchestra.run.smithi077.stderr:splice2pipe.c:57:3: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:45.232 INFO:teuthology.orchestra.run.smithi077.stderr: 57 | write(p[1], buffer, n); 2023-07-24T05:49:45.232 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:45.232 INFO:teuthology.orchestra.run.smithi077.stderr:splice2pipe.c:65:3: warning: ignoring return value of 'read', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:45.232 INFO:teuthology.orchestra.run.smithi077.stderr: 65 | read(p[0], buffer, n); 2023-07-24T05:49:45.233 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:45.327 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] uuid_ioctl 2023-07-24T05:49:45.735 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] fiemap-tester 2023-07-24T05:49:46.254 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_stripealign 2023-07-24T05:49:46.647 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] open_by_handle 2023-07-24T05:49:47.157 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] t_mmap_dio 2023-07-24T05:49:47.598 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] xfsfind 2023-07-24T05:49:48.042 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] fssum 2023-07-24T05:49:48.780 INFO:teuthology.orchestra.run.smithi077.stdout:Building log-writes 2023-07-24T05:49:48.794 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] replay-log 2023-07-24T05:49:49.398 INFO:teuthology.orchestra.run.smithi077.stdout:Building perf 2023-07-24T05:49:49.412 INFO:teuthology.orchestra.run.smithi077.stdout:Building aio-dio-regress 2023-07-24T05:49:49.431 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-dio-append-write-fallocate-race 2023-07-24T05:49:49.867 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-dio-fcntl-race 2023-07-24T05:49:50.282 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-dio-subblock-eof-read 2023-07-24T05:49:50.678 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-dio-append-write-read-race 2023-07-24T05:49:51.110 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-dio-invalidate-readahead 2023-07-24T05:49:51.549 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-dio-hole-filling-race 2023-07-24T05:49:51.951 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-07-24T05:49:52.330 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-last-ref-held-by-io 2023-07-24T05:49:52.764 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-dio-cycle-write 2023-07-24T05:49:53.086 INFO:teuthology.orchestra.run.smithi077.stderr:aio-dio-cycle-write.c: In function 'init_test': 2023-07-24T05:49:53.086 INFO:teuthology.orchestra.run.smithi077.stderr:aio-dio-cycle-write.c:83:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:53.086 INFO:teuthology.orchestra.run.smithi077.stderr: 83 | ftruncate(fd, buf_size); 2023-07-24T05:49:53.086 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:53.214 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-dio-extend-stat 2023-07-24T05:49:53.635 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-07-24T05:49:54.007 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aiocp 2023-07-24T05:49:54.509 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-dio-invalidate-failure 2023-07-24T05:49:54.910 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aiodio_sparse2 2023-07-24T05:49:55.223 INFO:teuthology.orchestra.run.smithi077.stderr:aiodio_sparse2.c: In function 'aiodio_sparse': 2023-07-24T05:49:55.223 INFO:teuthology.orchestra.run.smithi077.stderr:aiodio_sparse2.c:111:3: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:55.224 INFO:teuthology.orchestra.run.smithi077.stderr: 111 | ftruncate(fd, filesize); 2023-07-24T05:49:55.224 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:55.224 INFO:teuthology.orchestra.run.smithi077.stderr:aiodio_sparse2.c: In function 'dirty_freeblocks': 2023-07-24T05:49:55.224 INFO:teuthology.orchestra.run.smithi077.stderr:aiodio_sparse2.c:274:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-07-24T05:49:55.224 INFO:teuthology.orchestra.run.smithi077.stderr: 274 | ftruncate(fd, size); 2023-07-24T05:49:55.225 INFO:teuthology.orchestra.run.smithi077.stderr: | ^~~~~~~~~~~~~~~~~~~ 2023-07-24T05:49:55.384 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-dio-cow-race 2023-07-24T05:49:55.392 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:49:55.397 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:49:55.790 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-dio-write-verify 2023-07-24T05:49:56.255 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] aio-dio-eof-race 2023-07-24T05:49:56.706 INFO:teuthology.orchestra.run.smithi077.stdout:Building vfs 2023-07-24T05:49:56.724 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] vfstest 2023-07-24T05:49:59.365 INFO:teuthology.orchestra.run.smithi077.stdout: [CC] mount-idmapped 2023-07-24T05:50:00.033 INFO:teuthology.orchestra.run.smithi077.stdout:Building m4 2023-07-24T05:50:00.047 INFO:teuthology.orchestra.run.smithi077.stdout:Building common 2023-07-24T05:50:00.061 INFO:teuthology.orchestra.run.smithi077.stdout:Building tests 2023-07-24T05:50:00.077 INFO:teuthology.orchestra.run.smithi077.stdout:Building perf 2023-07-24T05:50:00.094 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/perf/group.list 2023-07-24T05:50:00.150 INFO:teuthology.orchestra.run.smithi077.stdout:Building ext4 2023-07-24T05:50:00.164 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/ext4/group.list 2023-07-24T05:50:00.339 INFO:teuthology.orchestra.run.smithi077.stdout:Building ocfs2 2023-07-24T05:50:00.356 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/ocfs2/group.list 2023-07-24T05:50:00.424 INFO:teuthology.orchestra.run.smithi077.stdout:Building overlay 2023-07-24T05:50:00.442 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/overlay/group.list 2023-07-24T05:50:00.633 INFO:teuthology.orchestra.run.smithi077.stdout:Building cifs 2023-07-24T05:50:00.651 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/cifs/group.list 2023-07-24T05:50:00.706 INFO:teuthology.orchestra.run.smithi077.stdout:Building generic 2023-07-24T05:50:00.727 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/generic/group.list 2023-07-24T05:50:01.184 INFO:teuthology.orchestra.run.smithi077.stdout:Building shared 2023-07-24T05:50:01.201 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/shared/group.list 2023-07-24T05:50:01.291 INFO:teuthology.orchestra.run.smithi077.stdout:Building xfs 2023-07-24T05:50:01.310 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/xfs/group.list 2023-07-24T05:50:01.768 INFO:teuthology.orchestra.run.smithi077.stdout:Building f2fs 2023-07-24T05:50:01.787 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/f2fs/group.list 2023-07-24T05:50:01.872 INFO:teuthology.orchestra.run.smithi077.stdout:Building udf 2023-07-24T05:50:01.892 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/udf/group.list 2023-07-24T05:50:01.949 INFO:teuthology.orchestra.run.smithi077.stdout:Building ceph 2023-07-24T05:50:01.966 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/ceph/group.list 2023-07-24T05:50:02.035 INFO:teuthology.orchestra.run.smithi077.stdout:Building nfs 2023-07-24T05:50:02.053 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/nfs/group.list 2023-07-24T05:50:02.127 INFO:teuthology.orchestra.run.smithi077.stdout:Building btrfs 2023-07-24T05:50:02.152 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/btrfs/group.list 2023-07-24T05:50:02.438 INFO:teuthology.orchestra.run.smithi077.stdout:Building tmpfs 2023-07-24T05:50:02.454 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/tmpfs/group.list 2023-07-24T05:50:02.519 INFO:teuthology.orchestra.run.smithi077.stdout:Building selftest 2023-07-24T05:50:02.537 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/selftest/group.list 2023-07-24T05:50:02.605 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo make install) 2023-07-24T05:50:02.693 INFO:teuthology.orchestra.run.smithi077.stdout:Building include 2023-07-24T05:50:02.706 INFO:teuthology.orchestra.run.smithi077.stdout:Building lib 2023-07-24T05:50:02.720 INFO:teuthology.orchestra.run.smithi077.stdout:Building ltp 2023-07-24T05:50:02.737 INFO:teuthology.orchestra.run.smithi077.stdout:Building src 2023-07-24T05:50:02.864 INFO:teuthology.orchestra.run.smithi077.stdout:Building log-writes 2023-07-24T05:50:02.879 INFO:teuthology.orchestra.run.smithi077.stdout:Building perf 2023-07-24T05:50:02.896 INFO:teuthology.orchestra.run.smithi077.stdout:Building aio-dio-regress 2023-07-24T05:50:02.913 INFO:teuthology.orchestra.run.smithi077.stdout:Building vfs 2023-07-24T05:50:02.931 INFO:teuthology.orchestra.run.smithi077.stdout:Building m4 2023-07-24T05:50:02.949 INFO:teuthology.orchestra.run.smithi077.stdout:Building common 2023-07-24T05:50:02.966 INFO:teuthology.orchestra.run.smithi077.stdout:Building tests 2023-07-24T05:50:02.984 INFO:teuthology.orchestra.run.smithi077.stdout:Building perf 2023-07-24T05:50:03.000 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/perf/group.list 2023-07-24T05:50:03.054 INFO:teuthology.orchestra.run.smithi077.stdout:Building ext4 2023-07-24T05:50:03.069 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/ext4/group.list 2023-07-24T05:50:03.246 INFO:teuthology.orchestra.run.smithi077.stdout:Building ocfs2 2023-07-24T05:50:03.262 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/ocfs2/group.list 2023-07-24T05:50:03.329 INFO:teuthology.orchestra.run.smithi077.stdout:Building overlay 2023-07-24T05:50:03.346 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/overlay/group.list 2023-07-24T05:50:03.518 INFO:teuthology.orchestra.run.smithi077.stdout:Building cifs 2023-07-24T05:50:03.536 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/cifs/group.list 2023-07-24T05:50:03.598 INFO:teuthology.orchestra.run.smithi077.stdout:Building generic 2023-07-24T05:50:03.621 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/generic/group.list 2023-07-24T05:50:04.063 INFO:teuthology.orchestra.run.smithi077.stdout:Building shared 2023-07-24T05:50:04.083 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/shared/group.list 2023-07-24T05:50:04.168 INFO:teuthology.orchestra.run.smithi077.stdout:Building xfs 2023-07-24T05:50:04.189 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/xfs/group.list 2023-07-24T05:50:04.643 INFO:teuthology.orchestra.run.smithi077.stdout:Building f2fs 2023-07-24T05:50:04.659 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/f2fs/group.list 2023-07-24T05:50:04.741 INFO:teuthology.orchestra.run.smithi077.stdout:Building udf 2023-07-24T05:50:04.757 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/udf/group.list 2023-07-24T05:50:04.818 INFO:teuthology.orchestra.run.smithi077.stdout:Building ceph 2023-07-24T05:50:04.838 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/ceph/group.list 2023-07-24T05:50:04.910 INFO:teuthology.orchestra.run.smithi077.stdout:Building nfs 2023-07-24T05:50:04.929 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/nfs/group.list 2023-07-24T05:50:05.002 INFO:teuthology.orchestra.run.smithi077.stdout:Building btrfs 2023-07-24T05:50:05.023 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/btrfs/group.list 2023-07-24T05:50:05.308 INFO:teuthology.orchestra.run.smithi077.stdout:Building tmpfs 2023-07-24T05:50:05.323 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/tmpfs/group.list 2023-07-24T05:50:05.392 INFO:teuthology.orchestra.run.smithi077.stdout:Building selftest 2023-07-24T05:50:05.410 INFO:teuthology.orchestra.run.smithi077.stdout: [GROUP] /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/selftest/group.list 2023-07-24T05:50:05.470 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/make --no-print-directory Q=@ -C include install 2023-07-24T05:50:05.476 INFO:teuthology.orchestra.run.smithi077.stdout:make[1]: Nothing to be done for 'install'. 2023-07-24T05:50:05.476 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/make --no-print-directory Q=@ -C lib install 2023-07-24T05:50:05.482 INFO:teuthology.orchestra.run.smithi077.stdout:make[1]: Nothing to be done for 'install'. 2023-07-24T05:50:05.482 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/make --no-print-directory Q=@ -C ltp install 2023-07-24T05:50:05.489 INFO:teuthology.orchestra.run.smithi077.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-07-24T05:50:05.538 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-07-24T05:50:05.901 INFO:teuthology.orchestra.run.smithi077.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-07-24T05:50:05.950 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/make --no-print-directory Q=@ -C src install 2023-07-24T05:50:06.013 INFO:teuthology.orchestra.run.smithi077.stdout:Building log-writes 2023-07-24T05:50:06.029 INFO:teuthology.orchestra.run.smithi077.stdout:Building perf 2023-07-24T05:50:06.043 INFO:teuthology.orchestra.run.smithi077.stdout:Building aio-dio-regress 2023-07-24T05:50:06.057 INFO:teuthology.orchestra.run.smithi077.stdout:Building vfs 2023-07-24T05:50:06.070 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/make -C log-writes install 2023-07-24T05:50:06.077 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-07-24T05:50:06.122 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-07-24T05:50:06.165 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/make -C perf install 2023-07-24T05:50:06.174 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-07-24T05:50:06.222 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-07-24T05:50:06.332 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/make -C aio-dio-regress install 2023-07-24T05:50:06.342 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-07-24T05:50:06.387 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-hole-filling-race aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aiocp aio-dio-append-write-fallocate-race aio-dio-invalidate-failure aiodio_sparse2 aio-dio-cow-race aio-dio-write-verify aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2023-07-24T05:50:06.637 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/make -C vfs install 2023-07-24T05:50:06.646 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-07-24T05:50:06.690 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-07-24T05:50:06.753 INFO:teuthology.orchestra.run.smithi077.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-07-24T05:50:06.802 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-07-24T05:50:12.907 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py /var/lib/xfstests/src 2023-07-24T05:50:13.352 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-07-24T05:50:13.464 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/make --no-print-directory Q=@ -C m4 install 2023-07-24T05:50:13.472 INFO:teuthology.orchestra.run.smithi077.stdout:make[1]: Nothing to be done for 'install'. 2023-07-24T05:50:13.472 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/make --no-print-directory Q=@ -C common install 2023-07-24T05:50:13.481 INFO:teuthology.orchestra.run.smithi077.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-07-24T05:50:13.528 INFO:teuthology.orchestra.run.smithi077.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-07-24T05:50:14.173 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/make --no-print-directory Q=@ -C tests install 2023-07-24T05:50:14.181 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/btrfs/ install 2023-07-24T05:50:14.190 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-07-24T05:50:14.237 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 299 /var/lib/xfstests/tests/btrfs 2023-07-24T05:50:18.153 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-07-24T05:50:18.200 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 041.out 016.out 145.out 064.out 240.out 279.out 180.out 282.out 267.out 280.out 140.out 265.out 206.out 121.out 040.out 106.out 199.out 233.out 234.out 248.out 009.out 033.out 252.out 270.out 148.out 088.out 137.out 096.out 125.out 110.out 165.out 152.out 143.out 264.out 015.out 192.out 075.out 178.out 284.out 052.out 228.out 276.out 046.out 273.out 074.out 251.out 176.out 209.out 020.out 195.out 215.out 115.out 179.out 250.out 191.out 266.out 111.out 051.out 177.out 219.out 119.out 244.out 128.out 232.out 012.out 107.out 162.out 147.out 288.out 196.out 242.out 187.out 024.out 220.out 238.out 120.out 202.out 102.out 002.out 171.out 261.out 156.out 092.out 082.out 072.out 068.out 048.out 062.out 084.out 129.out 066.out 229.out 254.out 047.out 011.out 029.out 035.out 134.out 170.out 260.out 034.out 065.out 286.out 161.out 246.out 056.out 216.out 116.out 043.out 274.out 287.out 010.out 001.out 138.out 237.out 097.out 153.out 181.out 160.out 175.out 091.out 081.out 071.out 061.out 239.out 067.out 200.out 100.out 025.out 258.out 269.out 208.out 039.out 222.out 275.out 169.out 098.out 290.out 080.out 070.out 060.out 207.out 108.out 006.out 167.out 217.out 133.out 117.out 017.out 236.out 159.out 211.out 158.out 085.out 277.out 146.out 188.out 189.out 204.out 104.out 225.out 073.out 174.out 268.out 135.out 257.out 124.out 142.out 172.out 103.out 058.out 262.out 042.out 193.out 283.out 083.out 099.out 247.out 186.out 053.out 109.out 157.out 164.out 154.out 094.out 241.out 089.out 141.out 214.out 114.out 014.out 278.out 223.out 028.out 086.out 123.out 144.out 032.out 182.out 205.out 136.out 005.out 036.out 198.out 008.out 190.out 173.out 050.out 105.out 263.out 291.out 185.out 095.out 285.out 155.out 201.out 019.out 063.out 299.out 151.out 231.out 227.out 069.out 131.out 213.out 113.out 013.out 031.out 057.out 272.out 078.out 004.out 184.out 259.out 210.out 132.out 037.out 093.out 197.out 235.out 127.out 230.out 027.out 292.out 130.out 023.out 044.out 030.out 203.out 003.out 101.out 055.out 166.out 245.out 243.out 194.out 249.out 122.out 076.out 022.out 289.out 038.out 045.out 281.out 090.out 224.out 271.out 149.out 183.out 077.out 218.out 118.out 018.out 256.out 168.out 007.out 293.out 079.out 054.out 059.out 150.out 049.out 226.out 163.out 126.out 026.out 021.out 253.out 255.out 139.out 221.out 087.out 212.out 112.out /var/lib/xfstests/tests/btrfs 2023-07-24T05:50:22.161 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/ceph/ install 2023-07-24T05:50:22.170 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-07-24T05:50:22.219 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-07-24T05:50:22.318 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-07-24T05:50:22.360 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-07-24T05:50:22.460 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/cifs/ install 2023-07-24T05:50:22.470 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-07-24T05:50:22.513 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-07-24T05:50:22.554 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-07-24T05:50:22.598 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-07-24T05:50:22.646 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/ext4/ install 2023-07-24T05:50:22.657 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-07-24T05:50:22.703 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-07-24T05:50:23.614 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-07-24T05:50:23.658 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 049.out 032.out 039.out 045.out 054.out 056.out 308.out 008.out 040.out 307.out 005.out 021.out 012.out 009.out 033.out 015.out 050.out 026.out 034.out 046.out 018.out 010.out 047.out 303.out 302.out 020.out 002.out 028.out 024.out 013.out 031.out 027.out 306.out 048.out 038.out 044.out 052.out 025.out 029.out 011.out 042.out 304.out 055.out 030.out 003.out 017.out 043.out 053.out 035.out 016.out 058.out 022.out 006.out 004.out 057.out 014.out 036.out 271.out 051.out 041.out 037.out 305.out 019.out 301.out 007.out 023.out 059.out /var/lib/xfstests/tests/ext4 2023-07-24T05:50:24.635 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/f2fs/ install 2023-07-24T05:50:24.645 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-07-24T05:50:24.692 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-07-24T05:50:24.749 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-07-24T05:50:24.796 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-07-24T05:50:24.855 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/generic/ install 2023-07-24T05:50:24.865 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-07-24T05:50:24.911 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 /var/lib/xfstests/tests/generic 2023-07-24T05:50:25.470 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:50:25.477 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:50:34.647 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-07-24T05:50:34.695 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 035.out.nfs 035.out.default 050.out.nojournal 050.out.xfsquota 050.out.default 050.cfg 035.cfg 021.out 233.out 518.out 055.out 295.out 683.out 337.out 385.out 082.out 270.out 460.out 237.out 502.out 088.out 597.out 097.out 202.out 137.out 034.out 110.out 389.out 593.out 571.out 040.out 646.out 592.out 282.out 728.out 468.out 628.out 428.out 507.out 328.out 566.out 127.out 557.out 273.out 182.out 420.out 609.out 576.out 087.out 506.out 057.out 195.out 711.out 007.out 466.out 311.out 532.out 591.out 719.out 111.out 432.out 519.out 623.out 131.out 319.out 177.out 219.out 119.out 423.out 661.out 232.out 134.out 260.out 095.out 611.out 638.out 465.out 716.out 161.out 416.out 026.out 216.out 116.out 043.out 358.out 338.out 238.out 439.out 138.out 263.out 497.out 160.out 647.out 433.out 481.out 061.out 377.out 686.out 333.out 258.out 322.out 039.out 222.out 098.out 330.out 690.out 480.out 706.out 606.out 406.out 306.out 206.out 106.out 006.out 447.out 003.out 217.out 120.out 191.out 117.out 355.out 357.out 542.out 485.out 074.out 033.out 188.out 367.out 489.out 279.out 624.out 524.out 174.out 163.out 324.out 224.out 257.out 124.out 672.out 668.out 058.out 262.out 366.out 648.out 042.out 537.out 193.out 083.out 399.out 365.out 509.out 568.out 309.out 209.out 441.out 255.out 356.out 474.out 341.out 640.out 094.out 241.out 089.out 691.out 616.out 614.out 514.out 312.out 141.out 314.out 214.out 381.out 056.out 671.out 041.out 016.out 340.out 649.out 572.out 586.out 240.out 549.out 673.out 633.out 321.out 140.out 708.out 608.out 449.out 185.out 408.out 308.out 208.out 380.out 670.out 604.out 404.out 104.out 047.out 476.out 192.out 199.out 278.out 639.out 443.out 540.out 186.out 539.out 133.out 164.out 376.out 589.out 154.out 339.out 652.out 239.out 440.out 498.out 139.out 180.out 267.out 317.out 552.out 017.out 169.out 565.out 315.out 580.out 452.out 679.out 336.out 020.out 252.out 585.out 678.out 448.out 352.out 348.out 651.out 184.out 435.out 409.out 248.out 009.out 482.out 625.out 283.out 488.out 496.out 325.out 551.out 225.out 636.out 125.out 544.out 693.out 296.out 650.out 152.out 563.out 143.out 024.out 015.out 392.out 682.out 472.out 595.out 578.out 642.out 550.out 052.out 062.out 655.out 276.out 451.out 450.out 463.out 004.out 157.out 069.out 644.out 316.out 344.out 487.out 715.out 615.out 395.out 151.out 415.out 674.out 215.out 115.out 384.out 351.out 250.out 266.out 051.out 536.out 228.out 577.out 244.out 128.out 662.out 579.out 144.out 405.out 205.out 136.out 598.out 363.out 712.out 176.out 198.out 723.out 108.out 390.out 680.out 705.out 605.out 505.out 305.out 105.out 005.out 523.out 084.out 149.out 179.out 703.out 619.out 727.out 685.out 562.out 419.out 388.out 527.out 158.out 044.out 019.out 695.out 086.out 574.out 332.out 060.out 142.out 584.out 045.out 372.out 478.out 612.out 462.out 173.out 687.out 350.out 132.out 037.out 293.out 197.out 492.out 499.out 246.out 032.out 112.out 660.out 414.out 063.out 101.out 561.out 343.out 323.out 702.out 362.out 387.out 594.out 438.out 721.out 289.out 699.out 284.out 477.out 621.out 290.out 548.out 299.out 456.out 707.out 461.out 391.out 445.out 632.out 256.out 493.out 107.out 658.out 251.out 526.out 479.out 713.out 426.out 221.out 326.out 226.out 413.out 126.out 121.out 313.out 555.out 694.out 347.out 275.out 038.out 090.out 361.out 528.out 564.out 294.out 656.out 066.out 455.out 558.out 162.out 147.out 288.out 396.out 547.out 531.out 698.out 148.out 301.out 360.out 374.out 261.out 076.out 657.out 692.out 304.out 634.out 724.out 129.out 726.out 729.out 458.out 534.out 626.out 529.out 603.out 434.out 329.out 587.out 165.out 229.out 590.out 371.out 234.out 183.out 645.out 486.out 223.out 123.out 669.out 023.out 459.out 688.out 277.out 516.out 146.out 398.out 696.out 247.out 427.out 190.out 280.out 484.out 491.out 187.out 046.out 227.out 583.out 285.out 631.out 654.out 359.out 501.out 171.out 155.out 431.out 099.out 331.out 231.out 613.out 513.out 028.out 213.out 113.out 013.out 031.out 630.out 675.out 667.out 272.out 530.out 627.out 573.out 430.out 310.out 454.out 259.out 210.out 327.out 397.out 067.out 093.out 287.out 230.out 027.out 292.out 130.out 370.out 403.out 030.out 203.out 103.out 354.out 025.out 386.out 560.out 722.out 291.out 622.out 243.out 522.out 543.out 422.out 394.out 159.out 249.out 122.out 689.out 166.out 022.out 424.out 637.out 684.out 490.out 353.out 375.out 181.out 676.out 271.out 570.out 618.out 064.out 018.out 418.out 077.out 218.out 118.out 575.out 172.out 079.out 469.out 054.out 059.out 049.out 442.out 569.out 521.out 378.out 253.out 421.out 475.out 512.out 494.out 412.out 212.out 538.out 379.out 342.out 012.out 167.out 554.out 471.out 070.out 596.out 720.out 620.out 196.out 520.out 242.out 457.out 320.out 220.out 629.out 602.out 153.out 402.out 302.out 102.out 002.out 717.out 617.out 517.out 429.out 417.out 156.out 092.out 664.out 072.out 068.out 473.out 369.out 511.out 411.out 029.out 211.out 011.out 659.out 194.out 170.out 053.out 065.out 286.out 245.out 437.out 545.out 714.out 559.out 710.out 036.out 610.out 510.out 274.out 410.out 701.out 601.out 401.out 201.out 010.out 001.out 495.out 281.out 048.out 665.out 114.out 014.out 346.out 581.out 297.out 145.out 168.out 641.out 436.out 091.out 081.out 071.out 075.out 653.out 700.out 600.out 500.out 400.out 300.out 200.out 100.out 464.out 541.out 269.out 546.out 382.out 677.out 553.out 178.out 175.out 298.out 446.out 080.out 709.out 607.out 508.out 407.out 307.out 207.out 109.out 008.out 643.out 150.out 349.out 453.out 666.out 236.out 078.out 364.out 567.out 725.out 582.out 383.out 085.out 704.out 588.out 635.out 334.out 504.out 525.out 189.out 204.out 535.out 425.out 345.out 318.out 467.out 368.out 681.out 254.out 335.out 718.out 073.out 235.out 470.out 268.out 556.out 135.out 503.out 533.out 303.out 264.out 515.out 373.out 265.out 697.out 444.out 483.out 096.out 393.out 663.out 599.out /var/lib/xfstests/tests/generic 2023-07-24T05:50:44.577 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/nfs/ install 2023-07-24T05:50:44.584 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-07-24T05:50:44.630 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-07-24T05:50:44.672 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-07-24T05:50:44.715 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-07-24T05:50:44.760 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/ocfs2/ install 2023-07-24T05:50:44.769 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-07-24T05:50:44.811 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-07-24T05:50:44.856 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-07-24T05:50:44.897 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-07-24T05:50:44.943 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/overlay/ install 2023-07-24T05:50:44.954 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-07-24T05:50:45.000 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-07-24T05:50:46.296 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-07-24T05:50:46.347 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 050.out 044.out 019.out 103.out 003.out 074.out 018.out 024.out 078.out 069.out 020.out 102.out 002.out 060.out 113.out 013.out 031.out 015.out 117.out 045.out 072.out 106.out 048.out 062.out 038.out 052.out 076.out 037.out 029.out 111.out 112.out 042.out 035.out 073.out 068.out 030.out 034.out 017.out 055.out 053.out 109.out 116.out 043.out 056.out 010.out 001.out 009.out 065.out 022.out 004.out 115.out 066.out 114.out 014.out 071.out 007.out 061.out 051.out 011.out 041.out 067.out 058.out 100.out 064.out 104.out 028.out 027.out 023.out 059.out 049.out 032.out 039.out 077.out 105.out 005.out 025.out 026.out 036.out 070.out 108.out 008.out 040.out 107.out 006.out 075.out 063.out 021.out 016.out 047.out 110.out 046.out 012.out 101.out 054.out 033.out 057.out /var/lib/xfstests/tests/overlay 2023-07-24T05:50:47.647 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/perf/ install 2023-07-24T05:50:47.655 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-07-24T05:50:47.700 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-07-24T05:50:47.741 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-07-24T05:50:47.783 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-07-24T05:50:47.827 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/selftest/ install 2023-07-24T05:50:47.835 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-07-24T05:50:47.884 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-07-24T05:50:47.985 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-07-24T05:50:48.027 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 006.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-07-24T05:50:48.141 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/shared/ install 2023-07-24T05:50:48.149 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-07-24T05:50:48.195 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-07-24T05:50:48.270 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-07-24T05:50:48.316 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-07-24T05:50:48.387 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/tmpfs/ install 2023-07-24T05:50:48.397 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-07-24T05:50:48.446 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-07-24T05:50:48.491 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-07-24T05:50:48.531 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-07-24T05:50:48.577 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/udf/ install 2023-07-24T05:50:48.583 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-07-24T05:50:48.626 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-07-24T05:50:48.673 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-07-24T05:50:48.723 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-07-24T05:50:48.764 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.l0Q1kOBHMTxfstests-dev/tests/xfs/ install 2023-07-24T05:50:48.776 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-07-24T05:50:48.825 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-07-24T05:50:55.543 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:50:55.547 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:50:58.032 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-07-24T05:50:58.077 INFO:teuthology.orchestra.run.smithi077.stdout:../../install-sh -o root -g root -m 644 033.out.crc 216.out.64mblog 096.out.external 033.out.default 071.out.64 216.out.classic 096.out.internal 071.out.32 216.cfg 033.cfg 449.out 185.out 508.out 221.out 057.out 308.out 208.out 737.out 108.out 404.out 457.out 455.out 233.out 194.out 443.out 295.out 497.out 337.out 237.out 502.out 088.out 366.out 202.out 137.out 002.out 389.out 593.out 571.out 775.out 040.out 765.out 592.out 282.out 728.out 528.out 428.out 407.out 328.out 566.out 261.out 557.out 273.out 468.out 074.out 427.out 059.out 789.out 195.out 711.out 732.out 784.out 532.out 191.out 111.out 432.out 519.out 419.out 131.out 319.out 177.out 219.out 119.out 423.out 232.out 529.out 434.out 329.out 467.out 229.out 103.out 234.out 183.out 733.out 134.out 260.out 157.out 718.out 034.out 465.out 716.out 161.out 416.out 116.out 043.out 155.out 358.out 338.out 238.out 224.out 065.out 439.out 138.out 189.out 097.out 160.out 175.out 291.out 481.out 345.out 025.out 772.out 768.out 258.out 379.out 322.out 039.out 742.out 098.out 290.out 480.out 060.out 506.out 406.out 306.out 206.out 006.out 167.out 003.out 217.out 117.out 355.out 357.out 542.out 783.out 485.out 442.out 188.out 026.out 099.out 342.out 279.out 281.out 524.out 174.out 771.out 324.out 313.out 257.out 124.out 758.out 058.out 741.out 384.out 262.out 042.out 377.out 193.out 799.out 473.out 770.out 365.out 409.out 309.out 209.out 441.out 109.out 255.out 740.out 558.out 474.out 341.out 094.out 712.out 241.out 089.out 540.out 256.out 714.out 514.out 141.out 314.out 214.out 114.out 381.out 147.out 275.out 041.out 721.out 340.out 793.out 156.out 572.out 568.out 586.out 240.out 180.out 549.out 267.out 280.out 543.out 140.out 708.out 334.out 504.out 525.out 204.out 535.out 104.out 425.out 399.out 254.out 335.out 531.out 235.out 470.out 268.out 556.out 135.out 503.out 533.out 303.out 264.out 110.out 318.out 515.out 373.out 036.out 169.out 483.out 393.out 333.out 476.out 087.out 192.out 199.out 739.out 068.out 591.out 752.out 736.out 236.out 773.out 539.out 749.out 164.out 376.out 154.out 587.out 339.out 239.out 440.out 458.out 456.out 489.out 139.out 774.out 790.out 317.out 552.out 781.out 017.out 064.out 444.out 580.out 452.out 020.out 252.out 724.out 352.out 794.out 348.out 394.out 356.out 184.out 435.out 509.out 466.out 278.out 248.out 785.out 009.out 283.out 750.out 045.out 297.out 488.out 496.out 325.out 551.out 225.out 125.out 186.out 544.out 296.out 152.out 563.out 143.out 436.out 392.out 545.out 075.out 472.out 463.out 550.out 052.out 062.out 276.out 266.out 450.out 744.out 004.out 764.out 069.out 316.out 487.out 762.out 715.out 395.out 151.out 415.out 315.out 344.out 215.out 115.out 015.out 351.out 250.out 464.out 051.out 536.out 228.out 244.out 128.out 385.out 336.out 086.out 579.out 144.out 505.out 205.out 136.out 537.out 176.out 198.out 723.out 390.out 178.out 050.out 405.out 305.out 105.out 005.out 523.out 761.out 437.out 719.out 727.out 363.out 095.out 562.out 382.out 271.out 570.out 388.out 590.out 527.out 158.out 044.out 019.out 577.out 777.out 760.out 574.out 332.out 372.out 478.out 462.out 220.out 350.out 132.out 293.out 492.out 263.out 212.out 499.out 246.out 112.out 414.out 063.out 101.out 561.out 343.out 362.out 387.out 798.out 594.out 438.out 265.out 289.out 106.out 477.out 548.out 299.out 364.out 595.out 461.out 391.out 451.out 493.out 786.out 007.out 448.out 251.out 380.out 526.out 479.out 713.out 426.out 150.out 326.out 082.out 226.out 413.out 126.out 555.out 347.out 035.out 361.out 564.out 294.out 788.out 066.out 795.out 076.out 747.out 585.out 162.out 796.out 197.out 396.out 576.out 547.out 298.out 148.out 301.out 360.out 374.out 734.out 447.out 292.out 304.out 482.out 129.out 726.out 729.out 048.out 534.out 073.out 368.out 486.out 223.out 123.out 179.out 023.out 032.out 748.out 277.out 433.out 516.out 146.out 424.out 398.out 168.out 751.out 190.out 173.out 484.out 491.out 754.out 016.out 046.out 227.out 731.out 782.out 583.out 285.out 127.out 501.out 171.out 581.out 027.out 431.out 288.out 331.out 791.out 743.out 047.out 231.out 024.out 513.out 371.out 213.out 730.out 113.out 013.out 031.out 367.out 182.out 323.out 272.out 530.out 573.out 430.out 569.out 454.out 259.out 210.out 327.out 330.out 067.out 093.out 287.out 230.out 769.out 061.out 130.out 370.out 403.out 030.out 203.out 354.out 165.out 386.out 560.out 055.out 722.out 245.out 243.out 522.out 787.out 745.out 422.out 222.out 159.out 249.out 122.out 166.out 022.out 038.out 346.out 578.out 490.out 565.out 353.out 375.out 181.out 500.out 149.out 518.out 018.out 418.out 077.out 218.out 118.out 575.out 780.out 172.out 792.out 079.out 469.out 054.out 049.out 021.out 738.out 163.out 776.out 521.out 270.out 378.out 253.out 421.out 321.out 475.out 512.out 494.out 412.out 312.out 121.out 538.out 012.out 028.out 554.out 397.out 070.out 596.out 720.out 196.out 520.out 242.out 420.out 498.out 320.out 120.out 153.out 402.out 302.out 102.out 717.out 460.out 517.out 429.out 417.out 142.out 092.out 759.out 072.out 778.out 084.out 056.out 369.out 247.out 511.out 411.out 029.out 311.out 211.out 011.out 767.out 187.out 170.out 053.out 133.out 286.out 756.out 755.out 766.out 559.out 710.out 510.out 274.out 410.out 310.out 401.out 201.out 010.out 001.out 495.out 584.out 589.out 753.out 014.out 459.out 145.out 797.out 757.out 091.out 081.out 083.out 800.out 037.out 400.out 300.out 200.out 100.out 359.out 471.out 541.out 445.out 779.out 269.out 546.out 553.out 763.out 446.out 090.out 080.out 709.out 507.out 408.out 307.out 207.out 107.out 008.out 746.out 284.out 349.out 453.out 078.out 567.out 725.out 582.out 735.out 383.out 085.out 588.out /var/lib/xfstests/tests/xfs 2023-07-24T05:51:07.354 INFO:teuthology.orchestra.run.smithi077.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-07-24T05:51:07.402 INFO:teuthology.orchestra.run.smithi077.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-07-24T05:51:07.447 INFO:teuthology.orchestra.run.smithi077.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-07-24T05:51:07.498 INFO:teuthology.orchestra.run.smithi077.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-07-24T05:51:07.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-24T05:51:07.547 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec ls tests/generic) 2023-07-24T05:51:07.569 INFO:teuthology.orchestra.run.smithi077.stdout:001 2023-07-24T05:51:07.569 INFO:teuthology.orchestra.run.smithi077.stdout:001.out 2023-07-24T05:51:07.569 INFO:teuthology.orchestra.run.smithi077.stdout:002 2023-07-24T05:51:07.570 INFO:teuthology.orchestra.run.smithi077.stdout:002.out 2023-07-24T05:51:07.570 INFO:teuthology.orchestra.run.smithi077.stdout:003 2023-07-24T05:51:07.570 INFO:teuthology.orchestra.run.smithi077.stdout:003.out 2023-07-24T05:51:07.570 INFO:teuthology.orchestra.run.smithi077.stdout:004 2023-07-24T05:51:07.570 INFO:teuthology.orchestra.run.smithi077.stdout:004.out 2023-07-24T05:51:07.570 INFO:teuthology.orchestra.run.smithi077.stdout:005 2023-07-24T05:51:07.570 INFO:teuthology.orchestra.run.smithi077.stdout:005.out 2023-07-24T05:51:07.571 INFO:teuthology.orchestra.run.smithi077.stdout:006 2023-07-24T05:51:07.571 INFO:teuthology.orchestra.run.smithi077.stdout:006.out 2023-07-24T05:51:07.571 INFO:teuthology.orchestra.run.smithi077.stdout:007 2023-07-24T05:51:07.571 INFO:teuthology.orchestra.run.smithi077.stdout:007.out 2023-07-24T05:51:07.571 INFO:teuthology.orchestra.run.smithi077.stdout:008 2023-07-24T05:51:07.571 INFO:teuthology.orchestra.run.smithi077.stdout:008.out 2023-07-24T05:51:07.571 INFO:teuthology.orchestra.run.smithi077.stdout:009 2023-07-24T05:51:07.572 INFO:teuthology.orchestra.run.smithi077.stdout:009.out 2023-07-24T05:51:07.572 INFO:teuthology.orchestra.run.smithi077.stdout:010 2023-07-24T05:51:07.572 INFO:teuthology.orchestra.run.smithi077.stdout:010.out 2023-07-24T05:51:07.572 INFO:teuthology.orchestra.run.smithi077.stdout:011 2023-07-24T05:51:07.572 INFO:teuthology.orchestra.run.smithi077.stdout:011.out 2023-07-24T05:51:07.572 INFO:teuthology.orchestra.run.smithi077.stdout:012 2023-07-24T05:51:07.572 INFO:teuthology.orchestra.run.smithi077.stdout:012.out 2023-07-24T05:51:07.573 INFO:teuthology.orchestra.run.smithi077.stdout:013 2023-07-24T05:51:07.573 INFO:teuthology.orchestra.run.smithi077.stdout:013.out 2023-07-24T05:51:07.573 INFO:teuthology.orchestra.run.smithi077.stdout:014 2023-07-24T05:51:07.573 INFO:teuthology.orchestra.run.smithi077.stdout:014.out 2023-07-24T05:51:07.573 INFO:teuthology.orchestra.run.smithi077.stdout:015 2023-07-24T05:51:07.573 INFO:teuthology.orchestra.run.smithi077.stdout:015.out 2023-07-24T05:51:07.573 INFO:teuthology.orchestra.run.smithi077.stdout:016 2023-07-24T05:51:07.573 INFO:teuthology.orchestra.run.smithi077.stdout:016.out 2023-07-24T05:51:07.574 INFO:teuthology.orchestra.run.smithi077.stdout:017 2023-07-24T05:51:07.574 INFO:teuthology.orchestra.run.smithi077.stdout:017.out 2023-07-24T05:51:07.574 INFO:teuthology.orchestra.run.smithi077.stdout:018 2023-07-24T05:51:07.574 INFO:teuthology.orchestra.run.smithi077.stdout:018.out 2023-07-24T05:51:07.574 INFO:teuthology.orchestra.run.smithi077.stdout:019 2023-07-24T05:51:07.574 INFO:teuthology.orchestra.run.smithi077.stdout:019.out 2023-07-24T05:51:07.574 INFO:teuthology.orchestra.run.smithi077.stdout:020 2023-07-24T05:51:07.575 INFO:teuthology.orchestra.run.smithi077.stdout:020.out 2023-07-24T05:51:07.575 INFO:teuthology.orchestra.run.smithi077.stdout:021 2023-07-24T05:51:07.575 INFO:teuthology.orchestra.run.smithi077.stdout:021.out 2023-07-24T05:51:07.575 INFO:teuthology.orchestra.run.smithi077.stdout:022 2023-07-24T05:51:07.575 INFO:teuthology.orchestra.run.smithi077.stdout:022.out 2023-07-24T05:51:07.575 INFO:teuthology.orchestra.run.smithi077.stdout:023 2023-07-24T05:51:07.575 INFO:teuthology.orchestra.run.smithi077.stdout:023.out 2023-07-24T05:51:07.575 INFO:teuthology.orchestra.run.smithi077.stdout:024 2023-07-24T05:51:07.576 INFO:teuthology.orchestra.run.smithi077.stdout:024.out 2023-07-24T05:51:07.576 INFO:teuthology.orchestra.run.smithi077.stdout:025 2023-07-24T05:51:07.576 INFO:teuthology.orchestra.run.smithi077.stdout:025.out 2023-07-24T05:51:07.576 INFO:teuthology.orchestra.run.smithi077.stdout:026 2023-07-24T05:51:07.576 INFO:teuthology.orchestra.run.smithi077.stdout:026.out 2023-07-24T05:51:07.576 INFO:teuthology.orchestra.run.smithi077.stdout:027 2023-07-24T05:51:07.576 INFO:teuthology.orchestra.run.smithi077.stdout:027.out 2023-07-24T05:51:07.577 INFO:teuthology.orchestra.run.smithi077.stdout:028 2023-07-24T05:51:07.577 INFO:teuthology.orchestra.run.smithi077.stdout:028.out 2023-07-24T05:51:07.577 INFO:teuthology.orchestra.run.smithi077.stdout:029 2023-07-24T05:51:07.577 INFO:teuthology.orchestra.run.smithi077.stdout:029.out 2023-07-24T05:51:07.577 INFO:teuthology.orchestra.run.smithi077.stdout:030 2023-07-24T05:51:07.577 INFO:teuthology.orchestra.run.smithi077.stdout:030.out 2023-07-24T05:51:07.577 INFO:teuthology.orchestra.run.smithi077.stdout:031 2023-07-24T05:51:07.577 INFO:teuthology.orchestra.run.smithi077.stdout:031.out 2023-07-24T05:51:07.578 INFO:teuthology.orchestra.run.smithi077.stdout:032 2023-07-24T05:51:07.578 INFO:teuthology.orchestra.run.smithi077.stdout:032.out 2023-07-24T05:51:07.578 INFO:teuthology.orchestra.run.smithi077.stdout:033 2023-07-24T05:51:07.578 INFO:teuthology.orchestra.run.smithi077.stdout:033.out 2023-07-24T05:51:07.578 INFO:teuthology.orchestra.run.smithi077.stdout:034 2023-07-24T05:51:07.578 INFO:teuthology.orchestra.run.smithi077.stdout:034.out 2023-07-24T05:51:07.578 INFO:teuthology.orchestra.run.smithi077.stdout:035 2023-07-24T05:51:07.578 INFO:teuthology.orchestra.run.smithi077.stdout:035.cfg 2023-07-24T05:51:07.579 INFO:teuthology.orchestra.run.smithi077.stdout:035.out.default 2023-07-24T05:51:07.579 INFO:teuthology.orchestra.run.smithi077.stdout:035.out.nfs 2023-07-24T05:51:07.579 INFO:teuthology.orchestra.run.smithi077.stdout:036 2023-07-24T05:51:07.579 INFO:teuthology.orchestra.run.smithi077.stdout:036.out 2023-07-24T05:51:07.579 INFO:teuthology.orchestra.run.smithi077.stdout:037 2023-07-24T05:51:07.579 INFO:teuthology.orchestra.run.smithi077.stdout:037.out 2023-07-24T05:51:07.579 INFO:teuthology.orchestra.run.smithi077.stdout:038 2023-07-24T05:51:07.580 INFO:teuthology.orchestra.run.smithi077.stdout:038.out 2023-07-24T05:51:07.580 INFO:teuthology.orchestra.run.smithi077.stdout:039 2023-07-24T05:51:07.580 INFO:teuthology.orchestra.run.smithi077.stdout:039.out 2023-07-24T05:51:07.580 INFO:teuthology.orchestra.run.smithi077.stdout:040 2023-07-24T05:51:07.580 INFO:teuthology.orchestra.run.smithi077.stdout:040.out 2023-07-24T05:51:07.580 INFO:teuthology.orchestra.run.smithi077.stdout:041 2023-07-24T05:51:07.580 INFO:teuthology.orchestra.run.smithi077.stdout:041.out 2023-07-24T05:51:07.580 INFO:teuthology.orchestra.run.smithi077.stdout:042 2023-07-24T05:51:07.581 INFO:teuthology.orchestra.run.smithi077.stdout:042.out 2023-07-24T05:51:07.581 INFO:teuthology.orchestra.run.smithi077.stdout:043 2023-07-24T05:51:07.581 INFO:teuthology.orchestra.run.smithi077.stdout:043.out 2023-07-24T05:51:07.581 INFO:teuthology.orchestra.run.smithi077.stdout:044 2023-07-24T05:51:07.581 INFO:teuthology.orchestra.run.smithi077.stdout:044.out 2023-07-24T05:51:07.581 INFO:teuthology.orchestra.run.smithi077.stdout:045 2023-07-24T05:51:07.581 INFO:teuthology.orchestra.run.smithi077.stdout:045.out 2023-07-24T05:51:07.581 INFO:teuthology.orchestra.run.smithi077.stdout:046 2023-07-24T05:51:07.582 INFO:teuthology.orchestra.run.smithi077.stdout:046.out 2023-07-24T05:51:07.582 INFO:teuthology.orchestra.run.smithi077.stdout:047 2023-07-24T05:51:07.582 INFO:teuthology.orchestra.run.smithi077.stdout:047.out 2023-07-24T05:51:07.582 INFO:teuthology.orchestra.run.smithi077.stdout:048 2023-07-24T05:51:07.582 INFO:teuthology.orchestra.run.smithi077.stdout:048.out 2023-07-24T05:51:07.582 INFO:teuthology.orchestra.run.smithi077.stdout:049 2023-07-24T05:51:07.582 INFO:teuthology.orchestra.run.smithi077.stdout:049.out 2023-07-24T05:51:07.582 INFO:teuthology.orchestra.run.smithi077.stdout:050 2023-07-24T05:51:07.583 INFO:teuthology.orchestra.run.smithi077.stdout:050.cfg 2023-07-24T05:51:07.583 INFO:teuthology.orchestra.run.smithi077.stdout:050.out.default 2023-07-24T05:51:07.583 INFO:teuthology.orchestra.run.smithi077.stdout:050.out.nojournal 2023-07-24T05:51:07.583 INFO:teuthology.orchestra.run.smithi077.stdout:050.out.xfsquota 2023-07-24T05:51:07.583 INFO:teuthology.orchestra.run.smithi077.stdout:051 2023-07-24T05:51:07.583 INFO:teuthology.orchestra.run.smithi077.stdout:051.out 2023-07-24T05:51:07.583 INFO:teuthology.orchestra.run.smithi077.stdout:052 2023-07-24T05:51:07.583 INFO:teuthology.orchestra.run.smithi077.stdout:052.out 2023-07-24T05:51:07.584 INFO:teuthology.orchestra.run.smithi077.stdout:053 2023-07-24T05:51:07.584 INFO:teuthology.orchestra.run.smithi077.stdout:053.out 2023-07-24T05:51:07.584 INFO:teuthology.orchestra.run.smithi077.stdout:054 2023-07-24T05:51:07.584 INFO:teuthology.orchestra.run.smithi077.stdout:054.out 2023-07-24T05:51:07.584 INFO:teuthology.orchestra.run.smithi077.stdout:055 2023-07-24T05:51:07.584 INFO:teuthology.orchestra.run.smithi077.stdout:055.out 2023-07-24T05:51:07.584 INFO:teuthology.orchestra.run.smithi077.stdout:056 2023-07-24T05:51:07.584 INFO:teuthology.orchestra.run.smithi077.stdout:056.out 2023-07-24T05:51:07.585 INFO:teuthology.orchestra.run.smithi077.stdout:057 2023-07-24T05:51:07.585 INFO:teuthology.orchestra.run.smithi077.stdout:057.out 2023-07-24T05:51:07.585 INFO:teuthology.orchestra.run.smithi077.stdout:058 2023-07-24T05:51:07.585 INFO:teuthology.orchestra.run.smithi077.stdout:058.out 2023-07-24T05:51:07.585 INFO:teuthology.orchestra.run.smithi077.stdout:059 2023-07-24T05:51:07.585 INFO:teuthology.orchestra.run.smithi077.stdout:059.out 2023-07-24T05:51:07.585 INFO:teuthology.orchestra.run.smithi077.stdout:060 2023-07-24T05:51:07.585 INFO:teuthology.orchestra.run.smithi077.stdout:060.out 2023-07-24T05:51:07.586 INFO:teuthology.orchestra.run.smithi077.stdout:061 2023-07-24T05:51:07.586 INFO:teuthology.orchestra.run.smithi077.stdout:061.out 2023-07-24T05:51:07.586 INFO:teuthology.orchestra.run.smithi077.stdout:062 2023-07-24T05:51:07.586 INFO:teuthology.orchestra.run.smithi077.stdout:062.out 2023-07-24T05:51:07.586 INFO:teuthology.orchestra.run.smithi077.stdout:063 2023-07-24T05:51:07.586 INFO:teuthology.orchestra.run.smithi077.stdout:063.out 2023-07-24T05:51:07.586 INFO:teuthology.orchestra.run.smithi077.stdout:064 2023-07-24T05:51:07.586 INFO:teuthology.orchestra.run.smithi077.stdout:064.out 2023-07-24T05:51:07.587 INFO:teuthology.orchestra.run.smithi077.stdout:065 2023-07-24T05:51:07.587 INFO:teuthology.orchestra.run.smithi077.stdout:065.out 2023-07-24T05:51:07.587 INFO:teuthology.orchestra.run.smithi077.stdout:066 2023-07-24T05:51:07.587 INFO:teuthology.orchestra.run.smithi077.stdout:066.out 2023-07-24T05:51:07.587 INFO:teuthology.orchestra.run.smithi077.stdout:067 2023-07-24T05:51:07.587 INFO:teuthology.orchestra.run.smithi077.stdout:067.out 2023-07-24T05:51:07.587 INFO:teuthology.orchestra.run.smithi077.stdout:068 2023-07-24T05:51:07.587 INFO:teuthology.orchestra.run.smithi077.stdout:068.out 2023-07-24T05:51:07.588 INFO:teuthology.orchestra.run.smithi077.stdout:069 2023-07-24T05:51:07.588 INFO:teuthology.orchestra.run.smithi077.stdout:069.out 2023-07-24T05:51:07.588 INFO:teuthology.orchestra.run.smithi077.stdout:070 2023-07-24T05:51:07.588 INFO:teuthology.orchestra.run.smithi077.stdout:070.out 2023-07-24T05:51:07.588 INFO:teuthology.orchestra.run.smithi077.stdout:071 2023-07-24T05:51:07.588 INFO:teuthology.orchestra.run.smithi077.stdout:071.out 2023-07-24T05:51:07.588 INFO:teuthology.orchestra.run.smithi077.stdout:072 2023-07-24T05:51:07.588 INFO:teuthology.orchestra.run.smithi077.stdout:072.out 2023-07-24T05:51:07.589 INFO:teuthology.orchestra.run.smithi077.stdout:073 2023-07-24T05:51:07.589 INFO:teuthology.orchestra.run.smithi077.stdout:073.out 2023-07-24T05:51:07.589 INFO:teuthology.orchestra.run.smithi077.stdout:074 2023-07-24T05:51:07.589 INFO:teuthology.orchestra.run.smithi077.stdout:074.out 2023-07-24T05:51:07.589 INFO:teuthology.orchestra.run.smithi077.stdout:075 2023-07-24T05:51:07.589 INFO:teuthology.orchestra.run.smithi077.stdout:075.out 2023-07-24T05:51:07.589 INFO:teuthology.orchestra.run.smithi077.stdout:076 2023-07-24T05:51:07.589 INFO:teuthology.orchestra.run.smithi077.stdout:076.out 2023-07-24T05:51:07.590 INFO:teuthology.orchestra.run.smithi077.stdout:077 2023-07-24T05:51:07.590 INFO:teuthology.orchestra.run.smithi077.stdout:077.out 2023-07-24T05:51:07.590 INFO:teuthology.orchestra.run.smithi077.stdout:078 2023-07-24T05:51:07.590 INFO:teuthology.orchestra.run.smithi077.stdout:078.out 2023-07-24T05:51:07.590 INFO:teuthology.orchestra.run.smithi077.stdout:079 2023-07-24T05:51:07.590 INFO:teuthology.orchestra.run.smithi077.stdout:079.out 2023-07-24T05:51:07.590 INFO:teuthology.orchestra.run.smithi077.stdout:080 2023-07-24T05:51:07.590 INFO:teuthology.orchestra.run.smithi077.stdout:080.out 2023-07-24T05:51:07.591 INFO:teuthology.orchestra.run.smithi077.stdout:081 2023-07-24T05:51:07.591 INFO:teuthology.orchestra.run.smithi077.stdout:081.out 2023-07-24T05:51:07.591 INFO:teuthology.orchestra.run.smithi077.stdout:082 2023-07-24T05:51:07.591 INFO:teuthology.orchestra.run.smithi077.stdout:082.out 2023-07-24T05:51:07.591 INFO:teuthology.orchestra.run.smithi077.stdout:083 2023-07-24T05:51:07.591 INFO:teuthology.orchestra.run.smithi077.stdout:083.out 2023-07-24T05:51:07.591 INFO:teuthology.orchestra.run.smithi077.stdout:084 2023-07-24T05:51:07.591 INFO:teuthology.orchestra.run.smithi077.stdout:084.out 2023-07-24T05:51:07.592 INFO:teuthology.orchestra.run.smithi077.stdout:085 2023-07-24T05:51:07.592 INFO:teuthology.orchestra.run.smithi077.stdout:085.out 2023-07-24T05:51:07.592 INFO:teuthology.orchestra.run.smithi077.stdout:086 2023-07-24T05:51:07.592 INFO:teuthology.orchestra.run.smithi077.stdout:086.out 2023-07-24T05:51:07.592 INFO:teuthology.orchestra.run.smithi077.stdout:087 2023-07-24T05:51:07.592 INFO:teuthology.orchestra.run.smithi077.stdout:087.out 2023-07-24T05:51:07.592 INFO:teuthology.orchestra.run.smithi077.stdout:088 2023-07-24T05:51:07.592 INFO:teuthology.orchestra.run.smithi077.stdout:088.out 2023-07-24T05:51:07.593 INFO:teuthology.orchestra.run.smithi077.stdout:089 2023-07-24T05:51:07.593 INFO:teuthology.orchestra.run.smithi077.stdout:089.out 2023-07-24T05:51:07.593 INFO:teuthology.orchestra.run.smithi077.stdout:090 2023-07-24T05:51:07.593 INFO:teuthology.orchestra.run.smithi077.stdout:090.out 2023-07-24T05:51:07.593 INFO:teuthology.orchestra.run.smithi077.stdout:091 2023-07-24T05:51:07.593 INFO:teuthology.orchestra.run.smithi077.stdout:091.out 2023-07-24T05:51:07.593 INFO:teuthology.orchestra.run.smithi077.stdout:092 2023-07-24T05:51:07.593 INFO:teuthology.orchestra.run.smithi077.stdout:092.out 2023-07-24T05:51:07.594 INFO:teuthology.orchestra.run.smithi077.stdout:093 2023-07-24T05:51:07.594 INFO:teuthology.orchestra.run.smithi077.stdout:093.out 2023-07-24T05:51:07.594 INFO:teuthology.orchestra.run.smithi077.stdout:094 2023-07-24T05:51:07.594 INFO:teuthology.orchestra.run.smithi077.stdout:094.out 2023-07-24T05:51:07.594 INFO:teuthology.orchestra.run.smithi077.stdout:095 2023-07-24T05:51:07.594 INFO:teuthology.orchestra.run.smithi077.stdout:095.out 2023-07-24T05:51:07.594 INFO:teuthology.orchestra.run.smithi077.stdout:096 2023-07-24T05:51:07.594 INFO:teuthology.orchestra.run.smithi077.stdout:096.out 2023-07-24T05:51:07.595 INFO:teuthology.orchestra.run.smithi077.stdout:097 2023-07-24T05:51:07.595 INFO:teuthology.orchestra.run.smithi077.stdout:097.out 2023-07-24T05:51:07.595 INFO:teuthology.orchestra.run.smithi077.stdout:098 2023-07-24T05:51:07.595 INFO:teuthology.orchestra.run.smithi077.stdout:098.out 2023-07-24T05:51:07.595 INFO:teuthology.orchestra.run.smithi077.stdout:099 2023-07-24T05:51:07.595 INFO:teuthology.orchestra.run.smithi077.stdout:099.out 2023-07-24T05:51:07.595 INFO:teuthology.orchestra.run.smithi077.stdout:100 2023-07-24T05:51:07.595 INFO:teuthology.orchestra.run.smithi077.stdout:100.out 2023-07-24T05:51:07.596 INFO:teuthology.orchestra.run.smithi077.stdout:101 2023-07-24T05:51:07.596 INFO:teuthology.orchestra.run.smithi077.stdout:101.out 2023-07-24T05:51:07.596 INFO:teuthology.orchestra.run.smithi077.stdout:102 2023-07-24T05:51:07.596 INFO:teuthology.orchestra.run.smithi077.stdout:102.out 2023-07-24T05:51:07.596 INFO:teuthology.orchestra.run.smithi077.stdout:103 2023-07-24T05:51:07.596 INFO:teuthology.orchestra.run.smithi077.stdout:103.out 2023-07-24T05:51:07.596 INFO:teuthology.orchestra.run.smithi077.stdout:104 2023-07-24T05:51:07.596 INFO:teuthology.orchestra.run.smithi077.stdout:104.out 2023-07-24T05:51:07.597 INFO:teuthology.orchestra.run.smithi077.stdout:105 2023-07-24T05:51:07.597 INFO:teuthology.orchestra.run.smithi077.stdout:105.out 2023-07-24T05:51:07.597 INFO:teuthology.orchestra.run.smithi077.stdout:106 2023-07-24T05:51:07.597 INFO:teuthology.orchestra.run.smithi077.stdout:106.out 2023-07-24T05:51:07.597 INFO:teuthology.orchestra.run.smithi077.stdout:107 2023-07-24T05:51:07.597 INFO:teuthology.orchestra.run.smithi077.stdout:107.out 2023-07-24T05:51:07.597 INFO:teuthology.orchestra.run.smithi077.stdout:108 2023-07-24T05:51:07.597 INFO:teuthology.orchestra.run.smithi077.stdout:108.out 2023-07-24T05:51:07.598 INFO:teuthology.orchestra.run.smithi077.stdout:109 2023-07-24T05:51:07.598 INFO:teuthology.orchestra.run.smithi077.stdout:109.out 2023-07-24T05:51:07.598 INFO:teuthology.orchestra.run.smithi077.stdout:110 2023-07-24T05:51:07.598 INFO:teuthology.orchestra.run.smithi077.stdout:110.out 2023-07-24T05:51:07.598 INFO:teuthology.orchestra.run.smithi077.stdout:111 2023-07-24T05:51:07.598 INFO:teuthology.orchestra.run.smithi077.stdout:111.out 2023-07-24T05:51:07.598 INFO:teuthology.orchestra.run.smithi077.stdout:112 2023-07-24T05:51:07.598 INFO:teuthology.orchestra.run.smithi077.stdout:112.out 2023-07-24T05:51:07.599 INFO:teuthology.orchestra.run.smithi077.stdout:113 2023-07-24T05:51:07.599 INFO:teuthology.orchestra.run.smithi077.stdout:113.out 2023-07-24T05:51:07.599 INFO:teuthology.orchestra.run.smithi077.stdout:114 2023-07-24T05:51:07.599 INFO:teuthology.orchestra.run.smithi077.stdout:114.out 2023-07-24T05:51:07.599 INFO:teuthology.orchestra.run.smithi077.stdout:115 2023-07-24T05:51:07.599 INFO:teuthology.orchestra.run.smithi077.stdout:115.out 2023-07-24T05:51:07.599 INFO:teuthology.orchestra.run.smithi077.stdout:116 2023-07-24T05:51:07.599 INFO:teuthology.orchestra.run.smithi077.stdout:116.out 2023-07-24T05:51:07.600 INFO:teuthology.orchestra.run.smithi077.stdout:117 2023-07-24T05:51:07.600 INFO:teuthology.orchestra.run.smithi077.stdout:117.out 2023-07-24T05:51:07.600 INFO:teuthology.orchestra.run.smithi077.stdout:118 2023-07-24T05:51:07.600 INFO:teuthology.orchestra.run.smithi077.stdout:118.out 2023-07-24T05:51:07.600 INFO:teuthology.orchestra.run.smithi077.stdout:119 2023-07-24T05:51:07.600 INFO:teuthology.orchestra.run.smithi077.stdout:119.out 2023-07-24T05:51:07.600 INFO:teuthology.orchestra.run.smithi077.stdout:120 2023-07-24T05:51:07.600 INFO:teuthology.orchestra.run.smithi077.stdout:120.out 2023-07-24T05:51:07.601 INFO:teuthology.orchestra.run.smithi077.stdout:121 2023-07-24T05:51:07.601 INFO:teuthology.orchestra.run.smithi077.stdout:121.out 2023-07-24T05:51:07.601 INFO:teuthology.orchestra.run.smithi077.stdout:122 2023-07-24T05:51:07.601 INFO:teuthology.orchestra.run.smithi077.stdout:122.out 2023-07-24T05:51:07.601 INFO:teuthology.orchestra.run.smithi077.stdout:123 2023-07-24T05:51:07.601 INFO:teuthology.orchestra.run.smithi077.stdout:123.out 2023-07-24T05:51:07.601 INFO:teuthology.orchestra.run.smithi077.stdout:124 2023-07-24T05:51:07.601 INFO:teuthology.orchestra.run.smithi077.stdout:124.out 2023-07-24T05:51:07.602 INFO:teuthology.orchestra.run.smithi077.stdout:125 2023-07-24T05:51:07.602 INFO:teuthology.orchestra.run.smithi077.stdout:125.out 2023-07-24T05:51:07.602 INFO:teuthology.orchestra.run.smithi077.stdout:126 2023-07-24T05:51:07.602 INFO:teuthology.orchestra.run.smithi077.stdout:126.out 2023-07-24T05:51:07.602 INFO:teuthology.orchestra.run.smithi077.stdout:127 2023-07-24T05:51:07.602 INFO:teuthology.orchestra.run.smithi077.stdout:127.out 2023-07-24T05:51:07.602 INFO:teuthology.orchestra.run.smithi077.stdout:128 2023-07-24T05:51:07.602 INFO:teuthology.orchestra.run.smithi077.stdout:128.out 2023-07-24T05:51:07.603 INFO:teuthology.orchestra.run.smithi077.stdout:129 2023-07-24T05:51:07.603 INFO:teuthology.orchestra.run.smithi077.stdout:129.out 2023-07-24T05:51:07.603 INFO:teuthology.orchestra.run.smithi077.stdout:130 2023-07-24T05:51:07.603 INFO:teuthology.orchestra.run.smithi077.stdout:130.out 2023-07-24T05:51:07.603 INFO:teuthology.orchestra.run.smithi077.stdout:131 2023-07-24T05:51:07.603 INFO:teuthology.orchestra.run.smithi077.stdout:131.out 2023-07-24T05:51:07.603 INFO:teuthology.orchestra.run.smithi077.stdout:132 2023-07-24T05:51:07.603 INFO:teuthology.orchestra.run.smithi077.stdout:132.out 2023-07-24T05:51:07.604 INFO:teuthology.orchestra.run.smithi077.stdout:133 2023-07-24T05:51:07.604 INFO:teuthology.orchestra.run.smithi077.stdout:133.out 2023-07-24T05:51:07.604 INFO:teuthology.orchestra.run.smithi077.stdout:134 2023-07-24T05:51:07.604 INFO:teuthology.orchestra.run.smithi077.stdout:134.out 2023-07-24T05:51:07.604 INFO:teuthology.orchestra.run.smithi077.stdout:135 2023-07-24T05:51:07.604 INFO:teuthology.orchestra.run.smithi077.stdout:135.out 2023-07-24T05:51:07.604 INFO:teuthology.orchestra.run.smithi077.stdout:136 2023-07-24T05:51:07.604 INFO:teuthology.orchestra.run.smithi077.stdout:136.out 2023-07-24T05:51:07.605 INFO:teuthology.orchestra.run.smithi077.stdout:137 2023-07-24T05:51:07.605 INFO:teuthology.orchestra.run.smithi077.stdout:137.out 2023-07-24T05:51:07.605 INFO:teuthology.orchestra.run.smithi077.stdout:138 2023-07-24T05:51:07.605 INFO:teuthology.orchestra.run.smithi077.stdout:138.out 2023-07-24T05:51:07.605 INFO:teuthology.orchestra.run.smithi077.stdout:139 2023-07-24T05:51:07.605 INFO:teuthology.orchestra.run.smithi077.stdout:139.out 2023-07-24T05:51:07.605 INFO:teuthology.orchestra.run.smithi077.stdout:140 2023-07-24T05:51:07.605 INFO:teuthology.orchestra.run.smithi077.stdout:140.out 2023-07-24T05:51:07.606 INFO:teuthology.orchestra.run.smithi077.stdout:141 2023-07-24T05:51:07.606 INFO:teuthology.orchestra.run.smithi077.stdout:141.out 2023-07-24T05:51:07.606 INFO:teuthology.orchestra.run.smithi077.stdout:142 2023-07-24T05:51:07.606 INFO:teuthology.orchestra.run.smithi077.stdout:142.out 2023-07-24T05:51:07.606 INFO:teuthology.orchestra.run.smithi077.stdout:143 2023-07-24T05:51:07.606 INFO:teuthology.orchestra.run.smithi077.stdout:143.out 2023-07-24T05:51:07.606 INFO:teuthology.orchestra.run.smithi077.stdout:144 2023-07-24T05:51:07.606 INFO:teuthology.orchestra.run.smithi077.stdout:144.out 2023-07-24T05:51:07.607 INFO:teuthology.orchestra.run.smithi077.stdout:145 2023-07-24T05:51:07.607 INFO:teuthology.orchestra.run.smithi077.stdout:145.out 2023-07-24T05:51:07.607 INFO:teuthology.orchestra.run.smithi077.stdout:146 2023-07-24T05:51:07.607 INFO:teuthology.orchestra.run.smithi077.stdout:146.out 2023-07-24T05:51:07.607 INFO:teuthology.orchestra.run.smithi077.stdout:147 2023-07-24T05:51:07.607 INFO:teuthology.orchestra.run.smithi077.stdout:147.out 2023-07-24T05:51:07.607 INFO:teuthology.orchestra.run.smithi077.stdout:148 2023-07-24T05:51:07.607 INFO:teuthology.orchestra.run.smithi077.stdout:148.out 2023-07-24T05:51:07.608 INFO:teuthology.orchestra.run.smithi077.stdout:149 2023-07-24T05:51:07.608 INFO:teuthology.orchestra.run.smithi077.stdout:149.out 2023-07-24T05:51:07.608 INFO:teuthology.orchestra.run.smithi077.stdout:150 2023-07-24T05:51:07.608 INFO:teuthology.orchestra.run.smithi077.stdout:150.out 2023-07-24T05:51:07.608 INFO:teuthology.orchestra.run.smithi077.stdout:151 2023-07-24T05:51:07.608 INFO:teuthology.orchestra.run.smithi077.stdout:151.out 2023-07-24T05:51:07.608 INFO:teuthology.orchestra.run.smithi077.stdout:152 2023-07-24T05:51:07.608 INFO:teuthology.orchestra.run.smithi077.stdout:152.out 2023-07-24T05:51:07.609 INFO:teuthology.orchestra.run.smithi077.stdout:153 2023-07-24T05:51:07.609 INFO:teuthology.orchestra.run.smithi077.stdout:153.out 2023-07-24T05:51:07.609 INFO:teuthology.orchestra.run.smithi077.stdout:154 2023-07-24T05:51:07.609 INFO:teuthology.orchestra.run.smithi077.stdout:154.out 2023-07-24T05:51:07.609 INFO:teuthology.orchestra.run.smithi077.stdout:155 2023-07-24T05:51:07.609 INFO:teuthology.orchestra.run.smithi077.stdout:155.out 2023-07-24T05:51:07.609 INFO:teuthology.orchestra.run.smithi077.stdout:156 2023-07-24T05:51:07.609 INFO:teuthology.orchestra.run.smithi077.stdout:156.out 2023-07-24T05:51:07.610 INFO:teuthology.orchestra.run.smithi077.stdout:157 2023-07-24T05:51:07.610 INFO:teuthology.orchestra.run.smithi077.stdout:157.out 2023-07-24T05:51:07.610 INFO:teuthology.orchestra.run.smithi077.stdout:158 2023-07-24T05:51:07.610 INFO:teuthology.orchestra.run.smithi077.stdout:158.out 2023-07-24T05:51:07.610 INFO:teuthology.orchestra.run.smithi077.stdout:159 2023-07-24T05:51:07.610 INFO:teuthology.orchestra.run.smithi077.stdout:159.out 2023-07-24T05:51:07.610 INFO:teuthology.orchestra.run.smithi077.stdout:160 2023-07-24T05:51:07.610 INFO:teuthology.orchestra.run.smithi077.stdout:160.out 2023-07-24T05:51:07.611 INFO:teuthology.orchestra.run.smithi077.stdout:161 2023-07-24T05:51:07.611 INFO:teuthology.orchestra.run.smithi077.stdout:161.out 2023-07-24T05:51:07.611 INFO:teuthology.orchestra.run.smithi077.stdout:162 2023-07-24T05:51:07.611 INFO:teuthology.orchestra.run.smithi077.stdout:162.out 2023-07-24T05:51:07.611 INFO:teuthology.orchestra.run.smithi077.stdout:163 2023-07-24T05:51:07.611 INFO:teuthology.orchestra.run.smithi077.stdout:163.out 2023-07-24T05:51:07.611 INFO:teuthology.orchestra.run.smithi077.stdout:164 2023-07-24T05:51:07.611 INFO:teuthology.orchestra.run.smithi077.stdout:164.out 2023-07-24T05:51:07.612 INFO:teuthology.orchestra.run.smithi077.stdout:165 2023-07-24T05:51:07.612 INFO:teuthology.orchestra.run.smithi077.stdout:165.out 2023-07-24T05:51:07.612 INFO:teuthology.orchestra.run.smithi077.stdout:166 2023-07-24T05:51:07.612 INFO:teuthology.orchestra.run.smithi077.stdout:166.out 2023-07-24T05:51:07.612 INFO:teuthology.orchestra.run.smithi077.stdout:167 2023-07-24T05:51:07.612 INFO:teuthology.orchestra.run.smithi077.stdout:167.out 2023-07-24T05:51:07.612 INFO:teuthology.orchestra.run.smithi077.stdout:168 2023-07-24T05:51:07.612 INFO:teuthology.orchestra.run.smithi077.stdout:168.out 2023-07-24T05:51:07.613 INFO:teuthology.orchestra.run.smithi077.stdout:169 2023-07-24T05:51:07.613 INFO:teuthology.orchestra.run.smithi077.stdout:169.out 2023-07-24T05:51:07.613 INFO:teuthology.orchestra.run.smithi077.stdout:170 2023-07-24T05:51:07.613 INFO:teuthology.orchestra.run.smithi077.stdout:170.out 2023-07-24T05:51:07.613 INFO:teuthology.orchestra.run.smithi077.stdout:171 2023-07-24T05:51:07.613 INFO:teuthology.orchestra.run.smithi077.stdout:171.out 2023-07-24T05:51:07.613 INFO:teuthology.orchestra.run.smithi077.stdout:172 2023-07-24T05:51:07.613 INFO:teuthology.orchestra.run.smithi077.stdout:172.out 2023-07-24T05:51:07.614 INFO:teuthology.orchestra.run.smithi077.stdout:173 2023-07-24T05:51:07.614 INFO:teuthology.orchestra.run.smithi077.stdout:173.out 2023-07-24T05:51:07.614 INFO:teuthology.orchestra.run.smithi077.stdout:174 2023-07-24T05:51:07.614 INFO:teuthology.orchestra.run.smithi077.stdout:174.out 2023-07-24T05:51:07.614 INFO:teuthology.orchestra.run.smithi077.stdout:175 2023-07-24T05:51:07.614 INFO:teuthology.orchestra.run.smithi077.stdout:175.out 2023-07-24T05:51:07.614 INFO:teuthology.orchestra.run.smithi077.stdout:176 2023-07-24T05:51:07.614 INFO:teuthology.orchestra.run.smithi077.stdout:176.out 2023-07-24T05:51:07.615 INFO:teuthology.orchestra.run.smithi077.stdout:177 2023-07-24T05:51:07.615 INFO:teuthology.orchestra.run.smithi077.stdout:177.out 2023-07-24T05:51:07.615 INFO:teuthology.orchestra.run.smithi077.stdout:178 2023-07-24T05:51:07.615 INFO:teuthology.orchestra.run.smithi077.stdout:178.out 2023-07-24T05:51:07.615 INFO:teuthology.orchestra.run.smithi077.stdout:179 2023-07-24T05:51:07.615 INFO:teuthology.orchestra.run.smithi077.stdout:179.out 2023-07-24T05:51:07.615 INFO:teuthology.orchestra.run.smithi077.stdout:180 2023-07-24T05:51:07.615 INFO:teuthology.orchestra.run.smithi077.stdout:180.out 2023-07-24T05:51:07.616 INFO:teuthology.orchestra.run.smithi077.stdout:181 2023-07-24T05:51:07.616 INFO:teuthology.orchestra.run.smithi077.stdout:181.out 2023-07-24T05:51:07.616 INFO:teuthology.orchestra.run.smithi077.stdout:182 2023-07-24T05:51:07.616 INFO:teuthology.orchestra.run.smithi077.stdout:182.out 2023-07-24T05:51:07.616 INFO:teuthology.orchestra.run.smithi077.stdout:183 2023-07-24T05:51:07.616 INFO:teuthology.orchestra.run.smithi077.stdout:183.out 2023-07-24T05:51:07.616 INFO:teuthology.orchestra.run.smithi077.stdout:184 2023-07-24T05:51:07.616 INFO:teuthology.orchestra.run.smithi077.stdout:184.out 2023-07-24T05:51:07.617 INFO:teuthology.orchestra.run.smithi077.stdout:185 2023-07-24T05:51:07.617 INFO:teuthology.orchestra.run.smithi077.stdout:185.out 2023-07-24T05:51:07.617 INFO:teuthology.orchestra.run.smithi077.stdout:186 2023-07-24T05:51:07.617 INFO:teuthology.orchestra.run.smithi077.stdout:186.out 2023-07-24T05:51:07.617 INFO:teuthology.orchestra.run.smithi077.stdout:187 2023-07-24T05:51:07.617 INFO:teuthology.orchestra.run.smithi077.stdout:187.out 2023-07-24T05:51:07.617 INFO:teuthology.orchestra.run.smithi077.stdout:188 2023-07-24T05:51:07.617 INFO:teuthology.orchestra.run.smithi077.stdout:188.out 2023-07-24T05:51:07.618 INFO:teuthology.orchestra.run.smithi077.stdout:189 2023-07-24T05:51:07.618 INFO:teuthology.orchestra.run.smithi077.stdout:189.out 2023-07-24T05:51:07.618 INFO:teuthology.orchestra.run.smithi077.stdout:190 2023-07-24T05:51:07.618 INFO:teuthology.orchestra.run.smithi077.stdout:190.out 2023-07-24T05:51:07.618 INFO:teuthology.orchestra.run.smithi077.stdout:191 2023-07-24T05:51:07.618 INFO:teuthology.orchestra.run.smithi077.stdout:191.out 2023-07-24T05:51:07.618 INFO:teuthology.orchestra.run.smithi077.stdout:192 2023-07-24T05:51:07.618 INFO:teuthology.orchestra.run.smithi077.stdout:192.out 2023-07-24T05:51:07.619 INFO:teuthology.orchestra.run.smithi077.stdout:193 2023-07-24T05:51:07.619 INFO:teuthology.orchestra.run.smithi077.stdout:193.out 2023-07-24T05:51:07.619 INFO:teuthology.orchestra.run.smithi077.stdout:194 2023-07-24T05:51:07.619 INFO:teuthology.orchestra.run.smithi077.stdout:194.out 2023-07-24T05:51:07.619 INFO:teuthology.orchestra.run.smithi077.stdout:195 2023-07-24T05:51:07.619 INFO:teuthology.orchestra.run.smithi077.stdout:195.out 2023-07-24T05:51:07.619 INFO:teuthology.orchestra.run.smithi077.stdout:196 2023-07-24T05:51:07.619 INFO:teuthology.orchestra.run.smithi077.stdout:196.out 2023-07-24T05:51:07.620 INFO:teuthology.orchestra.run.smithi077.stdout:197 2023-07-24T05:51:07.620 INFO:teuthology.orchestra.run.smithi077.stdout:197.out 2023-07-24T05:51:07.620 INFO:teuthology.orchestra.run.smithi077.stdout:198 2023-07-24T05:51:07.620 INFO:teuthology.orchestra.run.smithi077.stdout:198.out 2023-07-24T05:51:07.620 INFO:teuthology.orchestra.run.smithi077.stdout:199 2023-07-24T05:51:07.620 INFO:teuthology.orchestra.run.smithi077.stdout:199.out 2023-07-24T05:51:07.620 INFO:teuthology.orchestra.run.smithi077.stdout:200 2023-07-24T05:51:07.620 INFO:teuthology.orchestra.run.smithi077.stdout:200.out 2023-07-24T05:51:07.621 INFO:teuthology.orchestra.run.smithi077.stdout:201 2023-07-24T05:51:07.621 INFO:teuthology.orchestra.run.smithi077.stdout:201.out 2023-07-24T05:51:07.621 INFO:teuthology.orchestra.run.smithi077.stdout:202 2023-07-24T05:51:07.621 INFO:teuthology.orchestra.run.smithi077.stdout:202.out 2023-07-24T05:51:07.621 INFO:teuthology.orchestra.run.smithi077.stdout:203 2023-07-24T05:51:07.621 INFO:teuthology.orchestra.run.smithi077.stdout:203.out 2023-07-24T05:51:07.621 INFO:teuthology.orchestra.run.smithi077.stdout:204 2023-07-24T05:51:07.621 INFO:teuthology.orchestra.run.smithi077.stdout:204.out 2023-07-24T05:51:07.621 INFO:teuthology.orchestra.run.smithi077.stdout:205 2023-07-24T05:51:07.622 INFO:teuthology.orchestra.run.smithi077.stdout:205.out 2023-07-24T05:51:07.622 INFO:teuthology.orchestra.run.smithi077.stdout:206 2023-07-24T05:51:07.622 INFO:teuthology.orchestra.run.smithi077.stdout:206.out 2023-07-24T05:51:07.622 INFO:teuthology.orchestra.run.smithi077.stdout:207 2023-07-24T05:51:07.622 INFO:teuthology.orchestra.run.smithi077.stdout:207.out 2023-07-24T05:51:07.622 INFO:teuthology.orchestra.run.smithi077.stdout:208 2023-07-24T05:51:07.622 INFO:teuthology.orchestra.run.smithi077.stdout:208.out 2023-07-24T05:51:07.622 INFO:teuthology.orchestra.run.smithi077.stdout:209 2023-07-24T05:51:07.623 INFO:teuthology.orchestra.run.smithi077.stdout:209.out 2023-07-24T05:51:07.623 INFO:teuthology.orchestra.run.smithi077.stdout:210 2023-07-24T05:51:07.623 INFO:teuthology.orchestra.run.smithi077.stdout:210.out 2023-07-24T05:51:07.623 INFO:teuthology.orchestra.run.smithi077.stdout:211 2023-07-24T05:51:07.623 INFO:teuthology.orchestra.run.smithi077.stdout:211.out 2023-07-24T05:51:07.623 INFO:teuthology.orchestra.run.smithi077.stdout:212 2023-07-24T05:51:07.623 INFO:teuthology.orchestra.run.smithi077.stdout:212.out 2023-07-24T05:51:07.623 INFO:teuthology.orchestra.run.smithi077.stdout:213 2023-07-24T05:51:07.624 INFO:teuthology.orchestra.run.smithi077.stdout:213.out 2023-07-24T05:51:07.624 INFO:teuthology.orchestra.run.smithi077.stdout:214 2023-07-24T05:51:07.624 INFO:teuthology.orchestra.run.smithi077.stdout:214.out 2023-07-24T05:51:07.624 INFO:teuthology.orchestra.run.smithi077.stdout:215 2023-07-24T05:51:07.624 INFO:teuthology.orchestra.run.smithi077.stdout:215.out 2023-07-24T05:51:07.624 INFO:teuthology.orchestra.run.smithi077.stdout:216 2023-07-24T05:51:07.624 INFO:teuthology.orchestra.run.smithi077.stdout:216.out 2023-07-24T05:51:07.624 INFO:teuthology.orchestra.run.smithi077.stdout:217 2023-07-24T05:51:07.625 INFO:teuthology.orchestra.run.smithi077.stdout:217.out 2023-07-24T05:51:07.625 INFO:teuthology.orchestra.run.smithi077.stdout:218 2023-07-24T05:51:07.625 INFO:teuthology.orchestra.run.smithi077.stdout:218.out 2023-07-24T05:51:07.625 INFO:teuthology.orchestra.run.smithi077.stdout:219 2023-07-24T05:51:07.625 INFO:teuthology.orchestra.run.smithi077.stdout:219.out 2023-07-24T05:51:07.625 INFO:teuthology.orchestra.run.smithi077.stdout:220 2023-07-24T05:51:07.625 INFO:teuthology.orchestra.run.smithi077.stdout:220.out 2023-07-24T05:51:07.625 INFO:teuthology.orchestra.run.smithi077.stdout:221 2023-07-24T05:51:07.626 INFO:teuthology.orchestra.run.smithi077.stdout:221.out 2023-07-24T05:51:07.626 INFO:teuthology.orchestra.run.smithi077.stdout:222 2023-07-24T05:51:07.626 INFO:teuthology.orchestra.run.smithi077.stdout:222.out 2023-07-24T05:51:07.626 INFO:teuthology.orchestra.run.smithi077.stdout:223 2023-07-24T05:51:07.626 INFO:teuthology.orchestra.run.smithi077.stdout:223.out 2023-07-24T05:51:07.626 INFO:teuthology.orchestra.run.smithi077.stdout:224 2023-07-24T05:51:07.626 INFO:teuthology.orchestra.run.smithi077.stdout:224.out 2023-07-24T05:51:07.626 INFO:teuthology.orchestra.run.smithi077.stdout:225 2023-07-24T05:51:07.627 INFO:teuthology.orchestra.run.smithi077.stdout:225.out 2023-07-24T05:51:07.627 INFO:teuthology.orchestra.run.smithi077.stdout:226 2023-07-24T05:51:07.627 INFO:teuthology.orchestra.run.smithi077.stdout:226.out 2023-07-24T05:51:07.627 INFO:teuthology.orchestra.run.smithi077.stdout:227 2023-07-24T05:51:07.627 INFO:teuthology.orchestra.run.smithi077.stdout:227.out 2023-07-24T05:51:07.627 INFO:teuthology.orchestra.run.smithi077.stdout:228 2023-07-24T05:51:07.627 INFO:teuthology.orchestra.run.smithi077.stdout:228.out 2023-07-24T05:51:07.627 INFO:teuthology.orchestra.run.smithi077.stdout:229 2023-07-24T05:51:07.628 INFO:teuthology.orchestra.run.smithi077.stdout:229.out 2023-07-24T05:51:07.628 INFO:teuthology.orchestra.run.smithi077.stdout:230 2023-07-24T05:51:07.628 INFO:teuthology.orchestra.run.smithi077.stdout:230.out 2023-07-24T05:51:07.628 INFO:teuthology.orchestra.run.smithi077.stdout:231 2023-07-24T05:51:07.628 INFO:teuthology.orchestra.run.smithi077.stdout:231.out 2023-07-24T05:51:07.628 INFO:teuthology.orchestra.run.smithi077.stdout:232 2023-07-24T05:51:07.628 INFO:teuthology.orchestra.run.smithi077.stdout:232.out 2023-07-24T05:51:07.628 INFO:teuthology.orchestra.run.smithi077.stdout:233 2023-07-24T05:51:07.629 INFO:teuthology.orchestra.run.smithi077.stdout:233.out 2023-07-24T05:51:07.629 INFO:teuthology.orchestra.run.smithi077.stdout:234 2023-07-24T05:51:07.629 INFO:teuthology.orchestra.run.smithi077.stdout:234.out 2023-07-24T05:51:07.629 INFO:teuthology.orchestra.run.smithi077.stdout:235 2023-07-24T05:51:07.629 INFO:teuthology.orchestra.run.smithi077.stdout:235.out 2023-07-24T05:51:07.629 INFO:teuthology.orchestra.run.smithi077.stdout:236 2023-07-24T05:51:07.629 INFO:teuthology.orchestra.run.smithi077.stdout:236.out 2023-07-24T05:51:07.629 INFO:teuthology.orchestra.run.smithi077.stdout:237 2023-07-24T05:51:07.630 INFO:teuthology.orchestra.run.smithi077.stdout:237.out 2023-07-24T05:51:07.630 INFO:teuthology.orchestra.run.smithi077.stdout:238 2023-07-24T05:51:07.630 INFO:teuthology.orchestra.run.smithi077.stdout:238.out 2023-07-24T05:51:07.630 INFO:teuthology.orchestra.run.smithi077.stdout:239 2023-07-24T05:51:07.630 INFO:teuthology.orchestra.run.smithi077.stdout:239.out 2023-07-24T05:51:07.630 INFO:teuthology.orchestra.run.smithi077.stdout:240 2023-07-24T05:51:07.630 INFO:teuthology.orchestra.run.smithi077.stdout:240.out 2023-07-24T05:51:07.630 INFO:teuthology.orchestra.run.smithi077.stdout:241 2023-07-24T05:51:07.631 INFO:teuthology.orchestra.run.smithi077.stdout:241.out 2023-07-24T05:51:07.631 INFO:teuthology.orchestra.run.smithi077.stdout:242 2023-07-24T05:51:07.631 INFO:teuthology.orchestra.run.smithi077.stdout:242.out 2023-07-24T05:51:07.631 INFO:teuthology.orchestra.run.smithi077.stdout:243 2023-07-24T05:51:07.631 INFO:teuthology.orchestra.run.smithi077.stdout:243.out 2023-07-24T05:51:07.631 INFO:teuthology.orchestra.run.smithi077.stdout:244 2023-07-24T05:51:07.631 INFO:teuthology.orchestra.run.smithi077.stdout:244.out 2023-07-24T05:51:07.632 INFO:teuthology.orchestra.run.smithi077.stdout:245 2023-07-24T05:51:07.632 INFO:teuthology.orchestra.run.smithi077.stdout:245.out 2023-07-24T05:51:07.632 INFO:teuthology.orchestra.run.smithi077.stdout:246 2023-07-24T05:51:07.632 INFO:teuthology.orchestra.run.smithi077.stdout:246.out 2023-07-24T05:51:07.632 INFO:teuthology.orchestra.run.smithi077.stdout:247 2023-07-24T05:51:07.633 INFO:teuthology.orchestra.run.smithi077.stdout:247.out 2023-07-24T05:51:07.633 INFO:teuthology.orchestra.run.smithi077.stdout:248 2023-07-24T05:51:07.633 INFO:teuthology.orchestra.run.smithi077.stdout:248.out 2023-07-24T05:51:07.633 INFO:teuthology.orchestra.run.smithi077.stdout:249 2023-07-24T05:51:07.633 INFO:teuthology.orchestra.run.smithi077.stdout:249.out 2023-07-24T05:51:07.633 INFO:teuthology.orchestra.run.smithi077.stdout:250 2023-07-24T05:51:07.633 INFO:teuthology.orchestra.run.smithi077.stdout:250.out 2023-07-24T05:51:07.633 INFO:teuthology.orchestra.run.smithi077.stdout:251 2023-07-24T05:51:07.634 INFO:teuthology.orchestra.run.smithi077.stdout:251.out 2023-07-24T05:51:07.634 INFO:teuthology.orchestra.run.smithi077.stdout:252 2023-07-24T05:51:07.634 INFO:teuthology.orchestra.run.smithi077.stdout:252.out 2023-07-24T05:51:07.634 INFO:teuthology.orchestra.run.smithi077.stdout:253 2023-07-24T05:51:07.634 INFO:teuthology.orchestra.run.smithi077.stdout:253.out 2023-07-24T05:51:07.634 INFO:teuthology.orchestra.run.smithi077.stdout:254 2023-07-24T05:51:07.634 INFO:teuthology.orchestra.run.smithi077.stdout:254.out 2023-07-24T05:51:07.634 INFO:teuthology.orchestra.run.smithi077.stdout:255 2023-07-24T05:51:07.635 INFO:teuthology.orchestra.run.smithi077.stdout:255.out 2023-07-24T05:51:07.635 INFO:teuthology.orchestra.run.smithi077.stdout:256 2023-07-24T05:51:07.635 INFO:teuthology.orchestra.run.smithi077.stdout:256.out 2023-07-24T05:51:07.635 INFO:teuthology.orchestra.run.smithi077.stdout:257 2023-07-24T05:51:07.635 INFO:teuthology.orchestra.run.smithi077.stdout:257.out 2023-07-24T05:51:07.635 INFO:teuthology.orchestra.run.smithi077.stdout:258 2023-07-24T05:51:07.635 INFO:teuthology.orchestra.run.smithi077.stdout:258.out 2023-07-24T05:51:07.635 INFO:teuthology.orchestra.run.smithi077.stdout:259 2023-07-24T05:51:07.636 INFO:teuthology.orchestra.run.smithi077.stdout:259.out 2023-07-24T05:51:07.636 INFO:teuthology.orchestra.run.smithi077.stdout:260 2023-07-24T05:51:07.636 INFO:teuthology.orchestra.run.smithi077.stdout:260.out 2023-07-24T05:51:07.636 INFO:teuthology.orchestra.run.smithi077.stdout:261 2023-07-24T05:51:07.636 INFO:teuthology.orchestra.run.smithi077.stdout:261.out 2023-07-24T05:51:07.636 INFO:teuthology.orchestra.run.smithi077.stdout:262 2023-07-24T05:51:07.636 INFO:teuthology.orchestra.run.smithi077.stdout:262.out 2023-07-24T05:51:07.636 INFO:teuthology.orchestra.run.smithi077.stdout:263 2023-07-24T05:51:07.637 INFO:teuthology.orchestra.run.smithi077.stdout:263.out 2023-07-24T05:51:07.637 INFO:teuthology.orchestra.run.smithi077.stdout:264 2023-07-24T05:51:07.637 INFO:teuthology.orchestra.run.smithi077.stdout:264.out 2023-07-24T05:51:07.637 INFO:teuthology.orchestra.run.smithi077.stdout:265 2023-07-24T05:51:07.637 INFO:teuthology.orchestra.run.smithi077.stdout:265.out 2023-07-24T05:51:07.637 INFO:teuthology.orchestra.run.smithi077.stdout:266 2023-07-24T05:51:07.637 INFO:teuthology.orchestra.run.smithi077.stdout:266.out 2023-07-24T05:51:07.637 INFO:teuthology.orchestra.run.smithi077.stdout:267 2023-07-24T05:51:07.638 INFO:teuthology.orchestra.run.smithi077.stdout:267.out 2023-07-24T05:51:07.638 INFO:teuthology.orchestra.run.smithi077.stdout:268 2023-07-24T05:51:07.638 INFO:teuthology.orchestra.run.smithi077.stdout:268.out 2023-07-24T05:51:07.638 INFO:teuthology.orchestra.run.smithi077.stdout:269 2023-07-24T05:51:07.638 INFO:teuthology.orchestra.run.smithi077.stdout:269.out 2023-07-24T05:51:07.638 INFO:teuthology.orchestra.run.smithi077.stdout:270 2023-07-24T05:51:07.638 INFO:teuthology.orchestra.run.smithi077.stdout:270.out 2023-07-24T05:51:07.638 INFO:teuthology.orchestra.run.smithi077.stdout:271 2023-07-24T05:51:07.639 INFO:teuthology.orchestra.run.smithi077.stdout:271.out 2023-07-24T05:51:07.639 INFO:teuthology.orchestra.run.smithi077.stdout:272 2023-07-24T05:51:07.639 INFO:teuthology.orchestra.run.smithi077.stdout:272.out 2023-07-24T05:51:07.639 INFO:teuthology.orchestra.run.smithi077.stdout:273 2023-07-24T05:51:07.639 INFO:teuthology.orchestra.run.smithi077.stdout:273.out 2023-07-24T05:51:07.639 INFO:teuthology.orchestra.run.smithi077.stdout:274 2023-07-24T05:51:07.639 INFO:teuthology.orchestra.run.smithi077.stdout:274.out 2023-07-24T05:51:07.639 INFO:teuthology.orchestra.run.smithi077.stdout:275 2023-07-24T05:51:07.640 INFO:teuthology.orchestra.run.smithi077.stdout:275.out 2023-07-24T05:51:07.640 INFO:teuthology.orchestra.run.smithi077.stdout:276 2023-07-24T05:51:07.640 INFO:teuthology.orchestra.run.smithi077.stdout:276.out 2023-07-24T05:51:07.640 INFO:teuthology.orchestra.run.smithi077.stdout:277 2023-07-24T05:51:07.640 INFO:teuthology.orchestra.run.smithi077.stdout:277.out 2023-07-24T05:51:07.640 INFO:teuthology.orchestra.run.smithi077.stdout:278 2023-07-24T05:51:07.640 INFO:teuthology.orchestra.run.smithi077.stdout:278.out 2023-07-24T05:51:07.640 INFO:teuthology.orchestra.run.smithi077.stdout:279 2023-07-24T05:51:07.641 INFO:teuthology.orchestra.run.smithi077.stdout:279.out 2023-07-24T05:51:07.641 INFO:teuthology.orchestra.run.smithi077.stdout:280 2023-07-24T05:51:07.641 INFO:teuthology.orchestra.run.smithi077.stdout:280.out 2023-07-24T05:51:07.641 INFO:teuthology.orchestra.run.smithi077.stdout:281 2023-07-24T05:51:07.641 INFO:teuthology.orchestra.run.smithi077.stdout:281.out 2023-07-24T05:51:07.641 INFO:teuthology.orchestra.run.smithi077.stdout:282 2023-07-24T05:51:07.641 INFO:teuthology.orchestra.run.smithi077.stdout:282.out 2023-07-24T05:51:07.641 INFO:teuthology.orchestra.run.smithi077.stdout:283 2023-07-24T05:51:07.642 INFO:teuthology.orchestra.run.smithi077.stdout:283.out 2023-07-24T05:51:07.642 INFO:teuthology.orchestra.run.smithi077.stdout:284 2023-07-24T05:51:07.642 INFO:teuthology.orchestra.run.smithi077.stdout:284.out 2023-07-24T05:51:07.642 INFO:teuthology.orchestra.run.smithi077.stdout:285 2023-07-24T05:51:07.642 INFO:teuthology.orchestra.run.smithi077.stdout:285.out 2023-07-24T05:51:07.642 INFO:teuthology.orchestra.run.smithi077.stdout:286 2023-07-24T05:51:07.642 INFO:teuthology.orchestra.run.smithi077.stdout:286.out 2023-07-24T05:51:07.642 INFO:teuthology.orchestra.run.smithi077.stdout:287 2023-07-24T05:51:07.643 INFO:teuthology.orchestra.run.smithi077.stdout:287.out 2023-07-24T05:51:07.643 INFO:teuthology.orchestra.run.smithi077.stdout:288 2023-07-24T05:51:07.643 INFO:teuthology.orchestra.run.smithi077.stdout:288.out 2023-07-24T05:51:07.643 INFO:teuthology.orchestra.run.smithi077.stdout:289 2023-07-24T05:51:07.643 INFO:teuthology.orchestra.run.smithi077.stdout:289.out 2023-07-24T05:51:07.643 INFO:teuthology.orchestra.run.smithi077.stdout:290 2023-07-24T05:51:07.643 INFO:teuthology.orchestra.run.smithi077.stdout:290.out 2023-07-24T05:51:07.643 INFO:teuthology.orchestra.run.smithi077.stdout:291 2023-07-24T05:51:07.644 INFO:teuthology.orchestra.run.smithi077.stdout:291.out 2023-07-24T05:51:07.644 INFO:teuthology.orchestra.run.smithi077.stdout:292 2023-07-24T05:51:07.644 INFO:teuthology.orchestra.run.smithi077.stdout:292.out 2023-07-24T05:51:07.644 INFO:teuthology.orchestra.run.smithi077.stdout:293 2023-07-24T05:51:07.644 INFO:teuthology.orchestra.run.smithi077.stdout:293.out 2023-07-24T05:51:07.644 INFO:teuthology.orchestra.run.smithi077.stdout:294 2023-07-24T05:51:07.644 INFO:teuthology.orchestra.run.smithi077.stdout:294.out 2023-07-24T05:51:07.644 INFO:teuthology.orchestra.run.smithi077.stdout:295 2023-07-24T05:51:07.645 INFO:teuthology.orchestra.run.smithi077.stdout:295.out 2023-07-24T05:51:07.645 INFO:teuthology.orchestra.run.smithi077.stdout:296 2023-07-24T05:51:07.645 INFO:teuthology.orchestra.run.smithi077.stdout:296.out 2023-07-24T05:51:07.645 INFO:teuthology.orchestra.run.smithi077.stdout:297 2023-07-24T05:51:07.645 INFO:teuthology.orchestra.run.smithi077.stdout:297.out 2023-07-24T05:51:07.645 INFO:teuthology.orchestra.run.smithi077.stdout:298 2023-07-24T05:51:07.645 INFO:teuthology.orchestra.run.smithi077.stdout:298.out 2023-07-24T05:51:07.645 INFO:teuthology.orchestra.run.smithi077.stdout:299 2023-07-24T05:51:07.646 INFO:teuthology.orchestra.run.smithi077.stdout:299.out 2023-07-24T05:51:07.646 INFO:teuthology.orchestra.run.smithi077.stdout:300 2023-07-24T05:51:07.646 INFO:teuthology.orchestra.run.smithi077.stdout:300.out 2023-07-24T05:51:07.646 INFO:teuthology.orchestra.run.smithi077.stdout:301 2023-07-24T05:51:07.646 INFO:teuthology.orchestra.run.smithi077.stdout:301.out 2023-07-24T05:51:07.646 INFO:teuthology.orchestra.run.smithi077.stdout:302 2023-07-24T05:51:07.646 INFO:teuthology.orchestra.run.smithi077.stdout:302.out 2023-07-24T05:51:07.646 INFO:teuthology.orchestra.run.smithi077.stdout:303 2023-07-24T05:51:07.646 INFO:teuthology.orchestra.run.smithi077.stdout:303.out 2023-07-24T05:51:07.647 INFO:teuthology.orchestra.run.smithi077.stdout:304 2023-07-24T05:51:07.647 INFO:teuthology.orchestra.run.smithi077.stdout:304.out 2023-07-24T05:51:07.647 INFO:teuthology.orchestra.run.smithi077.stdout:305 2023-07-24T05:51:07.647 INFO:teuthology.orchestra.run.smithi077.stdout:305.out 2023-07-24T05:51:07.647 INFO:teuthology.orchestra.run.smithi077.stdout:306 2023-07-24T05:51:07.647 INFO:teuthology.orchestra.run.smithi077.stdout:306.out 2023-07-24T05:51:07.647 INFO:teuthology.orchestra.run.smithi077.stdout:307 2023-07-24T05:51:07.647 INFO:teuthology.orchestra.run.smithi077.stdout:307.out 2023-07-24T05:51:07.648 INFO:teuthology.orchestra.run.smithi077.stdout:308 2023-07-24T05:51:07.648 INFO:teuthology.orchestra.run.smithi077.stdout:308.out 2023-07-24T05:51:07.648 INFO:teuthology.orchestra.run.smithi077.stdout:309 2023-07-24T05:51:07.648 INFO:teuthology.orchestra.run.smithi077.stdout:309.out 2023-07-24T05:51:07.648 INFO:teuthology.orchestra.run.smithi077.stdout:310 2023-07-24T05:51:07.648 INFO:teuthology.orchestra.run.smithi077.stdout:310.out 2023-07-24T05:51:07.648 INFO:teuthology.orchestra.run.smithi077.stdout:311 2023-07-24T05:51:07.648 INFO:teuthology.orchestra.run.smithi077.stdout:311.out 2023-07-24T05:51:07.649 INFO:teuthology.orchestra.run.smithi077.stdout:312 2023-07-24T05:51:07.649 INFO:teuthology.orchestra.run.smithi077.stdout:312.out 2023-07-24T05:51:07.649 INFO:teuthology.orchestra.run.smithi077.stdout:313 2023-07-24T05:51:07.649 INFO:teuthology.orchestra.run.smithi077.stdout:313.out 2023-07-24T05:51:07.649 INFO:teuthology.orchestra.run.smithi077.stdout:314 2023-07-24T05:51:07.649 INFO:teuthology.orchestra.run.smithi077.stdout:314.out 2023-07-24T05:51:07.649 INFO:teuthology.orchestra.run.smithi077.stdout:315 2023-07-24T05:51:07.649 INFO:teuthology.orchestra.run.smithi077.stdout:315.out 2023-07-24T05:51:07.650 INFO:teuthology.orchestra.run.smithi077.stdout:316 2023-07-24T05:51:07.650 INFO:teuthology.orchestra.run.smithi077.stdout:316.out 2023-07-24T05:51:07.650 INFO:teuthology.orchestra.run.smithi077.stdout:317 2023-07-24T05:51:07.650 INFO:teuthology.orchestra.run.smithi077.stdout:317.out 2023-07-24T05:51:07.650 INFO:teuthology.orchestra.run.smithi077.stdout:318 2023-07-24T05:51:07.650 INFO:teuthology.orchestra.run.smithi077.stdout:318.out 2023-07-24T05:51:07.650 INFO:teuthology.orchestra.run.smithi077.stdout:319 2023-07-24T05:51:07.650 INFO:teuthology.orchestra.run.smithi077.stdout:319.out 2023-07-24T05:51:07.651 INFO:teuthology.orchestra.run.smithi077.stdout:320 2023-07-24T05:51:07.651 INFO:teuthology.orchestra.run.smithi077.stdout:320.out 2023-07-24T05:51:07.651 INFO:teuthology.orchestra.run.smithi077.stdout:321 2023-07-24T05:51:07.651 INFO:teuthology.orchestra.run.smithi077.stdout:321.out 2023-07-24T05:51:07.651 INFO:teuthology.orchestra.run.smithi077.stdout:322 2023-07-24T05:51:07.651 INFO:teuthology.orchestra.run.smithi077.stdout:322.out 2023-07-24T05:51:07.651 INFO:teuthology.orchestra.run.smithi077.stdout:323 2023-07-24T05:51:07.651 INFO:teuthology.orchestra.run.smithi077.stdout:323.out 2023-07-24T05:51:07.652 INFO:teuthology.orchestra.run.smithi077.stdout:324 2023-07-24T05:51:07.652 INFO:teuthology.orchestra.run.smithi077.stdout:324.out 2023-07-24T05:51:07.652 INFO:teuthology.orchestra.run.smithi077.stdout:325 2023-07-24T05:51:07.652 INFO:teuthology.orchestra.run.smithi077.stdout:325.out 2023-07-24T05:51:07.652 INFO:teuthology.orchestra.run.smithi077.stdout:326 2023-07-24T05:51:07.652 INFO:teuthology.orchestra.run.smithi077.stdout:326.out 2023-07-24T05:51:07.652 INFO:teuthology.orchestra.run.smithi077.stdout:327 2023-07-24T05:51:07.652 INFO:teuthology.orchestra.run.smithi077.stdout:327.out 2023-07-24T05:51:07.653 INFO:teuthology.orchestra.run.smithi077.stdout:328 2023-07-24T05:51:07.653 INFO:teuthology.orchestra.run.smithi077.stdout:328.out 2023-07-24T05:51:07.653 INFO:teuthology.orchestra.run.smithi077.stdout:329 2023-07-24T05:51:07.653 INFO:teuthology.orchestra.run.smithi077.stdout:329.out 2023-07-24T05:51:07.653 INFO:teuthology.orchestra.run.smithi077.stdout:330 2023-07-24T05:51:07.653 INFO:teuthology.orchestra.run.smithi077.stdout:330.out 2023-07-24T05:51:07.653 INFO:teuthology.orchestra.run.smithi077.stdout:331 2023-07-24T05:51:07.653 INFO:teuthology.orchestra.run.smithi077.stdout:331.out 2023-07-24T05:51:07.654 INFO:teuthology.orchestra.run.smithi077.stdout:332 2023-07-24T05:51:07.654 INFO:teuthology.orchestra.run.smithi077.stdout:332.out 2023-07-24T05:51:07.654 INFO:teuthology.orchestra.run.smithi077.stdout:333 2023-07-24T05:51:07.654 INFO:teuthology.orchestra.run.smithi077.stdout:333.out 2023-07-24T05:51:07.654 INFO:teuthology.orchestra.run.smithi077.stdout:334 2023-07-24T05:51:07.654 INFO:teuthology.orchestra.run.smithi077.stdout:334.out 2023-07-24T05:51:07.654 INFO:teuthology.orchestra.run.smithi077.stdout:335 2023-07-24T05:51:07.654 INFO:teuthology.orchestra.run.smithi077.stdout:335.out 2023-07-24T05:51:07.655 INFO:teuthology.orchestra.run.smithi077.stdout:336 2023-07-24T05:51:07.655 INFO:teuthology.orchestra.run.smithi077.stdout:336.out 2023-07-24T05:51:07.655 INFO:teuthology.orchestra.run.smithi077.stdout:337 2023-07-24T05:51:07.655 INFO:teuthology.orchestra.run.smithi077.stdout:337.out 2023-07-24T05:51:07.655 INFO:teuthology.orchestra.run.smithi077.stdout:338 2023-07-24T05:51:07.655 INFO:teuthology.orchestra.run.smithi077.stdout:338.out 2023-07-24T05:51:07.655 INFO:teuthology.orchestra.run.smithi077.stdout:339 2023-07-24T05:51:07.655 INFO:teuthology.orchestra.run.smithi077.stdout:339.out 2023-07-24T05:51:07.656 INFO:teuthology.orchestra.run.smithi077.stdout:340 2023-07-24T05:51:07.656 INFO:teuthology.orchestra.run.smithi077.stdout:340.out 2023-07-24T05:51:07.656 INFO:teuthology.orchestra.run.smithi077.stdout:341 2023-07-24T05:51:07.656 INFO:teuthology.orchestra.run.smithi077.stdout:341.out 2023-07-24T05:51:07.656 INFO:teuthology.orchestra.run.smithi077.stdout:342 2023-07-24T05:51:07.656 INFO:teuthology.orchestra.run.smithi077.stdout:342.out 2023-07-24T05:51:07.656 INFO:teuthology.orchestra.run.smithi077.stdout:343 2023-07-24T05:51:07.656 INFO:teuthology.orchestra.run.smithi077.stdout:343.out 2023-07-24T05:51:07.657 INFO:teuthology.orchestra.run.smithi077.stdout:344 2023-07-24T05:51:07.657 INFO:teuthology.orchestra.run.smithi077.stdout:344.out 2023-07-24T05:51:07.657 INFO:teuthology.orchestra.run.smithi077.stdout:345 2023-07-24T05:51:07.657 INFO:teuthology.orchestra.run.smithi077.stdout:345.out 2023-07-24T05:51:07.657 INFO:teuthology.orchestra.run.smithi077.stdout:346 2023-07-24T05:51:07.657 INFO:teuthology.orchestra.run.smithi077.stdout:346.out 2023-07-24T05:51:07.657 INFO:teuthology.orchestra.run.smithi077.stdout:347 2023-07-24T05:51:07.657 INFO:teuthology.orchestra.run.smithi077.stdout:347.out 2023-07-24T05:51:07.658 INFO:teuthology.orchestra.run.smithi077.stdout:348 2023-07-24T05:51:07.658 INFO:teuthology.orchestra.run.smithi077.stdout:348.out 2023-07-24T05:51:07.658 INFO:teuthology.orchestra.run.smithi077.stdout:349 2023-07-24T05:51:07.658 INFO:teuthology.orchestra.run.smithi077.stdout:349.out 2023-07-24T05:51:07.658 INFO:teuthology.orchestra.run.smithi077.stdout:350 2023-07-24T05:51:07.658 INFO:teuthology.orchestra.run.smithi077.stdout:350.out 2023-07-24T05:51:07.658 INFO:teuthology.orchestra.run.smithi077.stdout:351 2023-07-24T05:51:07.658 INFO:teuthology.orchestra.run.smithi077.stdout:351.out 2023-07-24T05:51:07.659 INFO:teuthology.orchestra.run.smithi077.stdout:352 2023-07-24T05:51:07.659 INFO:teuthology.orchestra.run.smithi077.stdout:352.out 2023-07-24T05:51:07.659 INFO:teuthology.orchestra.run.smithi077.stdout:353 2023-07-24T05:51:07.659 INFO:teuthology.orchestra.run.smithi077.stdout:353.out 2023-07-24T05:51:07.659 INFO:teuthology.orchestra.run.smithi077.stdout:354 2023-07-24T05:51:07.659 INFO:teuthology.orchestra.run.smithi077.stdout:354.out 2023-07-24T05:51:07.659 INFO:teuthology.orchestra.run.smithi077.stdout:355 2023-07-24T05:51:07.659 INFO:teuthology.orchestra.run.smithi077.stdout:355.out 2023-07-24T05:51:07.660 INFO:teuthology.orchestra.run.smithi077.stdout:356 2023-07-24T05:51:07.660 INFO:teuthology.orchestra.run.smithi077.stdout:356.out 2023-07-24T05:51:07.660 INFO:teuthology.orchestra.run.smithi077.stdout:357 2023-07-24T05:51:07.660 INFO:teuthology.orchestra.run.smithi077.stdout:357.out 2023-07-24T05:51:07.660 INFO:teuthology.orchestra.run.smithi077.stdout:358 2023-07-24T05:51:07.660 INFO:teuthology.orchestra.run.smithi077.stdout:358.out 2023-07-24T05:51:07.660 INFO:teuthology.orchestra.run.smithi077.stdout:359 2023-07-24T05:51:07.660 INFO:teuthology.orchestra.run.smithi077.stdout:359.out 2023-07-24T05:51:07.661 INFO:teuthology.orchestra.run.smithi077.stdout:360 2023-07-24T05:51:07.661 INFO:teuthology.orchestra.run.smithi077.stdout:360.out 2023-07-24T05:51:07.661 INFO:teuthology.orchestra.run.smithi077.stdout:361 2023-07-24T05:51:07.661 INFO:teuthology.orchestra.run.smithi077.stdout:361.out 2023-07-24T05:51:07.661 INFO:teuthology.orchestra.run.smithi077.stdout:362 2023-07-24T05:51:07.661 INFO:teuthology.orchestra.run.smithi077.stdout:362.out 2023-07-24T05:51:07.661 INFO:teuthology.orchestra.run.smithi077.stdout:363 2023-07-24T05:51:07.661 INFO:teuthology.orchestra.run.smithi077.stdout:363.out 2023-07-24T05:51:07.662 INFO:teuthology.orchestra.run.smithi077.stdout:364 2023-07-24T05:51:07.662 INFO:teuthology.orchestra.run.smithi077.stdout:364.out 2023-07-24T05:51:07.662 INFO:teuthology.orchestra.run.smithi077.stdout:365 2023-07-24T05:51:07.662 INFO:teuthology.orchestra.run.smithi077.stdout:365.out 2023-07-24T05:51:07.662 INFO:teuthology.orchestra.run.smithi077.stdout:366 2023-07-24T05:51:07.662 INFO:teuthology.orchestra.run.smithi077.stdout:366.out 2023-07-24T05:51:07.662 INFO:teuthology.orchestra.run.smithi077.stdout:367 2023-07-24T05:51:07.662 INFO:teuthology.orchestra.run.smithi077.stdout:367.out 2023-07-24T05:51:07.663 INFO:teuthology.orchestra.run.smithi077.stdout:368 2023-07-24T05:51:07.663 INFO:teuthology.orchestra.run.smithi077.stdout:368.out 2023-07-24T05:51:07.663 INFO:teuthology.orchestra.run.smithi077.stdout:369 2023-07-24T05:51:07.663 INFO:teuthology.orchestra.run.smithi077.stdout:369.out 2023-07-24T05:51:07.663 INFO:teuthology.orchestra.run.smithi077.stdout:370 2023-07-24T05:51:07.663 INFO:teuthology.orchestra.run.smithi077.stdout:370.out 2023-07-24T05:51:07.663 INFO:teuthology.orchestra.run.smithi077.stdout:371 2023-07-24T05:51:07.663 INFO:teuthology.orchestra.run.smithi077.stdout:371.out 2023-07-24T05:51:07.664 INFO:teuthology.orchestra.run.smithi077.stdout:372 2023-07-24T05:51:07.664 INFO:teuthology.orchestra.run.smithi077.stdout:372.out 2023-07-24T05:51:07.664 INFO:teuthology.orchestra.run.smithi077.stdout:373 2023-07-24T05:51:07.664 INFO:teuthology.orchestra.run.smithi077.stdout:373.out 2023-07-24T05:51:07.664 INFO:teuthology.orchestra.run.smithi077.stdout:374 2023-07-24T05:51:07.664 INFO:teuthology.orchestra.run.smithi077.stdout:374.out 2023-07-24T05:51:07.664 INFO:teuthology.orchestra.run.smithi077.stdout:375 2023-07-24T05:51:07.664 INFO:teuthology.orchestra.run.smithi077.stdout:375.out 2023-07-24T05:51:07.665 INFO:teuthology.orchestra.run.smithi077.stdout:376 2023-07-24T05:51:07.665 INFO:teuthology.orchestra.run.smithi077.stdout:376.out 2023-07-24T05:51:07.665 INFO:teuthology.orchestra.run.smithi077.stdout:377 2023-07-24T05:51:07.665 INFO:teuthology.orchestra.run.smithi077.stdout:377.out 2023-07-24T05:51:07.665 INFO:teuthology.orchestra.run.smithi077.stdout:378 2023-07-24T05:51:07.665 INFO:teuthology.orchestra.run.smithi077.stdout:378.out 2023-07-24T05:51:07.665 INFO:teuthology.orchestra.run.smithi077.stdout:379 2023-07-24T05:51:07.665 INFO:teuthology.orchestra.run.smithi077.stdout:379.out 2023-07-24T05:51:07.666 INFO:teuthology.orchestra.run.smithi077.stdout:380 2023-07-24T05:51:07.666 INFO:teuthology.orchestra.run.smithi077.stdout:380.out 2023-07-24T05:51:07.666 INFO:teuthology.orchestra.run.smithi077.stdout:381 2023-07-24T05:51:07.666 INFO:teuthology.orchestra.run.smithi077.stdout:381.out 2023-07-24T05:51:07.666 INFO:teuthology.orchestra.run.smithi077.stdout:382 2023-07-24T05:51:07.666 INFO:teuthology.orchestra.run.smithi077.stdout:382.out 2023-07-24T05:51:07.666 INFO:teuthology.orchestra.run.smithi077.stdout:383 2023-07-24T05:51:07.666 INFO:teuthology.orchestra.run.smithi077.stdout:383.out 2023-07-24T05:51:07.667 INFO:teuthology.orchestra.run.smithi077.stdout:384 2023-07-24T05:51:07.667 INFO:teuthology.orchestra.run.smithi077.stdout:384.out 2023-07-24T05:51:07.667 INFO:teuthology.orchestra.run.smithi077.stdout:385 2023-07-24T05:51:07.667 INFO:teuthology.orchestra.run.smithi077.stdout:385.out 2023-07-24T05:51:07.667 INFO:teuthology.orchestra.run.smithi077.stdout:386 2023-07-24T05:51:07.667 INFO:teuthology.orchestra.run.smithi077.stdout:386.out 2023-07-24T05:51:07.667 INFO:teuthology.orchestra.run.smithi077.stdout:387 2023-07-24T05:51:07.667 INFO:teuthology.orchestra.run.smithi077.stdout:387.out 2023-07-24T05:51:07.668 INFO:teuthology.orchestra.run.smithi077.stdout:388 2023-07-24T05:51:07.668 INFO:teuthology.orchestra.run.smithi077.stdout:388.out 2023-07-24T05:51:07.668 INFO:teuthology.orchestra.run.smithi077.stdout:389 2023-07-24T05:51:07.668 INFO:teuthology.orchestra.run.smithi077.stdout:389.out 2023-07-24T05:51:07.668 INFO:teuthology.orchestra.run.smithi077.stdout:390 2023-07-24T05:51:07.668 INFO:teuthology.orchestra.run.smithi077.stdout:390.out 2023-07-24T05:51:07.668 INFO:teuthology.orchestra.run.smithi077.stdout:391 2023-07-24T05:51:07.668 INFO:teuthology.orchestra.run.smithi077.stdout:391.out 2023-07-24T05:51:07.669 INFO:teuthology.orchestra.run.smithi077.stdout:392 2023-07-24T05:51:07.669 INFO:teuthology.orchestra.run.smithi077.stdout:392.out 2023-07-24T05:51:07.669 INFO:teuthology.orchestra.run.smithi077.stdout:393 2023-07-24T05:51:07.669 INFO:teuthology.orchestra.run.smithi077.stdout:393.out 2023-07-24T05:51:07.669 INFO:teuthology.orchestra.run.smithi077.stdout:394 2023-07-24T05:51:07.669 INFO:teuthology.orchestra.run.smithi077.stdout:394.out 2023-07-24T05:51:07.669 INFO:teuthology.orchestra.run.smithi077.stdout:395 2023-07-24T05:51:07.669 INFO:teuthology.orchestra.run.smithi077.stdout:395.out 2023-07-24T05:51:07.670 INFO:teuthology.orchestra.run.smithi077.stdout:396 2023-07-24T05:51:07.670 INFO:teuthology.orchestra.run.smithi077.stdout:396.out 2023-07-24T05:51:07.670 INFO:teuthology.orchestra.run.smithi077.stdout:397 2023-07-24T05:51:07.670 INFO:teuthology.orchestra.run.smithi077.stdout:397.out 2023-07-24T05:51:07.670 INFO:teuthology.orchestra.run.smithi077.stdout:398 2023-07-24T05:51:07.670 INFO:teuthology.orchestra.run.smithi077.stdout:398.out 2023-07-24T05:51:07.670 INFO:teuthology.orchestra.run.smithi077.stdout:399 2023-07-24T05:51:07.670 INFO:teuthology.orchestra.run.smithi077.stdout:399.out 2023-07-24T05:51:07.671 INFO:teuthology.orchestra.run.smithi077.stdout:400 2023-07-24T05:51:07.671 INFO:teuthology.orchestra.run.smithi077.stdout:400.out 2023-07-24T05:51:07.671 INFO:teuthology.orchestra.run.smithi077.stdout:401 2023-07-24T05:51:07.671 INFO:teuthology.orchestra.run.smithi077.stdout:401.out 2023-07-24T05:51:07.671 INFO:teuthology.orchestra.run.smithi077.stdout:402 2023-07-24T05:51:07.671 INFO:teuthology.orchestra.run.smithi077.stdout:402.out 2023-07-24T05:51:07.671 INFO:teuthology.orchestra.run.smithi077.stdout:403 2023-07-24T05:51:07.671 INFO:teuthology.orchestra.run.smithi077.stdout:403.out 2023-07-24T05:51:07.672 INFO:teuthology.orchestra.run.smithi077.stdout:404 2023-07-24T05:51:07.672 INFO:teuthology.orchestra.run.smithi077.stdout:404.out 2023-07-24T05:51:07.672 INFO:teuthology.orchestra.run.smithi077.stdout:405 2023-07-24T05:51:07.672 INFO:teuthology.orchestra.run.smithi077.stdout:405.out 2023-07-24T05:51:07.672 INFO:teuthology.orchestra.run.smithi077.stdout:406 2023-07-24T05:51:07.672 INFO:teuthology.orchestra.run.smithi077.stdout:406.out 2023-07-24T05:51:07.672 INFO:teuthology.orchestra.run.smithi077.stdout:407 2023-07-24T05:51:07.672 INFO:teuthology.orchestra.run.smithi077.stdout:407.out 2023-07-24T05:51:07.673 INFO:teuthology.orchestra.run.smithi077.stdout:408 2023-07-24T05:51:07.673 INFO:teuthology.orchestra.run.smithi077.stdout:408.out 2023-07-24T05:51:07.673 INFO:teuthology.orchestra.run.smithi077.stdout:409 2023-07-24T05:51:07.673 INFO:teuthology.orchestra.run.smithi077.stdout:409.out 2023-07-24T05:51:07.673 INFO:teuthology.orchestra.run.smithi077.stdout:410 2023-07-24T05:51:07.673 INFO:teuthology.orchestra.run.smithi077.stdout:410.out 2023-07-24T05:51:07.673 INFO:teuthology.orchestra.run.smithi077.stdout:411 2023-07-24T05:51:07.673 INFO:teuthology.orchestra.run.smithi077.stdout:411.out 2023-07-24T05:51:07.674 INFO:teuthology.orchestra.run.smithi077.stdout:412 2023-07-24T05:51:07.674 INFO:teuthology.orchestra.run.smithi077.stdout:412.out 2023-07-24T05:51:07.674 INFO:teuthology.orchestra.run.smithi077.stdout:413 2023-07-24T05:51:07.674 INFO:teuthology.orchestra.run.smithi077.stdout:413.out 2023-07-24T05:51:07.674 INFO:teuthology.orchestra.run.smithi077.stdout:414 2023-07-24T05:51:07.674 INFO:teuthology.orchestra.run.smithi077.stdout:414.out 2023-07-24T05:51:07.674 INFO:teuthology.orchestra.run.smithi077.stdout:415 2023-07-24T05:51:07.674 INFO:teuthology.orchestra.run.smithi077.stdout:415.out 2023-07-24T05:51:07.675 INFO:teuthology.orchestra.run.smithi077.stdout:416 2023-07-24T05:51:07.675 INFO:teuthology.orchestra.run.smithi077.stdout:416.out 2023-07-24T05:51:07.675 INFO:teuthology.orchestra.run.smithi077.stdout:417 2023-07-24T05:51:07.675 INFO:teuthology.orchestra.run.smithi077.stdout:417.out 2023-07-24T05:51:07.675 INFO:teuthology.orchestra.run.smithi077.stdout:418 2023-07-24T05:51:07.675 INFO:teuthology.orchestra.run.smithi077.stdout:418.out 2023-07-24T05:51:07.675 INFO:teuthology.orchestra.run.smithi077.stdout:419 2023-07-24T05:51:07.676 INFO:teuthology.orchestra.run.smithi077.stdout:419.out 2023-07-24T05:51:07.676 INFO:teuthology.orchestra.run.smithi077.stdout:420 2023-07-24T05:51:07.676 INFO:teuthology.orchestra.run.smithi077.stdout:420.out 2023-07-24T05:51:07.676 INFO:teuthology.orchestra.run.smithi077.stdout:421 2023-07-24T05:51:07.676 INFO:teuthology.orchestra.run.smithi077.stdout:421.out 2023-07-24T05:51:07.676 INFO:teuthology.orchestra.run.smithi077.stdout:422 2023-07-24T05:51:07.676 INFO:teuthology.orchestra.run.smithi077.stdout:422.out 2023-07-24T05:51:07.676 INFO:teuthology.orchestra.run.smithi077.stdout:423 2023-07-24T05:51:07.677 INFO:teuthology.orchestra.run.smithi077.stdout:423.out 2023-07-24T05:51:07.677 INFO:teuthology.orchestra.run.smithi077.stdout:424 2023-07-24T05:51:07.677 INFO:teuthology.orchestra.run.smithi077.stdout:424.out 2023-07-24T05:51:07.677 INFO:teuthology.orchestra.run.smithi077.stdout:425 2023-07-24T05:51:07.677 INFO:teuthology.orchestra.run.smithi077.stdout:425.out 2023-07-24T05:51:07.677 INFO:teuthology.orchestra.run.smithi077.stdout:426 2023-07-24T05:51:07.677 INFO:teuthology.orchestra.run.smithi077.stdout:426.out 2023-07-24T05:51:07.677 INFO:teuthology.orchestra.run.smithi077.stdout:427 2023-07-24T05:51:07.678 INFO:teuthology.orchestra.run.smithi077.stdout:427.out 2023-07-24T05:51:07.678 INFO:teuthology.orchestra.run.smithi077.stdout:428 2023-07-24T05:51:07.678 INFO:teuthology.orchestra.run.smithi077.stdout:428.out 2023-07-24T05:51:07.678 INFO:teuthology.orchestra.run.smithi077.stdout:429 2023-07-24T05:51:07.678 INFO:teuthology.orchestra.run.smithi077.stdout:429.out 2023-07-24T05:51:07.678 INFO:teuthology.orchestra.run.smithi077.stdout:430 2023-07-24T05:51:07.678 INFO:teuthology.orchestra.run.smithi077.stdout:430.out 2023-07-24T05:51:07.678 INFO:teuthology.orchestra.run.smithi077.stdout:431 2023-07-24T05:51:07.679 INFO:teuthology.orchestra.run.smithi077.stdout:431.out 2023-07-24T05:51:07.679 INFO:teuthology.orchestra.run.smithi077.stdout:432 2023-07-24T05:51:07.679 INFO:teuthology.orchestra.run.smithi077.stdout:432.out 2023-07-24T05:51:07.679 INFO:teuthology.orchestra.run.smithi077.stdout:433 2023-07-24T05:51:07.679 INFO:teuthology.orchestra.run.smithi077.stdout:433.out 2023-07-24T05:51:07.679 INFO:teuthology.orchestra.run.smithi077.stdout:434 2023-07-24T05:51:07.679 INFO:teuthology.orchestra.run.smithi077.stdout:434.out 2023-07-24T05:51:07.679 INFO:teuthology.orchestra.run.smithi077.stdout:435 2023-07-24T05:51:07.680 INFO:teuthology.orchestra.run.smithi077.stdout:435.out 2023-07-24T05:51:07.680 INFO:teuthology.orchestra.run.smithi077.stdout:436 2023-07-24T05:51:07.680 INFO:teuthology.orchestra.run.smithi077.stdout:436.out 2023-07-24T05:51:07.680 INFO:teuthology.orchestra.run.smithi077.stdout:437 2023-07-24T05:51:07.680 INFO:teuthology.orchestra.run.smithi077.stdout:437.out 2023-07-24T05:51:07.680 INFO:teuthology.orchestra.run.smithi077.stdout:438 2023-07-24T05:51:07.680 INFO:teuthology.orchestra.run.smithi077.stdout:438.out 2023-07-24T05:51:07.680 INFO:teuthology.orchestra.run.smithi077.stdout:439 2023-07-24T05:51:07.681 INFO:teuthology.orchestra.run.smithi077.stdout:439.out 2023-07-24T05:51:07.681 INFO:teuthology.orchestra.run.smithi077.stdout:440 2023-07-24T05:51:07.681 INFO:teuthology.orchestra.run.smithi077.stdout:440.out 2023-07-24T05:51:07.681 INFO:teuthology.orchestra.run.smithi077.stdout:441 2023-07-24T05:51:07.681 INFO:teuthology.orchestra.run.smithi077.stdout:441.out 2023-07-24T05:51:07.681 INFO:teuthology.orchestra.run.smithi077.stdout:442 2023-07-24T05:51:07.681 INFO:teuthology.orchestra.run.smithi077.stdout:442.out 2023-07-24T05:51:07.681 INFO:teuthology.orchestra.run.smithi077.stdout:443 2023-07-24T05:51:07.682 INFO:teuthology.orchestra.run.smithi077.stdout:443.out 2023-07-24T05:51:07.682 INFO:teuthology.orchestra.run.smithi077.stdout:444 2023-07-24T05:51:07.682 INFO:teuthology.orchestra.run.smithi077.stdout:444.out 2023-07-24T05:51:07.682 INFO:teuthology.orchestra.run.smithi077.stdout:445 2023-07-24T05:51:07.682 INFO:teuthology.orchestra.run.smithi077.stdout:445.out 2023-07-24T05:51:07.682 INFO:teuthology.orchestra.run.smithi077.stdout:446 2023-07-24T05:51:07.682 INFO:teuthology.orchestra.run.smithi077.stdout:446.out 2023-07-24T05:51:07.682 INFO:teuthology.orchestra.run.smithi077.stdout:447 2023-07-24T05:51:07.683 INFO:teuthology.orchestra.run.smithi077.stdout:447.out 2023-07-24T05:51:07.683 INFO:teuthology.orchestra.run.smithi077.stdout:448 2023-07-24T05:51:07.683 INFO:teuthology.orchestra.run.smithi077.stdout:448.out 2023-07-24T05:51:07.683 INFO:teuthology.orchestra.run.smithi077.stdout:449 2023-07-24T05:51:07.683 INFO:teuthology.orchestra.run.smithi077.stdout:449.out 2023-07-24T05:51:07.683 INFO:teuthology.orchestra.run.smithi077.stdout:450 2023-07-24T05:51:07.683 INFO:teuthology.orchestra.run.smithi077.stdout:450.out 2023-07-24T05:51:07.683 INFO:teuthology.orchestra.run.smithi077.stdout:451 2023-07-24T05:51:07.684 INFO:teuthology.orchestra.run.smithi077.stdout:451.out 2023-07-24T05:51:07.684 INFO:teuthology.orchestra.run.smithi077.stdout:452 2023-07-24T05:51:07.684 INFO:teuthology.orchestra.run.smithi077.stdout:452.out 2023-07-24T05:51:07.684 INFO:teuthology.orchestra.run.smithi077.stdout:453 2023-07-24T05:51:07.684 INFO:teuthology.orchestra.run.smithi077.stdout:453.out 2023-07-24T05:51:07.684 INFO:teuthology.orchestra.run.smithi077.stdout:454 2023-07-24T05:51:07.684 INFO:teuthology.orchestra.run.smithi077.stdout:454.out 2023-07-24T05:51:07.684 INFO:teuthology.orchestra.run.smithi077.stdout:455 2023-07-24T05:51:07.685 INFO:teuthology.orchestra.run.smithi077.stdout:455.out 2023-07-24T05:51:07.685 INFO:teuthology.orchestra.run.smithi077.stdout:456 2023-07-24T05:51:07.685 INFO:teuthology.orchestra.run.smithi077.stdout:456.out 2023-07-24T05:51:07.685 INFO:teuthology.orchestra.run.smithi077.stdout:457 2023-07-24T05:51:07.685 INFO:teuthology.orchestra.run.smithi077.stdout:457.out 2023-07-24T05:51:07.685 INFO:teuthology.orchestra.run.smithi077.stdout:458 2023-07-24T05:51:07.685 INFO:teuthology.orchestra.run.smithi077.stdout:458.out 2023-07-24T05:51:07.685 INFO:teuthology.orchestra.run.smithi077.stdout:459 2023-07-24T05:51:07.686 INFO:teuthology.orchestra.run.smithi077.stdout:459.out 2023-07-24T05:51:07.686 INFO:teuthology.orchestra.run.smithi077.stdout:460 2023-07-24T05:51:07.686 INFO:teuthology.orchestra.run.smithi077.stdout:460.out 2023-07-24T05:51:07.686 INFO:teuthology.orchestra.run.smithi077.stdout:461 2023-07-24T05:51:07.686 INFO:teuthology.orchestra.run.smithi077.stdout:461.out 2023-07-24T05:51:07.686 INFO:teuthology.orchestra.run.smithi077.stdout:462 2023-07-24T05:51:07.686 INFO:teuthology.orchestra.run.smithi077.stdout:462.out 2023-07-24T05:51:07.686 INFO:teuthology.orchestra.run.smithi077.stdout:463 2023-07-24T05:51:07.687 INFO:teuthology.orchestra.run.smithi077.stdout:463.out 2023-07-24T05:51:07.687 INFO:teuthology.orchestra.run.smithi077.stdout:464 2023-07-24T05:51:07.687 INFO:teuthology.orchestra.run.smithi077.stdout:464.out 2023-07-24T05:51:07.687 INFO:teuthology.orchestra.run.smithi077.stdout:465 2023-07-24T05:51:07.687 INFO:teuthology.orchestra.run.smithi077.stdout:465.out 2023-07-24T05:51:07.687 INFO:teuthology.orchestra.run.smithi077.stdout:466 2023-07-24T05:51:07.687 INFO:teuthology.orchestra.run.smithi077.stdout:466.out 2023-07-24T05:51:07.687 INFO:teuthology.orchestra.run.smithi077.stdout:467 2023-07-24T05:51:07.688 INFO:teuthology.orchestra.run.smithi077.stdout:467.out 2023-07-24T05:51:07.688 INFO:teuthology.orchestra.run.smithi077.stdout:468 2023-07-24T05:51:07.688 INFO:teuthology.orchestra.run.smithi077.stdout:468.out 2023-07-24T05:51:07.688 INFO:teuthology.orchestra.run.smithi077.stdout:469 2023-07-24T05:51:07.688 INFO:teuthology.orchestra.run.smithi077.stdout:469.out 2023-07-24T05:51:07.688 INFO:teuthology.orchestra.run.smithi077.stdout:470 2023-07-24T05:51:07.688 INFO:teuthology.orchestra.run.smithi077.stdout:470.out 2023-07-24T05:51:07.688 INFO:teuthology.orchestra.run.smithi077.stdout:471 2023-07-24T05:51:07.689 INFO:teuthology.orchestra.run.smithi077.stdout:471.out 2023-07-24T05:51:07.689 INFO:teuthology.orchestra.run.smithi077.stdout:472 2023-07-24T05:51:07.689 INFO:teuthology.orchestra.run.smithi077.stdout:472.out 2023-07-24T05:51:07.689 INFO:teuthology.orchestra.run.smithi077.stdout:473 2023-07-24T05:51:07.689 INFO:teuthology.orchestra.run.smithi077.stdout:473.out 2023-07-24T05:51:07.689 INFO:teuthology.orchestra.run.smithi077.stdout:474 2023-07-24T05:51:07.689 INFO:teuthology.orchestra.run.smithi077.stdout:474.out 2023-07-24T05:51:07.689 INFO:teuthology.orchestra.run.smithi077.stdout:475 2023-07-24T05:51:07.689 INFO:teuthology.orchestra.run.smithi077.stdout:475.out 2023-07-24T05:51:07.690 INFO:teuthology.orchestra.run.smithi077.stdout:476 2023-07-24T05:51:07.690 INFO:teuthology.orchestra.run.smithi077.stdout:476.out 2023-07-24T05:51:07.690 INFO:teuthology.orchestra.run.smithi077.stdout:477 2023-07-24T05:51:07.690 INFO:teuthology.orchestra.run.smithi077.stdout:477.out 2023-07-24T05:51:07.690 INFO:teuthology.orchestra.run.smithi077.stdout:478 2023-07-24T05:51:07.690 INFO:teuthology.orchestra.run.smithi077.stdout:478.out 2023-07-24T05:51:07.690 INFO:teuthology.orchestra.run.smithi077.stdout:479 2023-07-24T05:51:07.690 INFO:teuthology.orchestra.run.smithi077.stdout:479.out 2023-07-24T05:51:07.691 INFO:teuthology.orchestra.run.smithi077.stdout:480 2023-07-24T05:51:07.691 INFO:teuthology.orchestra.run.smithi077.stdout:480.out 2023-07-24T05:51:07.691 INFO:teuthology.orchestra.run.smithi077.stdout:481 2023-07-24T05:51:07.691 INFO:teuthology.orchestra.run.smithi077.stdout:481.out 2023-07-24T05:51:07.691 INFO:teuthology.orchestra.run.smithi077.stdout:482 2023-07-24T05:51:07.691 INFO:teuthology.orchestra.run.smithi077.stdout:482.out 2023-07-24T05:51:07.691 INFO:teuthology.orchestra.run.smithi077.stdout:483 2023-07-24T05:51:07.691 INFO:teuthology.orchestra.run.smithi077.stdout:483.out 2023-07-24T05:51:07.692 INFO:teuthology.orchestra.run.smithi077.stdout:484 2023-07-24T05:51:07.692 INFO:teuthology.orchestra.run.smithi077.stdout:484.out 2023-07-24T05:51:07.692 INFO:teuthology.orchestra.run.smithi077.stdout:485 2023-07-24T05:51:07.692 INFO:teuthology.orchestra.run.smithi077.stdout:485.out 2023-07-24T05:51:07.692 INFO:teuthology.orchestra.run.smithi077.stdout:486 2023-07-24T05:51:07.692 INFO:teuthology.orchestra.run.smithi077.stdout:486.out 2023-07-24T05:51:07.692 INFO:teuthology.orchestra.run.smithi077.stdout:487 2023-07-24T05:51:07.692 INFO:teuthology.orchestra.run.smithi077.stdout:487.out 2023-07-24T05:51:07.693 INFO:teuthology.orchestra.run.smithi077.stdout:488 2023-07-24T05:51:07.693 INFO:teuthology.orchestra.run.smithi077.stdout:488.out 2023-07-24T05:51:07.693 INFO:teuthology.orchestra.run.smithi077.stdout:489 2023-07-24T05:51:07.693 INFO:teuthology.orchestra.run.smithi077.stdout:489.out 2023-07-24T05:51:07.693 INFO:teuthology.orchestra.run.smithi077.stdout:490 2023-07-24T05:51:07.693 INFO:teuthology.orchestra.run.smithi077.stdout:490.out 2023-07-24T05:51:07.693 INFO:teuthology.orchestra.run.smithi077.stdout:491 2023-07-24T05:51:07.693 INFO:teuthology.orchestra.run.smithi077.stdout:491.out 2023-07-24T05:51:07.694 INFO:teuthology.orchestra.run.smithi077.stdout:492 2023-07-24T05:51:07.694 INFO:teuthology.orchestra.run.smithi077.stdout:492.out 2023-07-24T05:51:07.694 INFO:teuthology.orchestra.run.smithi077.stdout:493 2023-07-24T05:51:07.694 INFO:teuthology.orchestra.run.smithi077.stdout:493.out 2023-07-24T05:51:07.694 INFO:teuthology.orchestra.run.smithi077.stdout:494 2023-07-24T05:51:07.694 INFO:teuthology.orchestra.run.smithi077.stdout:494.out 2023-07-24T05:51:07.694 INFO:teuthology.orchestra.run.smithi077.stdout:495 2023-07-24T05:51:07.694 INFO:teuthology.orchestra.run.smithi077.stdout:495.out 2023-07-24T05:51:07.695 INFO:teuthology.orchestra.run.smithi077.stdout:496 2023-07-24T05:51:07.695 INFO:teuthology.orchestra.run.smithi077.stdout:496.out 2023-07-24T05:51:07.695 INFO:teuthology.orchestra.run.smithi077.stdout:497 2023-07-24T05:51:07.695 INFO:teuthology.orchestra.run.smithi077.stdout:497.out 2023-07-24T05:51:07.695 INFO:teuthology.orchestra.run.smithi077.stdout:498 2023-07-24T05:51:07.695 INFO:teuthology.orchestra.run.smithi077.stdout:498.out 2023-07-24T05:51:07.695 INFO:teuthology.orchestra.run.smithi077.stdout:499 2023-07-24T05:51:07.695 INFO:teuthology.orchestra.run.smithi077.stdout:499.out 2023-07-24T05:51:07.696 INFO:teuthology.orchestra.run.smithi077.stdout:500 2023-07-24T05:51:07.696 INFO:teuthology.orchestra.run.smithi077.stdout:500.out 2023-07-24T05:51:07.696 INFO:teuthology.orchestra.run.smithi077.stdout:501 2023-07-24T05:51:07.696 INFO:teuthology.orchestra.run.smithi077.stdout:501.out 2023-07-24T05:51:07.696 INFO:teuthology.orchestra.run.smithi077.stdout:502 2023-07-24T05:51:07.696 INFO:teuthology.orchestra.run.smithi077.stdout:502.out 2023-07-24T05:51:07.696 INFO:teuthology.orchestra.run.smithi077.stdout:503 2023-07-24T05:51:07.696 INFO:teuthology.orchestra.run.smithi077.stdout:503.out 2023-07-24T05:51:07.697 INFO:teuthology.orchestra.run.smithi077.stdout:504 2023-07-24T05:51:07.697 INFO:teuthology.orchestra.run.smithi077.stdout:504.out 2023-07-24T05:51:07.697 INFO:teuthology.orchestra.run.smithi077.stdout:505 2023-07-24T05:51:07.697 INFO:teuthology.orchestra.run.smithi077.stdout:505.out 2023-07-24T05:51:07.697 INFO:teuthology.orchestra.run.smithi077.stdout:506 2023-07-24T05:51:07.697 INFO:teuthology.orchestra.run.smithi077.stdout:506.out 2023-07-24T05:51:07.697 INFO:teuthology.orchestra.run.smithi077.stdout:507 2023-07-24T05:51:07.697 INFO:teuthology.orchestra.run.smithi077.stdout:507.out 2023-07-24T05:51:07.698 INFO:teuthology.orchestra.run.smithi077.stdout:508 2023-07-24T05:51:07.698 INFO:teuthology.orchestra.run.smithi077.stdout:508.out 2023-07-24T05:51:07.698 INFO:teuthology.orchestra.run.smithi077.stdout:509 2023-07-24T05:51:07.698 INFO:teuthology.orchestra.run.smithi077.stdout:509.out 2023-07-24T05:51:07.698 INFO:teuthology.orchestra.run.smithi077.stdout:510 2023-07-24T05:51:07.698 INFO:teuthology.orchestra.run.smithi077.stdout:510.out 2023-07-24T05:51:07.698 INFO:teuthology.orchestra.run.smithi077.stdout:511 2023-07-24T05:51:07.698 INFO:teuthology.orchestra.run.smithi077.stdout:511.out 2023-07-24T05:51:07.699 INFO:teuthology.orchestra.run.smithi077.stdout:512 2023-07-24T05:51:07.699 INFO:teuthology.orchestra.run.smithi077.stdout:512.out 2023-07-24T05:51:07.699 INFO:teuthology.orchestra.run.smithi077.stdout:513 2023-07-24T05:51:07.699 INFO:teuthology.orchestra.run.smithi077.stdout:513.out 2023-07-24T05:51:07.699 INFO:teuthology.orchestra.run.smithi077.stdout:514 2023-07-24T05:51:07.699 INFO:teuthology.orchestra.run.smithi077.stdout:514.out 2023-07-24T05:51:07.699 INFO:teuthology.orchestra.run.smithi077.stdout:515 2023-07-24T05:51:07.699 INFO:teuthology.orchestra.run.smithi077.stdout:515.out 2023-07-24T05:51:07.700 INFO:teuthology.orchestra.run.smithi077.stdout:516 2023-07-24T05:51:07.700 INFO:teuthology.orchestra.run.smithi077.stdout:516.out 2023-07-24T05:51:07.700 INFO:teuthology.orchestra.run.smithi077.stdout:517 2023-07-24T05:51:07.700 INFO:teuthology.orchestra.run.smithi077.stdout:517.out 2023-07-24T05:51:07.700 INFO:teuthology.orchestra.run.smithi077.stdout:518 2023-07-24T05:51:07.700 INFO:teuthology.orchestra.run.smithi077.stdout:518.out 2023-07-24T05:51:07.700 INFO:teuthology.orchestra.run.smithi077.stdout:519 2023-07-24T05:51:07.700 INFO:teuthology.orchestra.run.smithi077.stdout:519.out 2023-07-24T05:51:07.701 INFO:teuthology.orchestra.run.smithi077.stdout:520 2023-07-24T05:51:07.701 INFO:teuthology.orchestra.run.smithi077.stdout:520.out 2023-07-24T05:51:07.701 INFO:teuthology.orchestra.run.smithi077.stdout:521 2023-07-24T05:51:07.701 INFO:teuthology.orchestra.run.smithi077.stdout:521.out 2023-07-24T05:51:07.701 INFO:teuthology.orchestra.run.smithi077.stdout:522 2023-07-24T05:51:07.701 INFO:teuthology.orchestra.run.smithi077.stdout:522.out 2023-07-24T05:51:07.701 INFO:teuthology.orchestra.run.smithi077.stdout:523 2023-07-24T05:51:07.701 INFO:teuthology.orchestra.run.smithi077.stdout:523.out 2023-07-24T05:51:07.702 INFO:teuthology.orchestra.run.smithi077.stdout:524 2023-07-24T05:51:07.702 INFO:teuthology.orchestra.run.smithi077.stdout:524.out 2023-07-24T05:51:07.702 INFO:teuthology.orchestra.run.smithi077.stdout:525 2023-07-24T05:51:07.702 INFO:teuthology.orchestra.run.smithi077.stdout:525.out 2023-07-24T05:51:07.702 INFO:teuthology.orchestra.run.smithi077.stdout:526 2023-07-24T05:51:07.702 INFO:teuthology.orchestra.run.smithi077.stdout:526.out 2023-07-24T05:51:07.702 INFO:teuthology.orchestra.run.smithi077.stdout:527 2023-07-24T05:51:07.702 INFO:teuthology.orchestra.run.smithi077.stdout:527.out 2023-07-24T05:51:07.703 INFO:teuthology.orchestra.run.smithi077.stdout:528 2023-07-24T05:51:07.703 INFO:teuthology.orchestra.run.smithi077.stdout:528.out 2023-07-24T05:51:07.703 INFO:teuthology.orchestra.run.smithi077.stdout:529 2023-07-24T05:51:07.703 INFO:teuthology.orchestra.run.smithi077.stdout:529.out 2023-07-24T05:51:07.703 INFO:teuthology.orchestra.run.smithi077.stdout:530 2023-07-24T05:51:07.703 INFO:teuthology.orchestra.run.smithi077.stdout:530.out 2023-07-24T05:51:07.703 INFO:teuthology.orchestra.run.smithi077.stdout:531 2023-07-24T05:51:07.703 INFO:teuthology.orchestra.run.smithi077.stdout:531.out 2023-07-24T05:51:07.703 INFO:teuthology.orchestra.run.smithi077.stdout:532 2023-07-24T05:51:07.704 INFO:teuthology.orchestra.run.smithi077.stdout:532.out 2023-07-24T05:51:07.704 INFO:teuthology.orchestra.run.smithi077.stdout:533 2023-07-24T05:51:07.704 INFO:teuthology.orchestra.run.smithi077.stdout:533.out 2023-07-24T05:51:07.704 INFO:teuthology.orchestra.run.smithi077.stdout:534 2023-07-24T05:51:07.704 INFO:teuthology.orchestra.run.smithi077.stdout:534.out 2023-07-24T05:51:07.704 INFO:teuthology.orchestra.run.smithi077.stdout:535 2023-07-24T05:51:07.704 INFO:teuthology.orchestra.run.smithi077.stdout:535.out 2023-07-24T05:51:07.704 INFO:teuthology.orchestra.run.smithi077.stdout:536 2023-07-24T05:51:07.705 INFO:teuthology.orchestra.run.smithi077.stdout:536.out 2023-07-24T05:51:07.705 INFO:teuthology.orchestra.run.smithi077.stdout:537 2023-07-24T05:51:07.705 INFO:teuthology.orchestra.run.smithi077.stdout:537.out 2023-07-24T05:51:07.705 INFO:teuthology.orchestra.run.smithi077.stdout:538 2023-07-24T05:51:07.705 INFO:teuthology.orchestra.run.smithi077.stdout:538.out 2023-07-24T05:51:07.705 INFO:teuthology.orchestra.run.smithi077.stdout:539 2023-07-24T05:51:07.705 INFO:teuthology.orchestra.run.smithi077.stdout:539.out 2023-07-24T05:51:07.705 INFO:teuthology.orchestra.run.smithi077.stdout:540 2023-07-24T05:51:07.706 INFO:teuthology.orchestra.run.smithi077.stdout:540.out 2023-07-24T05:51:07.706 INFO:teuthology.orchestra.run.smithi077.stdout:541 2023-07-24T05:51:07.706 INFO:teuthology.orchestra.run.smithi077.stdout:541.out 2023-07-24T05:51:07.706 INFO:teuthology.orchestra.run.smithi077.stdout:542 2023-07-24T05:51:07.706 INFO:teuthology.orchestra.run.smithi077.stdout:542.out 2023-07-24T05:51:07.706 INFO:teuthology.orchestra.run.smithi077.stdout:543 2023-07-24T05:51:07.706 INFO:teuthology.orchestra.run.smithi077.stdout:543.out 2023-07-24T05:51:07.706 INFO:teuthology.orchestra.run.smithi077.stdout:544 2023-07-24T05:51:07.707 INFO:teuthology.orchestra.run.smithi077.stdout:544.out 2023-07-24T05:51:07.707 INFO:teuthology.orchestra.run.smithi077.stdout:545 2023-07-24T05:51:07.707 INFO:teuthology.orchestra.run.smithi077.stdout:545.out 2023-07-24T05:51:07.707 INFO:teuthology.orchestra.run.smithi077.stdout:546 2023-07-24T05:51:07.707 INFO:teuthology.orchestra.run.smithi077.stdout:546.out 2023-07-24T05:51:07.707 INFO:teuthology.orchestra.run.smithi077.stdout:547 2023-07-24T05:51:07.707 INFO:teuthology.orchestra.run.smithi077.stdout:547.out 2023-07-24T05:51:07.707 INFO:teuthology.orchestra.run.smithi077.stdout:548 2023-07-24T05:51:07.708 INFO:teuthology.orchestra.run.smithi077.stdout:548.out 2023-07-24T05:51:07.708 INFO:teuthology.orchestra.run.smithi077.stdout:549 2023-07-24T05:51:07.708 INFO:teuthology.orchestra.run.smithi077.stdout:549.out 2023-07-24T05:51:07.708 INFO:teuthology.orchestra.run.smithi077.stdout:550 2023-07-24T05:51:07.708 INFO:teuthology.orchestra.run.smithi077.stdout:550.out 2023-07-24T05:51:07.708 INFO:teuthology.orchestra.run.smithi077.stdout:551 2023-07-24T05:51:07.708 INFO:teuthology.orchestra.run.smithi077.stdout:551.out 2023-07-24T05:51:07.708 INFO:teuthology.orchestra.run.smithi077.stdout:552 2023-07-24T05:51:07.709 INFO:teuthology.orchestra.run.smithi077.stdout:552.out 2023-07-24T05:51:07.709 INFO:teuthology.orchestra.run.smithi077.stdout:553 2023-07-24T05:51:07.709 INFO:teuthology.orchestra.run.smithi077.stdout:553.out 2023-07-24T05:51:07.709 INFO:teuthology.orchestra.run.smithi077.stdout:554 2023-07-24T05:51:07.709 INFO:teuthology.orchestra.run.smithi077.stdout:554.out 2023-07-24T05:51:07.709 INFO:teuthology.orchestra.run.smithi077.stdout:555 2023-07-24T05:51:07.709 INFO:teuthology.orchestra.run.smithi077.stdout:555.out 2023-07-24T05:51:07.709 INFO:teuthology.orchestra.run.smithi077.stdout:556 2023-07-24T05:51:07.710 INFO:teuthology.orchestra.run.smithi077.stdout:556.out 2023-07-24T05:51:07.710 INFO:teuthology.orchestra.run.smithi077.stdout:557 2023-07-24T05:51:07.710 INFO:teuthology.orchestra.run.smithi077.stdout:557.out 2023-07-24T05:51:07.710 INFO:teuthology.orchestra.run.smithi077.stdout:558 2023-07-24T05:51:07.710 INFO:teuthology.orchestra.run.smithi077.stdout:558.out 2023-07-24T05:51:07.710 INFO:teuthology.orchestra.run.smithi077.stdout:559 2023-07-24T05:51:07.710 INFO:teuthology.orchestra.run.smithi077.stdout:559.out 2023-07-24T05:51:07.710 INFO:teuthology.orchestra.run.smithi077.stdout:560 2023-07-24T05:51:07.711 INFO:teuthology.orchestra.run.smithi077.stdout:560.out 2023-07-24T05:51:07.711 INFO:teuthology.orchestra.run.smithi077.stdout:561 2023-07-24T05:51:07.711 INFO:teuthology.orchestra.run.smithi077.stdout:561.out 2023-07-24T05:51:07.711 INFO:teuthology.orchestra.run.smithi077.stdout:562 2023-07-24T05:51:07.711 INFO:teuthology.orchestra.run.smithi077.stdout:562.out 2023-07-24T05:51:07.711 INFO:teuthology.orchestra.run.smithi077.stdout:563 2023-07-24T05:51:07.711 INFO:teuthology.orchestra.run.smithi077.stdout:563.out 2023-07-24T05:51:07.711 INFO:teuthology.orchestra.run.smithi077.stdout:564 2023-07-24T05:51:07.712 INFO:teuthology.orchestra.run.smithi077.stdout:564.out 2023-07-24T05:51:07.712 INFO:teuthology.orchestra.run.smithi077.stdout:565 2023-07-24T05:51:07.712 INFO:teuthology.orchestra.run.smithi077.stdout:565.out 2023-07-24T05:51:07.712 INFO:teuthology.orchestra.run.smithi077.stdout:566 2023-07-24T05:51:07.712 INFO:teuthology.orchestra.run.smithi077.stdout:566.out 2023-07-24T05:51:07.712 INFO:teuthology.orchestra.run.smithi077.stdout:567 2023-07-24T05:51:07.712 INFO:teuthology.orchestra.run.smithi077.stdout:567.out 2023-07-24T05:51:07.712 INFO:teuthology.orchestra.run.smithi077.stdout:568 2023-07-24T05:51:07.713 INFO:teuthology.orchestra.run.smithi077.stdout:568.out 2023-07-24T05:51:07.713 INFO:teuthology.orchestra.run.smithi077.stdout:569 2023-07-24T05:51:07.713 INFO:teuthology.orchestra.run.smithi077.stdout:569.out 2023-07-24T05:51:07.713 INFO:teuthology.orchestra.run.smithi077.stdout:570 2023-07-24T05:51:07.713 INFO:teuthology.orchestra.run.smithi077.stdout:570.out 2023-07-24T05:51:07.713 INFO:teuthology.orchestra.run.smithi077.stdout:571 2023-07-24T05:51:07.713 INFO:teuthology.orchestra.run.smithi077.stdout:571.out 2023-07-24T05:51:07.713 INFO:teuthology.orchestra.run.smithi077.stdout:572 2023-07-24T05:51:07.714 INFO:teuthology.orchestra.run.smithi077.stdout:572.out 2023-07-24T05:51:07.714 INFO:teuthology.orchestra.run.smithi077.stdout:573 2023-07-24T05:51:07.714 INFO:teuthology.orchestra.run.smithi077.stdout:573.out 2023-07-24T05:51:07.714 INFO:teuthology.orchestra.run.smithi077.stdout:574 2023-07-24T05:51:07.714 INFO:teuthology.orchestra.run.smithi077.stdout:574.out 2023-07-24T05:51:07.714 INFO:teuthology.orchestra.run.smithi077.stdout:575 2023-07-24T05:51:07.714 INFO:teuthology.orchestra.run.smithi077.stdout:575.out 2023-07-24T05:51:07.714 INFO:teuthology.orchestra.run.smithi077.stdout:576 2023-07-24T05:51:07.715 INFO:teuthology.orchestra.run.smithi077.stdout:576.out 2023-07-24T05:51:07.715 INFO:teuthology.orchestra.run.smithi077.stdout:577 2023-07-24T05:51:07.715 INFO:teuthology.orchestra.run.smithi077.stdout:577.out 2023-07-24T05:51:07.715 INFO:teuthology.orchestra.run.smithi077.stdout:578 2023-07-24T05:51:07.715 INFO:teuthology.orchestra.run.smithi077.stdout:578.out 2023-07-24T05:51:07.715 INFO:teuthology.orchestra.run.smithi077.stdout:579 2023-07-24T05:51:07.715 INFO:teuthology.orchestra.run.smithi077.stdout:579.out 2023-07-24T05:51:07.715 INFO:teuthology.orchestra.run.smithi077.stdout:580 2023-07-24T05:51:07.715 INFO:teuthology.orchestra.run.smithi077.stdout:580.out 2023-07-24T05:51:07.716 INFO:teuthology.orchestra.run.smithi077.stdout:581 2023-07-24T05:51:07.716 INFO:teuthology.orchestra.run.smithi077.stdout:581.out 2023-07-24T05:51:07.716 INFO:teuthology.orchestra.run.smithi077.stdout:582 2023-07-24T05:51:07.716 INFO:teuthology.orchestra.run.smithi077.stdout:582.out 2023-07-24T05:51:07.716 INFO:teuthology.orchestra.run.smithi077.stdout:583 2023-07-24T05:51:07.716 INFO:teuthology.orchestra.run.smithi077.stdout:583.out 2023-07-24T05:51:07.716 INFO:teuthology.orchestra.run.smithi077.stdout:584 2023-07-24T05:51:07.716 INFO:teuthology.orchestra.run.smithi077.stdout:584.out 2023-07-24T05:51:07.717 INFO:teuthology.orchestra.run.smithi077.stdout:585 2023-07-24T05:51:07.717 INFO:teuthology.orchestra.run.smithi077.stdout:585.out 2023-07-24T05:51:07.717 INFO:teuthology.orchestra.run.smithi077.stdout:586 2023-07-24T05:51:07.717 INFO:teuthology.orchestra.run.smithi077.stdout:586.out 2023-07-24T05:51:07.717 INFO:teuthology.orchestra.run.smithi077.stdout:587 2023-07-24T05:51:07.717 INFO:teuthology.orchestra.run.smithi077.stdout:587.out 2023-07-24T05:51:07.717 INFO:teuthology.orchestra.run.smithi077.stdout:588 2023-07-24T05:51:07.717 INFO:teuthology.orchestra.run.smithi077.stdout:588.out 2023-07-24T05:51:07.718 INFO:teuthology.orchestra.run.smithi077.stdout:589 2023-07-24T05:51:07.718 INFO:teuthology.orchestra.run.smithi077.stdout:589.out 2023-07-24T05:51:07.718 INFO:teuthology.orchestra.run.smithi077.stdout:590 2023-07-24T05:51:07.718 INFO:teuthology.orchestra.run.smithi077.stdout:590.out 2023-07-24T05:51:07.718 INFO:teuthology.orchestra.run.smithi077.stdout:591 2023-07-24T05:51:07.718 INFO:teuthology.orchestra.run.smithi077.stdout:591.out 2023-07-24T05:51:07.718 INFO:teuthology.orchestra.run.smithi077.stdout:592 2023-07-24T05:51:07.718 INFO:teuthology.orchestra.run.smithi077.stdout:592.out 2023-07-24T05:51:07.719 INFO:teuthology.orchestra.run.smithi077.stdout:593 2023-07-24T05:51:07.719 INFO:teuthology.orchestra.run.smithi077.stdout:593.out 2023-07-24T05:51:07.719 INFO:teuthology.orchestra.run.smithi077.stdout:594 2023-07-24T05:51:07.719 INFO:teuthology.orchestra.run.smithi077.stdout:594.out 2023-07-24T05:51:07.719 INFO:teuthology.orchestra.run.smithi077.stdout:595 2023-07-24T05:51:07.719 INFO:teuthology.orchestra.run.smithi077.stdout:595.out 2023-07-24T05:51:07.719 INFO:teuthology.orchestra.run.smithi077.stdout:596 2023-07-24T05:51:07.719 INFO:teuthology.orchestra.run.smithi077.stdout:596.out 2023-07-24T05:51:07.720 INFO:teuthology.orchestra.run.smithi077.stdout:597 2023-07-24T05:51:07.720 INFO:teuthology.orchestra.run.smithi077.stdout:597.out 2023-07-24T05:51:07.720 INFO:teuthology.orchestra.run.smithi077.stdout:598 2023-07-24T05:51:07.720 INFO:teuthology.orchestra.run.smithi077.stdout:598.out 2023-07-24T05:51:07.720 INFO:teuthology.orchestra.run.smithi077.stdout:599 2023-07-24T05:51:07.720 INFO:teuthology.orchestra.run.smithi077.stdout:599.out 2023-07-24T05:51:07.720 INFO:teuthology.orchestra.run.smithi077.stdout:600 2023-07-24T05:51:07.720 INFO:teuthology.orchestra.run.smithi077.stdout:600.out 2023-07-24T05:51:07.721 INFO:teuthology.orchestra.run.smithi077.stdout:601 2023-07-24T05:51:07.721 INFO:teuthology.orchestra.run.smithi077.stdout:601.out 2023-07-24T05:51:07.721 INFO:teuthology.orchestra.run.smithi077.stdout:602 2023-07-24T05:51:07.721 INFO:teuthology.orchestra.run.smithi077.stdout:602.out 2023-07-24T05:51:07.721 INFO:teuthology.orchestra.run.smithi077.stdout:603 2023-07-24T05:51:07.721 INFO:teuthology.orchestra.run.smithi077.stdout:603.out 2023-07-24T05:51:07.721 INFO:teuthology.orchestra.run.smithi077.stdout:604 2023-07-24T05:51:07.721 INFO:teuthology.orchestra.run.smithi077.stdout:604.out 2023-07-24T05:51:07.722 INFO:teuthology.orchestra.run.smithi077.stdout:605 2023-07-24T05:51:07.722 INFO:teuthology.orchestra.run.smithi077.stdout:605.out 2023-07-24T05:51:07.722 INFO:teuthology.orchestra.run.smithi077.stdout:606 2023-07-24T05:51:07.722 INFO:teuthology.orchestra.run.smithi077.stdout:606.out 2023-07-24T05:51:07.722 INFO:teuthology.orchestra.run.smithi077.stdout:607 2023-07-24T05:51:07.722 INFO:teuthology.orchestra.run.smithi077.stdout:607.out 2023-07-24T05:51:07.722 INFO:teuthology.orchestra.run.smithi077.stdout:608 2023-07-24T05:51:07.722 INFO:teuthology.orchestra.run.smithi077.stdout:608.out 2023-07-24T05:51:07.723 INFO:teuthology.orchestra.run.smithi077.stdout:609 2023-07-24T05:51:07.723 INFO:teuthology.orchestra.run.smithi077.stdout:609.out 2023-07-24T05:51:07.723 INFO:teuthology.orchestra.run.smithi077.stdout:610 2023-07-24T05:51:07.723 INFO:teuthology.orchestra.run.smithi077.stdout:610.out 2023-07-24T05:51:07.723 INFO:teuthology.orchestra.run.smithi077.stdout:611 2023-07-24T05:51:07.723 INFO:teuthology.orchestra.run.smithi077.stdout:611.out 2023-07-24T05:51:07.723 INFO:teuthology.orchestra.run.smithi077.stdout:612 2023-07-24T05:51:07.723 INFO:teuthology.orchestra.run.smithi077.stdout:612.out 2023-07-24T05:51:07.724 INFO:teuthology.orchestra.run.smithi077.stdout:613 2023-07-24T05:51:07.724 INFO:teuthology.orchestra.run.smithi077.stdout:613.out 2023-07-24T05:51:07.724 INFO:teuthology.orchestra.run.smithi077.stdout:614 2023-07-24T05:51:07.724 INFO:teuthology.orchestra.run.smithi077.stdout:614.out 2023-07-24T05:51:07.724 INFO:teuthology.orchestra.run.smithi077.stdout:615 2023-07-24T05:51:07.724 INFO:teuthology.orchestra.run.smithi077.stdout:615.out 2023-07-24T05:51:07.724 INFO:teuthology.orchestra.run.smithi077.stdout:616 2023-07-24T05:51:07.724 INFO:teuthology.orchestra.run.smithi077.stdout:616.out 2023-07-24T05:51:07.725 INFO:teuthology.orchestra.run.smithi077.stdout:617 2023-07-24T05:51:07.725 INFO:teuthology.orchestra.run.smithi077.stdout:617.out 2023-07-24T05:51:07.725 INFO:teuthology.orchestra.run.smithi077.stdout:618 2023-07-24T05:51:07.725 INFO:teuthology.orchestra.run.smithi077.stdout:618.out 2023-07-24T05:51:07.725 INFO:teuthology.orchestra.run.smithi077.stdout:619 2023-07-24T05:51:07.725 INFO:teuthology.orchestra.run.smithi077.stdout:619.out 2023-07-24T05:51:07.725 INFO:teuthology.orchestra.run.smithi077.stdout:620 2023-07-24T05:51:07.725 INFO:teuthology.orchestra.run.smithi077.stdout:620.out 2023-07-24T05:51:07.726 INFO:teuthology.orchestra.run.smithi077.stdout:621 2023-07-24T05:51:07.726 INFO:teuthology.orchestra.run.smithi077.stdout:621.out 2023-07-24T05:51:07.726 INFO:teuthology.orchestra.run.smithi077.stdout:622 2023-07-24T05:51:07.726 INFO:teuthology.orchestra.run.smithi077.stdout:622.out 2023-07-24T05:51:07.726 INFO:teuthology.orchestra.run.smithi077.stdout:623 2023-07-24T05:51:07.726 INFO:teuthology.orchestra.run.smithi077.stdout:623.out 2023-07-24T05:51:07.726 INFO:teuthology.orchestra.run.smithi077.stdout:624 2023-07-24T05:51:07.726 INFO:teuthology.orchestra.run.smithi077.stdout:624.out 2023-07-24T05:51:07.727 INFO:teuthology.orchestra.run.smithi077.stdout:625 2023-07-24T05:51:07.727 INFO:teuthology.orchestra.run.smithi077.stdout:625.out 2023-07-24T05:51:07.727 INFO:teuthology.orchestra.run.smithi077.stdout:626 2023-07-24T05:51:07.727 INFO:teuthology.orchestra.run.smithi077.stdout:626.out 2023-07-24T05:51:07.727 INFO:teuthology.orchestra.run.smithi077.stdout:627 2023-07-24T05:51:07.727 INFO:teuthology.orchestra.run.smithi077.stdout:627.out 2023-07-24T05:51:07.727 INFO:teuthology.orchestra.run.smithi077.stdout:628 2023-07-24T05:51:07.727 INFO:teuthology.orchestra.run.smithi077.stdout:628.out 2023-07-24T05:51:07.728 INFO:teuthology.orchestra.run.smithi077.stdout:629 2023-07-24T05:51:07.728 INFO:teuthology.orchestra.run.smithi077.stdout:629.out 2023-07-24T05:51:07.728 INFO:teuthology.orchestra.run.smithi077.stdout:630 2023-07-24T05:51:07.728 INFO:teuthology.orchestra.run.smithi077.stdout:630.out 2023-07-24T05:51:07.728 INFO:teuthology.orchestra.run.smithi077.stdout:631 2023-07-24T05:51:07.728 INFO:teuthology.orchestra.run.smithi077.stdout:631.out 2023-07-24T05:51:07.728 INFO:teuthology.orchestra.run.smithi077.stdout:632 2023-07-24T05:51:07.728 INFO:teuthology.orchestra.run.smithi077.stdout:632.out 2023-07-24T05:51:07.729 INFO:teuthology.orchestra.run.smithi077.stdout:633 2023-07-24T05:51:07.729 INFO:teuthology.orchestra.run.smithi077.stdout:633.out 2023-07-24T05:51:07.729 INFO:teuthology.orchestra.run.smithi077.stdout:634 2023-07-24T05:51:07.729 INFO:teuthology.orchestra.run.smithi077.stdout:634.out 2023-07-24T05:51:07.729 INFO:teuthology.orchestra.run.smithi077.stdout:635 2023-07-24T05:51:07.729 INFO:teuthology.orchestra.run.smithi077.stdout:635.out 2023-07-24T05:51:07.729 INFO:teuthology.orchestra.run.smithi077.stdout:636 2023-07-24T05:51:07.729 INFO:teuthology.orchestra.run.smithi077.stdout:636.out 2023-07-24T05:51:07.729 INFO:teuthology.orchestra.run.smithi077.stdout:637 2023-07-24T05:51:07.730 INFO:teuthology.orchestra.run.smithi077.stdout:637.out 2023-07-24T05:51:07.730 INFO:teuthology.orchestra.run.smithi077.stdout:638 2023-07-24T05:51:07.730 INFO:teuthology.orchestra.run.smithi077.stdout:638.out 2023-07-24T05:51:07.730 INFO:teuthology.orchestra.run.smithi077.stdout:639 2023-07-24T05:51:07.730 INFO:teuthology.orchestra.run.smithi077.stdout:639.out 2023-07-24T05:51:07.730 INFO:teuthology.orchestra.run.smithi077.stdout:640 2023-07-24T05:51:07.730 INFO:teuthology.orchestra.run.smithi077.stdout:640.out 2023-07-24T05:51:07.730 INFO:teuthology.orchestra.run.smithi077.stdout:641 2023-07-24T05:51:07.731 INFO:teuthology.orchestra.run.smithi077.stdout:641.out 2023-07-24T05:51:07.731 INFO:teuthology.orchestra.run.smithi077.stdout:642 2023-07-24T05:51:07.731 INFO:teuthology.orchestra.run.smithi077.stdout:642.out 2023-07-24T05:51:07.731 INFO:teuthology.orchestra.run.smithi077.stdout:643 2023-07-24T05:51:07.731 INFO:teuthology.orchestra.run.smithi077.stdout:643.out 2023-07-24T05:51:07.731 INFO:teuthology.orchestra.run.smithi077.stdout:644 2023-07-24T05:51:07.732 INFO:teuthology.orchestra.run.smithi077.stdout:644.out 2023-07-24T05:51:07.732 INFO:teuthology.orchestra.run.smithi077.stdout:645 2023-07-24T05:51:07.732 INFO:teuthology.orchestra.run.smithi077.stdout:645.out 2023-07-24T05:51:07.732 INFO:teuthology.orchestra.run.smithi077.stdout:646 2023-07-24T05:51:07.732 INFO:teuthology.orchestra.run.smithi077.stdout:646.out 2023-07-24T05:51:07.732 INFO:teuthology.orchestra.run.smithi077.stdout:647 2023-07-24T05:51:07.732 INFO:teuthology.orchestra.run.smithi077.stdout:647.out 2023-07-24T05:51:07.732 INFO:teuthology.orchestra.run.smithi077.stdout:648 2023-07-24T05:51:07.733 INFO:teuthology.orchestra.run.smithi077.stdout:648.out 2023-07-24T05:51:07.733 INFO:teuthology.orchestra.run.smithi077.stdout:649 2023-07-24T05:51:07.733 INFO:teuthology.orchestra.run.smithi077.stdout:649.out 2023-07-24T05:51:07.733 INFO:teuthology.orchestra.run.smithi077.stdout:650 2023-07-24T05:51:07.733 INFO:teuthology.orchestra.run.smithi077.stdout:650.out 2023-07-24T05:51:07.733 INFO:teuthology.orchestra.run.smithi077.stdout:651 2023-07-24T05:51:07.733 INFO:teuthology.orchestra.run.smithi077.stdout:651.out 2023-07-24T05:51:07.733 INFO:teuthology.orchestra.run.smithi077.stdout:652 2023-07-24T05:51:07.734 INFO:teuthology.orchestra.run.smithi077.stdout:652.out 2023-07-24T05:51:07.734 INFO:teuthology.orchestra.run.smithi077.stdout:653 2023-07-24T05:51:07.734 INFO:teuthology.orchestra.run.smithi077.stdout:653.out 2023-07-24T05:51:07.734 INFO:teuthology.orchestra.run.smithi077.stdout:654 2023-07-24T05:51:07.734 INFO:teuthology.orchestra.run.smithi077.stdout:654.out 2023-07-24T05:51:07.734 INFO:teuthology.orchestra.run.smithi077.stdout:655 2023-07-24T05:51:07.734 INFO:teuthology.orchestra.run.smithi077.stdout:655.out 2023-07-24T05:51:07.734 INFO:teuthology.orchestra.run.smithi077.stdout:656 2023-07-24T05:51:07.735 INFO:teuthology.orchestra.run.smithi077.stdout:656.out 2023-07-24T05:51:07.735 INFO:teuthology.orchestra.run.smithi077.stdout:657 2023-07-24T05:51:07.735 INFO:teuthology.orchestra.run.smithi077.stdout:657.out 2023-07-24T05:51:07.735 INFO:teuthology.orchestra.run.smithi077.stdout:658 2023-07-24T05:51:07.735 INFO:teuthology.orchestra.run.smithi077.stdout:658.out 2023-07-24T05:51:07.735 INFO:teuthology.orchestra.run.smithi077.stdout:659 2023-07-24T05:51:07.735 INFO:teuthology.orchestra.run.smithi077.stdout:659.out 2023-07-24T05:51:07.735 INFO:teuthology.orchestra.run.smithi077.stdout:660 2023-07-24T05:51:07.736 INFO:teuthology.orchestra.run.smithi077.stdout:660.out 2023-07-24T05:51:07.736 INFO:teuthology.orchestra.run.smithi077.stdout:661 2023-07-24T05:51:07.736 INFO:teuthology.orchestra.run.smithi077.stdout:661.out 2023-07-24T05:51:07.736 INFO:teuthology.orchestra.run.smithi077.stdout:662 2023-07-24T05:51:07.736 INFO:teuthology.orchestra.run.smithi077.stdout:662.out 2023-07-24T05:51:07.736 INFO:teuthology.orchestra.run.smithi077.stdout:663 2023-07-24T05:51:07.736 INFO:teuthology.orchestra.run.smithi077.stdout:663.out 2023-07-24T05:51:07.736 INFO:teuthology.orchestra.run.smithi077.stdout:664 2023-07-24T05:51:07.737 INFO:teuthology.orchestra.run.smithi077.stdout:664.out 2023-07-24T05:51:07.737 INFO:teuthology.orchestra.run.smithi077.stdout:665 2023-07-24T05:51:07.737 INFO:teuthology.orchestra.run.smithi077.stdout:665.out 2023-07-24T05:51:07.737 INFO:teuthology.orchestra.run.smithi077.stdout:666 2023-07-24T05:51:07.737 INFO:teuthology.orchestra.run.smithi077.stdout:666.out 2023-07-24T05:51:07.737 INFO:teuthology.orchestra.run.smithi077.stdout:667 2023-07-24T05:51:07.737 INFO:teuthology.orchestra.run.smithi077.stdout:667.out 2023-07-24T05:51:07.737 INFO:teuthology.orchestra.run.smithi077.stdout:668 2023-07-24T05:51:07.737 INFO:teuthology.orchestra.run.smithi077.stdout:668.out 2023-07-24T05:51:07.738 INFO:teuthology.orchestra.run.smithi077.stdout:669 2023-07-24T05:51:07.738 INFO:teuthology.orchestra.run.smithi077.stdout:669.out 2023-07-24T05:51:07.738 INFO:teuthology.orchestra.run.smithi077.stdout:670 2023-07-24T05:51:07.738 INFO:teuthology.orchestra.run.smithi077.stdout:670.out 2023-07-24T05:51:07.738 INFO:teuthology.orchestra.run.smithi077.stdout:671 2023-07-24T05:51:07.738 INFO:teuthology.orchestra.run.smithi077.stdout:671.out 2023-07-24T05:51:07.738 INFO:teuthology.orchestra.run.smithi077.stdout:672 2023-07-24T05:51:07.738 INFO:teuthology.orchestra.run.smithi077.stdout:672.out 2023-07-24T05:51:07.739 INFO:teuthology.orchestra.run.smithi077.stdout:673 2023-07-24T05:51:07.739 INFO:teuthology.orchestra.run.smithi077.stdout:673.out 2023-07-24T05:51:07.739 INFO:teuthology.orchestra.run.smithi077.stdout:674 2023-07-24T05:51:07.739 INFO:teuthology.orchestra.run.smithi077.stdout:674.out 2023-07-24T05:51:07.739 INFO:teuthology.orchestra.run.smithi077.stdout:675 2023-07-24T05:51:07.739 INFO:teuthology.orchestra.run.smithi077.stdout:675.out 2023-07-24T05:51:07.739 INFO:teuthology.orchestra.run.smithi077.stdout:676 2023-07-24T05:51:07.739 INFO:teuthology.orchestra.run.smithi077.stdout:676.out 2023-07-24T05:51:07.740 INFO:teuthology.orchestra.run.smithi077.stdout:677 2023-07-24T05:51:07.740 INFO:teuthology.orchestra.run.smithi077.stdout:677.out 2023-07-24T05:51:07.740 INFO:teuthology.orchestra.run.smithi077.stdout:678 2023-07-24T05:51:07.740 INFO:teuthology.orchestra.run.smithi077.stdout:678.out 2023-07-24T05:51:07.740 INFO:teuthology.orchestra.run.smithi077.stdout:679 2023-07-24T05:51:07.740 INFO:teuthology.orchestra.run.smithi077.stdout:679.out 2023-07-24T05:51:07.740 INFO:teuthology.orchestra.run.smithi077.stdout:680 2023-07-24T05:51:07.740 INFO:teuthology.orchestra.run.smithi077.stdout:680.out 2023-07-24T05:51:07.741 INFO:teuthology.orchestra.run.smithi077.stdout:681 2023-07-24T05:51:07.741 INFO:teuthology.orchestra.run.smithi077.stdout:681.out 2023-07-24T05:51:07.741 INFO:teuthology.orchestra.run.smithi077.stdout:682 2023-07-24T05:51:07.741 INFO:teuthology.orchestra.run.smithi077.stdout:682.out 2023-07-24T05:51:07.741 INFO:teuthology.orchestra.run.smithi077.stdout:683 2023-07-24T05:51:07.741 INFO:teuthology.orchestra.run.smithi077.stdout:683.out 2023-07-24T05:51:07.741 INFO:teuthology.orchestra.run.smithi077.stdout:684 2023-07-24T05:51:07.741 INFO:teuthology.orchestra.run.smithi077.stdout:684.out 2023-07-24T05:51:07.742 INFO:teuthology.orchestra.run.smithi077.stdout:685 2023-07-24T05:51:07.742 INFO:teuthology.orchestra.run.smithi077.stdout:685.out 2023-07-24T05:51:07.742 INFO:teuthology.orchestra.run.smithi077.stdout:686 2023-07-24T05:51:07.742 INFO:teuthology.orchestra.run.smithi077.stdout:686.out 2023-07-24T05:51:07.742 INFO:teuthology.orchestra.run.smithi077.stdout:687 2023-07-24T05:51:07.742 INFO:teuthology.orchestra.run.smithi077.stdout:687.out 2023-07-24T05:51:07.742 INFO:teuthology.orchestra.run.smithi077.stdout:688 2023-07-24T05:51:07.742 INFO:teuthology.orchestra.run.smithi077.stdout:688.out 2023-07-24T05:51:07.743 INFO:teuthology.orchestra.run.smithi077.stdout:689 2023-07-24T05:51:07.743 INFO:teuthology.orchestra.run.smithi077.stdout:689.out 2023-07-24T05:51:07.743 INFO:teuthology.orchestra.run.smithi077.stdout:690 2023-07-24T05:51:07.743 INFO:teuthology.orchestra.run.smithi077.stdout:690.out 2023-07-24T05:51:07.743 INFO:teuthology.orchestra.run.smithi077.stdout:691 2023-07-24T05:51:07.743 INFO:teuthology.orchestra.run.smithi077.stdout:691.out 2023-07-24T05:51:07.743 INFO:teuthology.orchestra.run.smithi077.stdout:692 2023-07-24T05:51:07.743 INFO:teuthology.orchestra.run.smithi077.stdout:692.out 2023-07-24T05:51:07.744 INFO:teuthology.orchestra.run.smithi077.stdout:693 2023-07-24T05:51:07.744 INFO:teuthology.orchestra.run.smithi077.stdout:693.out 2023-07-24T05:51:07.744 INFO:teuthology.orchestra.run.smithi077.stdout:694 2023-07-24T05:51:07.744 INFO:teuthology.orchestra.run.smithi077.stdout:694.out 2023-07-24T05:51:07.744 INFO:teuthology.orchestra.run.smithi077.stdout:695 2023-07-24T05:51:07.744 INFO:teuthology.orchestra.run.smithi077.stdout:695.out 2023-07-24T05:51:07.744 INFO:teuthology.orchestra.run.smithi077.stdout:696 2023-07-24T05:51:07.744 INFO:teuthology.orchestra.run.smithi077.stdout:696.out 2023-07-24T05:51:07.745 INFO:teuthology.orchestra.run.smithi077.stdout:697 2023-07-24T05:51:07.745 INFO:teuthology.orchestra.run.smithi077.stdout:697.out 2023-07-24T05:51:07.745 INFO:teuthology.orchestra.run.smithi077.stdout:698 2023-07-24T05:51:07.745 INFO:teuthology.orchestra.run.smithi077.stdout:698.out 2023-07-24T05:51:07.745 INFO:teuthology.orchestra.run.smithi077.stdout:699 2023-07-24T05:51:07.745 INFO:teuthology.orchestra.run.smithi077.stdout:699.out 2023-07-24T05:51:07.745 INFO:teuthology.orchestra.run.smithi077.stdout:700 2023-07-24T05:51:07.745 INFO:teuthology.orchestra.run.smithi077.stdout:700.out 2023-07-24T05:51:07.746 INFO:teuthology.orchestra.run.smithi077.stdout:701 2023-07-24T05:51:07.746 INFO:teuthology.orchestra.run.smithi077.stdout:701.out 2023-07-24T05:51:07.746 INFO:teuthology.orchestra.run.smithi077.stdout:702 2023-07-24T05:51:07.746 INFO:teuthology.orchestra.run.smithi077.stdout:702.out 2023-07-24T05:51:07.746 INFO:teuthology.orchestra.run.smithi077.stdout:703 2023-07-24T05:51:07.746 INFO:teuthology.orchestra.run.smithi077.stdout:703.out 2023-07-24T05:51:07.746 INFO:teuthology.orchestra.run.smithi077.stdout:704 2023-07-24T05:51:07.746 INFO:teuthology.orchestra.run.smithi077.stdout:704.out 2023-07-24T05:51:07.747 INFO:teuthology.orchestra.run.smithi077.stdout:705 2023-07-24T05:51:07.747 INFO:teuthology.orchestra.run.smithi077.stdout:705.out 2023-07-24T05:51:07.747 INFO:teuthology.orchestra.run.smithi077.stdout:706 2023-07-24T05:51:07.747 INFO:teuthology.orchestra.run.smithi077.stdout:706.out 2023-07-24T05:51:07.747 INFO:teuthology.orchestra.run.smithi077.stdout:707 2023-07-24T05:51:07.747 INFO:teuthology.orchestra.run.smithi077.stdout:707.out 2023-07-24T05:51:07.747 INFO:teuthology.orchestra.run.smithi077.stdout:708 2023-07-24T05:51:07.747 INFO:teuthology.orchestra.run.smithi077.stdout:708.out 2023-07-24T05:51:07.748 INFO:teuthology.orchestra.run.smithi077.stdout:709 2023-07-24T05:51:07.748 INFO:teuthology.orchestra.run.smithi077.stdout:709.out 2023-07-24T05:51:07.748 INFO:teuthology.orchestra.run.smithi077.stdout:710 2023-07-24T05:51:07.748 INFO:teuthology.orchestra.run.smithi077.stdout:710.out 2023-07-24T05:51:07.748 INFO:teuthology.orchestra.run.smithi077.stdout:711 2023-07-24T05:51:07.748 INFO:teuthology.orchestra.run.smithi077.stdout:711.out 2023-07-24T05:51:07.748 INFO:teuthology.orchestra.run.smithi077.stdout:712 2023-07-24T05:51:07.748 INFO:teuthology.orchestra.run.smithi077.stdout:712.out 2023-07-24T05:51:07.749 INFO:teuthology.orchestra.run.smithi077.stdout:713 2023-07-24T05:51:07.749 INFO:teuthology.orchestra.run.smithi077.stdout:713.out 2023-07-24T05:51:07.749 INFO:teuthology.orchestra.run.smithi077.stdout:714 2023-07-24T05:51:07.749 INFO:teuthology.orchestra.run.smithi077.stdout:714.out 2023-07-24T05:51:07.749 INFO:teuthology.orchestra.run.smithi077.stdout:715 2023-07-24T05:51:07.749 INFO:teuthology.orchestra.run.smithi077.stdout:715.out 2023-07-24T05:51:07.749 INFO:teuthology.orchestra.run.smithi077.stdout:716 2023-07-24T05:51:07.749 INFO:teuthology.orchestra.run.smithi077.stdout:716.out 2023-07-24T05:51:07.750 INFO:teuthology.orchestra.run.smithi077.stdout:717 2023-07-24T05:51:07.750 INFO:teuthology.orchestra.run.smithi077.stdout:717.out 2023-07-24T05:51:07.750 INFO:teuthology.orchestra.run.smithi077.stdout:718 2023-07-24T05:51:07.750 INFO:teuthology.orchestra.run.smithi077.stdout:718.out 2023-07-24T05:51:07.750 INFO:teuthology.orchestra.run.smithi077.stdout:719 2023-07-24T05:51:07.750 INFO:teuthology.orchestra.run.smithi077.stdout:719.out 2023-07-24T05:51:07.750 INFO:teuthology.orchestra.run.smithi077.stdout:720 2023-07-24T05:51:07.750 INFO:teuthology.orchestra.run.smithi077.stdout:720.out 2023-07-24T05:51:07.750 INFO:teuthology.orchestra.run.smithi077.stdout:721 2023-07-24T05:51:07.751 INFO:teuthology.orchestra.run.smithi077.stdout:721.out 2023-07-24T05:51:07.751 INFO:teuthology.orchestra.run.smithi077.stdout:722 2023-07-24T05:51:07.751 INFO:teuthology.orchestra.run.smithi077.stdout:722.out 2023-07-24T05:51:07.751 INFO:teuthology.orchestra.run.smithi077.stdout:723 2023-07-24T05:51:07.751 INFO:teuthology.orchestra.run.smithi077.stdout:723.out 2023-07-24T05:51:07.751 INFO:teuthology.orchestra.run.smithi077.stdout:724 2023-07-24T05:51:07.751 INFO:teuthology.orchestra.run.smithi077.stdout:724.out 2023-07-24T05:51:07.751 INFO:teuthology.orchestra.run.smithi077.stdout:725 2023-07-24T05:51:07.752 INFO:teuthology.orchestra.run.smithi077.stdout:725.out 2023-07-24T05:51:07.752 INFO:teuthology.orchestra.run.smithi077.stdout:726 2023-07-24T05:51:07.752 INFO:teuthology.orchestra.run.smithi077.stdout:726.out 2023-07-24T05:51:07.752 INFO:teuthology.orchestra.run.smithi077.stdout:727 2023-07-24T05:51:07.752 INFO:teuthology.orchestra.run.smithi077.stdout:727.out 2023-07-24T05:51:07.752 INFO:teuthology.orchestra.run.smithi077.stdout:728 2023-07-24T05:51:07.752 INFO:teuthology.orchestra.run.smithi077.stdout:728.out 2023-07-24T05:51:07.752 INFO:teuthology.orchestra.run.smithi077.stdout:729 2023-07-24T05:51:07.753 INFO:teuthology.orchestra.run.smithi077.stdout:729.out 2023-07-24T05:51:07.753 INFO:teuthology.orchestra.run.smithi077.stdout:group.list 2023-07-24T05:51:07.753 INFO:teuthology.orchestra.run.smithi077.stdout:Makefile 2023-07-24T05:51:07.754 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-07-24T05:51:08.452 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T05:51:08.473 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T05:51:08.474 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:51:19.447 INFO:teuthology.orchestra.run.smithi077.stdout:generic/001 11s 2023-07-24T05:51:19.476 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/001 2023-07-24T05:51:19.477 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T05:51:19.492 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:51:19.497 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi077.stderr:ceph-fuse[46155]: fuse finished with error 0 and tester_r 0 2023-07-24T05:51:19.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T05:51:19.522 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-07-24T05:51:20.194 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T05:51:20.216 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T05:51:20.216 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:51:21.941 INFO:teuthology.orchestra.run.smithi077.stdout:generic/002 1s 2023-07-24T05:51:21.971 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/002 2023-07-24T05:51:21.971 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T05:51:21.986 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:51:22.019 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T05:51:22.020 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-07-24T05:51:22.714 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T05:51:22.733 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T05:51:22.733 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:51:23.298 INFO:teuthology.orchestra.run.smithi077.stdout:generic/003 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T05:51:23.318 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/003 2023-07-24T05:51:23.318 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/003 2023-07-24T05:51:23.318 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T05:51:23.330 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:51:23.362 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T05:51:23.363 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-07-24T05:51:24.049 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T05:51:24.069 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T05:51:24.069 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:51:24.665 INFO:teuthology.orchestra.run.smithi077.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-07-24T05:51:24.684 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/004 2023-07-24T05:51:24.685 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/004 2023-07-24T05:51:24.685 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T05:51:24.697 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:51:24.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T05:51:24.730 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-07-24T05:51:25.420 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T05:51:25.441 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T05:51:25.441 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:51:25.615 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:51:25.621 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:51:27.568 INFO:teuthology.orchestra.run.smithi077.stdout:generic/005 2s 2023-07-24T05:51:27.595 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/005 2023-07-24T05:51:27.596 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T05:51:27.606 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:51:27.640 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T05:51:27.640 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-07-24T05:51:28.333 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T05:51:28.352 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T05:51:28.353 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:51:55.723 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:51:55.729 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:52:25.795 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:52:25.801 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:52:28.984 INFO:teuthology.orchestra.run.smithi077.stdout:generic/006 60s 2023-07-24T05:52:29.011 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/006 2023-07-24T05:52:29.011 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T05:52:29.021 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:52:29.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T05:52:29.064 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-07-24T05:52:29.855 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T05:52:29.876 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T05:52:29.876 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:52:55.914 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:52:55.922 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:53:31.300 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:53:31.305 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:54:01.367 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:54:01.374 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:54:31.470 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:54:31.477 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:55:01.544 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:55:01.551 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:55:05.888 INFO:teuthology.orchestra.run.smithi077.stdout:generic/007 156s 2023-07-24T05:55:05.912 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/007 2023-07-24T05:55:05.912 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T05:55:05.924 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:55:05.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T05:55:05.960 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-07-24T05:55:06.663 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T05:55:06.684 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T05:55:06.684 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:55:09.500 INFO:teuthology.orchestra.run.smithi077.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-07-24T05:55:09.520 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/008 2023-07-24T05:55:09.520 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/008 2023-07-24T05:55:09.521 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T05:55:09.535 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:55:09.569 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T05:55:09.570 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-07-24T05:55:10.249 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T05:55:10.269 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T05:55:10.269 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:55:12.737 INFO:teuthology.orchestra.run.smithi077.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-07-24T05:55:12.758 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/009 2023-07-24T05:55:12.758 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/009 2023-07-24T05:55:12.758 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T05:55:12.769 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:55:12.801 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T05:55:12.802 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-07-24T05:55:13.484 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T05:55:13.507 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T05:55:13.508 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:55:14.111 INFO:teuthology.orchestra.run.smithi077.stdout:generic/010 [not run] /tmp/tmp.l0Q1kOBHMTxfstests-dev/src/dbtest not built 2023-07-24T05:55:14.129 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/010 2023-07-24T05:55:14.130 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/010 2023-07-24T05:55:14.130 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T05:55:14.143 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:55:14.175 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T05:55:14.176 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-07-24T05:55:14.867 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T05:55:14.888 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T05:55:14.888 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:55:31.659 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:55:31.666 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:56:01.728 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:56:01.735 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:56:12.373 INFO:teuthology.orchestra.run.smithi077.stdout:generic/011 58s 2023-07-24T05:56:12.402 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/011 2023-07-24T05:56:12.402 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T05:56:12.414 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:56:12.455 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T05:56:12.456 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-07-24T05:56:13.171 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T05:56:13.193 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T05:56:13.193 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:56:15.705 INFO:teuthology.orchestra.run.smithi077.stdout:generic/012 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-24T05:56:15.724 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/012 2023-07-24T05:56:15.724 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/012 2023-07-24T05:56:15.724 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T05:56:15.736 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:56:15.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T05:56:15.807 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-07-24T05:56:16.496 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T05:56:16.518 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T05:56:16.519 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:56:36.010 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:56:36.016 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:57:06.090 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:57:06.096 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:57:36.764 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:57:36.770 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:58:12.167 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:58:12.173 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:58:16.151 INFO:teuthology.orchestra.run.smithi077.stdout:generic/013 120s 2023-07-24T05:58:16.205 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/013 2023-07-24T05:58:16.205 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T05:58:16.215 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:58:16.250 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T05:58:16.250 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-07-24T05:58:16.930 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T05:58:16.951 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T05:58:16.952 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T05:58:44.680 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:58:44.912 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T05:58:44.987 INFO:tasks.ceph.mds.b.smithi103.stderr:2023-07-24T05:58:44.978+0000 7f847086e700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 40706) UID: 0 2023-07-24T05:58:44.990 INFO:tasks.ceph.mds.d.smithi103.stderr:2023-07-24T05:58:44.978+0000 7f283c0db700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 40706) UID: 0 2023-07-24T06:02:26.100 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:02:26.104 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:03:00.082 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:03:00.087 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:03:30.171 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:03:30.176 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:03:36.701 INFO:teuthology.orchestra.run.smithi077.stdout:generic/014 320s 2023-07-24T06:03:40.488 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/014 2023-07-24T06:03:40.489 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:03:40.497 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:03:40.536 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:03:40.537 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-07-24T06:03:41.132 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:03:41.149 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:03:41.149 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:03:41.586 INFO:teuthology.orchestra.run.smithi077.stdout:generic/015 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:03:41.600 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/015 2023-07-24T06:03:41.600 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/015 2023-07-24T06:03:41.600 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:03:41.612 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:03:41.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:03:41.645 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-07-24T06:03:42.247 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:03:42.260 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:03:42.260 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:03:45.032 INFO:teuthology.orchestra.run.smithi077.stdout:generic/016 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-24T06:03:45.049 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/016 2023-07-24T06:03:45.050 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/016 2023-07-24T06:03:45.050 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:03:45.062 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:03:45.093 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:03:45.094 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-07-24T06:03:46.052 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:03:46.069 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:03:46.069 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:03:46.517 INFO:teuthology.orchestra.run.smithi077.stdout:generic/017 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:03:46.535 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/017 2023-07-24T06:03:46.535 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/017 2023-07-24T06:03:46.535 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:03:46.545 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:03:46.578 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:03:46.578 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-07-24T06:03:47.194 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:03:47.210 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:03:47.211 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:03:47.679 INFO:teuthology.orchestra.run.smithi077.stdout:generic/018 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:03:47.693 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/018 2023-07-24T06:03:47.693 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/018 2023-07-24T06:03:47.693 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:03:47.702 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:03:47.736 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:03:47.737 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-07-24T06:03:48.356 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:03:48.372 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:03:48.372 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:03:48.810 INFO:teuthology.orchestra.run.smithi077.stdout:generic/019 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:03:48.823 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/019 2023-07-24T06:03:48.824 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/019 2023-07-24T06:03:48.824 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:03:48.836 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:03:48.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:03:48.867 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-07-24T06:03:49.533 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:03:49.549 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:03:49.549 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:04:00.262 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:04:00.269 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:04:08.110 INFO:teuthology.orchestra.run.smithi077.stdout:generic/020 - output mismatch (see /tmp/tmp.l0Q1kOBHMTxfstests-dev/results//generic/020.out.bad) 2023-07-24T06:04:08.129 INFO:teuthology.orchestra.run.smithi077.stdout: --- tests/generic/020.out 2023-07-24 05:48:02.304395521 +0000 2023-07-24T06:04:08.129 INFO:teuthology.orchestra.run.smithi077.stdout: +++ /tmp/tmp.l0Q1kOBHMTxfstests-dev/results//generic/020.out.bad 2023-07-24 06:04:08.103916813 +0000 2023-07-24T06:04:08.129 INFO:teuthology.orchestra.run.smithi077.stdout: @@ -47,9 +47,13 @@ 2023-07-24T06:04:08.129 INFO:teuthology.orchestra.run.smithi077.stdout: user.snrub="fish2\012" 2023-07-24T06:04:08.129 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:04:08.130 INFO:teuthology.orchestra.run.smithi077.stdout: *** really long value 2023-07-24T06:04:08.130 INFO:teuthology.orchestra.run.smithi077.stdout: -0000000 00 2023-07-24T06:04:08.130 INFO:teuthology.orchestra.run.smithi077.stdout: -* 2023-07-24T06:04:08.130 INFO:teuthology.orchestra.run.smithi077.stdout: -ATTRSIZE 2023-07-24T06:04:08.130 INFO:teuthology.orchestra.run.smithi077.stdout: +attr_set: No space left on device 2023-07-24T06:04:08.130 INFO:teuthology.orchestra.run.smithi077.stdout: +Could not set "long_attr" for 2023-07-24T06:04:08.130 INFO:teuthology.orchestra.run.smithi077.stdout: +attr_get: No data available 2023-07-24T06:04:08.131 INFO:teuthology.orchestra.run.smithi077.stdout: +Could not get "long_attr" for 2023-07-24T06:04:08.131 INFO:teuthology.orchestra.run.smithi077.stdout: +0000000 2023-07-24T06:04:08.131 INFO:teuthology.orchestra.run.smithi077.stdout: +attr_remove: No data available 2023-07-24T06:04:08.131 INFO:teuthology.orchestra.run.smithi077.stdout: +Could not remove "long_attr" for 2023-07-24T06:04:08.132 INFO:teuthology.orchestra.run.smithi077.stdout: *** set/get/remove really long names (expect failure) 2023-07-24T06:04:08.132 INFO:teuthology.orchestra.run.smithi077.stdout: attr_set: Invalid argument 2023-07-24T06:04:08.132 INFO:teuthology.orchestra.run.smithi077.stdout: Could not set "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-07-24T06:04:08.140 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/020 2023-07-24T06:04:08.140 INFO:teuthology.orchestra.run.smithi077.stdout:Failures: generic/020 2023-07-24T06:04:08.140 INFO:teuthology.orchestra.run.smithi077.stdout:Failed 1 of 1 tests 2023-07-24T06:04:08.152 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:04:08.234 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-24T06:04:08.235 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-07-24T06:04:08.235 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-07-24T06:04:08.236 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-07-24T06:04:09.151 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:04:09.169 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:04:09.169 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:04:11.977 INFO:teuthology.orchestra.run.smithi077.stdout:generic/021 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-24T06:04:11.993 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/021 2023-07-24T06:04:11.994 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/021 2023-07-24T06:04:11.994 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:04:12.003 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:04:12.045 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:04:12.045 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-07-24T06:04:13.001 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:04:13.020 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:04:13.020 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:04:15.805 INFO:teuthology.orchestra.run.smithi077.stdout:generic/022 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-24T06:04:15.819 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/022 2023-07-24T06:04:15.820 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/022 2023-07-24T06:04:15.820 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:04:15.835 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:04:15.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:04:15.929 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-07-24T06:04:16.840 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:04:16.856 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:04:16.857 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:04:32.604 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:04:32.608 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:05:02.672 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:05:02.676 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:05:32.756 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:05:32.763 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:05:32.953 INFO:teuthology.orchestra.run.smithi077.stdout:generic/023 76s 2023-07-24T06:05:32.978 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/023 2023-07-24T06:05:32.978 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:05:32.989 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:05:33.036 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:05:33.036 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-07-24T06:05:34.004 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:05:34.021 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:05:34.021 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:05:34.656 INFO:teuthology.orchestra.run.smithi077.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-07-24T06:05:34.676 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/024 2023-07-24T06:05:34.676 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/024 2023-07-24T06:05:34.676 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:05:34.689 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:05:34.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:05:34.744 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-07-24T06:05:35.682 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:05:35.703 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:05:35.703 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:05:36.345 INFO:teuthology.orchestra.run.smithi077.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-07-24T06:05:36.364 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/025 2023-07-24T06:05:36.365 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/025 2023-07-24T06:05:36.365 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:05:36.380 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:05:36.428 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:05:36.428 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-07-24T06:05:37.341 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:05:37.362 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:05:37.363 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:05:38.081 INFO:teuthology.orchestra.run.smithi077.stdout:generic/026 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-07-24T06:05:38.101 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/026 2023-07-24T06:05:38.101 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/026 2023-07-24T06:05:38.102 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:05:38.114 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:05:38.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:05:38.149 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-07-24T06:05:38.860 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:05:38.882 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:05:38.883 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:05:39.451 INFO:teuthology.orchestra.run.smithi077.stdout:generic/027 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:05:39.470 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/027 2023-07-24T06:05:39.470 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/027 2023-07-24T06:05:39.470 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:05:39.482 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:05:39.513 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:05:39.514 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-07-24T06:05:40.204 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:05:40.227 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:05:40.227 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:05:45.841 INFO:teuthology.orchestra.run.smithi077.stdout:generic/028 5s 2023-07-24T06:05:45.867 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/028 2023-07-24T06:05:45.867 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:05:45.877 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:05:45.910 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:05:45.911 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-07-24T06:05:46.599 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:05:46.619 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:05:46.619 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:05:47.192 INFO:teuthology.orchestra.run.smithi077.stdout:generic/029 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:05:47.212 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/029 2023-07-24T06:05:47.212 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/029 2023-07-24T06:05:47.212 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:05:47.224 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:05:47.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:05:47.262 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-07-24T06:05:47.956 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:05:47.979 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:05:47.979 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:05:48.541 INFO:teuthology.orchestra.run.smithi077.stdout:generic/030 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:05:48.559 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/030 2023-07-24T06:05:48.559 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/030 2023-07-24T06:05:48.559 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:05:48.570 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:05:48.603 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:05:48.604 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-07-24T06:05:49.293 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:05:49.314 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:05:49.315 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:05:49.875 INFO:teuthology.orchestra.run.smithi077.stdout:generic/031 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:05:49.893 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/031 2023-07-24T06:05:49.893 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/031 2023-07-24T06:05:49.894 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:05:49.906 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:05:49.941 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:05:49.942 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-07-24T06:05:50.629 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:05:50.653 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:05:50.653 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:05:51.214 INFO:teuthology.orchestra.run.smithi077.stdout:generic/032 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:05:51.234 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/032 2023-07-24T06:05:51.235 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/032 2023-07-24T06:05:51.235 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:05:51.247 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:05:51.283 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:05:51.284 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-07-24T06:05:51.960 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:05:51.982 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:05:51.982 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:05:52.552 INFO:teuthology.orchestra.run.smithi077.stdout:generic/033 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:05:52.570 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/033 2023-07-24T06:05:52.571 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/033 2023-07-24T06:05:52.571 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:05:52.584 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:05:52.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:05:52.615 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-07-24T06:05:53.309 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:05:53.333 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:05:53.333 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:05:53.929 INFO:teuthology.orchestra.run.smithi077.stdout:generic/034 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:05:53.948 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/034 2023-07-24T06:05:53.949 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/034 2023-07-24T06:05:53.949 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:05:53.961 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:05:53.997 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:05:53.997 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-07-24T06:05:54.695 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:05:54.720 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:05:54.720 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:05:55.497 INFO:teuthology.orchestra.run.smithi077.stdout:generic/035 1s 2023-07-24T06:05:55.525 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/035 2023-07-24T06:05:55.525 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:05:55.537 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:05:55.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:05:55.595 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-07-24T06:05:56.502 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:05:56.522 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:05:56.522 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:02.869 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:06:02.875 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:06:07.397 INFO:teuthology.orchestra.run.smithi077.stdout:generic/036 11s 2023-07-24T06:06:07.421 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/036 2023-07-24T06:06:07.421 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:06:07.432 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:07.472 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:06:07.472 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-07-24T06:06:08.420 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:06:08.444 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:06:08.445 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:09.012 INFO:teuthology.orchestra.run.smithi077.stdout:generic/037 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:06:09.031 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/037 2023-07-24T06:06:09.032 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/037 2023-07-24T06:06:09.032 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:06:09.045 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:09.079 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:06:09.080 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-07-24T06:06:09.758 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:06:09.778 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:06:09.778 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:10.329 INFO:teuthology.orchestra.run.smithi077.stdout:generic/038 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:06:10.347 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/038 2023-07-24T06:06:10.347 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/038 2023-07-24T06:06:10.348 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:06:10.364 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:10.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:06:10.403 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-07-24T06:06:11.092 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:06:11.114 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:06:11.114 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:11.726 INFO:teuthology.orchestra.run.smithi077.stdout:generic/039 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:06:11.743 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/039 2023-07-24T06:06:11.743 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/039 2023-07-24T06:06:11.744 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:06:11.755 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:11.788 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:06:11.789 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-07-24T06:06:12.471 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:06:12.492 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:06:12.492 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:13.099 INFO:teuthology.orchestra.run.smithi077.stdout:generic/040 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:06:13.117 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/040 2023-07-24T06:06:13.117 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/040 2023-07-24T06:06:13.117 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:06:13.128 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:13.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:06:13.160 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-07-24T06:06:13.844 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:06:13.866 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:06:13.867 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:14.441 INFO:teuthology.orchestra.run.smithi077.stdout:generic/041 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:06:14.459 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/041 2023-07-24T06:06:14.459 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/041 2023-07-24T06:06:14.459 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:06:14.471 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:14.505 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:06:14.506 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-07-24T06:06:15.195 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:06:15.218 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:06:15.218 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:15.773 INFO:teuthology.orchestra.run.smithi077.stdout:generic/042 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:06:15.791 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/042 2023-07-24T06:06:15.791 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/042 2023-07-24T06:06:15.791 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:06:15.804 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:15.834 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:06:15.835 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-07-24T06:06:16.514 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:06:16.536 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:06:16.536 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:17.094 INFO:teuthology.orchestra.run.smithi077.stdout:generic/043 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:06:17.112 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/043 2023-07-24T06:06:17.112 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/043 2023-07-24T06:06:17.113 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:06:17.124 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:17.157 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:06:17.158 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-07-24T06:06:17.857 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:06:17.881 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:06:17.881 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:18.448 INFO:teuthology.orchestra.run.smithi077.stdout:generic/044 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:06:18.466 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/044 2023-07-24T06:06:18.467 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/044 2023-07-24T06:06:18.467 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:06:18.480 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:18.511 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:06:18.512 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-07-24T06:06:19.205 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:06:19.231 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:06:19.231 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:19.795 INFO:teuthology.orchestra.run.smithi077.stdout:generic/045 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:06:19.814 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/045 2023-07-24T06:06:19.815 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/045 2023-07-24T06:06:19.815 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:06:19.826 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:19.861 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:06:19.861 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-07-24T06:06:20.538 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:06:20.562 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:06:20.562 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:21.139 INFO:teuthology.orchestra.run.smithi077.stdout:generic/046 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:06:21.159 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/046 2023-07-24T06:06:21.159 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/046 2023-07-24T06:06:21.159 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:06:21.172 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:21.204 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:06:21.205 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-07-24T06:06:21.906 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:06:21.930 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:06:21.930 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:22.494 INFO:teuthology.orchestra.run.smithi077.stdout:generic/047 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:06:22.516 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/047 2023-07-24T06:06:22.516 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/047 2023-07-24T06:06:22.516 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:06:22.531 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:22.567 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:06:22.568 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-07-24T06:06:23.252 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:06:23.274 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:06:23.274 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:23.826 INFO:teuthology.orchestra.run.smithi077.stdout:generic/048 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:06:23.843 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/048 2023-07-24T06:06:23.844 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/048 2023-07-24T06:06:23.844 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:06:23.856 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:23.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:06:23.891 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-07-24T06:06:24.584 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:06:24.605 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:06:24.606 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:25.166 INFO:teuthology.orchestra.run.smithi077.stdout:generic/049 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:06:25.186 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/049 2023-07-24T06:06:25.186 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/049 2023-07-24T06:06:25.186 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:06:25.196 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:25.233 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:06:25.234 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-07-24T06:06:25.925 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:06:25.946 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:06:25.947 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:26.505 INFO:teuthology.orchestra.run.smithi077.stdout:generic/050 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:06:26.522 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/050 2023-07-24T06:06:26.522 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/050 2023-07-24T06:06:26.523 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:06:26.535 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:26.569 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:06:26.569 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-07-24T06:06:27.266 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:06:27.287 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:06:27.287 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:27.844 INFO:teuthology.orchestra.run.smithi077.stdout:generic/051 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:06:27.864 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/051 2023-07-24T06:06:27.865 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/051 2023-07-24T06:06:27.865 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:06:27.878 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:27.910 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:06:27.911 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-07-24T06:06:28.599 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:06:28.621 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:06:28.621 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:29.171 INFO:teuthology.orchestra.run.smithi077.stdout:generic/052 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:06:29.188 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/052 2023-07-24T06:06:29.188 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/052 2023-07-24T06:06:29.188 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:06:29.200 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:29.236 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:06:29.236 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-07-24T06:06:29.872 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:06:29.894 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:06:29.894 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:30.436 INFO:teuthology.orchestra.run.smithi077.stdout:generic/053 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:06:30.456 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/053 2023-07-24T06:06:30.456 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/053 2023-07-24T06:06:30.456 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:06:30.471 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:30.510 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:06:30.511 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-07-24T06:06:31.197 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:06:31.218 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:06:31.218 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:31.775 INFO:teuthology.orchestra.run.smithi077.stdout:generic/054 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:06:31.794 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/054 2023-07-24T06:06:31.795 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/054 2023-07-24T06:06:31.795 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:06:31.809 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:31.843 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:06:31.844 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-07-24T06:06:32.546 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:06:32.565 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:06:32.565 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:32.946 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:06:32.953 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:06:33.126 INFO:teuthology.orchestra.run.smithi077.stdout:generic/055 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:06:33.143 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/055 2023-07-24T06:06:33.143 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/055 2023-07-24T06:06:33.143 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:06:33.157 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:33.191 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:06:33.191 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-07-24T06:06:33.889 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:06:33.912 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:06:33.912 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:34.513 INFO:teuthology.orchestra.run.smithi077.stdout:generic/056 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:06:34.530 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/056 2023-07-24T06:06:34.531 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/056 2023-07-24T06:06:34.531 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:06:34.544 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:34.578 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:06:34.578 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-07-24T06:06:35.266 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:06:35.286 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:06:35.286 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:35.894 INFO:teuthology.orchestra.run.smithi077.stdout:generic/057 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:06:35.914 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/057 2023-07-24T06:06:35.914 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/057 2023-07-24T06:06:35.915 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:06:35.928 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:35.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:06:35.961 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-07-24T06:06:36.650 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:06:36.674 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:06:36.675 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:39.144 INFO:teuthology.orchestra.run.smithi077.stdout:generic/058 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-24T06:06:39.165 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/058 2023-07-24T06:06:39.165 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/058 2023-07-24T06:06:39.166 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:06:39.179 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:39.297 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:06:39.297 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-07-24T06:06:40.170 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:06:40.193 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:06:40.193 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:40.815 INFO:teuthology.orchestra.run.smithi077.stdout:generic/059 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:06:40.831 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/059 2023-07-24T06:06:40.832 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/059 2023-07-24T06:06:40.832 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:06:40.843 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:40.876 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:06:40.876 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-07-24T06:06:41.568 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:06:41.592 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:06:41.592 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:44.280 INFO:teuthology.orchestra.run.smithi077.stdout:generic/060 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-24T06:06:44.300 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/060 2023-07-24T06:06:44.300 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/060 2023-07-24T06:06:44.300 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:06:44.313 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:44.355 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:06:44.356 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-07-24T06:06:45.326 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:06:45.347 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:06:45.347 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:47.878 INFO:teuthology.orchestra.run.smithi077.stdout:generic/061 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-24T06:06:47.898 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/061 2023-07-24T06:06:47.899 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/061 2023-07-24T06:06:47.899 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:06:47.913 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:47.989 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:06:47.990 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-07-24T06:06:48.878 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:06:48.901 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:06:48.902 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:49.477 INFO:teuthology.orchestra.run.smithi077.stdout:generic/062 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:06:49.495 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/062 2023-07-24T06:06:49.496 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/062 2023-07-24T06:06:49.496 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:06:49.509 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:49.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:06:49.540 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-07-24T06:06:50.251 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:06:50.274 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:06:50.274 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:52.973 INFO:teuthology.orchestra.run.smithi077.stdout:generic/063 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-07-24T06:06:52.995 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/063 2023-07-24T06:06:52.995 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/063 2023-07-24T06:06:52.995 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:06:53.009 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:53.058 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:06:53.059 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-07-24T06:06:54.026 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:06:54.048 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:06:54.048 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:54.595 INFO:teuthology.orchestra.run.smithi077.stdout:generic/064 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:06:54.615 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/064 2023-07-24T06:06:54.615 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/064 2023-07-24T06:06:54.615 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:06:54.628 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:54.662 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:06:54.663 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-07-24T06:06:55.330 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:06:55.352 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:06:55.352 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:55.973 INFO:teuthology.orchestra.run.smithi077.stdout:generic/065 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:06:55.990 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/065 2023-07-24T06:06:55.990 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/065 2023-07-24T06:06:55.991 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:06:56.003 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:56.039 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:06:56.040 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-07-24T06:06:56.735 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:06:56.758 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:06:56.758 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:57.388 INFO:teuthology.orchestra.run.smithi077.stdout:generic/066 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:06:57.408 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/066 2023-07-24T06:06:57.409 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/066 2023-07-24T06:06:57.409 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:06:57.423 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:57.455 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:06:57.456 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-07-24T06:06:58.150 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:06:58.170 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:06:58.170 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:58.814 INFO:teuthology.orchestra.run.smithi077.stdout:generic/067 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:06:58.836 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/067 2023-07-24T06:06:58.836 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/067 2023-07-24T06:06:58.836 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:06:58.851 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:06:58.887 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:06:58.887 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-07-24T06:06:59.582 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:06:59.606 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:06:59.606 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:07:00.183 INFO:teuthology.orchestra.run.smithi077.stdout:generic/068 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:07:00.202 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/068 2023-07-24T06:07:00.203 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/068 2023-07-24T06:07:00.203 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:07:00.215 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:07:00.248 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:07:00.248 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-07-24T06:07:00.954 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:07:00.978 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:07:00.978 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:07:01.545 INFO:teuthology.orchestra.run.smithi077.stdout:generic/069 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:07:01.565 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/069 2023-07-24T06:07:01.566 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/069 2023-07-24T06:07:01.566 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:07:01.580 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:07:01.612 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:07:01.612 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-07-24T06:07:02.293 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:07:02.316 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:07:02.316 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:07:03.019 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:07:03.023 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:07:34.092 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:07:34.098 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:08:04.165 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:08:04.171 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:08:34.255 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:08:34.263 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:09:04.336 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:09:04.341 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:09:04.980 INFO:teuthology.orchestra.run.smithi077.stdout:generic/070 122s 2023-07-24T06:09:05.007 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/070 2023-07-24T06:09:05.007 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:09:05.018 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:09:05.100 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:09:05.101 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-07-24T06:09:06.050 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:09:06.069 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:09:06.069 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:09:06.507 INFO:teuthology.orchestra.run.smithi077.stdout:generic/071 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:09:06.521 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/071 2023-07-24T06:09:06.521 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/071 2023-07-24T06:09:06.521 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:09:06.530 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:09:06.562 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:09:06.563 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-07-24T06:09:07.199 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:09:07.216 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:09:07.216 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:09:09.920 INFO:teuthology.orchestra.run.smithi077.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-07-24T06:09:09.937 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/072 2023-07-24T06:09:09.937 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/072 2023-07-24T06:09:09.937 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:09:09.949 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:09:09.983 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:09:09.983 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-07-24T06:09:10.591 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:09:10.619 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:09:10.619 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:09:11.100 INFO:teuthology.orchestra.run.smithi077.stdout:generic/073 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:09:11.114 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/073 2023-07-24T06:09:11.114 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/073 2023-07-24T06:09:11.114 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:09:11.124 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:09:11.153 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:09:11.153 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-07-24T06:09:11.814 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:09:11.833 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:09:11.833 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:09:34.402 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:09:34.407 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:10:04.504 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:10:04.509 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:10:34.703 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:10:34.708 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:11:04.927 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:11:04.932 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:11:35.144 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:11:35.153 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:12:05.319 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:12:05.324 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:12:35.550 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:12:35.554 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:13:05.640 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:13:05.648 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:13:35.769 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:13:35.779 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:14:05.861 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:14:05.866 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:14:35.953 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:14:35.958 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:15:06.051 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:15:06.056 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:15:36.140 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:15:36.145 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:16:09.680 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:16:09.685 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:16:42.579 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:16:42.584 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:16:43.455 INFO:tasks.ceph.osd.1.smithi077.stderr:2023-07-24T06:16:43.456+0000 7fede8570700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118428) UID: 0 2023-07-24T06:16:43.456 INFO:tasks.ceph.osd.2.smithi077.stderr:2023-07-24T06:16:43.456+0000 7fd30de31700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118428) UID: 0 2023-07-24T06:16:43.456 INFO:tasks.ceph.osd.3.smithi077.stderr:2023-07-24T06:16:43.456+0000 7f28446bc700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118428) UID: 0 2023-07-24T06:16:43.470 INFO:tasks.ceph.osd.0.smithi077.stderr:2023-07-24T06:16:43.472+0000 7f709d486700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 118428) UID: 0 2023-07-24T06:22:51.099 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:22:51.105 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:22:51.172 INFO:tasks.ceph.osd.6.smithi103.stderr:2023-07-24T06:22:51.176+0000 7f5489710700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 40971) UID: 0 2023-07-24T06:22:51.173 INFO:tasks.ceph.osd.7.smithi103.stderr:2023-07-24T06:22:51.176+0000 7f5b4ed26700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 40971) UID: 0 2023-07-24T06:22:51.173 INFO:tasks.ceph.osd.4.smithi103.stderr:2023-07-24T06:22:51.176+0000 7f70fe439700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 40971) UID: 0 2023-07-24T06:22:51.173 INFO:tasks.ceph.osd.5.smithi103.stderr:2023-07-24T06:22:51.176+0000 7f21edeb9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 40971) UID: 0 2023-07-24T06:22:51.436 INFO:tasks.ceph.osd.2.smithi077.stderr:2023-07-24T06:22:51.440+0000 7fd30de31700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121827) UID: 0 2023-07-24T06:22:51.436 INFO:tasks.ceph.osd.0.smithi077.stderr:2023-07-24T06:22:51.440+0000 7f709d486700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121827) UID: 0 2023-07-24T06:22:51.437 INFO:tasks.ceph.osd.1.smithi077.stderr:2023-07-24T06:22:51.440+0000 7fede8570700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121827) UID: 0 2023-07-24T06:22:51.437 INFO:tasks.ceph.osd.3.smithi077.stderr:2023-07-24T06:22:51.440+0000 7f28446bc700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 121827) UID: 0 2023-07-24T06:35:38.810 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:35:38.840 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:35:38.903 INFO:tasks.ceph.osd.1.smithi077.stderr:2023-07-24T06:35:38.908+0000 7fede8570700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128525) UID: 0 2023-07-24T06:35:38.903 INFO:tasks.ceph.osd.0.smithi077.stderr:2023-07-24T06:35:38.908+0000 7f709d486700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128525) UID: 0 2023-07-24T06:35:38.903 INFO:tasks.ceph.osd.2.smithi077.stderr:2023-07-24T06:35:38.908+0000 7fd30de31700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128525) UID: 0 2023-07-24T06:35:38.904 INFO:tasks.ceph.osd.3.smithi077.stderr:2023-07-24T06:35:38.908+0000 7f28446bc700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 128525) UID: 0 2023-07-24T06:35:38.936 INFO:tasks.ceph.osd.4.smithi103.stderr:2023-07-24T06:35:38.942+0000 7f70fe439700 -1 Fail to open '/proc/41189/cmdline' error = (2) No such file or directory 2023-07-24T06:35:38.936 INFO:tasks.ceph.osd.7.smithi103.stderr:2023-07-24T06:35:38.942+0000 7f5b4ed26700 -1 Fail to open '/proc/41189/cmdline' error = (2) No such file or directory 2023-07-24T06:35:38.937 INFO:tasks.ceph.osd.7.smithi103.stderr:2023-07-24T06:35:38.942+0000 7f5b4ed26700 -1 received signal: Hangup from (PID: 41189) UID: 0 2023-07-24T06:35:38.937 INFO:tasks.ceph.osd.6.smithi103.stderr:2023-07-24T06:35:38.942+0000 7f5489710700 -1 Fail to open '/proc/41189/cmdline' error = (2) No such file or directory 2023-07-24T06:35:38.937 INFO:tasks.ceph.osd.6.smithi103.stderr:2023-07-24T06:35:38.942+0000 7f5489710700 -1 received signal: Hangup from (PID: 41189) UID: 0 2023-07-24T06:35:38.937 INFO:tasks.ceph.osd.5.smithi103.stderr:2023-07-24T06:35:38.942+0000 7f21edeb9700 -1 Fail to open '/proc/41189/cmdline' error = (2) No such file or directory 2023-07-24T06:35:38.938 INFO:tasks.ceph.osd.5.smithi103.stderr:2023-07-24T06:35:38.942+0000 7f21edeb9700 -1 received signal: Hangup from (PID: 41189) UID: 0 2023-07-24T06:35:38.938 INFO:tasks.ceph.osd.4.smithi103.stderr:2023-07-24T06:35:38.942+0000 7f70fe439700 -1 received signal: Hangup from (PID: 41189) UID: 0 2023-07-24T06:37:34.671 INFO:teuthology.orchestra.run.smithi077.stdout:generic/074 1703s 2023-07-24T06:37:34.800 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/074 2023-07-24T06:37:34.800 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:37:34.813 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:37:34.842 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:37:34.843 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-07-24T06:37:36.792 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:37:36.811 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:37:36.811 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:38:42.130 INFO:teuthology.orchestra.run.smithi077.stdout:generic/075 66s 2023-07-24T06:38:42.155 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/075 2023-07-24T06:38:42.155 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:38:42.169 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:38:42.216 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:38:42.216 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-07-24T06:38:43.172 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:38:43.190 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:38:43.190 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:38:43.709 INFO:teuthology.orchestra.run.smithi077.stdout:generic/076 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:38:43.728 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/076 2023-07-24T06:38:43.728 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/076 2023-07-24T06:38:43.728 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:38:43.740 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:38:43.769 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:38:43.769 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-07-24T06:38:44.406 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:38:44.421 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:38:44.421 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:38:49.025 INFO:teuthology.orchestra.run.smithi077.stdout:generic/077 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:38:49.042 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/077 2023-07-24T06:38:49.042 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/077 2023-07-24T06:38:49.042 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:38:49.053 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:38:49.082 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:38:49.082 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-07-24T06:38:49.701 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:38:49.720 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:38:49.720 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:38:50.398 INFO:teuthology.orchestra.run.smithi077.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-07-24T06:38:50.416 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/078 2023-07-24T06:38:50.416 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/078 2023-07-24T06:38:50.416 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:38:50.429 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:38:50.466 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:38:50.466 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-07-24T06:38:51.365 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:38:51.383 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:38:51.384 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:38:51.984 INFO:teuthology.orchestra.run.smithi077.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-07-24T06:38:52.001 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/079 2023-07-24T06:38:52.002 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/079 2023-07-24T06:38:52.002 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:38:52.013 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:38:52.045 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:38:52.046 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-07-24T06:38:52.658 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:38:52.675 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:38:52.675 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:38:55.400 INFO:teuthology.orchestra.run.smithi077.stdout:generic/080 3s 2023-07-24T06:38:55.423 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/080 2023-07-24T06:38:55.424 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:38:55.436 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:38:55.470 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:38:55.471 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-07-24T06:38:56.088 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:38:56.107 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:38:56.108 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:38:56.599 INFO:teuthology.orchestra.run.smithi077.stdout:generic/081 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:38:56.617 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/081 2023-07-24T06:38:56.617 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/081 2023-07-24T06:38:56.617 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:38:56.628 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:38:56.656 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:38:56.657 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-07-24T06:38:57.266 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:38:57.286 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:38:57.286 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:38:57.820 INFO:teuthology.orchestra.run.smithi077.stdout:generic/082 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:38:57.836 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/082 2023-07-24T06:38:57.837 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/082 2023-07-24T06:38:57.837 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:38:57.848 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:38:57.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:38:57.880 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-07-24T06:38:58.493 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:38:58.514 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:38:58.514 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:38:59.035 INFO:teuthology.orchestra.run.smithi077.stdout:generic/083 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:38:59.053 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/083 2023-07-24T06:38:59.053 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/083 2023-07-24T06:38:59.053 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:38:59.066 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:38:59.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:38:59.096 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-07-24T06:38:59.734 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:38:59.753 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:38:59.754 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:39:00.239 INFO:teuthology.orchestra.run.smithi077.stdout:generic/084 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:39:00.256 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/084 2023-07-24T06:39:00.256 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/084 2023-07-24T06:39:00.256 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:39:00.269 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:39:00.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:39:00.300 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-07-24T06:39:00.936 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:39:00.955 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:39:00.955 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:39:01.540 INFO:teuthology.orchestra.run.smithi077.stdout:generic/085 [not run] this test requires a valid $SCRATCH_DEV 2023-07-24T06:39:01.558 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/085 2023-07-24T06:39:01.559 INFO:teuthology.orchestra.run.smithi077.stdout:Not run: generic/085 2023-07-24T06:39:01.559 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:39:01.569 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:39:01.600 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:39:01.600 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-07-24T06:39:02.208 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:39:02.228 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:39:02.228 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:39:26.747 INFO:teuthology.orchestra.run.smithi077.stdout:generic/086 24s 2023-07-24T06:39:26.995 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/086 2023-07-24T06:39:26.995 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:39:27.006 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:39:27.124 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:39:27.125 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-07-24T06:39:30.307 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:39:30.327 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:39:30.327 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:39:31.397 INFO:teuthology.orchestra.run.smithi077.stdout:generic/087 1s 2023-07-24T06:39:31.417 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/087 2023-07-24T06:39:31.417 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:39:31.426 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:39:31.470 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:39:31.470 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-07-24T06:39:32.459 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:39:32.482 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:39:32.482 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:39:33.182 INFO:teuthology.orchestra.run.smithi077.stdout:generic/088 1s 2023-07-24T06:39:33.203 INFO:teuthology.orchestra.run.smithi077.stdout:Ran: generic/088 2023-07-24T06:39:33.203 INFO:teuthology.orchestra.run.smithi077.stdout:Passed all 1 tests 2023-07-24T06:39:33.217 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:39:33.260 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-07-24T06:39:33.261 DEBUG:teuthology.orchestra.run.smithi077:> (cd /tmp/tmp.l0Q1kOBHMTxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-07-24T06:39:34.165 INFO:teuthology.orchestra.run.smithi077.stdout:FSTYP -- ceph-fuse 2023-07-24T06:39:34.183 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM -- Linux/x86_64 smithi077 6.5.0-rc1-gc685da6f56cc #1 SMP PREEMPT_DYNAMIC Thu Jul 20 12:18:52 UTC 2023 2023-07-24T06:39:34.183 INFO:teuthology.orchestra.run.smithi077.stdout: 2023-07-24T06:46:28.029 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:46:28.037 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:46:58.253 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:46:58.260 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:47:28.408 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:47:28.416 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:47:58.500 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:47:58.507 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:48:28.722 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:48:28.730 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:48:58.887 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:48:58.895 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:49:29.027 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:49:29.035 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:49:59.191 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:49:59.199 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:50:29.373 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:50:29.381 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:50:59.455 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:50:59.462 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:51:29.617 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:51:29.621 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:51:59.865 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:51:59.872 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:52:29.940 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:52:29.947 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:53:00.021 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:53:00.029 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:53:30.177 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:53:30.185 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:54:00.341 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:54:00.349 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:54:30.423 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:54:30.430 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:55:00.521 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:55:00.529 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:55:30.659 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:55:30.667 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:56:00.750 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:56:00.757 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:56:30.822 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:56:30.830 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:57:00.971 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:57:00.979 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:57:31.041 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:57:31.048 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:58:01.191 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:58:01.199 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:58:31.289 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:58:31.297 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:59:01.454 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:59:01.461 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:59:31.609 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T06:59:31.617 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:00:01.756 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:00:01.763 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:00:31.921 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:00:31.929 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:01:02.010 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:01:02.018 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:01:32.166 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:01:32.174 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:02:02.322 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:02:02.329 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:02:32.461 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:02:32.469 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:03:02.610 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:03:02.617 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:03:32.710 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:03:32.717 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:04:02.857 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:04:02.865 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:04:32.996 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:04:33.003 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:05:03.203 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:05:03.211 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:05:33.360 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:05:33.367 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:06:03.525 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:06:03.532 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:06:33.665 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:06:33.672 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:07:03.795 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:07:03.803 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:07:33.952 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:07:33.960 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:08:04.115 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:08:04.119 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:08:34.180 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:08:34.188 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:09:04.312 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:09:04.319 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:09:34.535 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:09:34.542 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:10:04.607 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:10:04.614 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:10:34.822 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:10:34.828 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:11:05.078 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:11:05.086 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:11:35.200 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:11:35.207 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:12:05.341 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:12:05.349 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:12:35.488 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:12:35.496 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:13:05.645 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:13:05.653 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:13:35.821 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:13:35.828 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:14:05.936 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:14:05.944 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:14:36.108 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:14:36.116 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:15:06.173 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:15:06.180 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:15:36.355 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:15:36.363 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:16:06.521 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:16:06.528 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:16:36.684 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:16:36.693 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:17:06.858 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:17:06.866 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:17:36.990 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:17:36.998 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:18:07.080 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:18:07.088 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:18:37.252 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:18:37.259 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:19:07.410 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:19:07.417 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:19:37.566 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:19:37.573 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:20:07.690 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:20:07.699 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:20:37.855 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:20:37.863 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:21:08.044 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:21:08.052 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:21:38.216 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:21:38.224 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:22:08.349 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:22:08.356 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:22:38.495 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:22:38.503 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:23:08.701 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:23:08.706 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:23:38.776 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:23:38.783 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:24:08.922 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:24:08.929 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:24:39.032 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:24:39.039 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:25:09.201 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:25:09.209 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:25:39.357 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:25:39.364 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:26:09.497 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:26:09.505 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:26:39.663 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:26:39.667 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:27:09.828 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:27:09.835 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:27:39.993 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:27:40.002 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:28:10.074 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:28:10.081 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:28:40.212 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:28:40.220 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:29:10.377 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:29:10.385 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:29:40.508 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:29:40.516 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:30:10.664 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:30:10.672 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:30:40.805 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:30:40.814 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:31:10.929 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:31:10.937 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:31:41.088 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:31:41.096 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:32:11.168 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:32:11.177 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:32:41.318 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:32:41.329 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:33:11.478 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:33:11.496 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:33:41.663 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:33:41.678 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:34:11.809 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:34:11.826 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:34:41.961 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:34:41.973 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:35:12.100 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:35:12.108 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:35:42.276 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:35:42.287 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:36:12.459 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:36:12.473 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:36:42.616 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:36:42.627 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:37:12.694 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:37:12.705 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:37:42.867 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:37:42.887 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:38:12.966 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:38:12.975 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:38:43.125 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:38:43.134 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:39:13.300 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:39:13.309 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:39:43.459 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:39:43.467 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:40:13.625 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:40:13.634 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:40:43.789 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:40:43.798 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:41:13.913 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:41:13.925 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:41:44.078 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:41:44.085 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:42:14.171 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:42:14.179 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:42:44.320 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:42:44.327 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:43:14.459 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:43:14.467 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:43:44.616 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:43:44.624 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:44:14.915 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:44:14.923 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:44:45.064 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:44:45.070 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:45:15.196 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:45:15.204 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:45:45.345 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:45:45.352 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:46:15.561 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:46:15.568 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:46:45.692 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:46:45.700 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:47:15.833 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:47:15.840 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:47:45.983 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:47:45.990 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:48:16.148 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:48:16.155 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:48:46.268 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:48:46.275 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:49:16.399 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:49:16.407 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:49:46.536 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:49:46.543 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:50:16.618 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:50:16.625 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:50:46.691 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:50:46.700 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:51:17.048 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:51:17.055 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:51:47.190 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:51:47.194 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:52:17.295 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:52:17.302 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:52:47.506 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:52:47.513 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:53:17.635 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:53:17.643 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:53:47.765 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:53:47.772 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:54:17.927 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:54:17.934 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:54:48.161 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:54:48.169 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:55:18.321 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:55:18.328 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:55:48.451 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:55:48.458 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:56:18.611 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:56:18.619 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:56:48.750 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:56:48.758 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:57:18.888 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:57:18.896 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:57:49.037 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:57:49.045 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:58:19.194 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:58:19.201 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:58:49.377 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:58:49.385 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:59:19.493 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:59:19.501 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:59:49.652 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T07:59:49.660 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:00:19.802 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:00:19.810 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:00:49.948 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:00:49.956 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:01:20.120 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:01:20.128 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:01:50.293 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:01:50.300 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:02:20.442 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:02:20.449 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:02:50.514 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:02:50.522 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:03:20.670 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:03:20.675 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:03:50.813 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:03:50.821 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:04:20.972 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:04:20.979 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:04:51.102 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:04:51.110 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:05:21.281 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:05:21.288 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:05:51.430 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:05:51.438 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:06:21.580 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:06:21.588 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:06:51.725 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:06:51.733 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:07:21.881 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:07:21.889 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:07:52.021 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:07:52.028 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:08:22.150 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:08:22.158 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:08:52.316 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:08:52.321 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:09:22.456 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:09:22.464 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:09:52.621 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:09:52.627 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:10:22.744 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:10:22.748 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:10:52.838 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:10:52.844 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:11:23.079 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:11:23.087 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:11:53.225 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:11:53.232 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:12:23.376 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:12:23.384 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:12:53.511 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:12:53.517 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:13:23.612 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:13:23.619 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:13:53.773 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:13:53.780 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:14:23.937 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:14:23.944 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:14:54.084 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:14:54.092 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:15:24.215 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:15:24.222 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:15:54.373 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:15:54.380 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:16:24.668 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:16:24.676 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:16:54.820 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:16:54.828 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:17:24.961 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:17:24.969 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:17:55.101 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:17:55.109 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:18:25.240 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:18:25.248 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:18:55.404 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:18:55.412 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:19:25.560 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:19:25.568 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:19:55.737 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:19:55.745 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:20:25.856 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:20:25.864 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:20:56.011 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:20:56.019 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:21:26.153 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:21:26.161 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:21:56.269 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:21:56.277 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:22:26.392 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:22:26.400 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:22:56.516 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:22:56.524 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:23:26.654 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:23:26.662 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:23:56.779 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:23:56.787 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:24:26.875 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:24:26.882 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:24:57.025 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:24:57.032 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:25:27.098 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:25:27.106 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:25:57.220 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:25:57.228 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:26:27.303 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:26:27.310 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:26:57.418 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:26:57.426 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:27:27.567 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:27:27.574 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:27:57.723 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:27:57.731 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:28:27.847 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:28:27.854 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:28:57.928 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:28:57.934 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:29:28.001 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:29:28.005 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:29:58.158 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:29:58.166 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:30:28.298 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:30:28.303 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:30:58.372 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:30:58.380 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:31:28.469 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:31:28.477 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:31:58.618 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:31:58.626 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:32:28.691 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:32:28.700 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:32:58.773 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:32:58.781 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:33:28.921 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:33:28.929 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:33:59.070 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:33:59.078 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:34:29.153 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:34:29.160 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:34:59.234 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:34:59.242 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:35:29.308 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:35:29.315 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:35:59.390 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:35:59.398 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:36:29.490 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:36:29.497 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:36:59.569 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:36:59.576 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:37:29.643 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:37:29.651 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:37:59.728 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:37:59.736 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:38:29.791 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:38:29.799 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:38:59.872 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:38:59.879 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:39:29.954 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:39:29.961 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:40:00.029 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:40:00.038 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:40:30.109 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:40:30.117 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:41:00.189 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:41:00.196 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:41:30.287 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:41:30.295 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:42:00.383 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:42:00.390 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:42:30.463 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:42:30.471 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:43:00.537 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:43:00.545 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:43:30.617 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:43:30.625 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:44:00.693 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:44:00.700 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:44:30.770 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:44:30.778 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:45:00.916 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:45:00.924 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:45:31.030 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:45:31.038 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:46:01.171 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:46:01.179 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:46:31.261 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:46:31.269 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:47:01.334 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:47:01.342 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:47:31.451 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:47:31.458 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:48:01.613 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:48:01.621 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:48:31.747 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:48:31.754 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:49:01.894 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:49:01.901 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:49:32.036 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:49:32.047 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:50:02.157 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:50:02.164 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:50:32.298 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:50:32.306 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:51:02.446 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:51:02.454 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:51:32.753 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:51:32.760 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:52:02.884 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:52:02.891 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:52:33.040 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:52:33.046 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:53:03.187 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:53:03.192 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:53:33.327 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:53:33.335 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:54:03.466 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:54:03.474 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:54:33.615 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:54:33.621 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:55:03.753 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:55:03.760 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:55:33.919 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:55:33.927 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:56:04.093 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:56:04.100 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:56:34.257 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:56:34.262 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:57:04.397 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:57:04.405 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:57:34.554 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:57:34.561 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:58:04.694 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:58:04.702 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:58:34.860 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:58:34.867 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:59:05.097 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:59:05.103 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:59:35.240 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T08:59:35.247 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:00:05.367 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:00:05.374 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:00:35.570 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:00:35.576 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:01:05.700 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:01:05.707 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:01:35.873 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:01:35.880 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:02:06.010 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:02:06.017 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:02:36.243 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:02:36.251 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:03:06.359 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:03:06.366 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:03:36.493 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:03:36.501 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:04:06.604 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:04:06.611 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:04:36.755 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:04:36.762 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:05:06.830 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:05:06.838 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:05:36.973 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:05:36.979 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:06:07.120 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:06:07.127 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:06:37.214 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:06:37.222 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:07:07.387 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:07:07.394 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:07:37.456 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:07:37.463 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:08:07.597 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:08:07.605 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:08:37.765 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:08:37.773 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:09:07.848 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:09:07.856 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:09:37.957 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:09:37.965 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:10:08.100 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:10:08.104 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:10:38.219 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:10:38.227 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:11:08.386 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:11:08.393 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:11:38.794 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:11:38.803 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:12:08.954 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:12:08.961 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:12:39.080 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:12:39.088 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:13:09.216 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:13:09.223 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:13:39.373 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:13:39.380 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:14:09.533 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:14:09.541 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:14:39.675 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:14:39.683 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:15:09.823 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:15:09.831 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:15:40.010 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:15:40.019 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:16:10.144 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:16:10.152 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:16:40.287 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:16:40.295 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:17:10.572 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:17:10.580 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:17:40.663 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:17:40.670 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:18:10.792 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:18:10.801 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:18:40.902 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:18:40.910 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:19:11.036 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:19:11.045 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:19:41.152 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:19:41.160 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:20:11.306 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:20:11.314 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:20:41.453 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:20:41.463 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:21:11.613 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:21:11.622 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:21:41.781 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:21:41.795 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:22:11.915 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:22:11.923 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:22:42.086 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:22:42.095 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:23:12.164 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:23:12.173 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:23:42.244 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:23:42.253 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:24:12.380 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:24:12.385 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:24:42.540 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:24:42.549 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:25:12.675 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:25:12.680 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:25:42.797 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:25:42.805 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:26:12.959 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:26:12.967 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:26:43.288 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:26:43.296 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:27:13.474 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:27:13.483 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:27:43.565 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:27:43.572 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:28:13.728 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:28:13.736 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:28:43.870 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:28:43.878 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:29:14.029 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:29:14.037 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:29:44.163 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:29:44.170 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:30:14.315 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:30:14.323 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:30:44.393 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:30:44.401 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:31:14.567 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:31:14.574 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:31:44.686 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:31:44.694 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:32:14.820 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:32:14.827 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:32:44.952 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:32:44.961 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:33:15.104 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:33:15.112 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:33:45.254 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:33:45.261 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:34:15.407 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:34:15.414 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:34:45.558 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:34:45.565 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:35:15.707 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:35:15.714 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:35:45.857 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:35:45.864 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:36:16.016 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:36:16.024 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:36:46.121 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:36:46.129 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:37:16.295 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:37:16.302 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:37:46.459 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:37:46.465 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:38:16.607 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:38:16.615 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:38:46.767 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:38:46.774 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:39:16.915 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:39:16.923 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:39:47.072 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:39:47.077 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:40:17.456 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:40:17.463 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:40:47.532 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:40:47.539 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:41:17.680 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:41:17.687 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:41:47.864 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:41:47.871 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:42:17.974 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:42:17.982 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:42:48.122 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:42:48.129 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:43:18.254 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:43:18.262 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:43:48.430 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:43:48.437 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:44:18.598 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:44:18.605 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:44:48.750 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:44:48.757 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:45:18.974 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:45:18.982 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:45:49.068 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:45:49.076 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:46:19.200 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:46:19.209 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:46:49.365 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:46:49.373 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:47:19.525 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:47:19.533 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:47:49.592 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:47:49.599 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:48:19.755 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:48:19.762 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:48:49.930 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:48:49.938 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:49:20.008 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:49:20.015 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:49:50.096 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:49:50.104 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:50:20.232 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:50:20.239 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:50:50.400 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:50:50.408 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:51:20.558 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:51:20.565 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:51:50.819 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:51:50.827 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:52:20.972 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:52:20.980 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:52:51.107 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:52:51.114 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:53:21.244 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:53:21.252 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:53:51.414 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:53:51.422 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:54:21.559 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:54:21.567 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:54:51.899 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:54:51.906 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:55:21.976 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:55:21.983 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:55:52.094 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:55:52.102 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:56:22.248 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:56:22.255 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:56:52.416 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:56:52.423 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:57:22.560 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:57:22.568 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:57:52.696 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:57:52.703 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:58:22.844 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:58:22.851 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:58:53.134 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:58:53.141 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:59:23.208 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:59:23.216 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:59:53.302 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T09:59:53.310 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:00:23.451 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:00:23.460 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:00:53.603 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:00:53.610 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:01:23.771 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:01:23.778 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:01:53.923 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:01:53.931 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:02:24.051 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:02:24.059 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:02:54.161 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:02:54.168 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:03:24.266 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:03:24.273 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:03:54.342 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:03:54.349 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:04:24.508 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:04:24.515 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:04:54.643 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:04:54.651 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:05:24.799 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:05:24.807 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:05:54.931 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:05:54.939 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:06:25.075 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:06:25.082 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:06:55.475 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:06:55.483 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:07:25.740 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:07:25.748 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:07:55.842 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:07:55.849 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:08:25.987 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:08:25.994 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:08:56.141 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:08:56.148 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:09:26.326 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:09:26.334 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:09:56.475 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:09:56.482 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:10:26.642 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:10:26.649 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:10:56.807 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:10:56.814 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:11:26.954 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:11:26.961 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:11:57.135 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:11:57.139 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:12:27.280 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:12:27.288 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:12:57.342 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:12:57.350 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:13:27.505 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:13:27.513 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:13:57.659 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:13:57.668 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:14:27.751 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:14:27.758 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:14:57.892 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:14:57.899 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:15:28.054 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:15:28.061 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:15:58.124 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:15:58.132 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:16:28.278 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:16:28.286 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:16:58.550 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:16:58.557 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:17:28.621 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:17:28.629 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:17:58.792 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:17:58.800 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:18:28.940 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:18:28.948 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:18:59.016 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:18:59.023 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:19:29.184 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:19:29.192 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:19:59.309 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:19:59.317 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:20:29.437 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:20:29.444 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:20:59.595 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:20:59.603 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:21:29.668 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:21:29.676 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:21:59.765 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:21:59.772 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:22:29.894 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:22:29.902 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:23:00.063 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:23:00.070 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:23:30.232 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:23:30.239 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:24:00.403 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:24:00.410 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:24:30.541 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:24:30.549 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:25:00.686 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:25:00.694 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:25:30.844 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:25:30.852 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:26:00.922 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:26:00.930 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:26:31.076 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:26:31.081 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:27:01.336 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:27:01.344 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:27:31.508 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:27:31.513 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:28:01.610 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:28:01.616 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:28:31.747 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:28:31.755 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:29:01.917 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:29:01.924 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:29:32.026 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:29:32.032 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:30:02.192 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:30:02.199 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:30:32.324 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:30:32.332 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:31:02.471 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:31:02.478 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:31:32.621 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:31:32.628 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:32:02.835 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:32:02.842 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:32:32.971 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:32:32.979 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:33:03.142 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:33:03.150 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:33:33.296 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:33:33.303 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:34:03.407 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:34:03.415 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:34:33.666 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:34:33.674 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:35:03.737 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:35:03.745 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:35:33.876 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:35:33.884 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:36:04.016 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:36:04.024 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:36:34.179 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:36:34.184 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:37:04.363 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:37:04.371 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:37:34.524 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:37:34.532 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:38:04.688 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:38:04.695 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:38:34.779 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:38:34.786 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:39:04.907 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:39:04.913 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:39:35.062 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:39:35.069 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:40:05.192 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:40:05.200 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:40:35.320 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:40:35.328 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:41:05.473 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:41:05.480 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:41:35.621 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:41:35.629 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:42:05.894 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:42:05.900 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:42:36.020 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:42:36.027 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:43:06.175 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:43:06.182 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:43:36.344 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:43:36.351 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:44:06.487 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:44:06.492 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:44:36.553 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:44:36.561 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:45:06.715 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:45:06.723 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:45:36.854 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:45:36.861 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:46:07.020 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:46:07.028 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:46:37.177 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:46:37.185 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:47:07.370 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:47:07.378 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:47:37.537 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:47:37.543 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:48:07.650 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:48:07.657 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:48:37.749 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:48:37.757 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:49:07.831 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:49:07.838 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:49:37.989 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:49:37.995 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:50:08.120 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:50:08.128 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:50:38.197 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:50:38.204 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:51:08.336 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:51:08.344 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:51:38.478 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:51:38.486 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:52:08.883 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:52:08.891 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:52:39.041 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:52:39.046 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:53:09.114 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:53:09.122 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:53:39.279 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:53:39.286 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:54:09.420 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:54:09.428 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:54:39.521 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:54:39.528 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:55:09.646 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:55:09.654 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:55:39.793 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:55:39.801 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:56:09.940 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:56:09.948 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:56:40.060 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:56:40.068 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:57:10.242 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:57:10.250 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:57:40.380 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:57:40.388 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:58:10.547 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:58:10.556 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:58:40.710 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:58:40.719 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:59:10.843 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:59:10.851 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:59:41.019 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T10:59:41.027 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:00:11.174 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:00:11.182 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:00:41.442 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:00:41.449 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:01:11.517 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:01:11.522 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:01:41.713 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:01:41.721 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:02:11.865 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:02:11.873 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:02:42.012 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:02:42.019 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:03:12.083 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:03:12.090 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:03:42.214 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:03:42.221 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:04:12.286 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:04:12.294 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:04:42.432 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:04:42.441 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:05:12.587 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:05:12.596 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:05:42.784 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:05:42.791 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:06:12.940 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:06:12.947 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:06:43.011 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:06:43.018 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:07:13.339 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:07:13.345 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:07:43.476 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:07:43.484 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:08:13.624 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:08:13.632 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:08:43.697 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:08:43.704 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:09:13.858 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:09:13.866 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:09:44.023 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:09:44.031 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:10:14.186 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:10:14.192 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:10:44.300 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:10:44.307 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:11:14.467 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:11:14.474 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:11:44.567 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:11:44.575 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:12:14.724 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:12:14.731 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:12:44.888 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:12:44.896 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:13:15.035 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:13:15.043 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:13:45.213 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:13:45.220 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:14:15.361 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:14:15.369 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:14:45.550 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:14:45.557 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:15:15.680 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:15:15.687 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:15:45.826 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:15:45.833 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:16:15.983 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:16:15.991 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:16:46.148 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:16:46.157 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:17:16.310 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:17:16.318 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:17:46.459 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:17:46.467 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:18:16.603 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:18:16.612 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:18:46.865 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:18:46.872 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:19:16.962 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:19:16.971 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:19:47.107 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:19:47.115 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:20:17.261 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:20:17.267 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:20:47.332 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:20:47.339 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:21:17.479 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:21:17.486 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:21:47.611 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:21:47.618 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:22:17.832 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:22:17.839 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:22:47.996 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:22:48.003 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:23:18.070 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:23:18.078 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:23:48.217 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:23:48.225 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:24:18.337 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:24:18.355 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:24:48.486 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:24:48.494 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:25:18.576 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:25:18.585 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:25:48.673 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:25:48.681 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:26:18.752 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:26:18.760 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:26:48.826 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:26:48.835 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:27:18.923 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:27:18.932 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:27:49.004 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:27:49.013 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:28:19.082 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:28:19.089 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:28:49.162 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:28:49.169 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:29:19.243 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:29:19.251 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:29:49.376 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:29:49.383 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:30:19.508 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:30:19.516 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:30:49.640 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:30:49.648 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:31:19.770 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:31:19.778 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:31:49.926 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:31:49.934 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:32:20.014 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:32:20.022 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:32:50.097 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:32:50.104 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:33:20.170 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:33:20.178 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:33:50.250 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:33:50.258 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:34:20.390 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:34:20.398 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:34:50.531 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:34:50.538 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:35:20.705 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:35:20.712 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:35:50.791 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:35:50.799 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:36:20.974 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:36:20.981 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:36:51.054 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:36:51.061 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:37:21.145 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:37:21.153 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:37:51.298 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:37:51.306 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:38:21.405 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:38:21.414 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:38:51.561 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:38:51.569 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:39:21.693 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:39:21.700 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:39:51.838 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:39:51.845 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:40:21.937 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:40:21.944 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:40:52.078 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:40:52.082 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:41:22.159 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:41:22.166 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:41:52.322 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:41:52.330 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:42:22.422 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:42:22.430 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:42:52.492 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:42:52.501 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:43:22.667 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:43:22.674 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:43:52.790 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:43:52.798 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:44:22.926 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:44:22.935 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:44:53.066 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:44:53.077 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:45:23.192 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:45:23.201 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:45:53.272 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:45:53.280 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:46:23.392 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:46:23.405 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:46:53.553 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:46:53.563 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:47:23.657 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:47:23.667 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:47:53.827 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:47:53.833 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:48:23.967 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:48:23.981 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:48:54.082 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:48:54.091 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:49:24.188 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:49:24.196 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:49:54.340 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:49:54.351 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:50:24.432 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:50:24.453 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:50:54.582 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:50:54.593 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:51:24.725 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:51:24.731 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:51:54.880 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:51:54.888 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:52:24.970 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:52:24.979 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:52:55.127 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:52:55.134 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:53:25.197 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:53:25.204 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:53:55.280 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:53:55.288 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:54:25.369 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:54:25.379 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:54:55.447 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:54:55.454 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:55:25.530 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:55:25.537 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:55:55.683 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:55:55.688 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:56:25.866 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:56:25.874 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:56:56.024 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:56:56.032 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:57:26.112 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:57:26.120 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:57:56.253 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:57:56.264 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:58:26.332 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:58:26.340 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:58:56.482 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:58:56.487 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:59:26.629 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:59:26.638 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:59:56.802 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T11:59:56.810 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:00:26.895 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:00:26.903 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:00:57.054 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:00:57.064 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:01:27.140 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:01:27.148 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:01:57.300 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:01:57.308 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:02:27.610 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:02:27.618 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:02:57.750 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:02:57.758 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:03:27.906 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:03:27.914 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:03:58.063 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:03:58.069 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:04:28.145 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:04:28.152 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:04:58.328 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:04:58.333 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:05:28.397 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:05:28.404 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:05:58.537 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:05:58.545 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:06:28.620 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:06:28.628 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:06:58.876 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:06:58.883 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:07:29.107 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:07:29.115 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:07:59.265 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:07:59.273 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:08:29.348 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:08:29.355 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:08:59.479 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:08:59.487 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:09:29.627 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:09:29.635 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:09:59.735 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:09:59.743 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:10:29.883 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:10:29.888 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:11:00.015 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:11:00.023 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:11:30.206 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:11:30.214 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:12:00.361 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:12:00.369 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:12:30.470 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:12:30.480 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:13:00.634 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:13:00.641 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:13:30.748 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:13:30.756 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:14:00.881 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:14:00.889 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:14:31.061 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:14:31.068 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:15:01.229 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:15:01.233 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:15:31.375 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:15:31.383 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:16:01.525 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:16:01.532 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:16:31.656 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:16:31.665 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:17:01.746 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:17:01.753 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:17:32.128 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:17:32.135 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:18:02.291 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:18:02.298 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:18:32.398 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:18:32.405 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:19:02.552 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:19:02.559 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:19:32.626 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:19:32.634 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:20:02.773 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:20:02.781 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:20:32.996 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:20:33.001 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:21:03.075 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:21:03.083 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:21:33.219 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:21:33.227 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:22:03.370 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:22:03.378 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:22:33.542 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:22:33.550 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:23:03.667 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:23:03.675 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:23:33.794 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:23:33.802 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:24:03.956 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:24:03.964 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:24:34.105 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:24:34.113 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:25:04.222 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:25:04.230 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:25:34.362 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:25:34.371 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:26:04.461 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:26:04.469 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:26:34.601 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:26:34.609 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:27:04.687 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:27:04.695 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:27:34.864 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:27:34.872 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:28:05.020 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:28:05.028 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:28:35.141 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:28:35.148 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:29:05.275 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:29:05.283 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:29:35.352 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:29:35.360 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:30:05.437 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:30:05.446 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:30:35.601 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:30:35.609 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:31:05.743 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:31:05.751 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:31:35.821 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:31:35.829 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:32:05.941 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:32:05.950 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:32:36.043 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:32:36.051 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:33:06.178 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:33:06.186 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:33:36.367 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:33:36.376 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:34:06.479 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:34:06.485 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:34:36.623 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:34:36.631 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:35:06.699 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:35:06.709 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:35:36.833 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:35:36.844 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:36:06.970 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:36:06.978 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:36:37.117 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:36:37.124 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:37:07.279 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:37:07.286 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:37:37.379 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:37:37.386 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:38:07.519 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:38:07.527 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:38:37.659 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:38:37.668 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:39:07.751 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:39:07.760 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:39:37.890 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:39:37.898 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:40:08.046 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:40:08.053 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:40:38.195 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:40:38.205 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:41:08.328 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:41:08.337 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:41:38.492 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:41:38.501 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:42:08.634 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:42:08.644 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:42:38.981 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:42:38.990 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:43:09.145 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:43:09.152 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:43:39.293 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:43:39.301 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:44:09.388 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:44:09.396 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:44:39.538 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:44:39.546 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:45:09.680 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:45:09.688 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:45:39.797 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:45:39.805 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:46:09.940 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:46:09.949 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:46:40.044 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:46:40.052 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:47:10.187 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:47:10.194 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:47:40.357 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:47:40.365 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:48:10.513 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:48:10.520 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:48:40.612 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:48:40.620 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:49:10.778 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:49:10.785 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:49:40.845 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:49:40.854 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:50:11.011 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:50:11.019 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:50:41.127 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:50:41.135 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:51:11.275 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:51:11.282 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:51:41.348 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:51:41.356 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:52:11.427 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:52:11.435 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:52:41.523 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:52:41.530 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:53:11.674 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:53:11.681 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:53:41.746 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:53:41.754 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:54:11.887 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:54:11.894 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:54:41.966 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:54:41.974 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:55:12.089 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:55:12.098 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:55:42.237 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:55:42.245 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:56:12.369 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:56:12.377 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:56:42.451 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:56:42.459 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:57:12.605 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:57:12.613 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:57:42.703 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:57:42.711 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:58:12.851 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:58:12.856 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:58:42.959 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:58:42.966 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:59:13.123 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:59:13.131 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:59:43.221 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T12:59:43.230 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:00:13.375 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:00:13.383 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:00:43.533 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:00:43.540 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:01:13.690 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:01:13.698 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:01:43.774 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:01:43.783 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:02:13.901 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:02:13.909 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:02:44.126 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:02:44.132 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:03:14.249 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:03:14.256 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:03:44.418 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:03:44.426 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:04:14.557 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:04:14.565 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:04:44.793 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:04:44.798 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:05:14.860 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:05:14.868 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:05:45.024 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:05:45.032 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:06:15.109 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:06:15.117 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:06:45.247 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:06:45.256 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:07:15.418 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:07:15.426 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:07:45.734 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:07:45.742 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:08:15.889 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:08:15.895 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:08:45.971 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:08:45.978 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:09:16.117 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:09:16.125 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:09:46.198 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:09:46.206 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:10:16.279 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:10:16.287 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:10:46.437 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:10:46.445 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:11:16.585 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:11:16.594 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:11:46.741 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:11:46.748 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:12:16.873 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:12:16.882 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:12:47.134 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:12:47.142 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:13:17.286 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:13:17.292 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:13:47.453 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:13:47.461 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:14:17.526 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:14:17.533 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:14:47.676 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:14:47.684 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:15:17.830 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:15:17.837 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:15:47.957 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:15:47.977 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:16:18.135 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:16:18.143 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:16:48.213 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:16:48.221 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:17:18.318 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:17:18.325 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:17:48.590 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:17:48.597 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:18:18.702 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:18:18.710 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:18:48.857 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:18:48.865 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:19:18.971 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:19:18.978 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:19:49.126 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:19:49.134 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:20:19.257 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:20:19.264 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:20:49.411 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:20:49.419 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:21:19.533 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:21:19.541 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:21:49.681 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:21:49.687 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:22:19.749 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:22:19.756 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:22:50.063 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:22:50.071 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:23:20.192 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:23:20.200 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:23:50.346 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:23:50.353 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:24:20.484 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:24:20.492 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:24:50.650 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:24:50.658 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:25:20.816 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:25:20.824 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:25:50.971 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:25:50.979 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:26:21.259 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:26:21.267 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:26:51.408 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:26:51.416 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:27:21.489 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:27:21.496 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:27:51.580 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:27:51.588 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:28:21.678 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:28:21.687 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:28:51.833 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:28:51.841 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:29:21.971 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:29:21.979 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:29:52.121 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:29:52.129 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:30:22.268 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:30:22.276 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:30:52.407 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:30:52.414 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:31:22.488 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:31:22.495 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:31:52.561 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:31:52.569 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:32:22.642 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:32:22.650 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:32:52.740 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:32:52.748 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:33:22.896 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:33:22.901 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:33:52.968 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:33:52.976 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:34:23.118 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:34:23.126 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:34:53.266 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:34:53.274 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:35:23.420 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:35:23.427 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:35:53.572 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:35:53.580 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:36:23.710 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:36:23.718 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:36:53.789 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:36:53.798 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:37:23.938 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:37:23.946 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:37:54.324 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:37:54.332 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:38:24.473 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:38:24.480 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:38:54.621 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:38:54.629 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:39:24.760 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:39:24.768 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:39:54.913 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:39:54.920 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:40:25.039 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:40:25.046 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:40:55.189 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:40:55.196 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:41:25.397 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:41:25.405 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:41:55.543 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:41:55.551 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:42:25.674 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:42:25.682 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:42:55.839 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:42:55.846 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:43:25.970 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:43:25.978 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:43:56.135 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:43:56.143 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:44:26.248 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:44:26.257 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:44:56.561 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:44:56.568 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:45:26.690 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:45:26.697 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:45:56.861 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:45:56.871 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:46:26.972 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:46:26.979 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:46:57.122 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:46:57.130 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:47:27.198 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:47:27.205 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:47:57.384 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:47:57.392 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:48:27.549 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:48:27.557 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:48:57.713 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:48:57.722 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:49:27.856 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:49:27.863 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:49:57.992 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:49:58.001 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:50:28.161 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:50:28.170 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:50:58.317 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:50:58.326 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:51:28.461 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:51:28.469 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:51:58.617 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:51:58.625 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:52:28.735 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:52:28.742 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:52:58.917 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:52:58.925 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:53:29.065 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:53:29.074 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:53:59.237 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:53:59.244 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:54:29.389 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:54:29.397 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:54:59.592 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:54:59.600 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:55:29.764 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:55:29.773 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:55:59.902 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:55:59.910 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:56:30.042 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:56:30.049 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:57:00.204 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:57:00.212 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:57:30.367 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:57:30.373 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:58:00.492 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:58:00.500 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:58:30.649 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:58:30.656 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:59:00.766 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:59:00.773 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:59:30.897 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T13:59:30.906 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:00:01.037 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:00:01.044 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:00:31.183 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:00:31.190 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:01:01.323 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:01:01.331 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:01:31.494 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:01:31.502 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:02:01.670 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:02:01.677 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:02:31.815 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:02:31.822 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:03:02.193 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:03:02.201 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:03:32.315 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:03:32.323 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:04:02.402 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:04:02.410 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:04:32.533 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:04:32.540 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:05:02.638 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:05:02.646 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:05:32.773 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:05:32.780 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:06:02.914 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:06:02.922 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:06:33.055 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:06:33.062 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:07:03.197 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:07:03.205 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:07:33.309 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:07:33.317 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:08:03.555 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:08:03.562 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:08:33.724 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:08:33.732 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:09:03.879 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:09:03.887 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:09:33.972 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:09:33.979 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:10:04.111 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:10:04.119 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:10:34.280 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:10:34.284 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:11:04.436 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:11:04.444 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:11:34.590 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:11:34.597 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:12:04.733 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:12:04.740 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:12:34.800 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:12:34.807 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:13:05.154 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:13:05.162 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:13:35.362 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:13:35.367 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:14:05.523 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:14:05.531 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:14:35.598 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:14:35.605 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:15:05.747 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:15:05.754 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:15:35.941 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:15:35.950 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:16:06.069 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:16:06.077 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:16:36.197 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:16:36.204 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:17:06.366 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:17:06.373 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:17:36.442 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:17:36.450 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:18:06.546 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:18:06.552 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:18:36.698 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:18:36.709 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:19:06.878 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:19:06.885 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:19:37.047 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:19:37.056 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:20:07.132 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:20:07.140 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:20:37.296 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:20:37.304 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:21:07.447 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:21:07.455 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:21:37.520 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:21:37.528 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:22:07.600 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:22:07.609 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:22:37.740 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:22:37.748 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:23:08.068 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:23:08.076 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:23:38.196 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:23:38.203 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:24:08.358 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:24:08.366 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:24:38.508 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:24:38.516 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:25:08.638 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:25:08.647 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:25:38.809 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:25:38.818 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:26:08.972 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:26:08.979 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:26:39.065 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:26:39.075 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:27:09.150 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:27:09.157 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:27:39.259 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:27:39.267 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:28:09.413 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:28:09.420 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:28:39.556 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:28:39.563 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:29:09.692 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:29:09.701 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:29:39.818 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:29:39.824 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:30:09.943 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:30:09.950 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:30:40.021 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:30:40.028 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:31:10.289 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:31:10.297 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:31:40.378 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:31:40.386 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:32:10.514 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:32:10.523 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:32:40.710 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:32:40.718 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:33:11.054 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:33:11.063 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:33:41.223 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:33:41.231 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:34:11.304 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:34:11.316 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:34:41.458 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:34:41.465 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:35:11.603 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:35:11.610 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:35:41.763 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:35:41.770 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:36:11.940 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:36:11.947 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:36:42.083 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:36:42.090 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:37:12.241 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:37:12.248 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:37:42.342 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:37:42.350 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:38:12.515 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:38:12.521 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:38:42.634 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:38:42.642 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:39:12.779 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:39:12.786 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:39:42.857 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:39:42.866 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:40:13.227 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:40:13.235 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:40:43.307 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:40:43.316 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:41:13.454 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:41:13.462 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:41:43.592 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:41:43.600 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:42:13.761 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:42:13.801 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:42:43.926 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:42:43.934 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:43:14.099 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:43:14.106 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:43:44.246 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:43:44.253 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:44:14.336 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:44:14.346 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:44:44.483 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:44:44.492 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:45:14.632 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:45:14.641 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:45:44.713 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:45:44.721 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:46:14.843 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:46:14.851 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:46:44.998 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:46:45.006 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:47:15.148 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:47:15.156 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:47:45.313 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:47:45.320 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:48:15.652 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:48:15.660 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:48:45.742 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:48:45.749 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:49:15.825 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:49:15.835 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:49:45.963 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:49:45.971 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:50:16.137 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:50:16.146 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:50:46.268 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:50:46.277 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:51:16.417 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:51:16.425 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:51:46.489 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:51:46.497 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:52:16.586 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:52:16.592 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:52:46.725 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:52:46.734 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:53:17.098 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:53:17.106 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:53:47.263 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:53:47.270 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:54:17.393 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:54:17.401 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:54:47.517 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:54:47.525 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:55:17.639 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:55:17.646 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:55:47.788 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:55:47.794 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:56:17.894 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:56:17.902 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:56:48.060 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:56:48.065 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:57:18.200 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:57:18.208 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:57:48.288 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:57:48.295 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:58:18.445 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:58:18.453 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:58:48.583 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:58:48.591 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:59:18.692 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:59:18.699 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:59:48.840 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T14:59:48.847 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:00:19.005 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:00:19.012 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:00:49.145 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:00:49.152 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:01:19.294 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:01:19.301 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:01:49.451 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:01:49.457 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:02:19.533 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:02:19.541 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:02:49.630 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:02:49.638 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:03:19.996 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:03:20.003 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:03:50.143 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:03:50.151 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:04:20.241 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:04:20.249 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:04:50.398 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:04:50.404 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:05:20.462 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:05:20.468 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:05:50.603 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:05:50.611 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:06:20.694 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:06:20.701 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:06:50.800 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:06:50.808 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:07:20.945 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:07:20.952 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:07:51.097 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:07:51.104 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:08:21.434 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:08:21.442 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:08:51.555 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:08:51.562 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:09:21.664 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:09:21.672 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:09:51.818 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:09:51.826 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:10:21.888 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:10:21.897 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:10:51.982 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:10:51.990 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:11:22.124 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:11:22.131 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:11:52.273 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:11:52.280 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:12:22.433 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:12:22.441 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:12:52.545 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:12:52.552 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:13:22.804 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:13:22.812 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:13:52.911 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:13:52.919 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:14:23.066 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:14:23.074 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:14:53.222 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:14:53.231 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:15:23.361 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:15:23.369 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:15:53.527 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:15:53.535 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:16:23.626 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:16:23.633 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:16:53.766 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:16:53.774 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:17:23.881 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:17:23.889 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:17:54.053 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:17:54.060 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:18:24.319 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:18:24.328 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:18:54.407 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:18:54.415 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:19:24.489 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:19:24.497 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:19:54.580 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:19:54.587 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:20:24.659 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:20:24.668 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:20:54.809 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:20:54.815 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:21:24.938 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:21:24.945 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:21:55.130 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:21:55.138 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:22:25.277 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:22:25.284 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:22:55.436 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:22:55.445 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:23:25.820 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:23:25.828 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:23:55.972 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:23:55.978 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:24:26.073 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:24:26.080 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:24:56.160 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:24:56.168 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:25:26.260 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:25:26.268 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:25:56.399 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:25:56.407 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:26:26.556 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:26:26.564 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:26:56.711 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:26:56.719 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:27:26.861 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:27:26.868 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:27:57.007 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:27:57.016 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:28:27.230 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:28:27.238 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:28:57.397 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:28:57.405 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:29:27.552 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:29:27.560 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:29:57.694 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:29:57.701 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:30:27.808 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:30:27.815 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:30:57.933 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:30:57.940 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:31:28.073 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:31:28.080 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:31:58.239 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:31:58.247 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:32:28.385 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:32:28.393 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:32:58.476 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:32:58.485 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:33:28.801 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:33:28.808 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:33:58.899 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:33:58.907 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:34:29.064 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:34:29.078 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:34:59.206 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:34:59.214 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:35:29.354 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:35:29.362 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:35:59.428 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:35:59.436 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:36:29.601 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:36:29.608 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:36:59.716 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:36:59.724 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:37:29.791 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:37:29.799 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:37:59.930 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:37:59.939 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:38:30.129 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:38:30.138 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:39:00.286 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:39:00.294 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:39:30.418 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:39:30.425 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:40:00.542 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:40:00.550 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:40:30.707 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:40:30.712 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:41:00.814 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:41:00.822 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:41:30.962 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:41:30.968 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:42:01.043 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:42:01.050 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:42:31.118 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:42:31.126 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:43:01.259 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:43:01.268 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:43:31.549 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:43:31.555 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:44:01.672 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:44:01.680 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:44:31.829 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:44:31.835 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:45:01.902 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:45:01.909 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:45:32.051 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:45:32.059 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:46:02.132 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:46:02.139 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:46:32.272 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:46:32.280 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:47:02.421 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:47:02.429 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:47:32.569 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:47:32.578 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:48:02.735 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:48:02.742 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:48:32.834 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:48:32.844 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:49:02.907 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:49:02.913 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:49:32.973 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:49:32.982 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:50:03.063 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:50:03.076 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:50:33.152 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:50:33.159 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:51:03.241 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:51:03.249 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:51:33.331 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:51:33.339 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:52:03.421 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:52:03.429 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:52:33.511 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:52:33.520 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:53:03.642 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:53:03.652 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:53:33.751 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:53:33.766 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:54:03.834 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:54:03.842 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:54:34.114 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:54:34.122 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:55:04.179 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:55:04.187 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:55:34.367 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:55:34.375 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:56:04.440 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:56:04.448 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:56:34.589 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:56:34.597 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:57:04.750 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:57:04.758 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:57:34.899 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:57:34.907 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:58:05.059 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:58:05.066 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:58:35.312 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:58:35.321 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:59:05.480 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:59:05.487 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:59:35.584 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T15:59:35.592 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:00:05.660 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:00:05.668 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:00:35.731 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:00:35.739 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:01:05.814 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:01:05.823 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:01:35.896 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:01:35.904 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:02:06.016 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:02:06.023 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:02:36.147 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:02:36.154 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:03:06.224 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:03:06.231 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:03:36.312 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:03:36.319 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:04:06.386 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:04:06.394 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:04:36.469 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:04:36.477 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:05:06.548 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:05:06.556 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:05:36.622 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:05:36.630 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:06:06.703 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:06:06.711 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:06:36.785 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:06:36.793 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:07:06.858 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:07:06.866 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:07:36.946 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:07:36.954 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:08:07.022 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:08:07.030 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:08:37.102 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:08:37.110 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:09:07.174 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:09:07.181 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:09:37.250 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:09:37.257 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:10:07.322 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:10:07.329 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:10:37.395 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:10:37.402 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:11:07.476 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:11:07.484 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:11:37.549 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:11:37.557 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:12:07.622 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:12:07.630 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:12:37.703 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:12:37.711 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:13:07.776 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:13:07.784 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:13:37.867 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:13:37.873 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:14:07.940 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:14:07.948 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:14:38.013 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:14:38.020 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:15:08.086 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:15:08.091 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:15:38.162 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:15:38.169 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:16:08.232 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:16:08.236 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:16:38.314 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:16:38.321 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:17:08.386 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:17:08.393 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:17:38.459 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:17:38.466 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:18:08.532 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:18:08.539 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:18:38.614 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:18:38.622 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:19:08.686 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:19:08.694 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:19:38.759 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:19:38.767 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:20:08.833 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:20:08.840 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:20:38.915 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:20:38.923 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:21:08.989 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:21:08.996 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:21:39.060 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:21:39.068 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:22:09.135 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:22:09.143 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:22:39.207 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:22:39.215 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:23:09.280 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:23:09.288 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:23:39.377 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:23:39.384 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:24:09.443 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:24:09.450 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:24:39.518 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:24:39.526 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:25:09.591 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:25:09.599 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:25:39.672 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:25:39.679 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:26:09.746 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:26:09.754 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:26:39.820 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:26:39.829 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:27:09.893 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:27:09.899 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:27:39.981 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:27:39.989 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:28:10.073 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:28:10.081 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:28:40.160 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:28:40.168 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:29:10.234 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:29:10.241 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:29:40.300 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:29:40.308 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:30:10.367 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:30:10.375 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:30:40.439 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:30:40.447 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:31:10.505 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:31:10.509 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:31:40.626 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:31:40.635 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:32:10.717 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:32:10.725 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:32:40.789 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:32:40.796 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:33:10.863 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:33:10.871 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:33:40.954 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:33:40.962 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:34:11.030 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:34:11.038 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:34:41.114 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:34:41.122 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:35:11.197 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:35:11.206 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:35:41.271 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:35:41.278 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:36:11.352 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:36:11.360 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:36:41.425 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:36:41.432 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:37:11.514 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:37:11.522 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:37:41.623 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:37:41.631 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:38:11.765 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:38:11.772 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:38:41.849 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:38:41.857 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:39:11.998 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:39:12.006 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:39:42.082 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:39:42.090 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:40:12.165 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:40:12.173 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:40:42.316 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:40:42.323 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:41:12.415 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:41:12.423 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:41:42.573 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:41:42.581 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:42:12.682 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:42:12.690 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:42:42.815 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:42:42.822 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:43:12.947 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:43:12.954 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:43:43.031 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:43:43.038 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:44:13.162 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:44:13.170 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:44:43.297 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:44:43.305 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:45:13.446 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:45:13.452 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:45:43.604 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:45:43.610 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:46:13.742 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:46:13.750 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:46:43.884 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:46:43.892 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:47:13.992 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:47:13.999 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:47:44.141 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:47:44.149 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:48:14.226 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:48:14.234 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:48:44.331 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:48:44.339 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:49:14.420 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:49:14.428 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:49:44.495 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:49:44.502 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:50:14.568 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:50:14.576 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:50:44.641 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:50:44.644 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:51:14.707 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:51:14.715 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:51:44.789 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:51:44.796 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:52:14.863 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:52:14.872 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:52:44.938 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:52:44.944 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:53:15.026 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:53:15.034 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:53:45.110 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:53:45.119 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:54:15.192 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:54:15.201 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:54:45.274 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:54:45.280 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:55:15.346 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:55:15.354 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:55:45.421 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:55:45.429 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:56:15.502 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:56:15.510 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:56:45.581 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:56:45.588 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:57:15.717 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:57:15.723 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:57:45.880 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:57:45.888 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:58:16.054 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:58:16.060 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:58:46.145 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:58:46.153 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:59:16.310 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:59:16.318 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:59:46.442 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T16:59:46.450 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:00:16.600 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:00:16.605 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:00:46.681 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:00:46.688 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:01:16.841 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:01:16.847 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:01:46.919 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:01:46.927 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:02:17.092 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:02:17.100 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:02:47.256 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:02:47.263 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:03:17.381 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:03:17.387 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:03:47.470 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:03:47.477 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:04:17.619 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:04:17.627 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:04:47.743 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:04:47.751 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:05:17.883 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:05:17.890 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:05:48.033 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:05:48.040 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:06:18.156 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:06:18.163 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:06:48.290 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:06:48.297 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:07:18.427 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:07:18.434 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:07:48.596 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:07:48.604 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:08:18.746 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:08:18.754 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:08:49.136 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:08:49.144 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:09:19.294 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:09:19.301 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:09:49.378 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:09:49.386 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:10:19.509 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:10:19.517 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:10:49.666 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:10:49.674 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:11:19.815 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:11:19.823 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:11:49.892 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:11:49.900 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:12:20.062 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:12:20.070 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:12:50.208 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:12:50.215 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:13:20.273 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:13:20.281 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:13:50.551 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:13:50.557 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:14:20.621 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:14:20.628 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:14:50.691 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:14:50.698 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:15:20.772 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:15:20.779 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:15:50.907 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:15:50.914 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:16:21.055 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:16:21.063 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:16:51.219 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:16:51.226 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:17:21.313 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:17:21.322 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:17:51.461 DEBUG:teuthology.orchestra.run.smithi077:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:17:51.467 DEBUG:teuthology.orchestra.run.smithi103:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-24T17:18:14.591 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-07-24T17:18:14.592 DEBUG:teuthology.task.console_log:Killing console logger for smithi077 2023-07-24T17:18:14.593 DEBUG:teuthology.task.console_log:Killing console logger for smithi103 2023-07-24T17:18:14.593 DEBUG:teuthology.exit:Finished running handlers